2023-10-06T04:29:39.809 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-06T04:29:39.809 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412287 --owner scheduled_yuriw@teuthology --name yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/backtrace} --verbose -- /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412287/orig.config.yaml 2023-10-06T04:29:39.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T04:29:39.947 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412287 branch: wip-yuri3-testing-2023-10-05-0943-quincy description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/backtrace} email: yweinste@redhat.com first_in_suite: false job_id: '7412287' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri3-testing-2023-10-05-0943-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri3-testing-2023-10-05-0943-quincy sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 4002 sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri3-testing-2023-10-05-0943-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 targets: smithi017.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLin3JPzMpt4MygFVK2Xo2yDds7MpsWZR3TG0Y6x1MO6/IALD42nl0EeiRysfiezTJ7J19DcOw7w6ozualHKTbE= smithi136.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCT8z47jvyl4oo/EdApCPMBw2AAaO3RiCmjP65ogxYBMvnojcE6lkXAmmIf2dACNsYqr1Q5eQIPCZvP4rYGbt58= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_backtrace teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-05_23:54:57 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-06T04:29:39.948 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa; will attempt to use it 2023-10-06T04:29:39.949 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa/tasks 2023-10-06T04:29:39.949 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-06T04:29:39.950 INFO:teuthology.task.internal:Checking packages... 2023-10-06T04:29:39.975 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564' 2023-10-06T04:29:39.975 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-06T04:29:39.975 INFO:teuthology.packaging:ref: None 2023-10-06T04:29:39.975 INFO:teuthology.packaging:tag: None 2023-10-06T04:29:39.975 INFO:teuthology.packaging:branch: wip-yuri3-testing-2023-10-05-0943-quincy 2023-10-06T04:29:39.975 INFO:teuthology.packaging:sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T04:29:39.975 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri3-testing-2023-10-05-0943-quincy 2023-10-06T04:29:40.112 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1274.g68e53a4a 2023-10-06T04:29:40.112 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-06T04:29:40.123 INFO:teuthology.task.internal:no buildpackages task found 2023-10-06T04:29:40.123 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-06T04:29:40.129 INFO:teuthology.task.internal:Saving configuration 2023-10-06T04:29:40.146 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-06T04:29:40.152 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T04:29:40.182 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412287', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 04:24:35.095401', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLin3JPzMpt4MygFVK2Xo2yDds7MpsWZR3TG0Y6x1MO6/IALD42nl0EeiRysfiezTJ7J19DcOw7w6ozualHKTbE='} 2023-10-06T04:29:40.209 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi136.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412287', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 04:24:35.094038', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCT8z47jvyl4oo/EdApCPMBw2AAaO3RiCmjP65ogxYBMvnojcE6lkXAmmIf2dACNsYqr1Q5eQIPCZvP4rYGbt58='} 2023-10-06T04:29:40.209 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-06T04:29:40.217 INFO:teuthology.task.internal:roles: ubuntu@smithi017.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-06T04:29:40.217 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-06T04:29:40.217 INFO:teuthology.run_tasks:Running task console_log... 2023-10-06T04:29:40.292 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdacc08db80>, signals=[15]) 2023-10-06T04:29:40.292 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-06T04:29:40.299 INFO:teuthology.task.internal:Opening connections... 2023-10-06T04:29:40.299 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi017.front.sepia.ceph.com 2023-10-06T04:29:40.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:29:40.372 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi136.front.sepia.ceph.com 2023-10-06T04:29:40.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:29:40.440 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-06T04:29:40.446 DEBUG:teuthology.orchestra.run.smithi017:> uname -m 2023-10-06T04:29:40.464 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64 2023-10-06T04:29:40.465 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2023-10-06T04:29:40.521 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T04:29:40.522 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T04:29:40.522 INFO:teuthology.orchestra.run.smithi017.stdout:ID="rhel" 2023-10-06T04:29:40.522 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="fedora" 2023-10-06T04:29:40.522 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="8.4" 2023-10-06T04:29:40.522 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el8" 2023-10-06T04:29:40.522 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T04:29:40.522 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2023-10-06T04:29:40.522 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T04:29:40.522 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T04:29:40.522 INFO:teuthology.orchestra.run.smithi017.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T04:29:40.523 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T04:29:40.523 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:29:40.523 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T04:29:40.523 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T04:29:40.523 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T04:29:40.523 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T04:29:40.524 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2023-10-06T04:29:40.546 DEBUG:teuthology.orchestra.run.smithi136:> uname -m 2023-10-06T04:29:40.563 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64 2023-10-06T04:29:40.563 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2023-10-06T04:29:40.619 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T04:29:40.619 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T04:29:40.620 INFO:teuthology.orchestra.run.smithi136.stdout:ID="rhel" 2023-10-06T04:29:40.620 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="fedora" 2023-10-06T04:29:40.620 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="8.4" 2023-10-06T04:29:40.620 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el8" 2023-10-06T04:29:40.620 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T04:29:40.620 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2023-10-06T04:29:40.620 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T04:29:40.620 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T04:29:40.620 INFO:teuthology.orchestra.run.smithi136.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T04:29:40.620 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T04:29:40.620 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-10-06T04:29:40.621 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T04:29:40.621 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T04:29:40.621 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T04:29:40.621 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T04:29:40.621 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2023-10-06T04:29:40.646 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-06T04:29:40.656 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-06T04:29:40.662 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-06T04:29:40.662 DEBUG:teuthology.orchestra.run.smithi017:> test '!' -e /home/ubuntu/cephtest 2023-10-06T04:29:40.665 DEBUG:teuthology.orchestra.run.smithi136:> test '!' -e /home/ubuntu/cephtest 2023-10-06T04:29:40.680 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-06T04:29:40.687 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-06T04:29:40.687 DEBUG:teuthology.orchestra.run.smithi017:> test -z $(ls -A /var/lib/ceph) 2023-10-06T04:29:40.721 DEBUG:teuthology.orchestra.run.smithi136:> test -z $(ls -A /var/lib/ceph) 2023-10-06T04:29:40.738 INFO:teuthology.orchestra.run.smithi017.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-06T04:29:40.739 INFO:teuthology.orchestra.run.smithi136.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-06T04:29:40.739 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-06T04:29:40.792 INFO:teuthology.run_tasks:Running task kernel... 2023-10-06T04:29:40.806 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2023-10-06T04:29:40.807 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-10-06T04:29:40.807 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-10-06T04:29:40.807 DEBUG:teuthology.orchestra.run.smithi017:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T04:29:40.808 DEBUG:teuthology.orchestra.run.smithi136:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T04:29:40.823 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:29:40.823 DEBUG:teuthology.orchestra.run.smithi136:> uname -r 2023-10-06T04:29:40.824 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:29:40.824 DEBUG:teuthology.orchestra.run.smithi017:> uname -r 2023-10-06T04:29:40.880 INFO:teuthology.orchestra.run.smithi136.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-06T04:29:40.880 INFO:teuthology.task.kernel:Running kernel on smithi136: 4.18.0-305.25.1.el8_4.x86_64 2023-10-06T04:29:40.880 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum install -y kernel 2023-10-06T04:29:40.882 INFO:teuthology.orchestra.run.smithi017.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-06T04:29:40.882 INFO:teuthology.task.kernel:Running kernel on smithi017: 4.18.0-305.25.1.el8_4.x86_64 2023-10-06T04:29:40.882 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum install -y kernel 2023-10-06T04:29:42.302 INFO:teuthology.orchestra.run.smithi017.stdout:Updating Subscription Management repositories. 2023-10-06T04:29:42.302 INFO:teuthology.orchestra.run.smithi017.stdout:Unable to read consumer identity 2023-10-06T04:29:42.406 INFO:teuthology.orchestra.run.smithi136.stdout:Updating Subscription Management repositories. 2023-10-06T04:29:42.407 INFO:teuthology.orchestra.run.smithi136.stdout:Unable to read consumer identity 2023-10-06T04:29:43.590 INFO:teuthology.orchestra.run.smithi017.stdout:Copr repo for python3-asyncssh owned by ceph 39 kB/s | 3.5 kB 00:00 2023-10-06T04:29:43.761 INFO:teuthology.orchestra.run.smithi136.stdout:Copr repo for python3-asyncssh owned by ceph 38 kB/s | 3.5 kB 00:00 2023-10-06T04:29:44.172 INFO:teuthology.orchestra.run.smithi017.stdout:Extra Packages for Enterprise Linux 29 MB/s | 16 MB 00:00 2023-10-06T04:29:44.873 INFO:teuthology.orchestra.run.smithi136.stdout:Extra Packages for Enterprise Linux 15 MB/s | 16 MB 00:01 2023-10-06T04:29:47.658 INFO:teuthology.orchestra.run.smithi017.stdout:lab-extras 4.4 MB/s | 24 kB 00:00 2023-10-06T04:29:48.165 INFO:teuthology.orchestra.run.smithi136.stdout:lab-extras 4.2 MB/s | 24 kB 00:00 2023-10-06T04:29:48.387 INFO:teuthology.orchestra.run.smithi017.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-06T04:29:48.387 INFO:teuthology.orchestra.run.smithi017.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-06T04:29:48.387 INFO:teuthology.orchestra.run.smithi017.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-06T04:29:48.541 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2023-10-06T04:29:48.542 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2023-10-06T04:29:48.542 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2023-10-06T04:29:48.649 DEBUG:teuthology.orchestra.run.smithi017:> echo no | sudo yum reinstall kernel || true 2023-10-06T04:29:48.889 INFO:teuthology.orchestra.run.smithi136.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-06T04:29:48.890 INFO:teuthology.orchestra.run.smithi136.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-06T04:29:48.890 INFO:teuthology.orchestra.run.smithi136.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-06T04:29:49.015 INFO:teuthology.orchestra.run.smithi017.stdout:Updating Subscription Management repositories. 2023-10-06T04:29:49.015 INFO:teuthology.orchestra.run.smithi017.stdout:Unable to read consumer identity 2023-10-06T04:29:49.047 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2023-10-06T04:29:49.048 INFO:teuthology.orchestra.run.smithi136.stdout:Nothing to do. 2023-10-06T04:29:49.048 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2023-10-06T04:29:49.171 DEBUG:teuthology.orchestra.run.smithi136:> echo no | sudo yum reinstall kernel || true 2023-10-06T04:29:49.333 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:00:02 ago on Fri 06 Oct 2023 04:29:47 AM UTC. 2023-10-06T04:29:49.474 INFO:teuthology.orchestra.run.smithi017.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T04:29:49.474 INFO:teuthology.orchestra.run.smithi017.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T04:29:49.474 INFO:teuthology.orchestra.run.smithi017.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T04:29:49.498 INFO:teuthology.orchestra.run.smithi017.stderr:Error: No packages marked for reinstall. 2023-10-06T04:29:49.551 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum reinstall -y kernel || true 2023-10-06T04:29:49.557 INFO:teuthology.orchestra.run.smithi136.stdout:Updating Subscription Management repositories. 2023-10-06T04:29:49.557 INFO:teuthology.orchestra.run.smithi136.stdout:Unable to read consumer identity 2023-10-06T04:29:49.850 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:00:01 ago on Fri 06 Oct 2023 04:29:48 AM UTC. 2023-10-06T04:29:49.916 INFO:teuthology.orchestra.run.smithi017.stdout:Updating Subscription Management repositories. 2023-10-06T04:29:49.916 INFO:teuthology.orchestra.run.smithi017.stdout:Unable to read consumer identity 2023-10-06T04:29:49.976 INFO:teuthology.orchestra.run.smithi136.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T04:29:49.977 INFO:teuthology.orchestra.run.smithi136.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T04:29:49.977 INFO:teuthology.orchestra.run.smithi136.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T04:29:50.016 INFO:teuthology.orchestra.run.smithi136.stderr:Error: No packages marked for reinstall. 2023-10-06T04:29:50.067 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum reinstall -y kernel || true 2023-10-06T04:29:50.215 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:00:03 ago on Fri 06 Oct 2023 04:29:47 AM UTC. 2023-10-06T04:29:50.356 INFO:teuthology.orchestra.run.smithi017.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T04:29:50.356 INFO:teuthology.orchestra.run.smithi017.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T04:29:50.356 INFO:teuthology.orchestra.run.smithi017.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T04:29:50.368 INFO:teuthology.orchestra.run.smithi017.stderr:Error: No packages marked for reinstall. 2023-10-06T04:29:50.409 INFO:teuthology.orchestra.run.smithi136.stdout:Updating Subscription Management repositories. 2023-10-06T04:29:50.409 INFO:teuthology.orchestra.run.smithi136.stdout:Unable to read consumer identity 2023-10-06T04:29:50.419 DEBUG:teuthology.orchestra.run.smithi017:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T04:29:50.549 INFO:teuthology.orchestra.run.smithi017.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T04:29:50.549 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T04:29:50.549 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-06T04:29:50.550 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T04:29:50.550 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T04:29:50.550 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-10-06T04:29:50.550 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi017.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T04:29:50.550 DEBUG:teuthology.orchestra.run.smithi017:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T04:29:50.680 INFO:teuthology.orchestra.run.smithi017.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T04:29:50.680 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T04:29:50.681 DEBUG:teuthology.orchestra.run.smithi017:> sudo rpm -qi grub2-tools 2023-10-06T04:29:50.702 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:00:02 ago on Fri 06 Oct 2023 04:29:48 AM UTC. 2023-10-06T04:29:50.708 INFO:teuthology.orchestra.run.smithi017.stdout:Name : grub2-tools 2023-10-06T04:29:50.708 INFO:teuthology.orchestra.run.smithi017.stdout:Epoch : 1 2023-10-06T04:29:50.708 INFO:teuthology.orchestra.run.smithi017.stdout:Version : 2.02 2023-10-06T04:29:50.708 INFO:teuthology.orchestra.run.smithi017.stdout:Release : 99.el8_4.1 2023-10-06T04:29:50.709 INFO:teuthology.orchestra.run.smithi017.stdout:Architecture: x86_64 2023-10-06T04:29:50.709 INFO:teuthology.orchestra.run.smithi017.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-06T04:29:50.709 INFO:teuthology.orchestra.run.smithi017.stdout:Group : System Environment/Base 2023-10-06T04:29:50.709 INFO:teuthology.orchestra.run.smithi017.stdout:Size : 9264631 2023-10-06T04:29:50.709 INFO:teuthology.orchestra.run.smithi017.stdout:License : GPLv3+ 2023-10-06T04:29:50.709 INFO:teuthology.orchestra.run.smithi017.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-06T04:29:50.709 INFO:teuthology.orchestra.run.smithi017.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-06T04:29:50.709 INFO:teuthology.orchestra.run.smithi017.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-06T04:29:50.709 INFO:teuthology.orchestra.run.smithi017.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-06T04:29:50.709 INFO:teuthology.orchestra.run.smithi017.stdout:Relocations : (not relocatable) 2023-10-06T04:29:50.709 INFO:teuthology.orchestra.run.smithi017.stdout:Packager : Red Hat, Inc. 2023-10-06T04:29:50.710 INFO:teuthology.orchestra.run.smithi017.stdout:Vendor : Red Hat, Inc. 2023-10-06T04:29:50.710 INFO:teuthology.orchestra.run.smithi017.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T04:29:50.710 INFO:teuthology.orchestra.run.smithi017.stdout:Summary : Support tools for GRUB. 2023-10-06T04:29:50.710 INFO:teuthology.orchestra.run.smithi017.stdout:Description : 2023-10-06T04:29:50.710 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:29:50.710 INFO:teuthology.orchestra.run.smithi017.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T04:29:50.710 INFO:teuthology.orchestra.run.smithi017.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T04:29:50.710 INFO:teuthology.orchestra.run.smithi017.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T04:29:50.710 INFO:teuthology.orchestra.run.smithi017.stdout:hardware devices. 2023-10-06T04:29:50.710 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:29:50.710 INFO:teuthology.orchestra.run.smithi017.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T04:29:50.711 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T04:29:50.711 INFO:teuthology.task.kernel:Updating grub on smithi017 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-06T04:29:50.711 DEBUG:teuthology.orchestra.run.smithi017:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T04:29:50.844 INFO:teuthology.orchestra.run.smithi136.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T04:29:50.844 INFO:teuthology.orchestra.run.smithi136.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T04:29:50.845 INFO:teuthology.orchestra.run.smithi136.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T04:29:50.864 INFO:teuthology.orchestra.run.smithi136.stderr:Error: No packages marked for reinstall. 2023-10-06T04:29:50.921 DEBUG:teuthology.orchestra.run.smithi136:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T04:29:51.045 INFO:teuthology.orchestra.run.smithi136.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T04:29:51.045 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T04:29:51.045 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-06T04:29:51.045 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T04:29:51.045 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T04:29:51.045 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2023-10-06T04:29:51.045 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi136.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T04:29:51.046 DEBUG:teuthology.orchestra.run.smithi136:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T04:29:51.171 INFO:teuthology.orchestra.run.smithi136.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T04:29:51.172 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T04:29:51.172 DEBUG:teuthology.orchestra.run.smithi136:> sudo rpm -qi grub2-tools 2023-10-06T04:29:51.198 INFO:teuthology.orchestra.run.smithi136.stdout:Name : grub2-tools 2023-10-06T04:29:51.199 INFO:teuthology.orchestra.run.smithi136.stdout:Epoch : 1 2023-10-06T04:29:51.199 INFO:teuthology.orchestra.run.smithi136.stdout:Version : 2.02 2023-10-06T04:29:51.199 INFO:teuthology.orchestra.run.smithi136.stdout:Release : 99.el8_4.1 2023-10-06T04:29:51.199 INFO:teuthology.orchestra.run.smithi136.stdout:Architecture: x86_64 2023-10-06T04:29:51.199 INFO:teuthology.orchestra.run.smithi136.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-06T04:29:51.199 INFO:teuthology.orchestra.run.smithi136.stdout:Group : System Environment/Base 2023-10-06T04:29:51.199 INFO:teuthology.orchestra.run.smithi136.stdout:Size : 9264631 2023-10-06T04:29:51.199 INFO:teuthology.orchestra.run.smithi136.stdout:License : GPLv3+ 2023-10-06T04:29:51.199 INFO:teuthology.orchestra.run.smithi136.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-06T04:29:51.199 INFO:teuthology.orchestra.run.smithi136.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-06T04:29:51.199 INFO:teuthology.orchestra.run.smithi136.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-06T04:29:51.199 INFO:teuthology.orchestra.run.smithi136.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-06T04:29:51.200 INFO:teuthology.orchestra.run.smithi136.stdout:Relocations : (not relocatable) 2023-10-06T04:29:51.200 INFO:teuthology.orchestra.run.smithi136.stdout:Packager : Red Hat, Inc. 2023-10-06T04:29:51.200 INFO:teuthology.orchestra.run.smithi136.stdout:Vendor : Red Hat, Inc. 2023-10-06T04:29:51.200 INFO:teuthology.orchestra.run.smithi136.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T04:29:51.200 INFO:teuthology.orchestra.run.smithi136.stdout:Summary : Support tools for GRUB. 2023-10-06T04:29:51.200 INFO:teuthology.orchestra.run.smithi136.stdout:Description : 2023-10-06T04:29:51.200 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-10-06T04:29:51.200 INFO:teuthology.orchestra.run.smithi136.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T04:29:51.200 INFO:teuthology.orchestra.run.smithi136.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T04:29:51.200 INFO:teuthology.orchestra.run.smithi136.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T04:29:51.200 INFO:teuthology.orchestra.run.smithi136.stdout:hardware devices. 2023-10-06T04:29:51.200 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-10-06T04:29:51.201 INFO:teuthology.orchestra.run.smithi136.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T04:29:51.201 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T04:29:51.201 INFO:teuthology.task.kernel:Updating grub on smithi136 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-06T04:29:51.201 DEBUG:teuthology.orchestra.run.smithi136:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T04:29:52.017 INFO:teuthology.orchestra.run.smithi017.stderr:Generating grub configuration file ... 2023-10-06T04:29:52.640 INFO:teuthology.orchestra.run.smithi136.stderr:Generating grub configuration file ... 2023-10-06T04:29:54.074 INFO:teuthology.orchestra.run.smithi017.stderr:done 2023-10-06T04:29:54.076 DEBUG:teuthology.orchestra.run.smithi017:> mktemp 2023-10-06T04:29:54.089 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.OrB3f2pnO9 2023-10-06T04:29:54.090 DEBUG:teuthology.orchestra.run.smithi017:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.OrB3f2pnO9 2023-10-06T04:29:54.159 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.OrB3f2pnO9 2023-10-06T04:29:54.312 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.OrB3f2pnO9 is 6KB 2023-10-06T04:29:54.331 DEBUG:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.OrB3f2pnO9 2023-10-06T04:29:54.345 DEBUG:teuthology.orchestra.run.smithi017:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T04:29:54.417 INFO:teuthology.orchestra.run.smithi017.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-06T04:29:54.418 INFO:teuthology.orchestra.run.smithi017.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-06T04:29:54.418 INFO:teuthology.orchestra.run.smithi017.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-06T04:29:54.418 INFO:teuthology.orchestra.run.smithi017.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-06T04:29:54.419 DEBUG:teuthology.orchestra.run.smithi017:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-06T04:29:54.566 DEBUG:teuthology.orchestra.run.smithi017:> sudo shutdown -r now 2023-10-06T04:29:54.997 INFO:teuthology.orchestra.run.smithi136.stderr:done 2023-10-06T04:29:54.999 DEBUG:teuthology.orchestra.run.smithi136:> mktemp 2023-10-06T04:29:55.012 INFO:teuthology.orchestra.run.smithi136.stdout:/tmp/tmp.pR2pufb2zO 2023-10-06T04:29:55.013 DEBUG:teuthology.orchestra.run.smithi136:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.pR2pufb2zO 2023-10-06T04:29:55.083 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0666 /tmp/tmp.pR2pufb2zO 2023-10-06T04:29:55.245 DEBUG:teuthology.orchestra.remote:smithi136:/tmp/tmp.pR2pufb2zO is 6KB 2023-10-06T04:29:55.294 DEBUG:teuthology.orchestra.run.smithi136:> rm -fr /tmp/tmp.pR2pufb2zO 2023-10-06T04:29:55.307 DEBUG:teuthology.orchestra.run.smithi136:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T04:29:55.377 INFO:teuthology.orchestra.run.smithi136.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-06T04:29:55.377 INFO:teuthology.orchestra.run.smithi136.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-06T04:29:55.377 INFO:teuthology.orchestra.run.smithi136.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-06T04:29:55.377 INFO:teuthology.orchestra.run.smithi136.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-06T04:29:55.378 DEBUG:teuthology.orchestra.run.smithi136:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-06T04:29:55.536 DEBUG:teuthology.orchestra.run.smithi136:> sudo shutdown -r now 2023-10-06T04:30:24.594 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-06T04:30:24.595 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-10-06T04:30:24.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:30:25.540 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-10-06T04:30:25.540 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2023-10-06T04:30:25.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:31:24.654 DEBUG:teuthology.orchestra.remote:timed out 2023-10-06T04:31:25.544 DEBUG:teuthology.orchestra.remote:timed out 2023-10-06T04:31:33.663 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-10-06T04:31:33.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:31:34.545 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2023-10-06T04:31:34.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:31:34.944 DEBUG:teuthology.orchestra.run.smithi136:> true 2023-10-06T04:31:35.217 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2023-10-06T04:31:35.217 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-06T04:31:35.217 DEBUG:teuthology.orchestra.run.smithi136:> uname -r 2023-10-06T04:31:35.273 INFO:teuthology.orchestra.run.smithi136.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-06T04:31:35.273 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-06T04:31:35.274 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T04:31:35.274 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-06T04:31:36.275 DEBUG:teuthology.parallel:result is None 2023-10-06T04:31:37.083 DEBUG:teuthology.orchestra.run.smithi017:> true 2023-10-06T04:31:37.307 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-10-06T04:31:37.308 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-06T04:31:37.308 DEBUG:teuthology.orchestra.run.smithi017:> uname -r 2023-10-06T04:31:37.364 INFO:teuthology.orchestra.run.smithi017.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-06T04:31:37.365 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-06T04:31:37.365 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T04:31:37.365 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-06T04:31:38.366 DEBUG:teuthology.parallel:result is None 2023-10-06T04:31:38.366 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-06T04:31:38.375 INFO:teuthology.task.internal:Creating test directory... 2023-10-06T04:31:38.375 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T04:31:38.378 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T04:31:38.395 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-06T04:31:38.403 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-06T04:31:38.413 INFO:teuthology.task.internal:Creating archive directory... 2023-10-06T04:31:38.413 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T04:31:38.435 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T04:31:38.459 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-06T04:31:38.467 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-06T04:31:38.468 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T04:31:38.491 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T04:31:38.607 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T04:31:38.621 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T04:31:38.679 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T04:31:38.743 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T04:31:38.745 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-06T04:31:38.752 INFO:teuthology.task.internal:Configuring sudo... 2023-10-06T04:31:38.752 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T04:31:38.754 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T04:31:38.780 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-06T04:31:38.790 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-06T04:31:38.790 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T04:31:38.821 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T04:31:38.836 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T04:31:38.917 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T04:31:38.965 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T04:31:39.048 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T04:31:39.089 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-06T04:31:39.089 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T04:31:39.164 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T04:31:39.207 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T04:31:39.253 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T04:31:39.338 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T04:31:39.382 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-10-06T04:31:39.383 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T04:31:39.466 DEBUG:teuthology.orchestra.run.smithi017:> sudo service rsyslog restart 2023-10-06T04:31:39.468 DEBUG:teuthology.orchestra.run.smithi136:> sudo service rsyslog restart 2023-10-06T04:31:39.562 INFO:teuthology.orchestra.run.smithi136.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T04:31:39.564 INFO:teuthology.orchestra.run.smithi017.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T04:31:39.847 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-06T04:31:39.857 INFO:teuthology.task.internal:Starting timer... 2023-10-06T04:31:39.858 INFO:teuthology.run_tasks:Running task pcp... 2023-10-06T04:31:39.870 INFO:teuthology.run_tasks:Running task selinux... 2023-10-06T04:31:39.887 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-10-06T04:31:39.887 DEBUG:teuthology.orchestra.run.smithi017:> sudo service auditd rotate 2023-10-06T04:31:39.943 INFO:teuthology.orchestra.run.smithi017.stdout:Rotating logs: [ OK ] 2023-10-06T04:31:39.945 DEBUG:teuthology.orchestra.run.smithi136:> sudo service auditd rotate 2023-10-06T04:31:40.013 INFO:teuthology.orchestra.run.smithi136.stdout:Rotating logs: [ OK ] 2023-10-06T04:31:40.015 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-06T04:31:40.015 DEBUG:teuthology.orchestra.run.smithi017:> /usr/sbin/getenforce 2023-10-06T04:31:40.031 INFO:teuthology.orchestra.run.smithi017.stdout:Permissive 2023-10-06T04:31:40.031 DEBUG:teuthology.orchestra.run.smithi136:> /usr/sbin/getenforce 2023-10-06T04:31:40.062 INFO:teuthology.orchestra.run.smithi136.stdout:Permissive 2023-10-06T04:31:40.063 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi017.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi136.front.sepia.ceph.com': 'permissive'} 2023-10-06T04:31:40.063 DEBUG:teuthology.orchestra.run.smithi017:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T04:31:40.097 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:31:40.098 DEBUG:teuthology.orchestra.run.smithi136:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T04:31:40.132 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:31:40.133 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-06T04:31:40.133 DEBUG:teuthology.orchestra.run.smithi017:> sudo /usr/sbin/setenforce permissive 2023-10-06T04:31:40.170 DEBUG:teuthology.orchestra.run.smithi136:> sudo /usr/sbin/setenforce permissive 2023-10-06T04:31:40.203 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-06T04:31:40.217 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-06T04:31:40.218 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-06T04:31:40.235 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-06T04:31:40.236 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi017.front.sepia.ceph.com,smithi136.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-06T04:40:25.450 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi017.front.sepia.ceph.com'), Remote(name='ubuntu@smithi136.front.sepia.ceph.com')] 2023-10-06T04:40:25.451 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-10-06T04:40:25.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:40:25.522 DEBUG:teuthology.orchestra.run.smithi017:> true 2023-10-06T04:40:25.589 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-10-06T04:40:25.590 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2023-10-06T04:40:25.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:40:25.659 DEBUG:teuthology.orchestra.run.smithi136:> true 2023-10-06T04:40:25.726 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2023-10-06T04:40:25.726 INFO:teuthology.run_tasks:Running task clock... 2023-10-06T04:40:25.739 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-06T04:40:25.739 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T04:40:25.740 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T04:40:25.742 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T04:40:25.742 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T04:40:25.770 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T04:40:25.785 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T04:40:25.796 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T04:40:25.810 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T04:40:25.831 INFO:teuthology.orchestra.run.smithi017.stderr:sudo: ntpd: command not found 2023-10-06T04:40:25.842 INFO:teuthology.orchestra.run.smithi017.stdout:506 Cannot talk to daemon 2023-10-06T04:40:25.849 INFO:teuthology.orchestra.run.smithi136.stderr:sudo: ntpd: command not found 2023-10-06T04:40:25.856 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T04:40:25.859 INFO:teuthology.orchestra.run.smithi136.stdout:506 Cannot talk to daemon 2023-10-06T04:40:25.871 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T04:40:25.873 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T04:40:25.886 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T04:40:25.940 INFO:teuthology.orchestra.run.smithi017.stderr:bash: ntpq: command not found 2023-10-06T04:40:25.943 INFO:teuthology.orchestra.run.smithi017.stdout:210 Number of sources = 4 2023-10-06T04:40:25.943 INFO:teuthology.orchestra.run.smithi017.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T04:40:25.943 INFO:teuthology.orchestra.run.smithi017.stdout:=============================================================================== 2023-10-06T04:40:25.943 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:40:25.943 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:40:25.943 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:40:25.943 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:40:25.961 INFO:teuthology.orchestra.run.smithi136.stderr:bash: ntpq: command not found 2023-10-06T04:40:25.963 INFO:teuthology.orchestra.run.smithi136.stdout:210 Number of sources = 4 2023-10-06T04:40:25.963 INFO:teuthology.orchestra.run.smithi136.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T04:40:25.963 INFO:teuthology.orchestra.run.smithi136.stdout:=============================================================================== 2023-10-06T04:40:25.963 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:40:25.963 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:40:25.964 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:40:25.964 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:40:25.965 INFO:teuthology.run_tasks:Running task install... 2023-10-06T04:40:25.973 DEBUG:teuthology.task.install:project ceph 2023-10-06T04:40:25.973 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}} 2023-10-06T04:40:25.973 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'} 2023-10-06T04:40:25.973 INFO:teuthology.task.install:Using flavor: default 2023-10-06T04:40:25.979 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-06T04:40:25.979 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-06T04:40:25.979 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564', 'tag': None, 'wait_for_package': False} 2023-10-06T04:40:25.980 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T04:40:25.981 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564', 'tag': None, 'wait_for_package': False} 2023-10-06T04:40:25.982 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T04:40:26.199 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/ 2023-10-06T04:40:26.199 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1274.g68e53a4a 2023-10-06T04:40:26.213 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/ 2023-10-06T04:40:26.213 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1274.g68e53a4a 2023-10-06T04:40:26.320 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T04:40:26.321 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-10-06T04:40:26.321 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T04:40:26.346 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-06T04:40:26.347 DEBUG:teuthology.orchestra.run.smithi136:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T04:40:26.374 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T04:40:26.375 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-06T04:40:26.375 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T04:40:26.402 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-06T04:40:26.403 DEBUG:teuthology.orchestra.run.smithi017:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T04:40:26.412 DEBUG:teuthology.orchestra.run.smithi136:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T04:40:26.469 DEBUG:teuthology.orchestra.run.smithi017:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T04:40:26.487 DEBUG:teuthology.orchestra.run.smithi136:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T04:40:26.546 DEBUG:teuthology.orchestra.run.smithi017:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T04:40:26.551 INFO:teuthology.orchestra.run.smithi136.stdout:check_obsoletes = 1 2023-10-06T04:40:26.553 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum clean all 2023-10-06T04:40:26.611 INFO:teuthology.orchestra.run.smithi017.stdout:check_obsoletes = 1 2023-10-06T04:40:26.613 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum clean all 2023-10-06T04:40:26.943 INFO:teuthology.orchestra.run.smithi136.stdout:Updating Subscription Management repositories. 2023-10-06T04:40:27.024 INFO:teuthology.orchestra.run.smithi017.stdout:Updating Subscription Management repositories. 2023-10-06T04:40:27.259 INFO:teuthology.orchestra.run.smithi136.stdout:44 files removed 2023-10-06T04:40:27.303 INFO:teuthology.orchestra.run.smithi017.stdout:44 files removed 2023-10-06T04:40:27.310 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-06T04:40:27.360 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-06T04:40:27.661 INFO:teuthology.orchestra.run.smithi136.stdout:Updating Subscription Management repositories. 2023-10-06T04:40:27.729 INFO:teuthology.orchestra.run.smithi017.stdout:Updating Subscription Management repositories. 2023-10-06T04:40:28.389 INFO:teuthology.orchestra.run.smithi136.stdout:ceph packages for x86_64 250 kB/s | 78 kB 00:00 2023-10-06T04:40:28.466 INFO:teuthology.orchestra.run.smithi017.stdout:ceph packages for x86_64 276 kB/s | 78 kB 00:00 2023-10-06T04:40:28.614 INFO:teuthology.orchestra.run.smithi136.stdout:ceph noarch packages 50 kB/s | 9.2 kB 00:00 2023-10-06T04:40:28.755 INFO:teuthology.orchestra.run.smithi017.stdout:ceph noarch packages 37 kB/s | 9.2 kB 00:00 2023-10-06T04:40:28.946 INFO:teuthology.orchestra.run.smithi136.stdout:ceph source packages 4.8 kB/s | 1.4 kB 00:00 2023-10-06T04:40:29.030 INFO:teuthology.orchestra.run.smithi017.stdout:ceph source packages 6.0 kB/s | 1.4 kB 00:00 2023-10-06T04:40:29.057 INFO:teuthology.orchestra.run.smithi136.stdout:Copr repo for python3-asyncssh owned by ceph 42 kB/s | 3.5 kB 00:00 2023-10-06T04:40:29.144 INFO:teuthology.orchestra.run.smithi017.stdout:Copr repo for python3-asyncssh owned by ceph 42 kB/s | 3.5 kB 00:00 2023-10-06T04:40:30.182 INFO:teuthology.orchestra.run.smithi017.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:01 2023-10-06T04:40:30.932 INFO:teuthology.orchestra.run.smithi136.stdout:Extra Packages for Enterprise Linux 8.6 MB/s | 16 MB 00:01 2023-10-06T04:40:33.747 INFO:teuthology.orchestra.run.smithi017.stdout:lab-extras 1.3 MB/s | 24 kB 00:00 2023-10-06T04:40:34.170 INFO:teuthology.orchestra.run.smithi017.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 98 MB/s | 33 MB 00:00 2023-10-06T04:40:34.329 INFO:teuthology.orchestra.run.smithi136.stdout:lab-extras 4.5 MB/s | 24 kB 00:00 2023-10-06T04:40:34.684 INFO:teuthology.orchestra.run.smithi136.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 120 MB/s | 33 MB 00:00 2023-10-06T04:40:39.838 INFO:teuthology.orchestra.run.smithi017.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 98 MB/s | 38 MB 00:00 2023-10-06T04:40:40.096 INFO:teuthology.orchestra.run.smithi136.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 126 MB/s | 38 MB 00:00 2023-10-06T04:40:48.790 INFO:teuthology.orchestra.run.smithi136.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T04:40:48.791 INFO:teuthology.orchestra.run.smithi136.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T04:40:48.801 INFO:teuthology.orchestra.run.smithi136.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-06T04:40:48.802 INFO:teuthology.orchestra.run.smithi136.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-06T04:40:48.803 INFO:teuthology.orchestra.run.smithi136.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-06T04:40:48.804 INFO:teuthology.orchestra.run.smithi136.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T04:40:48.806 INFO:teuthology.orchestra.run.smithi136.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T04:40:48.808 INFO:teuthology.orchestra.run.smithi136.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-06T04:40:48.809 INFO:teuthology.orchestra.run.smithi136.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T04:40:48.945 INFO:teuthology.orchestra.run.smithi017.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T04:40:48.945 INFO:teuthology.orchestra.run.smithi017.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T04:40:48.957 INFO:teuthology.orchestra.run.smithi017.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-06T04:40:48.958 INFO:teuthology.orchestra.run.smithi017.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-06T04:40:48.959 INFO:teuthology.orchestra.run.smithi017.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-06T04:40:48.959 INFO:teuthology.orchestra.run.smithi017.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T04:40:48.961 INFO:teuthology.orchestra.run.smithi017.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T04:40:48.964 INFO:teuthology.orchestra.run.smithi017.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-06T04:40:48.965 INFO:teuthology.orchestra.run.smithi017.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T04:40:49.310 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2023-10-06T04:40:49.321 INFO:teuthology.orchestra.run.smithi136.stdout:====================================================================================================================== 2023-10-06T04:40:49.321 INFO:teuthology.orchestra.run.smithi136.stdout: Package Arch Version Repository Size 2023-10-06T04:40:49.321 INFO:teuthology.orchestra.run.smithi136.stdout:====================================================================================================================== 2023-10-06T04:40:49.321 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2023-10-06T04:40:49.321 INFO:teuthology.orchestra.run.smithi136.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-06T04:40:49.322 INFO:teuthology.orchestra.run.smithi136.stdout: ceph x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 6.4 k 2023-10-06T04:40:49.322 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-base x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 5.2 M 2023-10-06T04:40:49.322 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-fuse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 877 k 2023-10-06T04:40:49.322 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 162 k 2023-10-06T04:40:49.322 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 1.6 M 2023-10-06T04:40:49.322 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 121 k 2023-10-06T04:40:49.322 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 1.7 M 2023-10-06T04:40:49.322 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 7.4 M 2023-10-06T04:40:49.322 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-rook noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 47 k 2023-10-06T04:40:49.323 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-radosgw x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 17 M 2023-10-06T04:40:49.323 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-test x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 52 M 2023-10-06T04:40:49.323 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-volume noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 267 k 2023-10-06T04:40:49.323 INFO:teuthology.orchestra.run.smithi136.stdout: cephadm noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 80 k 2023-10-06T04:40:49.323 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-mirror x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 255 k 2023-10-06T04:40:49.323 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-top noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 18 k 2023-10-06T04:40:49.323 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-06T04:40:49.323 INFO:teuthology.orchestra.run.smithi136.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-06T04:40:49.323 INFO:teuthology.orchestra.run.smithi136.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-06T04:40:49.323 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs-devel x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 25 k 2023-10-06T04:40:49.324 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 797 k 2023-10-06T04:40:49.324 INFO:teuthology.orchestra.run.smithi136.stdout: librados-devel x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 130 k 2023-10-06T04:40:49.324 INFO:teuthology.orchestra.run.smithi136.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-06T04:40:49.324 INFO:teuthology.orchestra.run.smithi136.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-06T04:40:49.324 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-06T04:40:49.324 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cephfs x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 190 k 2023-10-06T04:40:49.325 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rados x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 371 k 2023-10-06T04:40:49.325 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rbd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 358 k 2023-10-06T04:40:49.325 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rgw x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 107 k 2023-10-06T04:40:49.325 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-fuse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 91 k 2023-10-06T04:40:49.325 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-mirror x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.5 M 2023-10-06T04:40:49.325 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-nbd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 173 k 2023-10-06T04:40:49.326 INFO:teuthology.orchestra.run.smithi136.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-06T04:40:49.326 INFO:teuthology.orchestra.run.smithi136.stdout:Upgrading: 2023-10-06T04:40:49.326 INFO:teuthology.orchestra.run.smithi136.stdout: librados2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.4 M 2023-10-06T04:40:49.326 INFO:teuthology.orchestra.run.smithi136.stdout: librbd1 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.5 M 2023-10-06T04:40:49.326 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2023-10-06T04:40:49.327 INFO:teuthology.orchestra.run.smithi136.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-06T04:40:49.327 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-common x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 23 M 2023-10-06T04:40:49.327 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 23 k 2023-10-06T04:40:49.327 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mds x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 2.3 M 2023-10-06T04:40:49.327 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 238 k 2023-10-06T04:40:49.327 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mon x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.9 M 2023-10-06T04:40:49.327 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-osd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 17 M 2023-10-06T04:40:49.327 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 14 k 2023-10-06T04:40:49.328 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-selinux x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 24 k 2023-10-06T04:40:49.328 INFO:teuthology.orchestra.run.smithi136.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-06T04:40:49.328 INFO:teuthology.orchestra.run.smithi136.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T04:40:49.328 INFO:teuthology.orchestra.run.smithi136.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-06T04:40:49.328 INFO:teuthology.orchestra.run.smithi136.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-06T04:40:49.328 INFO:teuthology.orchestra.run.smithi136.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-06T04:40:49.328 INFO:teuthology.orchestra.run.smithi136.stdout: libcephsqlite x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 175 k 2023-10-06T04:40:49.329 INFO:teuthology.orchestra.run.smithi136.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-06T04:40:49.329 INFO:teuthology.orchestra.run.smithi136.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-06T04:40:49.329 INFO:teuthology.orchestra.run.smithi136.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T04:40:49.329 INFO:teuthology.orchestra.run.smithi136.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-06T04:40:49.329 INFO:teuthology.orchestra.run.smithi136.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-06T04:40:49.329 INFO:teuthology.orchestra.run.smithi136.stdout: libradosstriper1 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 506 k 2023-10-06T04:40:49.329 INFO:teuthology.orchestra.run.smithi136.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-06T04:40:49.330 INFO:teuthology.orchestra.run.smithi136.stdout: librgw2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 5.6 M 2023-10-06T04:40:49.330 INFO:teuthology.orchestra.run.smithi136.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-06T04:40:49.330 INFO:teuthology.orchestra.run.smithi136.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-06T04:40:49.330 INFO:teuthology.orchestra.run.smithi136.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T04:40:49.330 INFO:teuthology.orchestra.run.smithi136.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-06T04:40:49.330 INFO:teuthology.orchestra.run.smithi136.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-06T04:40:49.331 INFO:teuthology.orchestra.run.smithi136.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-06T04:40:49.331 INFO:teuthology.orchestra.run.smithi136.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-06T04:40:49.331 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-06T04:40:49.331 INFO:teuthology.orchestra.run.smithi136.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-06T04:40:49.331 INFO:teuthology.orchestra.run.smithi136.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-06T04:40:49.332 INFO:teuthology.orchestra.run.smithi136.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-06T04:40:49.332 INFO:teuthology.orchestra.run.smithi136.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T04:40:49.332 INFO:teuthology.orchestra.run.smithi136.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-06T04:40:49.332 INFO:teuthology.orchestra.run.smithi136.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T04:40:49.332 INFO:teuthology.orchestra.run.smithi136.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T04:40:49.332 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T04:40:49.332 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-argparse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 45 k 2023-10-06T04:40:49.333 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-common x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 115 k 2023-10-06T04:40:49.333 INFO:teuthology.orchestra.run.smithi136.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T04:40:49.333 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T04:40:49.333 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T04:40:49.333 INFO:teuthology.orchestra.run.smithi136.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T04:40:49.333 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T04:40:49.333 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T04:40:49.333 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T04:40:49.333 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-06T04:40:49.333 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-06T04:40:49.334 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T04:40:49.334 INFO:teuthology.orchestra.run.smithi136.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T04:40:49.334 INFO:teuthology.orchestra.run.smithi136.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T04:40:49.334 INFO:teuthology.orchestra.run.smithi136.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-06T04:40:49.334 INFO:teuthology.orchestra.run.smithi136.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-06T04:40:49.334 INFO:teuthology.orchestra.run.smithi136.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T04:40:49.334 INFO:teuthology.orchestra.run.smithi136.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T04:40:49.334 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-06T04:40:49.334 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-06T04:40:49.335 INFO:teuthology.orchestra.run.smithi136.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-06T04:40:49.335 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T04:40:49.335 INFO:teuthology.orchestra.run.smithi136.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T04:40:49.335 INFO:teuthology.orchestra.run.smithi136.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-06T04:40:49.335 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-06T04:40:49.335 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-06T04:40:49.335 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-06T04:40:49.335 INFO:teuthology.orchestra.run.smithi136.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T04:40:49.335 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T04:40:49.335 INFO:teuthology.orchestra.run.smithi136.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T04:40:49.335 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T04:40:49.336 INFO:teuthology.orchestra.run.smithi136.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-06T04:40:49.336 INFO:teuthology.orchestra.run.smithi136.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T04:40:49.336 INFO:teuthology.orchestra.run.smithi136.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T04:40:49.336 INFO:teuthology.orchestra.run.smithi136.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T04:40:49.336 INFO:teuthology.orchestra.run.smithi136.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T04:40:49.336 INFO:teuthology.orchestra.run.smithi136.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T04:40:49.336 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T04:40:49.336 INFO:teuthology.orchestra.run.smithi136.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T04:40:49.336 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T04:40:49.336 INFO:teuthology.orchestra.run.smithi136.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-06T04:40:49.336 INFO:teuthology.orchestra.run.smithi136.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T04:40:49.336 INFO:teuthology.orchestra.run.smithi136.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-06T04:40:49.337 INFO:teuthology.orchestra.run.smithi136.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T04:40:49.337 INFO:teuthology.orchestra.run.smithi136.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-06T04:40:49.337 INFO:teuthology.orchestra.run.smithi136.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-06T04:40:49.337 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-10-06T04:40:49.337 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2023-10-06T04:40:49.337 INFO:teuthology.orchestra.run.smithi136.stdout:====================================================================================================================== 2023-10-06T04:40:49.337 INFO:teuthology.orchestra.run.smithi136.stdout:Install 118 Packages 2023-10-06T04:40:49.337 INFO:teuthology.orchestra.run.smithi136.stdout:Upgrade 2 Packages 2023-10-06T04:40:49.337 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-10-06T04:40:49.338 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 201 M 2023-10-06T04:40:49.338 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2023-10-06T04:40:49.502 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2023-10-06T04:40:49.515 INFO:teuthology.orchestra.run.smithi017.stdout:====================================================================================================================== 2023-10-06T04:40:49.515 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2023-10-06T04:40:49.515 INFO:teuthology.orchestra.run.smithi017.stdout:====================================================================================================================== 2023-10-06T04:40:49.515 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2023-10-06T04:40:49.515 INFO:teuthology.orchestra.run.smithi017.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-06T04:40:49.515 INFO:teuthology.orchestra.run.smithi017.stdout: ceph x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 6.4 k 2023-10-06T04:40:49.515 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 5.2 M 2023-10-06T04:40:49.515 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 877 k 2023-10-06T04:40:49.515 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 162 k 2023-10-06T04:40:49.516 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 1.6 M 2023-10-06T04:40:49.516 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 121 k 2023-10-06T04:40:49.516 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 1.7 M 2023-10-06T04:40:49.516 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 7.4 M 2023-10-06T04:40:49.516 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-rook noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 47 k 2023-10-06T04:40:49.516 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 17 M 2023-10-06T04:40:49.516 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 52 M 2023-10-06T04:40:49.516 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-volume noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 267 k 2023-10-06T04:40:49.516 INFO:teuthology.orchestra.run.smithi017.stdout: cephadm noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 80 k 2023-10-06T04:40:49.516 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-mirror x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 255 k 2023-10-06T04:40:49.516 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-top noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 18 k 2023-10-06T04:40:49.516 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-06T04:40:49.517 INFO:teuthology.orchestra.run.smithi017.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-06T04:40:49.517 INFO:teuthology.orchestra.run.smithi017.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-06T04:40:49.517 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs-devel x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 25 k 2023-10-06T04:40:49.517 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 797 k 2023-10-06T04:40:49.517 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 130 k 2023-10-06T04:40:49.517 INFO:teuthology.orchestra.run.smithi017.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-06T04:40:49.517 INFO:teuthology.orchestra.run.smithi017.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-06T04:40:49.517 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-06T04:40:49.517 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 190 k 2023-10-06T04:40:49.517 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 371 k 2023-10-06T04:40:49.517 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 358 k 2023-10-06T04:40:49.518 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 107 k 2023-10-06T04:40:49.518 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 91 k 2023-10-06T04:40:49.518 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.5 M 2023-10-06T04:40:49.518 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 173 k 2023-10-06T04:40:49.518 INFO:teuthology.orchestra.run.smithi017.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-06T04:40:49.518 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrading: 2023-10-06T04:40:49.518 INFO:teuthology.orchestra.run.smithi017.stdout: librados2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.4 M 2023-10-06T04:40:49.518 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.5 M 2023-10-06T04:40:49.518 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2023-10-06T04:40:49.518 INFO:teuthology.orchestra.run.smithi017.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-06T04:40:49.518 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 23 M 2023-10-06T04:40:49.518 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 23 k 2023-10-06T04:40:49.519 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 2.3 M 2023-10-06T04:40:49.519 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 238 k 2023-10-06T04:40:49.519 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.9 M 2023-10-06T04:40:49.519 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 17 M 2023-10-06T04:40:49.519 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 14 k 2023-10-06T04:40:49.519 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-selinux x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 24 k 2023-10-06T04:40:49.519 INFO:teuthology.orchestra.run.smithi017.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-06T04:40:49.519 INFO:teuthology.orchestra.run.smithi017.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T04:40:49.519 INFO:teuthology.orchestra.run.smithi017.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-06T04:40:49.519 INFO:teuthology.orchestra.run.smithi017.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-06T04:40:49.519 INFO:teuthology.orchestra.run.smithi017.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-06T04:40:49.519 INFO:teuthology.orchestra.run.smithi017.stdout: libcephsqlite x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 175 k 2023-10-06T04:40:49.520 INFO:teuthology.orchestra.run.smithi017.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-06T04:40:49.520 INFO:teuthology.orchestra.run.smithi017.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-06T04:40:49.520 INFO:teuthology.orchestra.run.smithi017.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T04:40:49.520 INFO:teuthology.orchestra.run.smithi017.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-06T04:40:49.520 INFO:teuthology.orchestra.run.smithi017.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-06T04:40:49.520 INFO:teuthology.orchestra.run.smithi017.stdout: libradosstriper1 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 506 k 2023-10-06T04:40:49.520 INFO:teuthology.orchestra.run.smithi017.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-06T04:40:49.520 INFO:teuthology.orchestra.run.smithi017.stdout: librgw2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 5.6 M 2023-10-06T04:40:49.520 INFO:teuthology.orchestra.run.smithi017.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-06T04:40:49.520 INFO:teuthology.orchestra.run.smithi017.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-06T04:40:49.520 INFO:teuthology.orchestra.run.smithi017.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T04:40:49.520 INFO:teuthology.orchestra.run.smithi017.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-06T04:40:49.521 INFO:teuthology.orchestra.run.smithi017.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-06T04:40:49.521 INFO:teuthology.orchestra.run.smithi017.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-06T04:40:49.521 INFO:teuthology.orchestra.run.smithi017.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-06T04:40:49.521 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-06T04:40:49.521 INFO:teuthology.orchestra.run.smithi017.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-06T04:40:49.521 INFO:teuthology.orchestra.run.smithi017.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-06T04:40:49.521 INFO:teuthology.orchestra.run.smithi017.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-06T04:40:49.521 INFO:teuthology.orchestra.run.smithi017.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T04:40:49.521 INFO:teuthology.orchestra.run.smithi017.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-06T04:40:49.521 INFO:teuthology.orchestra.run.smithi017.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T04:40:49.521 INFO:teuthology.orchestra.run.smithi017.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T04:40:49.521 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T04:40:49.522 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-argparse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 45 k 2023-10-06T04:40:49.522 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-common x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 115 k 2023-10-06T04:40:49.522 INFO:teuthology.orchestra.run.smithi017.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T04:40:49.522 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T04:40:49.522 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T04:40:49.522 INFO:teuthology.orchestra.run.smithi017.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T04:40:49.522 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T04:40:49.522 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T04:40:49.522 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T04:40:49.522 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-06T04:40:49.522 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-06T04:40:49.523 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T04:40:49.523 INFO:teuthology.orchestra.run.smithi017.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T04:40:49.523 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T04:40:49.523 INFO:teuthology.orchestra.run.smithi017.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-06T04:40:49.523 INFO:teuthology.orchestra.run.smithi017.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-06T04:40:49.523 INFO:teuthology.orchestra.run.smithi017.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T04:40:49.523 INFO:teuthology.orchestra.run.smithi017.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T04:40:49.523 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-06T04:40:49.523 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-06T04:40:49.524 INFO:teuthology.orchestra.run.smithi017.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-06T04:40:49.524 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T04:40:49.524 INFO:teuthology.orchestra.run.smithi017.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T04:40:49.524 INFO:teuthology.orchestra.run.smithi017.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-06T04:40:49.524 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-06T04:40:49.524 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-06T04:40:49.524 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-06T04:40:49.524 INFO:teuthology.orchestra.run.smithi017.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T04:40:49.524 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T04:40:49.524 INFO:teuthology.orchestra.run.smithi017.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T04:40:49.525 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T04:40:49.525 INFO:teuthology.orchestra.run.smithi017.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-06T04:40:49.525 INFO:teuthology.orchestra.run.smithi017.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T04:40:49.525 INFO:teuthology.orchestra.run.smithi017.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T04:40:49.525 INFO:teuthology.orchestra.run.smithi017.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T04:40:49.525 INFO:teuthology.orchestra.run.smithi017.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T04:40:49.525 INFO:teuthology.orchestra.run.smithi017.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T04:40:49.525 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T04:40:49.526 INFO:teuthology.orchestra.run.smithi017.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T04:40:49.526 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T04:40:49.526 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-06T04:40:49.526 INFO:teuthology.orchestra.run.smithi017.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T04:40:49.526 INFO:teuthology.orchestra.run.smithi017.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-06T04:40:49.526 INFO:teuthology.orchestra.run.smithi017.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T04:40:49.526 INFO:teuthology.orchestra.run.smithi017.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-06T04:40:49.526 INFO:teuthology.orchestra.run.smithi017.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-06T04:40:49.526 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:40:49.527 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2023-10-06T04:40:49.527 INFO:teuthology.orchestra.run.smithi017.stdout:====================================================================================================================== 2023-10-06T04:40:49.527 INFO:teuthology.orchestra.run.smithi017.stdout:Install 118 Packages 2023-10-06T04:40:49.527 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrade 2 Packages 2023-10-06T04:40:49.527 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:40:49.529 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 201 M 2023-10-06T04:40:49.529 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2023-10-06T04:40:49.603 INFO:teuthology.orchestra.run.smithi136.stdout:(1/120): ceph-17.2.6-1274.g68e53a4a.el8.x86_64. 72 kB/s | 6.4 kB 00:00 2023-10-06T04:40:49.742 INFO:teuthology.orchestra.run.smithi017.stdout:(1/120): ceph-17.2.6-1274.g68e53a4a.el8.x86_64. 43 kB/s | 6.4 kB 00:00 2023-10-06T04:40:49.789 INFO:teuthology.orchestra.run.smithi136.stdout:(2/120): ceph-fuse-17.2.6-1274.g68e53a4a.el8.x8 4.6 MB/s | 877 kB 00:00 2023-10-06T04:40:49.816 INFO:teuthology.orchestra.run.smithi136.stdout:(3/120): ceph-immutable-object-cache-17.2.6-127 5.9 MB/s | 162 kB 00:00 2023-10-06T04:40:50.179 INFO:teuthology.orchestra.run.smithi017.stdout:(2/120): ceph-fuse-17.2.6-1274.g68e53a4a.el8.x8 2.0 MB/s | 877 kB 00:00 2023-10-06T04:40:50.225 INFO:teuthology.orchestra.run.smithi136.stdout:(4/120): ceph-mds-17.2.6-1274.g68e53a4a.el8.x86 5.6 MB/s | 2.3 MB 00:00 2023-10-06T04:40:50.241 INFO:teuthology.orchestra.run.smithi017.stdout:(3/120): ceph-immutable-object-cache-17.2.6-127 2.6 MB/s | 162 kB 00:00 2023-10-06T04:40:50.501 INFO:teuthology.orchestra.run.smithi136.stdout:(5/120): ceph-mgr-17.2.6-1274.g68e53a4a.el8.x86 5.7 MB/s | 1.6 MB 00:00 2023-10-06T04:40:50.656 INFO:teuthology.orchestra.run.smithi017.stdout:(4/120): ceph-base-17.2.6-1274.g68e53a4a.el8.x8 4.9 MB/s | 5.2 MB 00:01 2023-10-06T04:40:51.040 INFO:teuthology.orchestra.run.smithi017.stdout:(5/120): ceph-mgr-17.2.6-1274.g68e53a4a.el8.x86 4.1 MB/s | 1.6 MB 00:00 2023-10-06T04:40:51.113 INFO:teuthology.orchestra.run.smithi017.stdout:(6/120): ceph-mds-17.2.6-1274.g68e53a4a.el8.x86 2.6 MB/s | 2.3 MB 00:00 2023-10-06T04:40:51.190 INFO:teuthology.orchestra.run.smithi136.stdout:(6/120): ceph-mon-17.2.6-1274.g68e53a4a.el8.x86 5.7 MB/s | 3.9 MB 00:00 2023-10-06T04:40:51.253 INFO:teuthology.orchestra.run.smithi136.stdout:(7/120): ceph-base-17.2.6-1274.g68e53a4a.el8.x8 3.0 MB/s | 5.2 MB 00:01 2023-10-06T04:40:51.846 INFO:teuthology.orchestra.run.smithi017.stdout:(7/120): ceph-mon-17.2.6-1274.g68e53a4a.el8.x86 4.9 MB/s | 3.9 MB 00:00 2023-10-06T04:40:53.528 INFO:teuthology.orchestra.run.smithi136.stdout:(8/120): ceph-common-17.2.6-1274.g68e53a4a.el8. 5.8 MB/s | 23 MB 00:04 2023-10-06T04:40:53.602 INFO:teuthology.orchestra.run.smithi136.stdout:(9/120): ceph-selinux-17.2.6-1274.g68e53a4a.el8 332 kB/s | 24 kB 00:00 2023-10-06T04:40:53.732 INFO:teuthology.orchestra.run.smithi017.stdout:(8/120): ceph-osd-17.2.6-1274.g68e53a4a.el8.x86 6.4 MB/s | 17 MB 00:02 2023-10-06T04:40:53.797 INFO:teuthology.orchestra.run.smithi017.stdout:(9/120): ceph-selinux-17.2.6-1274.g68e53a4a.el8 372 kB/s | 24 kB 00:00 2023-10-06T04:40:54.483 INFO:teuthology.orchestra.run.smithi017.stdout:(10/120): ceph-common-17.2.6-1274.g68e53a4a.el8 4.8 MB/s | 23 MB 00:04 2023-10-06T04:40:54.602 INFO:teuthology.orchestra.run.smithi017.stdout:(11/120): cephfs-mirror-17.2.6-1274.g68e53a4a.e 2.1 MB/s | 255 kB 00:00 2023-10-06T04:40:54.659 INFO:teuthology.orchestra.run.smithi017.stdout:(12/120): libcephfs-devel-17.2.6-1274.g68e53a4a 434 kB/s | 25 kB 00:00 2023-10-06T04:40:54.753 INFO:teuthology.orchestra.run.smithi136.stdout:(10/120): ceph-osd-17.2.6-1274.g68e53a4a.el8.x8 4.7 MB/s | 17 MB 00:03 2023-10-06T04:40:54.875 INFO:teuthology.orchestra.run.smithi136.stdout:(11/120): cephfs-mirror-17.2.6-1274.g68e53a4a.e 2.1 MB/s | 255 kB 00:00 2023-10-06T04:40:54.887 INFO:teuthology.orchestra.run.smithi017.stdout:(13/120): libcephfs2-17.2.6-1274.g68e53a4a.el8. 3.4 MB/s | 797 kB 00:00 2023-10-06T04:40:54.927 INFO:teuthology.orchestra.run.smithi136.stdout:(12/120): libcephfs-devel-17.2.6-1274.g68e53a4a 476 kB/s | 25 kB 00:00 2023-10-06T04:40:54.942 INFO:teuthology.orchestra.run.smithi017.stdout:(14/120): libcephsqlite-17.2.6-1274.g68e53a4a.e 3.1 MB/s | 175 kB 00:00 2023-10-06T04:40:55.006 INFO:teuthology.orchestra.run.smithi017.stdout:(15/120): librados-devel-17.2.6-1274.g68e53a4a. 2.0 MB/s | 130 kB 00:00 2023-10-06T04:40:55.183 INFO:teuthology.orchestra.run.smithi136.stdout:(13/120): libcephfs2-17.2.6-1274.g68e53a4a.el8. 3.0 MB/s | 797 kB 00:00 2023-10-06T04:40:55.195 INFO:teuthology.orchestra.run.smithi017.stdout:(16/120): libradosstriper1-17.2.6-1274.g68e53a4 2.6 MB/s | 506 kB 00:00 2023-10-06T04:40:55.242 INFO:teuthology.orchestra.run.smithi136.stdout:(14/120): libcephsqlite-17.2.6-1274.g68e53a4a.e 2.9 MB/s | 175 kB 00:00 2023-10-06T04:40:55.307 INFO:teuthology.orchestra.run.smithi136.stdout:(15/120): librados-devel-17.2.6-1274.g68e53a4a. 1.9 MB/s | 130 kB 00:00 2023-10-06T04:40:55.449 INFO:teuthology.orchestra.run.smithi136.stdout:(16/120): libradosstriper1-17.2.6-1274.g68e53a4 3.5 MB/s | 506 kB 00:00 2023-10-06T04:40:55.601 INFO:teuthology.orchestra.run.smithi017.stdout:(17/120): ceph-radosgw-17.2.6-1274.g68e53a4a.el 4.5 MB/s | 17 MB 00:03 2023-10-06T04:40:55.662 INFO:teuthology.orchestra.run.smithi017.stdout:(18/120): python3-ceph-argparse-17.2.6-1274.g68 746 kB/s | 45 kB 00:00 2023-10-06T04:40:55.728 INFO:teuthology.orchestra.run.smithi017.stdout:(19/120): python3-ceph-common-17.2.6-1274.g68e5 1.7 MB/s | 115 kB 00:00 2023-10-06T04:40:55.797 INFO:teuthology.orchestra.run.smithi017.stdout:(20/120): python3-cephfs-17.2.6-1274.g68e53a4a. 2.7 MB/s | 190 kB 00:00 2023-10-06T04:40:55.932 INFO:teuthology.orchestra.run.smithi017.stdout:(21/120): python3-rados-17.2.6-1274.g68e53a4a.e 2.7 MB/s | 371 kB 00:00 2023-10-06T04:40:56.063 INFO:teuthology.orchestra.run.smithi017.stdout:(22/120): python3-rbd-17.2.6-1274.g68e53a4a.el8 2.7 MB/s | 358 kB 00:00 2023-10-06T04:40:56.129 INFO:teuthology.orchestra.run.smithi017.stdout:(23/120): python3-rgw-17.2.6-1274.g68e53a4a.el8 1.6 MB/s | 107 kB 00:00 2023-10-06T04:40:56.195 INFO:teuthology.orchestra.run.smithi017.stdout:(24/120): rbd-fuse-17.2.6-1274.g68e53a4a.el8.x8 1.3 MB/s | 91 kB 00:00 2023-10-06T04:40:56.750 INFO:teuthology.orchestra.run.smithi017.stdout:(25/120): librgw2-17.2.6-1274.g68e53a4a.el8.x86 3.6 MB/s | 5.6 MB 00:01 2023-10-06T04:40:56.824 INFO:teuthology.orchestra.run.smithi017.stdout:(26/120): rbd-nbd-17.2.6-1274.g68e53a4a.el8.x86 2.3 MB/s | 173 kB 00:00 2023-10-06T04:40:56.890 INFO:teuthology.orchestra.run.smithi017.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1274.g 351 kB/s | 23 kB 00:00 2023-10-06T04:40:56.945 INFO:teuthology.orchestra.run.smithi136.stdout:(17/120): librgw2-17.2.6-1274.g68e53a4a.el8.x86 3.7 MB/s | 5.6 MB 00:01 2023-10-06T04:40:56.952 INFO:teuthology.orchestra.run.smithi017.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1274.g68e53a4 1.9 MB/s | 121 kB 00:00 2023-10-06T04:40:56.994 INFO:teuthology.orchestra.run.smithi017.stdout:(29/120): rbd-mirror-17.2.6-1274.g68e53a4a.el8. 4.3 MB/s | 3.5 MB 00:00 2023-10-06T04:40:57.004 INFO:teuthology.orchestra.run.smithi136.stdout:(18/120): python3-ceph-argparse-17.2.6-1274.g68 752 kB/s | 45 kB 00:00 2023-10-06T04:40:57.073 INFO:teuthology.orchestra.run.smithi136.stdout:(19/120): python3-ceph-common-17.2.6-1274.g68e5 1.6 MB/s | 115 kB 00:00 2023-10-06T04:40:57.149 INFO:teuthology.orchestra.run.smithi136.stdout:(20/120): python3-cephfs-17.2.6-1274.g68e53a4a. 2.5 MB/s | 190 kB 00:00 2023-10-06T04:40:57.299 INFO:teuthology.orchestra.run.smithi136.stdout:(21/120): python3-rados-17.2.6-1274.g68e53a4a.e 2.4 MB/s | 371 kB 00:00 2023-10-06T04:40:57.443 INFO:teuthology.orchestra.run.smithi136.stdout:(22/120): python3-rbd-17.2.6-1274.g68e53a4a.el8 2.4 MB/s | 358 kB 00:00 2023-10-06T04:40:57.460 INFO:teuthology.orchestra.run.smithi017.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1274.g68e53 3.3 MB/s | 1.7 MB 00:00 2023-10-06T04:40:57.505 INFO:teuthology.orchestra.run.smithi136.stdout:(23/120): python3-rgw-17.2.6-1274.g68e53a4a.el8 1.7 MB/s | 107 kB 00:00 2023-10-06T04:40:57.525 INFO:teuthology.orchestra.run.smithi017.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1274.g68 3.6 MB/s | 238 kB 00:00 2023-10-06T04:40:57.569 INFO:teuthology.orchestra.run.smithi136.stdout:(24/120): rbd-fuse-17.2.6-1274.g68e53a4a.el8.x8 1.4 MB/s | 91 kB 00:00 2023-10-06T04:40:57.586 INFO:teuthology.orchestra.run.smithi017.stdout:(32/120): ceph-mgr-rook-17.2.6-1274.g68e53a4a.e 786 kB/s | 47 kB 00:00 2023-10-06T04:40:57.648 INFO:teuthology.orchestra.run.smithi017.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1274.g6 233 kB/s | 14 kB 00:00 2023-10-06T04:40:57.719 INFO:teuthology.orchestra.run.smithi017.stdout:(34/120): ceph-volume-17.2.6-1274.g68e53a4a.el8 3.7 MB/s | 267 kB 00:00 2023-10-06T04:40:57.790 INFO:teuthology.orchestra.run.smithi017.stdout:(35/120): cephadm-17.2.6-1274.g68e53a4a.el8.noa 1.1 MB/s | 80 kB 00:00 2023-10-06T04:40:57.855 INFO:teuthology.orchestra.run.smithi017.stdout:(36/120): cephfs-top-17.2.6-1274.g68e53a4a.el8. 275 kB/s | 18 kB 00:00 2023-10-06T04:40:58.191 INFO:teuthology.orchestra.run.smithi136.stdout:(25/120): ceph-radosgw-17.2.6-1274.g68e53a4a.el 2.4 MB/s | 17 MB 00:06 2023-10-06T04:40:58.235 INFO:teuthology.orchestra.run.smithi136.stdout:(26/120): rbd-nbd-17.2.6-1274.g68e53a4a.el8.x86 3.8 MB/s | 173 kB 00:00 2023-10-06T04:40:58.282 INFO:teuthology.orchestra.run.smithi136.stdout:(27/120): rbd-mirror-17.2.6-1274.g68e53a4a.el8. 4.8 MB/s | 3.5 MB 00:00 2023-10-06T04:40:58.282 INFO:teuthology.orchestra.run.smithi136.stdout:(28/120): ceph-grafana-dashboards-17.2.6-1274.g 496 kB/s | 23 kB 00:00 2023-10-06T04:40:58.304 INFO:teuthology.orchestra.run.smithi136.stdout:(29/120): ceph-mgr-cephadm-17.2.6-1274.g68e53a4 5.5 MB/s | 121 kB 00:00 2023-10-06T04:40:58.524 INFO:teuthology.orchestra.run.smithi017.stdout:(37/120): ceph-test-17.2.6-1274.g68e53a4a.el8.x 11 MB/s | 52 MB 00:04 2023-10-06T04:40:58.527 INFO:teuthology.orchestra.run.smithi017.stdout:(38/120): gperftools-libs-2.7-9.el8.x86_64.rpm 455 kB/s | 306 kB 00:00 2023-10-06T04:40:58.558 INFO:teuthology.orchestra.run.smithi017.stdout:(39/120): ceph-mgr-diskprediction-local-17.2.6- 4.7 MB/s | 7.4 MB 00:01 2023-10-06T04:40:58.650 INFO:teuthology.orchestra.run.smithi136.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1274.g68e53 4.6 MB/s | 1.7 MB 00:00 2023-10-06T04:40:58.724 INFO:teuthology.orchestra.run.smithi136.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1274.g68 3.2 MB/s | 238 kB 00:00 2023-10-06T04:40:58.726 INFO:teuthology.orchestra.run.smithi017.stdout:(40/120): liboath-2.6.2-3.el8.x86_64.rpm 291 kB/s | 59 kB 00:00 2023-10-06T04:40:58.741 INFO:teuthology.orchestra.run.smithi017.stdout:(41/120): libunwind-1.3.1-3.el8.x86_64.rpm 352 kB/s | 75 kB 00:00 2023-10-06T04:40:58.760 INFO:teuthology.orchestra.run.smithi136.stdout:(32/120): ceph-mgr-rook-17.2.6-1274.g68e53a4a.e 1.3 MB/s | 47 kB 00:00 2023-10-06T04:40:58.797 INFO:teuthology.orchestra.run.smithi136.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1274.g6 400 kB/s | 14 kB 00:00 2023-10-06T04:40:58.871 INFO:teuthology.orchestra.run.smithi136.stdout:(34/120): ceph-volume-17.2.6-1274.g68e53a4a.el8 3.5 MB/s | 267 kB 00:00 2023-10-06T04:40:58.892 INFO:teuthology.orchestra.run.smithi017.stdout:(42/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 264 kB/s | 44 kB 00:00 2023-10-06T04:40:58.909 INFO:teuthology.orchestra.run.smithi136.stdout:(35/120): cephadm-17.2.6-1274.g68e53a4a.el8.noa 2.1 MB/s | 80 kB 00:00 2023-10-06T04:40:58.910 INFO:teuthology.orchestra.run.smithi017.stdout:(43/120): python3-asyncssh-2.7.0-2.el8.noarch.r 1.3 MB/s | 476 kB 00:00 2023-10-06T04:40:58.944 INFO:teuthology.orchestra.run.smithi136.stdout:(36/120): ceph-mgr-diskprediction-local-17.2.6- 12 MB/s | 7.4 MB 00:00 2023-10-06T04:40:58.945 INFO:teuthology.orchestra.run.smithi136.stdout:(37/120): cephfs-top-17.2.6-1274.g68e53a4a.el8. 482 kB/s | 18 kB 00:00 2023-10-06T04:40:58.967 INFO:teuthology.orchestra.run.smithi017.stdout:(44/120): python3-beautifulsoup4-4.6.3-2.el8.1. 822 kB/s | 185 kB 00:00 2023-10-06T04:40:59.065 INFO:teuthology.orchestra.run.smithi017.stdout:(45/120): python3-cachetools-3.1.1-4.el8.noarch 192 kB/s | 33 kB 00:00 2023-10-06T04:40:59.072 INFO:teuthology.orchestra.run.smithi017.stdout:(46/120): python3-certifi-2018.10.15-7.el8.noar 101 kB/s | 16 kB 00:00 2023-10-06T04:40:59.199 INFO:teuthology.orchestra.run.smithi136.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 232 kB/s | 59 kB 00:00 2023-10-06T04:40:59.206 INFO:teuthology.orchestra.run.smithi017.stdout:(47/120): python3-cheroot-8.5.2-1.el8.noarch.rp 724 kB/s | 173 kB 00:00 2023-10-06T04:40:59.275 INFO:teuthology.orchestra.run.smithi017.stdout:(48/120): python3-google-auth-1.1.1-10.el8.noar 402 kB/s | 81 kB 00:00 2023-10-06T04:40:59.279 INFO:teuthology.orchestra.run.smithi136.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 927 kB/s | 75 kB 00:00 2023-10-06T04:40:59.305 INFO:teuthology.orchestra.run.smithi136.stdout:(40/120): gperftools-libs-2.7-9.el8.x86_64.rpm 851 kB/s | 306 kB 00:00 2023-10-06T04:40:59.330 INFO:teuthology.orchestra.run.smithi017.stdout:(49/120): python3-jaraco-6.2-6.el8.noarch.rpm 90 kB/s | 11 kB 00:00 2023-10-06T04:40:59.357 INFO:teuthology.orchestra.run.smithi136.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 829 kB/s | 44 kB 00:00 2023-10-06T04:40:59.384 INFO:teuthology.orchestra.run.smithi017.stdout:(50/120): python3-cherrypy-18.4.0-1.el8.noarch. 1.2 MB/s | 384 kB 00:00 2023-10-06T04:40:59.431 INFO:teuthology.orchestra.run.smithi136.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 2.4 MB/s | 185 kB 00:00 2023-10-06T04:40:59.447 INFO:teuthology.orchestra.run.smithi017.stdout:(51/120): python3-jaraco-functools-2.0-4.el8.no 102 kB/s | 18 kB 00:00 2023-10-06T04:40:59.451 INFO:teuthology.orchestra.run.smithi136.stdout:(43/120): python3-asyncssh-2.7.0-2.el8.noarch.r 2.7 MB/s | 476 kB 00:00 2023-10-06T04:40:59.492 INFO:teuthology.orchestra.run.smithi136.stdout:(44/120): python3-cachetools-3.1.1-4.el8.noarch 545 kB/s | 33 kB 00:00 2023-10-06T04:40:59.500 INFO:teuthology.orchestra.run.smithi136.stdout:(45/120): python3-certifi-2018.10.15-7.el8.noar 334 kB/s | 16 kB 00:00 2023-10-06T04:40:59.559 INFO:teuthology.orchestra.run.smithi136.stdout:(46/120): python3-cheroot-8.5.2-1.el8.noarch.rp 2.5 MB/s | 173 kB 00:00 2023-10-06T04:40:59.568 INFO:teuthology.orchestra.run.smithi017.stdout:(52/120): python3-logutils-0.3.5-11.el8.noarch. 266 kB/s | 49 kB 00:00 2023-10-06T04:40:59.572 INFO:teuthology.orchestra.run.smithi136.stdout:(47/120): python3-cherrypy-18.4.0-1.el8.noarch. 5.2 MB/s | 384 kB 00:00 2023-10-06T04:40:59.616 INFO:teuthology.orchestra.run.smithi136.stdout:(48/120): python3-google-auth-1.1.1-10.el8.noar 1.4 MB/s | 81 kB 00:00 2023-10-06T04:40:59.617 INFO:teuthology.orchestra.run.smithi017.stdout:(53/120): python3-more-itertools-7.2.0-3.el8.no 356 kB/s | 59 kB 00:00 2023-10-06T04:40:59.621 INFO:teuthology.orchestra.run.smithi136.stdout:(49/120): python3-jaraco-6.2-6.el8.noarch.rpm 229 kB/s | 11 kB 00:00 2023-10-06T04:40:59.665 INFO:teuthology.orchestra.run.smithi136.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 355 kB/s | 18 kB 00:00 2023-10-06T04:40:59.719 INFO:teuthology.orchestra.run.smithi136.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 914 kB/s | 49 kB 00:00 2023-10-06T04:40:59.745 INFO:teuthology.orchestra.run.smithi136.stdout:(52/120): python3-kubernetes-11.0.0-6.el8.noarc 9.4 MB/s | 1.2 MB 00:00 2023-10-06T04:40:59.766 INFO:teuthology.orchestra.run.smithi017.stdout:(54/120): python3-kubernetes-11.0.0-6.el8.noarc 2.7 MB/s | 1.2 MB 00:00 2023-10-06T04:40:59.773 INFO:teuthology.orchestra.run.smithi136.stdout:(53/120): python3-more-itertools-7.2.0-3.el8.no 1.1 MB/s | 59 kB 00:00 2023-10-06T04:40:59.782 INFO:teuthology.orchestra.run.smithi017.stdout:(55/120): python3-natsort-7.1.1-2.el8.noarch.rp 282 kB/s | 60 kB 00:00 2023-10-06T04:40:59.794 INFO:teuthology.orchestra.run.smithi136.stdout:(54/120): python3-natsort-7.1.1-2.el8.noarch.rp 1.2 MB/s | 60 kB 00:00 2023-10-06T04:40:59.843 INFO:teuthology.orchestra.run.smithi136.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 323 kB/s | 16 kB 00:00 2023-10-06T04:40:59.853 INFO:teuthology.orchestra.run.smithi136.stdout:(56/120): python3-pecan-1.3.2-9.el8.noarch.rpm 3.5 MB/s | 283 kB 00:00 2023-10-06T04:40:59.892 INFO:teuthology.orchestra.run.smithi136.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 691 kB/s | 34 kB 00:00 2023-10-06T04:40:59.911 INFO:teuthology.orchestra.run.smithi017.stdout:(56/120): python3-portend-2.6-1.el8.noarch.rpm 108 kB/s | 16 kB 00:00 2023-10-06T04:40:59.913 INFO:teuthology.orchestra.run.smithi017.stdout:(57/120): python3-pecan-1.3.2-9.el8.noarch.rpm 957 kB/s | 283 kB 00:00 2023-10-06T04:40:59.920 INFO:teuthology.orchestra.run.smithi136.stdout:(58/120): python3-routes-2.4.1-12.el8.noarch.rp 2.9 MB/s | 196 kB 00:00 2023-10-06T04:40:59.942 INFO:teuthology.orchestra.run.smithi136.stdout:(59/120): python3-rsa-4.9-2.el8.noarch.rpm 1.2 MB/s | 64 kB 00:00 2023-10-06T04:40:59.948 INFO:teuthology.orchestra.run.smithi017.stdout:(58/120): python3-repoze-lru-0.7-6.el8.noarch.r 203 kB/s | 34 kB 00:00 2023-10-06T04:40:59.970 INFO:teuthology.orchestra.run.smithi136.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 376 kB/s | 19 kB 00:00 2023-10-06T04:40:59.991 INFO:teuthology.orchestra.run.smithi136.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 495 kB/s | 24 kB 00:00 2023-10-06T04:41:00.021 INFO:teuthology.orchestra.run.smithi136.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 578 kB/s | 29 kB 00:00 2023-10-06T04:41:00.039 INFO:teuthology.orchestra.run.smithi136.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 568 kB/s | 27 kB 00:00 2023-10-06T04:41:00.095 INFO:teuthology.orchestra.run.smithi136.stdout:(64/120): python3-webob-1.8.5-1.el8.1.noarch.rp 4.5 MB/s | 251 kB 00:00 2023-10-06T04:41:00.096 INFO:teuthology.orchestra.run.smithi136.stdout:(65/120): python3-waitress-1.4.3-1.el8.noarch.r 3.4 MB/s | 255 kB 00:00 2023-10-06T04:41:00.114 INFO:teuthology.orchestra.run.smithi017.stdout:(59/120): python3-rsa-4.9-2.el8.noarch.rpm 322 kB/s | 64 kB 00:00 2023-10-06T04:41:00.118 INFO:teuthology.orchestra.run.smithi017.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 112 kB/s | 19 kB 00:00 2023-10-06T04:41:00.146 INFO:teuthology.orchestra.run.smithi136.stdout:(66/120): python3-webtest-2.0.33-1.el8.noarch.r 1.7 MB/s | 85 kB 00:00 2023-10-06T04:41:00.147 INFO:teuthology.orchestra.run.smithi136.stdout:(67/120): python3-websocket-client-0.56.0-5.el8 1.1 MB/s | 61 kB 00:00 2023-10-06T04:41:00.173 INFO:teuthology.orchestra.run.smithi017.stdout:(61/120): python3-routes-2.4.1-12.el8.noarch.rp 756 kB/s | 196 kB 00:00 2023-10-06T04:41:00.195 INFO:teuthology.orchestra.run.smithi136.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 461 kB/s | 23 kB 00:00 2023-10-06T04:41:00.198 INFO:teuthology.orchestra.run.smithi136.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 18 MB/s | 70 kB 00:00 2023-10-06T04:41:00.256 INFO:teuthology.orchestra.run.smithi017.stdout:(62/120): python3-singledispatch-3.4.0.3-18.el8 168 kB/s | 24 kB 00:00 2023-10-06T04:41:00.291 INFO:teuthology.orchestra.run.smithi017.stdout:(63/120): python3-tempora-1.14.1-5.el8.noarch.r 167 kB/s | 29 kB 00:00 2023-10-06T04:41:00.317 INFO:teuthology.orchestra.run.smithi017.stdout:(64/120): python3-trustme-0.6.0-4.el8.noarch.rp 191 kB/s | 27 kB 00:00 2023-10-06T04:41:00.322 INFO:teuthology.orchestra.run.smithi136.stdout:(70/120): thrift-0.13.0-2.el8.x86_64.rpm 10 MB/s | 1.7 MB 00:00 2023-10-06T04:41:00.368 INFO:teuthology.orchestra.run.smithi136.stdout:(71/120): python3-prettytable-0.7.2-14.el8.noar 961 kB/s | 44 kB 00:00 2023-10-06T04:41:00.476 INFO:teuthology.orchestra.run.smithi136.stdout:(72/120): python3-scipy-1.0.0-20.module+el8.1.0 52 MB/s | 15 MB 00:00 2023-10-06T04:41:00.477 INFO:teuthology.orchestra.run.smithi136.stdout:(73/120): python3-jsonpatch-1.21-2.el8.noarch.r 243 kB/s | 27 kB 00:00 2023-10-06T04:41:00.504 INFO:teuthology.orchestra.run.smithi017.stdout:(65/120): python3-websocket-client-0.56.0-5.el8 326 kB/s | 61 kB 00:00 2023-10-06T04:41:00.511 INFO:teuthology.orchestra.run.smithi136.stdout:(74/120): jq-1.5-12.el8.x86_64.rpm 4.6 MB/s | 161 kB 00:00 2023-10-06T04:41:00.516 INFO:teuthology.orchestra.run.smithi136.stdout:(75/120): flex-2.6.1-9.el8.x86_64.rpm 8.3 MB/s | 320 kB 00:00 2023-10-06T04:41:00.557 INFO:teuthology.orchestra.run.smithi017.stdout:(66/120): python3-waitress-1.4.3-1.el8.noarch.r 851 kB/s | 255 kB 00:00 2023-10-06T04:41:00.576 INFO:teuthology.orchestra.run.smithi017.stdout:(67/120): python3-webob-1.8.5-1.el8.1.noarch.rp 883 kB/s | 251 kB 00:00 2023-10-06T04:41:00.670 INFO:teuthology.orchestra.run.smithi017.stdout:(68/120): python3-webtest-2.0.33-1.el8.noarch.r 520 kB/s | 85 kB 00:00 2023-10-06T04:41:00.675 INFO:teuthology.orchestra.run.smithi017.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 14 MB/s | 70 kB 00:00 2023-10-06T04:41:00.704 INFO:teuthology.orchestra.run.smithi017.stdout:(70/120): python3-zc-lockfile-2.0-2.el8.noarch. 156 kB/s | 23 kB 00:00 2023-10-06T04:41:00.743 INFO:teuthology.orchestra.run.smithi017.stdout:(71/120): python3-prettytable-0.7.2-14.el8.noar 1.1 MB/s | 44 kB 00:00 2023-10-06T04:41:00.758 INFO:teuthology.orchestra.run.smithi017.stdout:(72/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.8 MB/s | 27 kB 00:00 2023-10-06T04:41:00.776 INFO:teuthology.orchestra.run.smithi017.stdout:(73/120): jq-1.5-12.el8.x86_64.rpm 8.7 MB/s | 161 kB 00:00 2023-10-06T04:41:00.796 INFO:teuthology.orchestra.run.smithi017.stdout:(74/120): flex-2.6.1-9.el8.x86_64.rpm 16 MB/s | 320 kB 00:00 2023-10-06T04:41:00.822 INFO:teuthology.orchestra.run.smithi017.stdout:(75/120): python3-werkzeug-0.12.2-4.el8.noarch. 17 MB/s | 457 kB 00:00 2023-10-06T04:41:00.905 INFO:teuthology.orchestra.run.smithi136.stdout:(76/120): ceph-test-17.2.6-1274.g68e53a4a.el8.x 7.1 MB/s | 52 MB 00:07 2023-10-06T04:41:00.921 INFO:teuthology.orchestra.run.smithi017.stdout:(76/120): python3-babel-2.5.1-5.el8.noarch.rpm 49 MB/s | 4.8 MB 00:00 2023-10-06T04:41:00.921 INFO:teuthology.orchestra.run.smithi136.stdout:(77/120): python3-werkzeug-0.12.2-4.el8.noarch. 1.1 MB/s | 457 kB 00:00 2023-10-06T04:41:00.954 INFO:teuthology.orchestra.run.smithi136.stdout:(78/120): python3-markupsafe-0.23-19.el8.x86_64 805 kB/s | 39 kB 00:00 2023-10-06T04:41:00.965 INFO:teuthology.orchestra.run.smithi136.stdout:(79/120): bison-3.0.4-10.el8.x86_64.rpm 16 MB/s | 688 kB 00:00 2023-10-06T04:41:00.981 INFO:teuthology.orchestra.run.smithi136.stdout:(80/120): python3-babel-2.5.1-5.el8.noarch.rpm 10 MB/s | 4.8 MB 00:00 2023-10-06T04:41:00.986 INFO:teuthology.orchestra.run.smithi136.stdout:(81/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 7.8 MB/s | 259 kB 00:00 2023-10-06T04:41:01.002 INFO:teuthology.orchestra.run.smithi136.stdout:(82/120): python3-numpy-f2py-1.14.3-9.el8.x86_6 5.9 MB/s | 225 kB 00:00 2023-10-06T04:41:01.027 INFO:teuthology.orchestra.run.smithi136.stdout:(83/120): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.7 MB/s | 126 kB 00:00 2023-10-06T04:41:01.038 INFO:teuthology.orchestra.run.smithi136.stdout:(84/120): oniguruma-6.8.2-2.el8.x86_64.rpm 5.1 MB/s | 187 kB 00:00 2023-10-06T04:41:01.044 INFO:teuthology.orchestra.run.smithi017.stdout:(77/120): python3-scipy-1.0.0-20.module+el8.1.0 39 MB/s | 15 MB 00:00 2023-10-06T04:41:01.045 INFO:teuthology.orchestra.run.smithi017.stdout:(78/120): python3-markupsafe-0.23-19.el8.x86_64 313 kB/s | 39 kB 00:00 2023-10-06T04:41:01.067 INFO:teuthology.orchestra.run.smithi136.stdout:(85/120): python3-numpy-1.14.3-9.el8.x86_64.rpm 47 MB/s | 3.7 MB 00:00 2023-10-06T04:41:01.067 INFO:teuthology.orchestra.run.smithi017.stdout:(79/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 11 MB/s | 259 kB 00:00 2023-10-06T04:41:01.073 INFO:teuthology.orchestra.run.smithi136.stdout:(86/120): python3-jinja2-2.10.1-2.el8_0.noarch. 12 MB/s | 538 kB 00:00 2023-10-06T04:41:01.075 INFO:teuthology.orchestra.run.smithi017.stdout:(80/120): bison-3.0.4-10.el8.x86_64.rpm 22 MB/s | 688 kB 00:00 2023-10-06T04:41:01.077 INFO:teuthology.orchestra.run.smithi136.stdout:(87/120): socat-1.7.3.3-2.el8.x86_64.rpm 7.6 MB/s | 302 kB 00:00 2023-10-06T04:41:01.092 INFO:teuthology.orchestra.run.smithi017.stdout:(81/120): python3-numpy-f2py-1.14.3-9.el8.x86_6 9.0 MB/s | 225 kB 00:00 2023-10-06T04:41:01.104 INFO:teuthology.orchestra.run.smithi136.stdout:(88/120): python3-mako-1.0.6-13.el8.noarch.rpm 4.1 MB/s | 157 kB 00:00 2023-10-06T04:41:01.110 INFO:teuthology.orchestra.run.smithi017.stdout:(82/120): python3-pyasn1-0.3.7-6.el8.noarch.rpm 3.5 MB/s | 126 kB 00:00 2023-10-06T04:41:01.118 INFO:teuthology.orchestra.run.smithi136.stdout:(89/120): librdkafka-0.11.4-1.el8.x86_64.rpm 8.6 MB/s | 353 kB 00:00 2023-10-06T04:41:01.132 INFO:teuthology.orchestra.run.smithi017.stdout:(83/120): oniguruma-6.8.2-2.el8.x86_64.rpm 8.7 MB/s | 187 kB 00:00 2023-10-06T04:41:01.140 INFO:teuthology.orchestra.run.smithi136.stdout:(90/120): python3-pyasn1-modules-0.3.7-6.el8.no 1.6 MB/s | 110 kB 00:00 2023-10-06T04:41:01.145 INFO:teuthology.orchestra.run.smithi136.stdout:(91/120): python3-jsonpointer-1.10-11.el8.noarc 493 kB/s | 20 kB 00:00 2023-10-06T04:41:01.158 INFO:teuthology.orchestra.run.smithi017.stdout:(84/120): python3-jinja2-2.10.1-2.el8_0.noarch. 20 MB/s | 538 kB 00:00 2023-10-06T04:41:01.161 INFO:teuthology.orchestra.run.smithi136.stdout:(92/120): libtool-2.4.6-25.el8.x86_64.rpm 16 MB/s | 709 kB 00:00 2023-10-06T04:41:01.178 INFO:teuthology.orchestra.run.smithi136.stdout:(93/120): python3-pytz-2017.2-9.el8.noarch.rpm 1.4 MB/s | 54 kB 00:00 2023-10-06T04:41:01.190 INFO:teuthology.orchestra.run.smithi017.stdout:(85/120): python3-numpy-1.14.3-9.el8.x86_64.rpm 38 MB/s | 3.7 MB 00:00 2023-10-06T04:41:01.196 INFO:teuthology.orchestra.run.smithi017.stdout:(86/120): socat-1.7.3.3-2.el8.x86_64.rpm 7.8 MB/s | 302 kB 00:00 2023-10-06T04:41:01.210 INFO:teuthology.orchestra.run.smithi017.stdout:(87/120): python3-mako-1.0.6-13.el8.noarch.rpm 7.6 MB/s | 157 kB 00:00 2023-10-06T04:41:01.217 INFO:teuthology.orchestra.run.smithi017.stdout:(88/120): python3-pyasn1-modules-0.3.7-6.el8.no 5.2 MB/s | 110 kB 00:00 2023-10-06T04:41:01.221 INFO:teuthology.orchestra.run.smithi136.stdout:(94/120): automake-1.16.1-7.el8.noarch.rpm 16 MB/s | 713 kB 00:00 2023-10-06T04:41:01.231 INFO:teuthology.orchestra.run.smithi017.stdout:(89/120): librdkafka-0.11.4-1.el8.x86_64.rpm 17 MB/s | 353 kB 00:00 2023-10-06T04:41:01.241 INFO:teuthology.orchestra.run.smithi017.stdout:(90/120): python3-jsonpointer-1.10-11.el8.noarc 852 kB/s | 20 kB 00:00 2023-10-06T04:41:01.254 INFO:teuthology.orchestra.run.smithi017.stdout:(91/120): libtool-2.4.6-25.el8.x86_64.rpm 30 MB/s | 709 kB 00:00 2023-10-06T04:41:01.258 INFO:teuthology.orchestra.run.smithi017.stdout:(92/120): python3-pytz-2017.2-9.el8.noarch.rpm 3.1 MB/s | 54 kB 00:00 2023-10-06T04:41:01.259 INFO:teuthology.orchestra.run.smithi136.stdout:(95/120): openblas-0.3.12-1.el8.x86_64.rpm 47 MB/s | 4.6 MB 00:00 2023-10-06T04:41:01.276 INFO:teuthology.orchestra.run.smithi136.stdout:(96/120): openblas-threads-0.3.12-1.el8.x86_64. 36 MB/s | 4.7 MB 00:00 2023-10-06T04:41:01.276 INFO:teuthology.orchestra.run.smithi136.stdout:(97/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 340 kB/s | 19 kB 00:00 2023-10-06T04:41:01.291 INFO:teuthology.orchestra.run.smithi017.stdout:(93/120): thrift-0.13.0-2.el8.x86_64.rpm 2.4 MB/s | 1.7 MB 00:00 2023-10-06T04:41:01.304 INFO:teuthology.orchestra.run.smithi136.stdout:(98/120): python3-jwt-1.6.1-2.el8.noarch.rpm 968 kB/s | 43 kB 00:00 2023-10-06T04:41:01.312 INFO:teuthology.orchestra.run.smithi136.stdout:(99/120): python3-oauthlib-2.1.0-1.el8.noarch.r 4.2 MB/s | 155 kB 00:00 2023-10-06T04:41:01.313 INFO:teuthology.orchestra.run.smithi136.stdout:(100/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.9 MB/s | 220 kB 00:00 2023-10-06T04:41:01.339 INFO:teuthology.orchestra.run.smithi136.stdout:(101/120): keyutils-libs-devel-1.5.10-6.el8.x86 1.3 MB/s | 48 kB 00:00 2023-10-06T04:41:01.346 INFO:teuthology.orchestra.run.smithi017.stdout:(94/120): automake-1.16.1-7.el8.noarch.rpm 13 MB/s | 713 kB 00:00 2023-10-06T04:41:01.348 INFO:teuthology.orchestra.run.smithi136.stdout:(102/120): python3-requests-oauthlib-1.0.0-1.el 1.2 MB/s | 43 kB 00:00 2023-10-06T04:41:01.352 INFO:teuthology.orchestra.run.smithi136.stdout:(103/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 5.6 MB/s | 229 kB 00:00 2023-10-06T04:41:01.364 INFO:teuthology.orchestra.run.smithi017.stdout:(95/120): openblas-threads-0.3.12-1.el8.x86_64. 43 MB/s | 4.7 MB 00:00 2023-10-06T04:41:01.365 INFO:teuthology.orchestra.run.smithi017.stdout:(96/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 998 kB/s | 19 kB 00:00 2023-10-06T04:41:01.380 INFO:teuthology.orchestra.run.smithi017.stdout:(97/120): openblas-0.3.12-1.el8.x86_64.rpm 38 MB/s | 4.6 MB 00:00 2023-10-06T04:41:01.382 INFO:teuthology.orchestra.run.smithi136.stdout:(104/120): libverto-devel-0.3.0-5.el8.x86_64.rp 526 kB/s | 18 kB 00:00 2023-10-06T04:41:01.386 INFO:teuthology.orchestra.run.smithi017.stdout:(98/120): python3-jwt-1.6.1-2.el8.noarch.rpm 2.0 MB/s | 43 kB 00:00 2023-10-06T04:41:01.388 INFO:teuthology.orchestra.run.smithi017.stdout:(99/120): python3-oauthlib-2.1.0-1.el8.noarch.r 6.6 MB/s | 155 kB 00:00 2023-10-06T04:41:01.398 INFO:teuthology.orchestra.run.smithi136.stdout:(105/120): pcre2-devel-10.32-2.el8.x86_64.rpm 13 MB/s | 605 kB 00:00 2023-10-06T04:41:01.410 INFO:teuthology.orchestra.run.smithi017.stdout:(100/120): keyutils-libs-devel-1.5.10-6.el8.x86 1.9 MB/s | 48 kB 00:00 2023-10-06T04:41:01.411 INFO:teuthology.orchestra.run.smithi017.stdout:(101/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 6.9 MB/s | 220 kB 00:00 2023-10-06T04:41:01.412 INFO:teuthology.orchestra.run.smithi017.stdout:(102/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 9.4 MB/s | 229 kB 00:00 2023-10-06T04:41:01.413 INFO:teuthology.orchestra.run.smithi136.stdout:(106/120): openssl-devel-1.1.1g-15.el8_3.x86_64 31 MB/s | 2.3 MB 00:00 2023-10-06T04:41:01.419 INFO:teuthology.orchestra.run.smithi136.stdout:(107/120): fuse-2.9.7-12.el8.x86_64.rpm 2.2 MB/s | 83 kB 00:00 2023-10-06T04:41:01.433 INFO:teuthology.orchestra.run.smithi017.stdout:(103/120): python3-requests-oauthlib-1.0.0-1.el 1.8 MB/s | 43 kB 00:00 2023-10-06T04:41:01.434 INFO:teuthology.orchestra.run.smithi017.stdout:(104/120): libverto-devel-0.3.0-5.el8.x86_64.rp 836 kB/s | 18 kB 00:00 2023-10-06T04:41:01.453 INFO:teuthology.orchestra.run.smithi136.stdout:(108/120): elfutils-libelf-devel-0.182-3.el8.x8 1.1 MB/s | 59 kB 00:00 2023-10-06T04:41:01.456 INFO:teuthology.orchestra.run.smithi136.stdout:(109/120): libcom_err-devel-1.45.6-1.el8.x86_64 1.0 MB/s | 38 kB 00:00 2023-10-06T04:41:01.464 INFO:teuthology.orchestra.run.smithi017.stdout:(105/120): openssl-devel-1.1.1g-15.el8_3.x86_64 44 MB/s | 2.3 MB 00:00 2023-10-06T04:41:01.466 INFO:teuthology.orchestra.run.smithi017.stdout:(106/120): pcre2-devel-10.32-2.el8.x86_64.rpm 18 MB/s | 605 kB 00:00 2023-10-06T04:41:01.477 INFO:teuthology.orchestra.run.smithi017.stdout:(107/120): fuse-2.9.7-12.el8.x86_64.rpm 1.9 MB/s | 83 kB 00:00 2023-10-06T04:41:01.479 INFO:teuthology.orchestra.run.smithi136.stdout:(110/120): libquadmath-8.4.1-1.el8.x86_64.rpm 2.5 MB/s | 169 kB 00:00 2023-10-06T04:41:01.490 INFO:teuthology.orchestra.run.smithi136.stdout:(111/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 1.7 MB/s | 58 kB 00:00 2023-10-06T04:41:01.492 INFO:teuthology.orchestra.run.smithi136.stdout:(112/120): libsepol-devel-2.9-2.el8.x86_64.rpm 2.2 MB/s | 86 kB 00:00 2023-10-06T04:41:01.496 INFO:teuthology.orchestra.run.smithi017.stdout:(108/120): elfutils-libelf-devel-0.182-3.el8.x8 1.8 MB/s | 59 kB 00:00 2023-10-06T04:41:01.497 INFO:teuthology.orchestra.run.smithi017.stdout:(109/120): libcom_err-devel-1.45.6-1.el8.x86_64 1.9 MB/s | 38 kB 00:00 2023-10-06T04:41:01.509 INFO:teuthology.orchestra.run.smithi017.stdout:(110/120): libquadmath-8.4.1-1.el8.x86_64.rpm 3.9 MB/s | 169 kB 00:00 2023-10-06T04:41:01.515 INFO:teuthology.orchestra.run.smithi136.stdout:(113/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.3 MB/s | 47 kB 00:00 2023-10-06T04:41:01.524 INFO:teuthology.orchestra.run.smithi017.stdout:(111/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 2.1 MB/s | 58 kB 00:00 2023-10-06T04:41:01.532 INFO:teuthology.orchestra.run.smithi136.stdout:(114/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.r 13 MB/s | 559 kB 00:00 2023-10-06T04:41:01.535 INFO:teuthology.orchestra.run.smithi017.stdout:(112/120): libsepol-devel-2.9-2.el8.x86_64.rpm 2.2 MB/s | 86 kB 00:00 2023-10-06T04:41:01.550 INFO:teuthology.orchestra.run.smithi017.stdout:(113/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.r 21 MB/s | 559 kB 00:00 2023-10-06T04:41:01.557 INFO:teuthology.orchestra.run.smithi017.stdout:(114/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 969 kB/s | 47 kB 00:00 2023-10-06T04:41:01.565 INFO:teuthology.orchestra.run.smithi136.stdout:(115/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rp 1.4 MB/s | 70 kB 00:00 2023-10-06T04:41:01.567 INFO:teuthology.orchestra.run.smithi136.stdout:(116/120): libgfortran-8.4.1-1.el8.x86_64.rpm 8.3 MB/s | 639 kB 00:00 2023-10-06T04:41:01.575 INFO:teuthology.orchestra.run.smithi136.stdout:(117/120): libselinux-devel-2.9-5.el8.x86_64.rp 4.6 MB/s | 200 kB 00:00 2023-10-06T04:41:01.580 INFO:teuthology.orchestra.run.smithi017.stdout:(115/120): libgfortran-8.4.1-1.el8.x86_64.rpm 14 MB/s | 639 kB 00:00 2023-10-06T04:41:01.584 INFO:teuthology.orchestra.run.smithi017.stdout:(116/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rp 2.0 MB/s | 70 kB 00:00 2023-10-06T04:41:01.591 INFO:teuthology.orchestra.run.smithi017.stdout:(117/120): libselinux-devel-2.9-5.el8.x86_64.rp 5.8 MB/s | 200 kB 00:00 2023-10-06T04:41:01.599 INFO:teuthology.orchestra.run.smithi136.stdout:(118/120): libuuid-devel-2.32.1-27.el8.x86_64.r 2.8 MB/s | 97 kB 00:00 2023-10-06T04:41:01.609 INFO:teuthology.orchestra.run.smithi017.stdout:(118/120): libuuid-devel-2.32.1-27.el8.x86_64.r 3.2 MB/s | 97 kB 00:00 2023-10-06T04:41:02.051 INFO:teuthology.orchestra.run.smithi136.stdout:(119/120): librados2-17.2.6-1274.g68e53a4a.el8. 7.1 MB/s | 3.4 MB 00:00 2023-10-06T04:41:02.069 INFO:teuthology.orchestra.run.smithi017.stdout:(119/120): librbd1-17.2.6-1274.g68e53a4a.el8.x8 7.4 MB/s | 3.5 MB 00:00 2023-10-06T04:41:02.080 INFO:teuthology.orchestra.run.smithi017.stdout:(120/120): librados2-17.2.6-1274.g68e53a4a.el8. 6.9 MB/s | 3.4 MB 00:00 2023-10-06T04:41:02.083 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2023-10-06T04:41:02.083 INFO:teuthology.orchestra.run.smithi017.stdout:Total 16 MB/s | 201 MB 00:12 2023-10-06T04:41:02.135 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2023-10-06T04:41:02.259 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2023-10-06T04:41:02.259 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2023-10-06T04:41:02.537 INFO:teuthology.orchestra.run.smithi136.stdout:(120/120): librbd1-17.2.6-1274.g68e53a4a.el8.x8 3.7 MB/s | 3.5 MB 00:00 2023-10-06T04:41:02.542 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2023-10-06T04:41:02.542 INFO:teuthology.orchestra.run.smithi136.stdout:Total 15 MB/s | 201 MB 00:13 2023-10-06T04:41:02.589 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2023-10-06T04:41:02.703 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2023-10-06T04:41:02.703 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2023-10-06T04:41:03.969 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2023-10-06T04:41:03.974 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2023-10-06T04:41:04.500 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2023-10-06T04:41:04.504 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2023-10-06T04:41:08.521 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2023-10-06T04:41:08.713 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-06T04:41:08.924 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 2/122 2023-10-06T04:41:09.114 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-06T04:41:09.146 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2023-10-06T04:41:09.253 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-06T04:41:09.372 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-06T04:41:09.413 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-06T04:41:09.606 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 2/122 2023-10-06T04:41:09.805 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-06T04:41:09.812 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-06T04:41:09.922 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-06T04:41:10.013 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 5/122 2023-10-06T04:41:10.153 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-06T04:41:10.432 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 5/122 2023-10-06T04:41:10.537 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-06T04:41:10.606 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 6/122 2023-10-06T04:41:10.745 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 6/122 2023-10-06T04:41:10.795 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 5/122 2023-10-06T04:41:10.946 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 7/122 2023-10-06T04:41:11.028 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 7/122 2023-10-06T04:41:11.190 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 5/122 2023-10-06T04:41:11.354 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 8/122 2023-10-06T04:41:11.362 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 6/122 2023-10-06T04:41:11.494 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 6/122 2023-10-06T04:41:11.695 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 7/122 2023-10-06T04:41:11.796 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 7/122 2023-10-06T04:41:12.040 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-06T04:41:12.142 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 8/122 2023-10-06T04:41:12.196 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/122 2023-10-06T04:41:12.313 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/122 2023-10-06T04:41:12.534 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-06T04:41:12.688 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-06T04:41:12.834 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-06T04:41:12.879 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/122 2023-10-06T04:41:12.994 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/122 2023-10-06T04:41:13.017 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/122 2023-10-06T04:41:13.121 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/122 2023-10-06T04:41:13.163 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 14/122 2023-10-06T04:41:13.238 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 14/122 2023-10-06T04:41:13.382 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-06T04:41:13.382 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 15/122 2023-10-06T04:41:13.530 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-06T04:41:13.585 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-06T04:41:13.701 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-06T04:41:13.778 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/122 2023-10-06T04:41:13.863 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-06T04:41:13.921 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/122 2023-10-06T04:41:14.069 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 14/122 2023-10-06T04:41:14.140 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 14/122 2023-10-06T04:41:14.330 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 15/122 2023-10-06T04:41:14.439 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-06T04:41:14.494 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-06T04:41:14.588 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-06T04:41:14.636 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-06T04:41:14.827 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-06T04:41:15.145 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-06T04:41:15.337 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openblas-0.3.12-1.el8.x86_64 19/122 2023-10-06T04:41:15.369 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-06T04:41:15.527 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-06T04:41:16.048 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-06T04:41:16.121 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 19/122 2023-10-06T04:41:16.294 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openblas-0.3.12-1.el8.x86_64 19/122 2023-10-06T04:41:16.401 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 20/122 2023-10-06T04:41:16.563 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 21/122 2023-10-06T04:41:16.727 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 22/122 2023-10-06T04:41:17.004 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/122 2023-10-06T04:41:17.017 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 19/122 2023-10-06T04:41:17.272 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 20/122 2023-10-06T04:41:17.493 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 21/122 2023-10-06T04:41:17.665 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 22/122 2023-10-06T04:41:17.667 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/122 2023-10-06T04:41:17.890 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-06T04:41:17.968 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/122 2023-10-06T04:41:18.053 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8. 26/122 2023-10-06T04:41:18.209 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el 27/122 2023-10-06T04:41:18.431 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_6 28/122 2023-10-06T04:41:18.531 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/122 2023-10-06T04:41:18.797 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-06T04:41:19.009 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8. 26/122 2023-10-06T04:41:19.146 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el 27/122 2023-10-06T04:41:19.401 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_6 28/122 2023-10-06T04:41:19.492 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/122 2023-10-06T04:41:19.802 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 30/122 2023-10-06T04:41:20.117 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 31/122 2023-10-06T04:41:20.328 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 32/122 2023-10-06T04:41:20.429 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/122 2023-10-06T04:41:20.592 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 33/122 2023-10-06T04:41:20.775 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 30/122 2023-10-06T04:41:20.828 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-06T04:41:21.077 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 31/122 2023-10-06T04:41:21.332 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 32/122 2023-10-06T04:41:21.643 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 33/122 2023-10-06T04:41:21.910 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-06T04:41:23.018 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-06T04:41:23.351 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 35/122 2023-10-06T04:41:23.553 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-06T04:41:23.724 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-06T04:41:23.924 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 38/122 2023-10-06T04:41:23.947 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-06T04:41:24.076 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 39/122 2023-10-06T04:41:24.229 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_6 40/122 2023-10-06T04:41:24.305 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 35/122 2023-10-06T04:41:24.394 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 41/122 2023-10-06T04:41:24.583 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 42/122 2023-10-06T04:41:24.606 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-06T04:41:24.737 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 43/122 2023-10-06T04:41:24.786 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-06T04:41:24.881 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : fuse-2.9.7-12.el8.x86_64 44/122 2023-10-06T04:41:25.010 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 38/122 2023-10-06T04:41:25.025 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 45/122 2023-10-06T04:41:25.201 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 39/122 2023-10-06T04:41:25.212 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 46/122 2023-10-06T04:41:25.382 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 47/122 2023-10-06T04:41:25.436 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_6 40/122 2023-10-06T04:41:25.616 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 41/122 2023-10-06T04:41:25.669 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 48/122 2023-10-06T04:41:25.814 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 42/122 2023-10-06T04:41:25.993 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 49/122 2023-10-06T04:41:26.037 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 43/122 2023-10-06T04:41:26.203 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : fuse-2.9.7-12.el8.x86_64 44/122 2023-10-06T04:41:26.232 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 50/122 2023-10-06T04:41:26.345 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 45/122 2023-10-06T04:41:26.566 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 46/122 2023-10-06T04:41:26.595 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 51/122 2023-10-06T04:41:26.720 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 47/122 2023-10-06T04:41:26.777 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : automake-1.16.1-7.el8.noarch 52/122 2023-10-06T04:41:26.961 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 53/122 2023-10-06T04:41:27.069 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 48/122 2023-10-06T04:41:27.160 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 54/122 2023-10-06T04:41:27.332 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 55/122 2023-10-06T04:41:27.356 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 49/122 2023-10-06T04:41:27.478 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-06T04:41:27.540 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-06T04:41:27.630 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 50/122 2023-10-06T04:41:27.737 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : jq-1.5-12.el8.x86_64 57/122 2023-10-06T04:41:27.910 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 58/122 2023-10-06T04:41:27.968 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 51/122 2023-10-06T04:41:28.062 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-06T04:41:28.167 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : automake-1.16.1-7.el8.noarch 52/122 2023-10-06T04:41:28.234 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-06T04:41:28.340 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 53/122 2023-10-06T04:41:28.489 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-06T04:41:28.553 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 54/122 2023-10-06T04:41:28.695 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-06T04:41:28.786 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 55/122 2023-10-06T04:41:28.901 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-06T04:41:28.958 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-06T04:41:29.020 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-06T04:41:29.057 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-06T04:41:29.206 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-06T04:41:29.233 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : jq-1.5-12.el8.x86_64 57/122 2023-10-06T04:41:29.383 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-06T04:41:29.432 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 58/122 2023-10-06T04:41:29.592 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-06T04:41:29.641 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-06T04:41:29.816 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-06T04:41:29.821 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-06T04:41:29.998 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-06T04:41:30.088 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-06T04:41:30.189 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-06T04:41:30.274 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-06T04:41:30.470 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-06T04:41:30.498 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-06T04:41:30.644 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-06T04:41:30.684 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-06T04:41:30.843 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-06T04:41:30.868 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-06T04:41:31.041 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-06T04:41:31.201 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-06T04:41:31.294 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-06T04:41:31.437 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-06T04:41:31.577 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-06T04:41:31.674 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-06T04:41:31.785 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-06T04:41:31.913 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-06T04:41:32.002 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-06T04:41:32.230 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-06T04:41:32.486 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-06T04:41:32.729 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-06T04:41:33.016 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-06T04:41:33.085 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-06T04:41:33.289 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-06T04:41:33.360 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-06T04:41:33.523 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-06T04:41:33.539 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-06T04:41:33.767 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-06T04:41:33.881 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-06T04:41:34.114 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-06T04:41:34.437 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-06T04:41:34.651 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-06T04:41:34.850 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-06T04:41:34.956 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-06T04:41:35.019 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-06T04:41:35.280 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-06T04:41:35.558 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-06T04:41:35.893 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-06T04:41:36.179 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-06T04:41:36.561 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-06T04:41:36.808 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-06T04:41:36.990 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-06T04:41:37.215 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-06T04:41:40.446 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 87/122 2023-10-06T04:41:40.668 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 87/122 2023-10-06T04:41:41.295 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 87/122 2023-10-06T04:41:41.549 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 88/122 2023-10-06T04:41:41.629 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 88/122 2023-10-06T04:41:41.776 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 89/122 2023-10-06T04:41:42.351 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 87/122 2023-10-06T04:41:42.605 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 87/122 2023-10-06T04:41:43.186 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 87/122 2023-10-06T04:41:43.484 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 88/122 2023-10-06T04:41:43.571 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 88/122 2023-10-06T04:41:43.729 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 89/122 2023-10-06T04:41:59.988 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 89/122 2023-10-06T04:41:59.988 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /sys 2023-10-06T04:41:59.988 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /proc 2023-10-06T04:41:59.988 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /dev 2023-10-06T04:41:59.988 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /run 2023-10-06T04:41:59.988 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /mnt 2023-10-06T04:41:59.989 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /var/tmp 2023-10-06T04:41:59.989 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /home 2023-10-06T04:41:59.989 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /tmp 2023-10-06T04:41:59.989 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /dev 2023-10-06T04:41:59.989 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:42:00.391 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 90/122 2023-10-06T04:42:01.476 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 89/122 2023-10-06T04:42:01.477 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /sys 2023-10-06T04:42:01.477 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /proc 2023-10-06T04:42:01.477 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /dev 2023-10-06T04:42:01.477 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /run 2023-10-06T04:42:01.477 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /mnt 2023-10-06T04:42:01.477 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /var/tmp 2023-10-06T04:42:01.477 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /home 2023-10-06T04:42:01.477 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /tmp 2023-10-06T04:42:01.477 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /dev 2023-10-06T04:42:01.477 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-10-06T04:42:01.876 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 90/122 2023-10-06T04:42:01.970 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 90/122 2023-10-06T04:42:02.172 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 91/122 2023-10-06T04:42:02.407 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 91/122 2023-10-06T04:42:02.541 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 92/122 2023-10-06T04:42:02.968 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 92/122 2023-10-06T04:42:03.124 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 93/122 2023-10-06T04:42:03.142 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 93/122 2023-10-06T04:42:03.359 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 90/122 2023-10-06T04:42:03.554 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 91/122 2023-10-06T04:42:03.777 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 91/122 2023-10-06T04:42:03.942 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 92/122 2023-10-06T04:42:04.348 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 92/122 2023-10-06T04:42:04.542 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 93/122 2023-10-06T04:42:04.559 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 93/122 2023-10-06T04:42:06.203 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 94/122 2023-10-06T04:42:06.316 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 94/122 2023-10-06T04:42:06.514 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.e 95/122 2023-10-06T04:42:06.702 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a. 96/122 2023-10-06T04:42:06.864 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 97/122 2023-10-06T04:42:07.093 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 97/122 2023-10-06T04:42:07.321 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 98/122 2023-10-06T04:42:07.365 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 94/122 2023-10-06T04:42:07.507 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 94/122 2023-10-06T04:42:07.689 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.e 95/122 2023-10-06T04:42:07.905 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a. 96/122 2023-10-06T04:42:08.091 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 97/122 2023-10-06T04:42:08.306 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 97/122 2023-10-06T04:42:08.353 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 98/122 2023-10-06T04:42:08.511 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 98/122 2023-10-06T04:42:08.514 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 99/122 2023-10-06T04:42:08.618 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 99/122 2023-10-06T04:42:08.978 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el 100/122 2023-10-06T04:42:09.129 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 101/122 2023-10-06T04:42:09.168 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 101/122 2023-10-06T04:42:09.347 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 102/122 2023-10-06T04:42:09.359 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 102/122 2023-10-06T04:42:09.480 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 98/122 2023-10-06T04:42:09.674 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 99/122 2023-10-06T04:42:09.772 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 99/122 2023-10-06T04:42:10.142 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el 100/122 2023-10-06T04:42:10.362 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 101/122 2023-10-06T04:42:10.399 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 101/122 2023-10-06T04:42:10.573 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 102/122 2023-10-06T04:42:10.585 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 102/122 2023-10-06T04:42:11.028 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 103/122 2023-10-06T04:42:11.254 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 104/122 2023-10-06T04:42:11.332 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 104/122 2023-10-06T04:42:11.481 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1274.g68e53 105/122 2023-10-06T04:42:11.529 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1274.g68e53 105/122 2023-10-06T04:42:11.681 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 106/122 2023-10-06T04:42:12.051 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 106/122 2023-10-06T04:42:12.171 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 103/122 2023-10-06T04:42:12.222 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 107/122 2023-10-06T04:42:12.402 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 104/122 2023-10-06T04:42:12.522 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 104/122 2023-10-06T04:42:12.707 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1274.g68e53 105/122 2023-10-06T04:42:12.760 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1274.g68e53 105/122 2023-10-06T04:42:12.934 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 106/122 2023-10-06T04:42:13.282 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 106/122 2023-10-06T04:42:13.440 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 107/122 2023-10-06T04:42:17.473 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 107/122 2023-10-06T04:42:17.793 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 108/122 2023-10-06T04:42:17.904 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libtool-2.4.6-25.el8.x86_64 109/122 2023-10-06T04:42:18.384 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 107/122 2023-10-06T04:42:18.670 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 109/122 2023-10-06T04:42:18.698 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 108/122 2023-10-06T04:42:18.846 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libtool-2.4.6-25.el8.x86_64 109/122 2023-10-06T04:42:19.032 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 110/122 2023-10-06T04:42:19.208 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 111/122 2023-10-06T04:42:19.350 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 112/122 2023-10-06T04:42:19.493 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_ 113/122 2023-10-06T04:42:19.553 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 109/122 2023-10-06T04:42:19.660 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-06T04:42:19.789 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 115/122 2023-10-06T04:42:19.891 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 110/122 2023-10-06T04:42:19.981 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 116/122 2023-10-06T04:42:20.061 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 111/122 2023-10-06T04:42:20.114 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 117/122 2023-10-06T04:42:20.275 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 112/122 2023-10-06T04:42:20.354 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 118/122 2023-10-06T04:42:20.443 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_ 113/122 2023-10-06T04:42:20.538 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : bison-3.0.4-10.el8.x86_64 119/122 2023-10-06T04:42:20.601 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 119/122 2023-10-06T04:42:20.626 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-06T04:42:20.771 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/122 2023-10-06T04:42:20.782 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/122 2023-10-06T04:42:20.782 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T04:42:20.805 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 115/122 2023-10-06T04:42:20.966 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T04:42:20.966 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T04:42:21.030 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 116/122 2023-10-06T04:42:21.198 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 117/122 2023-10-06T04:42:21.439 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 118/122 2023-10-06T04:42:21.646 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : bison-3.0.4-10.el8.x86_64 119/122 2023-10-06T04:42:21.715 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 119/122 2023-10-06T04:42:21.830 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T04:42:21.831 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 1/122 2023-10-06T04:42:21.831 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 2/122 2023-10-06T04:42:21.831 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 3/122 2023-10-06T04:42:21.831 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 4/122 2023-10-06T04:42:21.831 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1274.g68e53 5/122 2023-10-06T04:42:21.831 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 6/122 2023-10-06T04:42:21.831 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 7/122 2023-10-06T04:42:21.831 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 8/122 2023-10-06T04:42:21.831 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 9/122 2023-10-06T04:42:21.831 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/122 2023-10-06T04:42:21.832 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 11/122 2023-10-06T04:42:21.832 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 12/122 2023-10-06T04:42:21.832 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/122 2023-10-06T04:42:21.832 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_ 14/122 2023-10-06T04:42:21.832 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 15/122 2023-10-06T04:42:21.832 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 16/122 2023-10-06T04:42:21.832 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_6 17/122 2023-10-06T04:42:21.832 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 18/122 2023-10-06T04:42:21.832 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 19/122 2023-10-06T04:42:21.832 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el 20/122 2023-10-06T04:42:21.832 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8. 21/122 2023-10-06T04:42:21.832 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_6 22/122 2023-10-06T04:42:21.833 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 23/122 2023-10-06T04:42:21.833 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 24/122 2023-10-06T04:42:21.833 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 25/122 2023-10-06T04:42:21.833 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 26/122 2023-10-06T04:42:21.833 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 27/122 2023-10-06T04:42:21.833 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 28/122 2023-10-06T04:42:21.833 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a. 29/122 2023-10-06T04:42:21.833 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 30/122 2023-10-06T04:42:21.841 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 31/122 2023-10-06T04:42:21.841 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 32/122 2023-10-06T04:42:21.841 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el 33/122 2023-10-06T04:42:21.841 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 34/122 2023-10-06T04:42:21.841 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.e 35/122 2023-10-06T04:42:21.841 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 36/122 2023-10-06T04:42:21.841 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 37/122 2023-10-06T04:42:21.841 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 38/122 2023-10-06T04:42:21.841 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-06T04:42:21.842 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-06T04:42:21.842 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-06T04:42:21.842 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-06T04:42:21.842 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-06T04:42:21.842 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-06T04:42:21.842 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-06T04:42:21.842 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-06T04:42:21.842 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-06T04:42:21.842 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-06T04:42:21.842 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-06T04:42:21.842 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-06T04:42:21.842 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-06T04:42:21.843 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-06T04:42:21.843 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-06T04:42:21.843 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-06T04:42:21.843 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-06T04:42:21.843 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-06T04:42:21.843 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-06T04:42:21.843 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-06T04:42:21.843 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-06T04:42:21.843 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-06T04:42:21.843 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-06T04:42:21.843 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-06T04:42:21.843 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-06T04:42:21.844 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-06T04:42:21.844 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-06T04:42:21.844 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-06T04:42:21.844 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-06T04:42:21.844 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-06T04:42:21.844 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-06T04:42:21.844 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-06T04:42:21.844 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-06T04:42:21.844 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 72/122 2023-10-06T04:42:21.844 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 73/122 2023-10-06T04:42:21.844 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 74/122 2023-10-06T04:42:21.844 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : jq-1.5-12.el8.x86_64 75/122 2023-10-06T04:42:21.845 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flex-2.6.1-9.el8.x86_64 76/122 2023-10-06T04:42:21.845 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/122 2023-10-06T04:42:21.845 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 78/122 2023-10-06T04:42:21.845 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 79/122 2023-10-06T04:42:21.845 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : bison-3.0.4-10.el8.x86_64 80/122 2023-10-06T04:42:21.845 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 81/122 2023-10-06T04:42:21.845 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 82/122 2023-10-06T04:42:21.845 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 83/122 2023-10-06T04:42:21.845 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 84/122 2023-10-06T04:42:21.845 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 85/122 2023-10-06T04:42:21.845 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 86/122 2023-10-06T04:42:21.845 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 87/122 2023-10-06T04:42:21.845 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 88/122 2023-10-06T04:42:21.846 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 89/122 2023-10-06T04:42:21.846 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 90/122 2023-10-06T04:42:21.846 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 91/122 2023-10-06T04:42:21.846 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 92/122 2023-10-06T04:42:21.846 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 93/122 2023-10-06T04:42:21.846 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 94/122 2023-10-06T04:42:21.846 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 95/122 2023-10-06T04:42:21.846 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : automake-1.16.1-7.el8.noarch 96/122 2023-10-06T04:42:21.846 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 97/122 2023-10-06T04:42:21.846 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/122 2023-10-06T04:42:21.846 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 99/122 2023-10-06T04:42:21.846 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 100/122 2023-10-06T04:42:21.847 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 101/122 2023-10-06T04:42:21.847 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 102/122 2023-10-06T04:42:21.847 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 103/122 2023-10-06T04:42:21.847 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 104/122 2023-10-06T04:42:21.847 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 105/122 2023-10-06T04:42:21.847 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 106/122 2023-10-06T04:42:21.847 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 107/122 2023-10-06T04:42:21.847 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 108/122 2023-10-06T04:42:21.847 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 109/122 2023-10-06T04:42:21.847 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 110/122 2023-10-06T04:42:21.847 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 111/122 2023-10-06T04:42:21.847 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 112/122 2023-10-06T04:42:21.848 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 113/122 2023-10-06T04:42:21.848 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 114/122 2023-10-06T04:42:21.848 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 115/122 2023-10-06T04:42:21.848 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 116/122 2023-10-06T04:42:21.848 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 117/122 2023-10-06T04:42:21.848 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 118/122 2023-10-06T04:42:21.848 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 119/122 2023-10-06T04:42:21.848 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-06T04:42:21.848 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 121/122 2023-10-06T04:42:21.921 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/122 2023-10-06T04:42:21.931 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/122 2023-10-06T04:42:21.931 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T04:42:22.169 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T04:42:22.169 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T04:42:23.005 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T04:42:23.005 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 1/122 2023-10-06T04:42:23.006 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 2/122 2023-10-06T04:42:23.006 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 3/122 2023-10-06T04:42:23.006 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 4/122 2023-10-06T04:42:23.006 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1274.g68e53 5/122 2023-10-06T04:42:23.006 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 6/122 2023-10-06T04:42:23.006 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 7/122 2023-10-06T04:42:23.006 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 8/122 2023-10-06T04:42:23.006 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 9/122 2023-10-06T04:42:23.006 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/122 2023-10-06T04:42:23.006 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 11/122 2023-10-06T04:42:23.007 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 12/122 2023-10-06T04:42:23.007 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/122 2023-10-06T04:42:23.007 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_ 14/122 2023-10-06T04:42:23.007 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 15/122 2023-10-06T04:42:23.007 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 16/122 2023-10-06T04:42:23.007 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_6 17/122 2023-10-06T04:42:23.007 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 18/122 2023-10-06T04:42:23.007 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 19/122 2023-10-06T04:42:23.007 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el 20/122 2023-10-06T04:42:23.007 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8. 21/122 2023-10-06T04:42:23.008 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_6 22/122 2023-10-06T04:42:23.008 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 23/122 2023-10-06T04:42:23.008 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 24/122 2023-10-06T04:42:23.008 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 25/122 2023-10-06T04:42:23.008 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 26/122 2023-10-06T04:42:23.008 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 27/122 2023-10-06T04:42:23.008 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 28/122 2023-10-06T04:42:23.008 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a. 29/122 2023-10-06T04:42:23.008 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 30/122 2023-10-06T04:42:23.008 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 31/122 2023-10-06T04:42:23.018 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 32/122 2023-10-06T04:42:23.018 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el 33/122 2023-10-06T04:42:23.018 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 34/122 2023-10-06T04:42:23.018 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.e 35/122 2023-10-06T04:42:23.018 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 36/122 2023-10-06T04:42:23.018 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 37/122 2023-10-06T04:42:23.018 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 38/122 2023-10-06T04:42:23.018 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-06T04:42:23.019 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-06T04:42:23.019 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-06T04:42:23.019 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-06T04:42:23.019 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-06T04:42:23.019 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-06T04:42:23.019 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-06T04:42:23.019 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-06T04:42:23.019 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-06T04:42:23.019 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-06T04:42:23.020 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-06T04:42:23.020 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-06T04:42:23.020 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-06T04:42:23.020 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-06T04:42:23.020 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-06T04:42:23.020 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-06T04:42:23.020 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-06T04:42:23.020 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-06T04:42:23.020 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-06T04:42:23.020 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-06T04:42:23.021 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-06T04:42:23.021 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-06T04:42:23.021 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-06T04:42:23.021 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-06T04:42:23.021 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-06T04:42:23.021 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-06T04:42:23.021 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-06T04:42:23.021 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-06T04:42:23.021 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-06T04:42:23.021 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-06T04:42:23.022 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-06T04:42:23.022 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-06T04:42:23.022 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-06T04:42:23.022 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 72/122 2023-10-06T04:42:23.022 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 73/122 2023-10-06T04:42:23.022 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 74/122 2023-10-06T04:42:23.022 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : jq-1.5-12.el8.x86_64 75/122 2023-10-06T04:42:23.022 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flex-2.6.1-9.el8.x86_64 76/122 2023-10-06T04:42:23.022 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/122 2023-10-06T04:42:23.023 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 78/122 2023-10-06T04:42:23.023 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 79/122 2023-10-06T04:42:23.023 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : bison-3.0.4-10.el8.x86_64 80/122 2023-10-06T04:42:23.023 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 81/122 2023-10-06T04:42:23.023 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 82/122 2023-10-06T04:42:23.023 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 83/122 2023-10-06T04:42:23.023 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 84/122 2023-10-06T04:42:23.023 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 85/122 2023-10-06T04:42:23.023 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 86/122 2023-10-06T04:42:23.023 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 87/122 2023-10-06T04:42:23.024 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 88/122 2023-10-06T04:42:23.024 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 89/122 2023-10-06T04:42:23.024 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 90/122 2023-10-06T04:42:23.024 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 91/122 2023-10-06T04:42:23.024 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 92/122 2023-10-06T04:42:23.024 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 93/122 2023-10-06T04:42:23.024 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 94/122 2023-10-06T04:42:23.024 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 95/122 2023-10-06T04:42:23.024 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : automake-1.16.1-7.el8.noarch 96/122 2023-10-06T04:42:23.024 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 97/122 2023-10-06T04:42:23.025 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/122 2023-10-06T04:42:23.025 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 99/122 2023-10-06T04:42:23.025 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 100/122 2023-10-06T04:42:23.025 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 101/122 2023-10-06T04:42:23.025 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 102/122 2023-10-06T04:42:23.025 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 103/122 2023-10-06T04:42:23.025 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 104/122 2023-10-06T04:42:23.025 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 105/122 2023-10-06T04:42:23.025 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 106/122 2023-10-06T04:42:23.025 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 107/122 2023-10-06T04:42:23.025 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 108/122 2023-10-06T04:42:23.026 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 109/122 2023-10-06T04:42:23.026 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 110/122 2023-10-06T04:42:23.026 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 111/122 2023-10-06T04:42:23.026 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 112/122 2023-10-06T04:42:23.026 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 113/122 2023-10-06T04:42:23.026 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 114/122 2023-10-06T04:42:23.026 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 115/122 2023-10-06T04:42:23.027 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 116/122 2023-10-06T04:42:23.027 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 117/122 2023-10-06T04:42:23.027 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 118/122 2023-10-06T04:42:23.027 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 119/122 2023-10-06T04:42:23.027 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-06T04:42:23.027 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 121/122 2023-10-06T04:42:24.067 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T04:42:24.067 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:45 ago on Fri 06 Oct 2023 04:40:39 AM UTC. 2023-10-06T04:42:25.290 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T04:42:25.290 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:01:45 ago on Fri 06 Oct 2023 04:40:40 AM UTC. 2023-10-06T04:42:26.142 INFO:teuthology.orchestra.run.smithi017.stdout:Installed products updated. 2023-10-06T04:42:26.283 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:42:26.284 INFO:teuthology.orchestra.run.smithi017.stdout:Upgraded: 2023-10-06T04:42:26.284 INFO:teuthology.orchestra.run.smithi017.stdout: librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:26.284 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:26.284 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2023-10-06T04:42:26.284 INFO:teuthology.orchestra.run.smithi017.stdout: automake-1.16.1-7.el8.noarch 2023-10-06T04:42:26.284 INFO:teuthology.orchestra.run.smithi017.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T04:42:26.284 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:26.284 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:26.284 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:26.284 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:26.284 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:42:26.285 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:26.285 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:26.285 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:26.285 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:42:26.285 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:42:26.285 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:42:26.285 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:42:26.285 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:42:26.285 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:26.285 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:26.285 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:42:26.285 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:26.286 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:26.286 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:26.286 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:42:26.286 INFO:teuthology.orchestra.run.smithi017.stdout: cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:42:26.286 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:26.286 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:42:26.286 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-06T04:42:26.286 INFO:teuthology.orchestra.run.smithi017.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T04:42:26.286 INFO:teuthology.orchestra.run.smithi017.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-06T04:42:26.286 INFO:teuthology.orchestra.run.smithi017.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T04:42:26.286 INFO:teuthology.orchestra.run.smithi017.stdout: jq-1.5-12.el8.x86_64 2023-10-06T04:42:26.287 INFO:teuthology.orchestra.run.smithi017.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-06T04:42:26.287 INFO:teuthology.orchestra.run.smithi017.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-06T04:42:26.287 INFO:teuthology.orchestra.run.smithi017.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T04:42:26.287 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:26.287 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:26.287 INFO:teuthology.orchestra.run.smithi017.stdout: libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:26.287 INFO:teuthology.orchestra.run.smithi017.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-06T04:42:26.287 INFO:teuthology.orchestra.run.smithi017.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-06T04:42:26.287 INFO:teuthology.orchestra.run.smithi017.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T04:42:26.287 INFO:teuthology.orchestra.run.smithi017.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-06T04:42:26.287 INFO:teuthology.orchestra.run.smithi017.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-06T04:42:26.287 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:26.288 INFO:teuthology.orchestra.run.smithi017.stdout: libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:26.288 INFO:teuthology.orchestra.run.smithi017.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-06T04:42:26.288 INFO:teuthology.orchestra.run.smithi017.stdout: librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:26.288 INFO:teuthology.orchestra.run.smithi017.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-06T04:42:26.288 INFO:teuthology.orchestra.run.smithi017.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-06T04:42:26.288 INFO:teuthology.orchestra.run.smithi017.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T04:42:26.288 INFO:teuthology.orchestra.run.smithi017.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T04:42:26.288 INFO:teuthology.orchestra.run.smithi017.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-06T04:42:26.288 INFO:teuthology.orchestra.run.smithi017.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-06T04:42:26.288 INFO:teuthology.orchestra.run.smithi017.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T04:42:26.288 INFO:teuthology.orchestra.run.smithi017.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T04:42:26.289 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-06T04:42:26.289 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-06T04:42:26.289 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-06T04:42:26.289 INFO:teuthology.orchestra.run.smithi017.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-06T04:42:26.289 INFO:teuthology.orchestra.run.smithi017.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-06T04:42:26.289 INFO:teuthology.orchestra.run.smithi017.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-06T04:42:26.289 INFO:teuthology.orchestra.run.smithi017.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T04:42:26.289 INFO:teuthology.orchestra.run.smithi017.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-06T04:42:26.289 INFO:teuthology.orchestra.run.smithi017.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T04:42:26.289 INFO:teuthology.orchestra.run.smithi017.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T04:42:26.289 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T04:42:26.289 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:26.290 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:26.290 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:26.290 INFO:teuthology.orchestra.run.smithi017.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T04:42:26.290 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T04:42:26.290 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T04:42:26.290 INFO:teuthology.orchestra.run.smithi017.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T04:42:26.290 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T04:42:26.290 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T04:42:26.290 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-06T04:42:26.290 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T04:42:26.290 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T04:42:26.290 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T04:42:26.291 INFO:teuthology.orchestra.run.smithi017.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T04:42:26.291 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T04:42:26.291 INFO:teuthology.orchestra.run.smithi017.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-06T04:42:26.291 INFO:teuthology.orchestra.run.smithi017.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T04:42:26.291 INFO:teuthology.orchestra.run.smithi017.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T04:42:26.291 INFO:teuthology.orchestra.run.smithi017.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T04:42:26.291 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-06T04:42:26.291 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-06T04:42:26.291 INFO:teuthology.orchestra.run.smithi017.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T04:42:26.291 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T04:42:26.291 INFO:teuthology.orchestra.run.smithi017.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T04:42:26.292 INFO:teuthology.orchestra.run.smithi017.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T04:42:26.292 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T04:42:26.292 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T04:42:26.292 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-06T04:42:26.292 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:26.292 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:26.292 INFO:teuthology.orchestra.run.smithi017.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T04:42:26.292 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T04:42:26.292 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:26.292 INFO:teuthology.orchestra.run.smithi017.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T04:42:26.292 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T04:42:26.292 INFO:teuthology.orchestra.run.smithi017.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-06T04:42:26.293 INFO:teuthology.orchestra.run.smithi017.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T04:42:26.293 INFO:teuthology.orchestra.run.smithi017.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T04:42:26.293 INFO:teuthology.orchestra.run.smithi017.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T04:42:26.293 INFO:teuthology.orchestra.run.smithi017.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T04:42:26.293 INFO:teuthology.orchestra.run.smithi017.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T04:42:26.293 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T04:42:26.293 INFO:teuthology.orchestra.run.smithi017.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T04:42:26.293 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T04:42:26.293 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T04:42:26.293 INFO:teuthology.orchestra.run.smithi017.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T04:42:26.293 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:26.294 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:26.294 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:26.294 INFO:teuthology.orchestra.run.smithi017.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-06T04:42:26.294 INFO:teuthology.orchestra.run.smithi017.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T04:42:26.294 INFO:teuthology.orchestra.run.smithi017.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-06T04:42:26.294 INFO:teuthology.orchestra.run.smithi017.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T04:42:26.294 INFO:teuthology.orchestra.run.smithi017.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-06T04:42:26.294 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:42:26.295 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2023-10-06T04:42:26.543 DEBUG:teuthology.parallel:result is None 2023-10-06T04:42:27.353 INFO:teuthology.orchestra.run.smithi136.stdout:Installed products updated. 2023-10-06T04:42:27.505 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-10-06T04:42:27.506 INFO:teuthology.orchestra.run.smithi136.stdout:Upgraded: 2023-10-06T04:42:27.506 INFO:teuthology.orchestra.run.smithi136.stdout: librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:27.506 INFO:teuthology.orchestra.run.smithi136.stdout: librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:27.506 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2023-10-06T04:42:27.506 INFO:teuthology.orchestra.run.smithi136.stdout: automake-1.16.1-7.el8.noarch 2023-10-06T04:42:27.506 INFO:teuthology.orchestra.run.smithi136.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T04:42:27.506 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:27.506 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:27.506 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:27.506 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:27.507 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:42:27.507 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-immutable-object-cache-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:27.507 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:27.507 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:27.507 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:42:27.507 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:42:27.507 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:42:27.507 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:42:27.507 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:42:27.507 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:27.507 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:27.507 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:42:27.508 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:27.508 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:27.508 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:27.508 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:42:27.508 INFO:teuthology.orchestra.run.smithi136.stdout: cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:42:27.508 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:27.508 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:42:27.508 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-06T04:42:27.508 INFO:teuthology.orchestra.run.smithi136.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T04:42:27.508 INFO:teuthology.orchestra.run.smithi136.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-06T04:42:27.508 INFO:teuthology.orchestra.run.smithi136.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T04:42:27.508 INFO:teuthology.orchestra.run.smithi136.stdout: jq-1.5-12.el8.x86_64 2023-10-06T04:42:27.509 INFO:teuthology.orchestra.run.smithi136.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-06T04:42:27.509 INFO:teuthology.orchestra.run.smithi136.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-06T04:42:27.509 INFO:teuthology.orchestra.run.smithi136.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T04:42:27.509 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:27.509 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:27.509 INFO:teuthology.orchestra.run.smithi136.stdout: libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:27.509 INFO:teuthology.orchestra.run.smithi136.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-06T04:42:27.509 INFO:teuthology.orchestra.run.smithi136.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-06T04:42:27.509 INFO:teuthology.orchestra.run.smithi136.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T04:42:27.509 INFO:teuthology.orchestra.run.smithi136.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-06T04:42:27.509 INFO:teuthology.orchestra.run.smithi136.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-06T04:42:27.509 INFO:teuthology.orchestra.run.smithi136.stdout: librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:27.510 INFO:teuthology.orchestra.run.smithi136.stdout: libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:27.510 INFO:teuthology.orchestra.run.smithi136.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-06T04:42:27.510 INFO:teuthology.orchestra.run.smithi136.stdout: librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:27.510 INFO:teuthology.orchestra.run.smithi136.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-06T04:42:27.510 INFO:teuthology.orchestra.run.smithi136.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-06T04:42:27.510 INFO:teuthology.orchestra.run.smithi136.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T04:42:27.510 INFO:teuthology.orchestra.run.smithi136.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T04:42:27.510 INFO:teuthology.orchestra.run.smithi136.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-06T04:42:27.510 INFO:teuthology.orchestra.run.smithi136.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-06T04:42:27.510 INFO:teuthology.orchestra.run.smithi136.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T04:42:27.510 INFO:teuthology.orchestra.run.smithi136.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T04:42:27.510 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-06T04:42:27.511 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-06T04:42:27.511 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-06T04:42:27.511 INFO:teuthology.orchestra.run.smithi136.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-06T04:42:27.511 INFO:teuthology.orchestra.run.smithi136.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-06T04:42:27.511 INFO:teuthology.orchestra.run.smithi136.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-06T04:42:27.511 INFO:teuthology.orchestra.run.smithi136.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T04:42:27.511 INFO:teuthology.orchestra.run.smithi136.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-06T04:42:27.511 INFO:teuthology.orchestra.run.smithi136.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T04:42:27.511 INFO:teuthology.orchestra.run.smithi136.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T04:42:27.511 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T04:42:27.511 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:27.511 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:27.512 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:27.512 INFO:teuthology.orchestra.run.smithi136.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T04:42:27.512 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T04:42:27.512 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T04:42:27.512 INFO:teuthology.orchestra.run.smithi136.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T04:42:27.512 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T04:42:27.512 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T04:42:27.512 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-06T04:42:27.512 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T04:42:27.512 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T04:42:27.512 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T04:42:27.512 INFO:teuthology.orchestra.run.smithi136.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T04:42:27.513 INFO:teuthology.orchestra.run.smithi136.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T04:42:27.513 INFO:teuthology.orchestra.run.smithi136.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-06T04:42:27.513 INFO:teuthology.orchestra.run.smithi136.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T04:42:27.513 INFO:teuthology.orchestra.run.smithi136.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T04:42:27.513 INFO:teuthology.orchestra.run.smithi136.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T04:42:27.513 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-06T04:42:27.513 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-06T04:42:27.513 INFO:teuthology.orchestra.run.smithi136.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T04:42:27.513 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T04:42:27.513 INFO:teuthology.orchestra.run.smithi136.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T04:42:27.513 INFO:teuthology.orchestra.run.smithi136.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T04:42:27.513 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T04:42:27.514 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T04:42:27.514 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-06T04:42:27.514 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:27.514 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:27.514 INFO:teuthology.orchestra.run.smithi136.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T04:42:27.514 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T04:42:27.514 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:27.514 INFO:teuthology.orchestra.run.smithi136.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T04:42:27.514 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T04:42:27.514 INFO:teuthology.orchestra.run.smithi136.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-06T04:42:27.514 INFO:teuthology.orchestra.run.smithi136.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T04:42:27.514 INFO:teuthology.orchestra.run.smithi136.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T04:42:27.515 INFO:teuthology.orchestra.run.smithi136.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T04:42:27.515 INFO:teuthology.orchestra.run.smithi136.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T04:42:27.515 INFO:teuthology.orchestra.run.smithi136.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T04:42:27.515 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T04:42:27.515 INFO:teuthology.orchestra.run.smithi136.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T04:42:27.515 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T04:42:27.515 INFO:teuthology.orchestra.run.smithi136.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T04:42:27.515 INFO:teuthology.orchestra.run.smithi136.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T04:42:27.515 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:27.515 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:27.515 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:42:27.515 INFO:teuthology.orchestra.run.smithi136.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-06T04:42:27.516 INFO:teuthology.orchestra.run.smithi136.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T04:42:27.516 INFO:teuthology.orchestra.run.smithi136.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-06T04:42:27.516 INFO:teuthology.orchestra.run.smithi136.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T04:42:27.516 INFO:teuthology.orchestra.run.smithi136.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-06T04:42:27.516 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-10-06T04:42:27.516 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2023-10-06T04:42:27.849 DEBUG:teuthology.parallel:result is None 2023-10-06T04:42:27.850 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T04:42:28.074 DEBUG:teuthology.orchestra.run.smithi017:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T04:42:28.100 INFO:teuthology.orchestra.run.smithi017.stdout:17.2.6-1274.g68e53a4a.el8 2023-10-06T04:42:28.101 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1274.g68e53a4a.el8 2023-10-06T04:42:28.101 INFO:teuthology.task.install:The correct ceph version 17.2.6-1274.g68e53a4a is installed. 2023-10-06T04:42:28.101 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T04:42:28.246 DEBUG:teuthology.orchestra.run.smithi136:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T04:42:28.267 INFO:teuthology.orchestra.run.smithi136.stdout:17.2.6-1274.g68e53a4a.el8 2023-10-06T04:42:28.268 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1274.g68e53a4a.el8 2023-10-06T04:42:28.268 INFO:teuthology.task.install:The correct ceph version 17.2.6-1274.g68e53a4a is installed. 2023-10-06T04:42:28.268 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-06T04:42:28.268 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-06T04:42:28.269 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T04:42:28.313 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-10-06T04:42:28.314 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T04:42:28.351 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-06T04:42:28.352 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-06T04:42:28.352 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T04:42:28.380 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T04:42:28.447 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-10-06T04:42:28.447 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T04:42:28.471 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T04:42:28.534 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-06T04:42:28.535 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-06T04:42:28.535 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T04:42:28.561 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T04:42:28.627 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-10-06T04:42:28.628 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T04:42:28.654 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T04:42:28.718 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-06T04:42:28.718 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-06T04:42:28.718 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T04:42:28.744 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T04:42:28.810 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-10-06T04:42:28.810 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T04:42:28.833 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T04:42:28.898 INFO:teuthology.run_tasks:Running task ceph... 2023-10-06T04:42:28.992 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-06T04:42:28.992 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 777 /var/log/ceph 2023-10-06T04:42:28.994 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 777 /var/log/ceph 2023-10-06T04:42:29.018 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-06T04:42:29.018 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T04:42:29.060 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T04:42:29.083 INFO:tasks.ceph:Creating extra log directories... 2023-10-06T04:42:29.083 DEBUG:teuthology.orchestra.run.smithi017:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T04:42:29.125 DEBUG:teuthology.orchestra.run.smithi136:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T04:42:29.154 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-06T04:42:29.155 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-06T04:42:29.155 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-06T04:42:29.155 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-06T04:42:29.155 DEBUG:teuthology.orchestra.run.smithi017:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T04:42:29.203 DEBUG:teuthology.orchestra.run.smithi017:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T04:42:29.317 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-06T04:42:29.343 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-10-06T04:42:29.343 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T04:42:29.359 DEBUG:teuthology.orchestra.run.smithi136:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T04:42:29.466 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-06T04:42:29.496 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-06T04:42:29.496 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-06T04:42:29.496 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412287', 'branch': 'wip-yuri3-testing-2023-10-05-0943-quincy', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/backtrace}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7412287', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri3-testing-2023-10-05-0943-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri3-testing-2023-10-05-0943-quincy', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 4002, 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri3-testing-2023-10-05-0943-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564', 'targets': {'smithi017.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLin3JPzMpt4MygFVK2Xo2yDds7MpsWZR3TG0Y6x1MO6/IALD42nl0EeiRysfiezTJ7J19DcOw7w6ozualHKTbE=', 'smithi136.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCT8z47jvyl4oo/EdApCPMBw2AAaO3RiCmjP65ogxYBMvnojcE6lkXAmmIf2dACNsYqr1Q5eQIPCZvP4rYGbt58='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_backtrace']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-05_23:54:57', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-06T04:42:29.497 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T04:42:29.499 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T04:42:29.545 DEBUG:teuthology.orchestra.run.smithi017:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T04:42:29.554 DEBUG:teuthology.orchestra.run.smithi136:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T04:42:29.610 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-06T04:42:29.610 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T04:42:29.633 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T04:42:29.634 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_1 2023-10-06T04:42:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T04:42:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:42:29.689 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 6h/6d Inode: 219809 Links: 1 2023-10-06T04:42:29.689 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:42:29.689 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:42:29.689 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2023-10-06 04:42:21.407992424 +0000 2023-10-06T04:42:29.690 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2023-10-06 04:39:54.785531123 +0000 2023-10-06T04:42:29.690 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2023-10-06 04:39:54.785531123 +0000 2023-10-06T04:42:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: - 2023-10-06T04:42:29.690 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T04:42:29.752 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2023-10-06T04:42:29.753 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2023-10-06T04:42:29.753 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000116904 s, 4.4 MB/s 2023-10-06T04:42:29.754 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T04:42:29.810 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_2 2023-10-06T04:42:29.866 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T04:42:29.866 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:42:29.866 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 6h/6d Inode: 216622 Links: 1 2023-10-06T04:42:29.867 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:42:29.867 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:42:29.867 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2023-10-06 04:42:21.407992424 +0000 2023-10-06T04:42:29.867 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2023-10-06 04:39:55.285526692 +0000 2023-10-06T04:42:29.867 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2023-10-06 04:39:55.285526692 +0000 2023-10-06T04:42:29.867 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: - 2023-10-06T04:42:29.867 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T04:42:29.929 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2023-10-06T04:42:29.930 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2023-10-06T04:42:29.930 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000114308 s, 4.5 MB/s 2023-10-06T04:42:29.931 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T04:42:29.986 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_3 2023-10-06T04:42:30.042 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T04:42:30.042 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:42:30.042 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 6h/6d Inode: 220045 Links: 1 2023-10-06T04:42:30.042 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:42:30.043 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:42:30.043 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2023-10-06 04:42:21.408992415 +0000 2023-10-06T04:42:30.043 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2023-10-06 04:39:55.794522182 +0000 2023-10-06T04:42:30.043 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2023-10-06 04:39:55.794522182 +0000 2023-10-06T04:42:30.043 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: - 2023-10-06T04:42:30.043 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T04:42:30.105 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2023-10-06T04:42:30.106 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2023-10-06T04:42:30.106 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000106779 s, 4.8 MB/s 2023-10-06T04:42:30.107 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T04:42:30.163 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_4 2023-10-06T04:42:30.218 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T04:42:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:42:30.219 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 6h/6d Inode: 215923 Links: 1 2023-10-06T04:42:30.219 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:42:30.219 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:42:30.219 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2023-10-06 04:42:21.408992415 +0000 2023-10-06T04:42:30.219 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2023-10-06 04:39:56.279517884 +0000 2023-10-06T04:42:30.219 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2023-10-06 04:39:56.279517884 +0000 2023-10-06T04:42:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: - 2023-10-06T04:42:30.219 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T04:42:30.282 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2023-10-06T04:42:30.282 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2023-10-06T04:42:30.283 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 9.7691e-05 s, 5.2 MB/s 2023-10-06T04:42:30.283 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T04:42:30.339 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T04:42:30.339 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-10-06T04:42:30.339 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T04:42:30.354 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T04:42:30.354 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_1 2023-10-06T04:42:30.410 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T04:42:30.410 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:42:30.410 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 6h/6d Inode: 215927 Links: 1 2023-10-06T04:42:30.410 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:42:30.410 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:42:30.410 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2023-10-06 04:42:22.600537276 +0000 2023-10-06T04:42:30.410 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2023-10-06 04:39:35.865789907 +0000 2023-10-06T04:42:30.411 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2023-10-06 04:39:35.865789907 +0000 2023-10-06T04:42:30.411 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: - 2023-10-06T04:42:30.411 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T04:42:30.473 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2023-10-06T04:42:30.473 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2023-10-06T04:42:30.473 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000243932 s, 2.1 MB/s 2023-10-06T04:42:30.474 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T04:42:30.529 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_2 2023-10-06T04:42:30.584 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T04:42:30.585 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:42:30.585 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 6h/6d Inode: 223339 Links: 1 2023-10-06T04:42:30.585 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:42:30.585 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:42:30.585 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2023-10-06 04:42:22.600537276 +0000 2023-10-06T04:42:30.585 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2023-10-06 04:39:36.365779181 +0000 2023-10-06T04:42:30.585 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2023-10-06 04:39:36.365779181 +0000 2023-10-06T04:42:30.585 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: - 2023-10-06T04:42:30.586 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T04:42:30.647 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2023-10-06T04:42:30.647 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2023-10-06T04:42:30.648 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000219858 s, 2.3 MB/s 2023-10-06T04:42:30.648 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T04:42:30.704 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_3 2023-10-06T04:42:30.759 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T04:42:30.759 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:42:30.760 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 6h/6d Inode: 224393 Links: 1 2023-10-06T04:42:30.760 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:42:30.760 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:42:30.760 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2023-10-06 04:42:22.600537276 +0000 2023-10-06T04:42:30.761 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2023-10-06 04:39:36.849768798 +0000 2023-10-06T04:42:30.761 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2023-10-06 04:39:36.849768798 +0000 2023-10-06T04:42:30.761 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: - 2023-10-06T04:42:30.761 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T04:42:30.823 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2023-10-06T04:42:30.823 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2023-10-06T04:42:30.823 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000225085 s, 2.3 MB/s 2023-10-06T04:42:30.824 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T04:42:30.882 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_4 2023-10-06T04:42:30.937 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T04:42:30.937 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:42:30.937 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 6h/6d Inode: 221390 Links: 1 2023-10-06T04:42:30.937 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:42:30.938 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:42:30.938 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2023-10-06 04:42:22.600537276 +0000 2023-10-06T04:42:30.938 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2023-10-06 04:39:37.341758244 +0000 2023-10-06T04:42:30.938 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2023-10-06 04:39:37.341758244 +0000 2023-10-06T04:42:30.938 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: - 2023-10-06T04:42:30.939 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T04:42:31.000 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2023-10-06T04:42:31.000 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2023-10-06T04:42:31.000 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000229482 s, 2.2 MB/s 2023-10-06T04:42:31.001 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T04:42:31.056 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T04:42:31.056 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi017.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi136.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T04:42:31.056 INFO:tasks.ceph:Generating config... 2023-10-06T04:42:31.058 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-06T04:42:31.058 INFO:tasks.ceph:[client] debug client = 20 2023-10-06T04:42:31.058 INFO:tasks.ceph:[client] debug ms = 1 2023-10-06T04:42:31.058 INFO:tasks.ceph:[client] pid file = 2023-10-06T04:42:31.058 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-06T04:42:31.058 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-06T04:42:31.059 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-06T04:42:31.059 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-06T04:42:31.059 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-06T04:42:31.059 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-06T04:42:31.059 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-06T04:42:31.059 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-06T04:42:31.059 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-06T04:42:31.059 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-06T04:42:31.060 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-06T04:42:31.060 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-06T04:42:31.060 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-06T04:42:31.060 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-06T04:42:31.060 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-06T04:42:31.060 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-06T04:42:31.061 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-06T04:42:31.061 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-06T04:42:31.061 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-06T04:42:31.061 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-06T04:42:31.061 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-06T04:42:31.061 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-06T04:42:31.061 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-06T04:42:31.061 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-06T04:42:31.062 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-06T04:42:31.062 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-06T04:42:31.062 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-06T04:42:31.062 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-06T04:42:31.062 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-06T04:42:31.062 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-06T04:42:31.062 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-06T04:42:31.063 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-06T04:42:31.063 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-06T04:42:31.063 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-06T04:42:31.063 INFO:tasks.ceph:Setting up mon.a... 2023-10-06T04:42:31.063 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-06T04:42:31.112 INFO:teuthology.orchestra.run.smithi017.stdout:creating /etc/ceph/ceph.keyring 2023-10-06T04:42:31.115 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-06T04:42:31.156 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T04:42:31.222 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.17'), ('mon.b', '172.21.15.136'), ('mon.c', '[v2:172.21.15.136:3301,v1:172.21.15.136:6790]')] 2023-10-06T04:42:31.223 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.17,172.21.15.136,[v2:172.21.15.136:3301,v1:172.21.15.136:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-06T04:42:31.224 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-06T04:42:31.224 DEBUG:teuthology.orchestra.run.smithi017:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T04:42:31.278 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.17 --add b 172.21.15.136 --addv c '[v2:172.21.15.136:3301,v1:172.21.15.136:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:42:31.360 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:42:31.361 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool: generated fsid 780777c4-2b25-4d35-9058-c9f2d62e3ad9 2023-10-06T04:42:31.361 INFO:teuthology.orchestra.run.smithi017.stdout:setting min_mon_release = octopus 2023-10-06T04:42:31.361 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 0 2023-10-06T04:42:31.361 INFO:teuthology.orchestra.run.smithi017.stdout:fsid 780777c4-2b25-4d35-9058-c9f2d62e3ad9 2023-10-06T04:42:31.361 INFO:teuthology.orchestra.run.smithi017.stdout:last_changed 2023-10-06T04:42:31.360009+0000 2023-10-06T04:42:31.361 INFO:teuthology.orchestra.run.smithi017.stdout:created 2023-10-06T04:42:31.360009+0000 2023-10-06T04:42:31.361 INFO:teuthology.orchestra.run.smithi017.stdout:min_mon_release 15 (octopus) 2023-10-06T04:42:31.361 INFO:teuthology.orchestra.run.smithi017.stdout:election_strategy: 1 2023-10-06T04:42:31.361 INFO:teuthology.orchestra.run.smithi017.stdout:0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2023-10-06T04:42:31.361 INFO:teuthology.orchestra.run.smithi017.stdout:1: [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon.b 2023-10-06T04:42:31.361 INFO:teuthology.orchestra.run.smithi017.stdout:2: [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] mon.c 2023-10-06T04:42:31.361 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-06T04:42:31.363 DEBUG:teuthology.orchestra.run.smithi017:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T04:42:31.417 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 780777c4-2b25-4d35-9058-c9f2d62e3ad9... 2023-10-06T04:42:31.419 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T04:42:31.460 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T04:42:31.501 INFO:teuthology.orchestra.run.smithi017.stdout:[global] 2023-10-06T04:42:31.501 INFO:teuthology.orchestra.run.smithi017.stdout: chdir = "" 2023-10-06T04:42:31.501 INFO:teuthology.orchestra.run.smithi017.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T04:42:31.501 INFO:teuthology.orchestra.run.smithi017.stdout: auth supported = cephx 2023-10-06T04:42:31.502 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:42:31.502 INFO:teuthology.orchestra.run.smithi017.stdout: filestore xattr use omap = true 2023-10-06T04:42:31.502 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:42:31.502 INFO:teuthology.orchestra.run.smithi017.stdout: mon clock drift allowed = 1.000 2023-10-06T04:42:31.502 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:42:31.502 INFO:teuthology.orchestra.run.smithi017.stdout: osd crush chooseleaf type = 0 2023-10-06T04:42:31.502 INFO:teuthology.orchestra.run.smithi017.stdout: auth debug = true 2023-10-06T04:42:31.502 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:42:31.502 INFO:teuthology.orchestra.run.smithi017.stdout: ms die on old message = true 2023-10-06T04:42:31.502 INFO:teuthology.orchestra.run.smithi017.stdout: ms die on bug = true 2023-10-06T04:42:31.502 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:42:31.502 INFO:teuthology.orchestra.run.smithi017.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T04:42:31.503 INFO:teuthology.orchestra.run.smithi017.stdout: mon pg warn max object skew = 0 2023-10-06T04:42:31.503 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:42:31.503 INFO:teuthology.orchestra.run.smithi017.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T04:42:31.503 INFO:teuthology.orchestra.run.smithi017.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T04:42:31.503 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:42:31.503 INFO:teuthology.orchestra.run.smithi017.stdout: osd pool default size = 2 2023-10-06T04:42:31.503 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:42:31.503 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd allow primary affinity = true 2023-10-06T04:42:31.503 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd allow pg remap = true 2023-10-06T04:42:31.503 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on legacy crush tunables = false 2023-10-06T04:42:31.503 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on crush straw calc version zero = false 2023-10-06T04:42:31.503 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on no sortbitwise = false 2023-10-06T04:42:31.504 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on osd down out interval zero = false 2023-10-06T04:42:31.504 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on too few osds = false 2023-10-06T04:42:31.504 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T04:42:31.504 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T04:42:31.504 INFO:teuthology.orchestra.run.smithi017.stdout: mon_allow_pool_size_one = true 2023-10-06T04:42:31.504 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:42:31.504 INFO:teuthology.orchestra.run.smithi017.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T04:42:31.504 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:42:31.504 INFO:teuthology.orchestra.run.smithi017.stdout: osd default data pool replay window = 5 2023-10-06T04:42:31.504 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:42:31.504 INFO:teuthology.orchestra.run.smithi017.stdout: mon allow pool delete = true 2023-10-06T04:42:31.504 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:42:31.505 INFO:teuthology.orchestra.run.smithi017.stdout: mon cluster log file level = debug 2023-10-06T04:42:31.505 INFO:teuthology.orchestra.run.smithi017.stdout: debug asserts on shutdown = true 2023-10-06T04:42:31.505 INFO:teuthology.orchestra.run.smithi017.stdout: mon health detail to clog = false 2023-10-06T04:42:31.505 INFO:teuthology.orchestra.run.smithi017.stdout: mon host = "172.21.15.17,172.21.15.136,[v2:172.21.15.136:3301,v1:172.21.15.136:6790]" 2023-10-06T04:42:31.505 INFO:teuthology.orchestra.run.smithi017.stdout: ms die on skipped message = False 2023-10-06T04:42:31.505 INFO:teuthology.orchestra.run.smithi017.stdout: fsid = 780777c4-2b25-4d35-9058-c9f2d62e3ad9 2023-10-06T04:42:31.505 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:42:31.505 INFO:teuthology.orchestra.run.smithi017.stdout:[osd] 2023-10-06T04:42:31.505 INFO:teuthology.orchestra.run.smithi017.stdout: osd journal size = 100 2023-10-06T04:42:31.506 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:42:31.506 INFO:teuthology.orchestra.run.smithi017.stdout: osd scrub load threshold = 5.0 2023-10-06T04:42:31.506 INFO:teuthology.orchestra.run.smithi017.stdout: osd scrub max interval = 600 2023-10-06T04:42:31.506 INFO:teuthology.orchestra.run.smithi017.stdout: osd mclock profile = high_recovery_ops 2023-10-06T04:42:31.506 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:42:31.506 INFO:teuthology.orchestra.run.smithi017.stdout: osd recover clone overlap = true 2023-10-06T04:42:31.506 INFO:teuthology.orchestra.run.smithi017.stdout: osd recovery max chunk = 1048576 2023-10-06T04:42:31.506 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:42:31.506 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug shutdown = true 2023-10-06T04:42:31.506 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug op order = true 2023-10-06T04:42:31.506 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug verify stray on activate = true 2023-10-06T04:42:31.506 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:42:31.507 INFO:teuthology.orchestra.run.smithi017.stdout: osd open classes on start = true 2023-10-06T04:42:31.507 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug pg log writeout = true 2023-10-06T04:42:31.507 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:42:31.507 INFO:teuthology.orchestra.run.smithi017.stdout: osd deep scrub update digest min age = 30 2023-10-06T04:42:31.507 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:42:31.507 INFO:teuthology.orchestra.run.smithi017.stdout: osd map max advance = 10 2023-10-06T04:42:31.507 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:42:31.507 INFO:teuthology.orchestra.run.smithi017.stdout: journal zero on create = true 2023-10-06T04:42:31.507 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:42:31.507 INFO:teuthology.orchestra.run.smithi017.stdout: filestore ondisk finisher threads = 3 2023-10-06T04:42:31.508 INFO:teuthology.orchestra.run.smithi017.stdout: filestore apply finisher threads = 3 2023-10-06T04:42:31.508 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:42:31.508 INFO:teuthology.orchestra.run.smithi017.stdout: bdev debug aio = true 2023-10-06T04:42:31.508 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug misdirected ops = true 2023-10-06T04:42:31.508 INFO:teuthology.orchestra.run.smithi017.stdout: bdev async discard = True 2023-10-06T04:42:31.508 INFO:teuthology.orchestra.run.smithi017.stdout: bdev enable discard = True 2023-10-06T04:42:31.508 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore allocator = bitmap 2023-10-06T04:42:31.508 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore block size = 96636764160 2023-10-06T04:42:31.508 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore fsck on mount = True 2023-10-06T04:42:31.508 INFO:teuthology.orchestra.run.smithi017.stdout: debug bluefs = 1/20 2023-10-06T04:42:31.508 INFO:teuthology.orchestra.run.smithi017.stdout: debug bluestore = 1/20 2023-10-06T04:42:31.508 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2023-10-06T04:42:31.509 INFO:teuthology.orchestra.run.smithi017.stdout: debug osd = 20 2023-10-06T04:42:31.509 INFO:teuthology.orchestra.run.smithi017.stdout: debug rocksdb = 4/10 2023-10-06T04:42:31.509 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T04:42:31.509 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd full ratio = 0.9 2023-10-06T04:42:31.509 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd nearfull ratio = 0.8 2023-10-06T04:42:31.509 INFO:teuthology.orchestra.run.smithi017.stdout: osd failsafe full ratio = 0.95 2023-10-06T04:42:31.509 INFO:teuthology.orchestra.run.smithi017.stdout: osd objectstore = bluestore 2023-10-06T04:42:31.509 INFO:teuthology.orchestra.run.smithi017.stdout: osd op complaint time = 180 2023-10-06T04:42:31.509 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:42:31.509 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr] 2023-10-06T04:42:31.509 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2023-10-06T04:42:31.509 INFO:teuthology.orchestra.run.smithi017.stdout: debug mgr = 20 2023-10-06T04:42:31.510 INFO:teuthology.orchestra.run.smithi017.stdout: debug mon = 20 2023-10-06T04:42:31.510 INFO:teuthology.orchestra.run.smithi017.stdout: debug auth = 20 2023-10-06T04:42:31.510 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min pgs per osd = 4 2023-10-06T04:42:31.510 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min bytes per osd = 10 2023-10-06T04:42:31.510 INFO:teuthology.orchestra.run.smithi017.stdout: mgr/telemetry/nag = false 2023-10-06T04:42:31.510 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:42:31.510 INFO:teuthology.orchestra.run.smithi017.stdout:[mon] 2023-10-06T04:42:31.510 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2023-10-06T04:42:31.510 INFO:teuthology.orchestra.run.smithi017.stdout: debug mon = 20 2023-10-06T04:42:31.510 INFO:teuthology.orchestra.run.smithi017.stdout: debug paxos = 20 2023-10-06T04:42:31.510 INFO:teuthology.orchestra.run.smithi017.stdout: debug auth = 20 2023-10-06T04:42:31.510 INFO:teuthology.orchestra.run.smithi017.stdout: mon data avail warn = 5 2023-10-06T04:42:31.511 INFO:teuthology.orchestra.run.smithi017.stdout: mon mgr mkfs grace = 240 2023-10-06T04:42:31.511 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min pgs per osd = 4 2023-10-06T04:42:31.511 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd reporter subtree level = osd 2023-10-06T04:42:31.511 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd prime pg temp = true 2023-10-06T04:42:31.511 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min bytes per osd = 10 2023-10-06T04:42:31.511 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:42:31.511 INFO:teuthology.orchestra.run.smithi017.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T04:42:31.511 INFO:teuthology.orchestra.run.smithi017.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T04:42:31.511 INFO:teuthology.orchestra.run.smithi017.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T04:42:31.511 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:42:31.511 INFO:teuthology.orchestra.run.smithi017.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T04:42:31.511 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T04:42:31.512 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T04:42:31.512 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:42:31.512 INFO:teuthology.orchestra.run.smithi017.stdout: # 1m isn't quite enough 2023-10-06T04:42:31.512 INFO:teuthology.orchestra.run.smithi017.stdout: mon_down_mkfs_grace = 2m 2023-10-06T04:42:31.512 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:42:31.512 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_filestore_osds = false 2023-10-06T04:42:31.512 INFO:teuthology.orchestra.run.smithi017.stdout: mon op complaint time = 120 2023-10-06T04:42:31.512 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:42:31.512 INFO:teuthology.orchestra.run.smithi017.stdout:[client] 2023-10-06T04:42:31.512 INFO:teuthology.orchestra.run.smithi017.stdout: rgw cache enabled = true 2023-10-06T04:42:31.512 INFO:teuthology.orchestra.run.smithi017.stdout: rgw enable ops log = true 2023-10-06T04:42:31.513 INFO:teuthology.orchestra.run.smithi017.stdout: rgw enable usage log = true 2023-10-06T04:42:31.513 INFO:teuthology.orchestra.run.smithi017.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T04:42:31.513 INFO:teuthology.orchestra.run.smithi017.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T04:42:31.513 INFO:teuthology.orchestra.run.smithi017.stdout: client mount timeout = 600 2023-10-06T04:42:31.513 INFO:teuthology.orchestra.run.smithi017.stdout: debug client = 20 2023-10-06T04:42:31.513 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2023-10-06T04:42:31.513 INFO:teuthology.orchestra.run.smithi017.stdout: pid file = "" 2023-10-06T04:42:31.513 INFO:teuthology.orchestra.run.smithi017.stdout: rados mon op timeout = 900 2023-10-06T04:42:31.513 INFO:teuthology.orchestra.run.smithi017.stdout: rados osd op timeout = 900 2023-10-06T04:42:31.513 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.a] 2023-10-06T04:42:31.513 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.b] 2023-10-06T04:42:31.513 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.c] 2023-10-06T04:42:31.513 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.a] 2023-10-06T04:42:31.514 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.c] 2023-10-06T04:42:31.514 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.b] 2023-10-06T04:42:31.514 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.d] 2023-10-06T04:42:31.514 INFO:teuthology.orchestra.run.smithi017.stdout:[mds] 2023-10-06T04:42:31.514 INFO:teuthology.orchestra.run.smithi017.stdout: debug mds = 20 2023-10-06T04:42:31.514 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2023-10-06T04:42:31.514 INFO:teuthology.orchestra.run.smithi017.stdout: mds debug frag = True 2023-10-06T04:42:31.514 INFO:teuthology.orchestra.run.smithi017.stdout: mds debug scatterstat = True 2023-10-06T04:42:31.514 INFO:teuthology.orchestra.run.smithi017.stdout: mds op complaint time = 180 2023-10-06T04:42:31.514 INFO:teuthology.orchestra.run.smithi017.stdout: mds verify scatter = True 2023-10-06T04:42:31.514 INFO:teuthology.orchestra.run.smithi017.stdout: osd op complaint time = 180 2023-10-06T04:42:31.514 INFO:teuthology.orchestra.run.smithi017.stdout: rados mon op timeout = 900 2023-10-06T04:42:31.514 INFO:teuthology.orchestra.run.smithi017.stdout: rados osd op timeout = 900 2023-10-06T04:42:31.516 INFO:teuthology.orchestra.run.smithi136.stdout:[global] 2023-10-06T04:42:31.516 INFO:teuthology.orchestra.run.smithi136.stdout: chdir = "" 2023-10-06T04:42:31.516 INFO:teuthology.orchestra.run.smithi136.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T04:42:31.516 INFO:teuthology.orchestra.run.smithi136.stdout: auth supported = cephx 2023-10-06T04:42:31.516 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-10-06T04:42:31.516 INFO:teuthology.orchestra.run.smithi136.stdout: filestore xattr use omap = true 2023-10-06T04:42:31.516 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-10-06T04:42:31.517 INFO:teuthology.orchestra.run.smithi136.stdout: mon clock drift allowed = 1.000 2023-10-06T04:42:31.517 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-10-06T04:42:31.517 INFO:teuthology.orchestra.run.smithi136.stdout: osd crush chooseleaf type = 0 2023-10-06T04:42:31.517 INFO:teuthology.orchestra.run.smithi136.stdout: auth debug = true 2023-10-06T04:42:31.517 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-10-06T04:42:31.517 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on old message = true 2023-10-06T04:42:31.517 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on bug = true 2023-10-06T04:42:31.517 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-10-06T04:42:31.517 INFO:teuthology.orchestra.run.smithi136.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T04:42:31.517 INFO:teuthology.orchestra.run.smithi136.stdout: mon pg warn max object skew = 0 2023-10-06T04:42:31.517 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-10-06T04:42:31.517 INFO:teuthology.orchestra.run.smithi136.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T04:42:31.518 INFO:teuthology.orchestra.run.smithi136.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T04:42:31.518 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-10-06T04:42:31.518 INFO:teuthology.orchestra.run.smithi136.stdout: osd pool default size = 2 2023-10-06T04:42:31.518 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-10-06T04:42:31.518 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd allow primary affinity = true 2023-10-06T04:42:31.518 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd allow pg remap = true 2023-10-06T04:42:31.518 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on legacy crush tunables = false 2023-10-06T04:42:31.518 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on crush straw calc version zero = false 2023-10-06T04:42:31.518 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on no sortbitwise = false 2023-10-06T04:42:31.518 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on osd down out interval zero = false 2023-10-06T04:42:31.518 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on too few osds = false 2023-10-06T04:42:31.518 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T04:42:31.518 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T04:42:31.519 INFO:teuthology.orchestra.run.smithi136.stdout: mon_allow_pool_size_one = true 2023-10-06T04:42:31.519 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-10-06T04:42:31.519 INFO:teuthology.orchestra.run.smithi136.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T04:42:31.519 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-10-06T04:42:31.519 INFO:teuthology.orchestra.run.smithi136.stdout: osd default data pool replay window = 5 2023-10-06T04:42:31.519 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-10-06T04:42:31.519 INFO:teuthology.orchestra.run.smithi136.stdout: mon allow pool delete = true 2023-10-06T04:42:31.519 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-10-06T04:42:31.519 INFO:teuthology.orchestra.run.smithi136.stdout: mon cluster log file level = debug 2023-10-06T04:42:31.519 INFO:teuthology.orchestra.run.smithi136.stdout: debug asserts on shutdown = true 2023-10-06T04:42:31.519 INFO:teuthology.orchestra.run.smithi136.stdout: mon health detail to clog = false 2023-10-06T04:42:31.519 INFO:teuthology.orchestra.run.smithi136.stdout: mon host = "172.21.15.17,172.21.15.136,[v2:172.21.15.136:3301,v1:172.21.15.136:6790]" 2023-10-06T04:42:31.519 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on skipped message = False 2023-10-06T04:42:31.520 INFO:teuthology.orchestra.run.smithi136.stdout: fsid = 780777c4-2b25-4d35-9058-c9f2d62e3ad9 2023-10-06T04:42:31.520 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-10-06T04:42:31.520 INFO:teuthology.orchestra.run.smithi136.stdout:[osd] 2023-10-06T04:42:31.520 INFO:teuthology.orchestra.run.smithi136.stdout: osd journal size = 100 2023-10-06T04:42:31.520 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-10-06T04:42:31.520 INFO:teuthology.orchestra.run.smithi136.stdout: osd scrub load threshold = 5.0 2023-10-06T04:42:31.520 INFO:teuthology.orchestra.run.smithi136.stdout: osd scrub max interval = 600 2023-10-06T04:42:31.520 INFO:teuthology.orchestra.run.smithi136.stdout: osd mclock profile = high_recovery_ops 2023-10-06T04:42:31.520 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-10-06T04:42:31.520 INFO:teuthology.orchestra.run.smithi136.stdout: osd recover clone overlap = true 2023-10-06T04:42:31.521 INFO:teuthology.orchestra.run.smithi136.stdout: osd recovery max chunk = 1048576 2023-10-06T04:42:31.521 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-10-06T04:42:31.521 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug shutdown = true 2023-10-06T04:42:31.521 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug op order = true 2023-10-06T04:42:31.521 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug verify stray on activate = true 2023-10-06T04:42:31.521 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-10-06T04:42:31.521 INFO:teuthology.orchestra.run.smithi136.stdout: osd open classes on start = true 2023-10-06T04:42:31.521 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug pg log writeout = true 2023-10-06T04:42:31.521 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-10-06T04:42:31.521 INFO:teuthology.orchestra.run.smithi136.stdout: osd deep scrub update digest min age = 30 2023-10-06T04:42:31.521 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-10-06T04:42:31.521 INFO:teuthology.orchestra.run.smithi136.stdout: osd map max advance = 10 2023-10-06T04:42:31.521 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-10-06T04:42:31.522 INFO:teuthology.orchestra.run.smithi136.stdout: journal zero on create = true 2023-10-06T04:42:31.522 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-10-06T04:42:31.522 INFO:teuthology.orchestra.run.smithi136.stdout: filestore ondisk finisher threads = 3 2023-10-06T04:42:31.522 INFO:teuthology.orchestra.run.smithi136.stdout: filestore apply finisher threads = 3 2023-10-06T04:42:31.522 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-10-06T04:42:31.522 INFO:teuthology.orchestra.run.smithi136.stdout: bdev debug aio = true 2023-10-06T04:42:31.522 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug misdirected ops = true 2023-10-06T04:42:31.522 INFO:teuthology.orchestra.run.smithi136.stdout: bdev async discard = True 2023-10-06T04:42:31.522 INFO:teuthology.orchestra.run.smithi136.stdout: bdev enable discard = True 2023-10-06T04:42:31.522 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore allocator = bitmap 2023-10-06T04:42:31.522 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore block size = 96636764160 2023-10-06T04:42:31.522 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore fsck on mount = True 2023-10-06T04:42:31.523 INFO:teuthology.orchestra.run.smithi136.stdout: debug bluefs = 1/20 2023-10-06T04:42:31.523 INFO:teuthology.orchestra.run.smithi136.stdout: debug bluestore = 1/20 2023-10-06T04:42:31.523 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2023-10-06T04:42:31.523 INFO:teuthology.orchestra.run.smithi136.stdout: debug osd = 20 2023-10-06T04:42:31.523 INFO:teuthology.orchestra.run.smithi136.stdout: debug rocksdb = 4/10 2023-10-06T04:42:31.523 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T04:42:31.523 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd full ratio = 0.9 2023-10-06T04:42:31.523 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd nearfull ratio = 0.8 2023-10-06T04:42:31.523 INFO:teuthology.orchestra.run.smithi136.stdout: osd failsafe full ratio = 0.95 2023-10-06T04:42:31.523 INFO:teuthology.orchestra.run.smithi136.stdout: osd objectstore = bluestore 2023-10-06T04:42:31.523 INFO:teuthology.orchestra.run.smithi136.stdout: osd op complaint time = 180 2023-10-06T04:42:31.523 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-10-06T04:42:31.523 INFO:teuthology.orchestra.run.smithi136.stdout:[mgr] 2023-10-06T04:42:31.524 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2023-10-06T04:42:31.524 INFO:teuthology.orchestra.run.smithi136.stdout: debug mgr = 20 2023-10-06T04:42:31.524 INFO:teuthology.orchestra.run.smithi136.stdout: debug mon = 20 2023-10-06T04:42:31.524 INFO:teuthology.orchestra.run.smithi136.stdout: debug auth = 20 2023-10-06T04:42:31.524 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min pgs per osd = 4 2023-10-06T04:42:31.524 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min bytes per osd = 10 2023-10-06T04:42:31.524 INFO:teuthology.orchestra.run.smithi136.stdout: mgr/telemetry/nag = false 2023-10-06T04:42:31.524 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-10-06T04:42:31.524 INFO:teuthology.orchestra.run.smithi136.stdout:[mon] 2023-10-06T04:42:31.524 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2023-10-06T04:42:31.524 INFO:teuthology.orchestra.run.smithi136.stdout: debug mon = 20 2023-10-06T04:42:31.524 INFO:teuthology.orchestra.run.smithi136.stdout: debug paxos = 20 2023-10-06T04:42:31.525 INFO:teuthology.orchestra.run.smithi136.stdout: debug auth = 20 2023-10-06T04:42:31.525 INFO:teuthology.orchestra.run.smithi136.stdout: mon data avail warn = 5 2023-10-06T04:42:31.525 INFO:teuthology.orchestra.run.smithi136.stdout: mon mgr mkfs grace = 240 2023-10-06T04:42:31.525 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min pgs per osd = 4 2023-10-06T04:42:31.525 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd reporter subtree level = osd 2023-10-06T04:42:31.525 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd prime pg temp = true 2023-10-06T04:42:31.525 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min bytes per osd = 10 2023-10-06T04:42:31.525 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-10-06T04:42:31.525 INFO:teuthology.orchestra.run.smithi136.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T04:42:31.525 INFO:teuthology.orchestra.run.smithi136.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T04:42:31.525 INFO:teuthology.orchestra.run.smithi136.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T04:42:31.525 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-10-06T04:42:31.526 INFO:teuthology.orchestra.run.smithi136.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T04:42:31.526 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T04:42:31.526 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T04:42:31.526 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-10-06T04:42:31.526 INFO:teuthology.orchestra.run.smithi136.stdout: # 1m isn't quite enough 2023-10-06T04:42:31.526 INFO:teuthology.orchestra.run.smithi136.stdout: mon_down_mkfs_grace = 2m 2023-10-06T04:42:31.526 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-10-06T04:42:31.526 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_filestore_osds = false 2023-10-06T04:42:31.526 INFO:teuthology.orchestra.run.smithi136.stdout: mon op complaint time = 120 2023-10-06T04:42:31.526 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-10-06T04:42:31.526 INFO:teuthology.orchestra.run.smithi136.stdout:[client] 2023-10-06T04:42:31.526 INFO:teuthology.orchestra.run.smithi136.stdout: rgw cache enabled = true 2023-10-06T04:42:31.527 INFO:teuthology.orchestra.run.smithi136.stdout: rgw enable ops log = true 2023-10-06T04:42:31.527 INFO:teuthology.orchestra.run.smithi136.stdout: rgw enable usage log = true 2023-10-06T04:42:31.527 INFO:teuthology.orchestra.run.smithi136.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T04:42:31.527 INFO:teuthology.orchestra.run.smithi136.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T04:42:31.527 INFO:teuthology.orchestra.run.smithi136.stdout: client mount timeout = 600 2023-10-06T04:42:31.527 INFO:teuthology.orchestra.run.smithi136.stdout: debug client = 20 2023-10-06T04:42:31.527 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2023-10-06T04:42:31.527 INFO:teuthology.orchestra.run.smithi136.stdout: pid file = "" 2023-10-06T04:42:31.527 INFO:teuthology.orchestra.run.smithi136.stdout: rados mon op timeout = 900 2023-10-06T04:42:31.527 INFO:teuthology.orchestra.run.smithi136.stdout: rados osd op timeout = 900 2023-10-06T04:42:31.527 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.a] 2023-10-06T04:42:31.527 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.b] 2023-10-06T04:42:31.527 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.c] 2023-10-06T04:42:31.528 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.a] 2023-10-06T04:42:31.528 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.c] 2023-10-06T04:42:31.528 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.b] 2023-10-06T04:42:31.528 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.d] 2023-10-06T04:42:31.528 INFO:teuthology.orchestra.run.smithi136.stdout:[mds] 2023-10-06T04:42:31.528 INFO:teuthology.orchestra.run.smithi136.stdout: debug mds = 20 2023-10-06T04:42:31.528 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2023-10-06T04:42:31.528 INFO:teuthology.orchestra.run.smithi136.stdout: mds debug frag = True 2023-10-06T04:42:31.528 INFO:teuthology.orchestra.run.smithi136.stdout: mds debug scatterstat = True 2023-10-06T04:42:31.528 INFO:teuthology.orchestra.run.smithi136.stdout: mds op complaint time = 180 2023-10-06T04:42:31.528 INFO:teuthology.orchestra.run.smithi136.stdout: mds verify scatter = True 2023-10-06T04:42:31.528 INFO:teuthology.orchestra.run.smithi136.stdout: osd op complaint time = 180 2023-10-06T04:42:31.529 INFO:teuthology.orchestra.run.smithi136.stdout: rados mon op timeout = 900 2023-10-06T04:42:31.529 INFO:teuthology.orchestra.run.smithi136.stdout: rados osd op timeout = 900 2023-10-06T04:42:31.529 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-06T04:42:31.529 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-06T04:42:31.608 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-06T04:42:31.609 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-06T04:42:31.609 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-06T04:42:31.624 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-06T04:42:31.624 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-06T04:42:31.679 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi017.front.sepia.ceph.com 2023-10-06T04:42:31.679 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-06T04:42:31.679 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T04:42:31.679 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T04:42:31.753 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-06T04:42:31.753 DEBUG:teuthology.orchestra.run.smithi017:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:42:31.808 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi136.front.sepia.ceph.com 2023-10-06T04:42:31.809 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-10-06T04:42:31.809 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T04:42:31.809 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T04:42:31.844 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-10-06T04:42:31.844 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:42:31.899 INFO:tasks.ceph:Setting up mon nodes... 2023-10-06T04:42:31.899 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-06T04:42:31.899 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T04:42:31.949 INFO:teuthology.orchestra.run.smithi017.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T04:42:31.951 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T04:42:32.005 INFO:teuthology.orchestra.run.smithi136.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T04:42:32.007 INFO:tasks.ceph:Setting up mds nodes... 2023-10-06T04:42:32.008 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T04:42:32.058 INFO:teuthology.orchestra.run.smithi017.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T04:42:32.060 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-06T04:42:32.084 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T04:42:32.173 INFO:teuthology.orchestra.run.smithi017.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T04:42:32.175 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-06T04:42:32.200 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T04:42:32.248 INFO:teuthology.orchestra.run.smithi136.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T04:42:32.250 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-06T04:42:32.274 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T04:42:32.361 INFO:teuthology.orchestra.run.smithi136.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T04:42:32.363 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-06T04:42:32.387 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-06T04:42:32.388 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-06T04:42:32.427 INFO:teuthology.orchestra.run.smithi017.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-06T04:42:32.439 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-06T04:42:32.518 INFO:teuthology.orchestra.run.smithi017.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-06T04:42:32.531 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-06T04:42:32.569 INFO:teuthology.orchestra.run.smithi136.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-06T04:42:32.582 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-06T04:42:32.659 INFO:teuthology.orchestra.run.smithi136.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-06T04:42:32.671 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-06T04:42:32.672 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi017.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi136.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T04:42:32.672 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-06T04:42:32.697 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T04:42:32.697 INFO:tasks.ceph:role: osd.0 2023-10-06T04:42:32.698 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi017.front.sepia.ceph.com 2023-10-06T04:42:32.698 DEBUG:teuthology.orchestra.run.smithi017:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T04:42:32.762 INFO:teuthology.orchestra.run.smithi017.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:42:32.763 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:42:32.763 INFO:teuthology.orchestra.run.smithi017.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:42:32.763 INFO:teuthology.orchestra.run.smithi017.stdout: = reflink=1 2023-10-06T04:42:32.763 INFO:teuthology.orchestra.run.smithi017.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:42:32.763 INFO:teuthology.orchestra.run.smithi017.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:42:32.763 INFO:teuthology.orchestra.run.smithi017.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:42:32.763 INFO:teuthology.orchestra.run.smithi017.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:42:32.763 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:42:32.763 INFO:teuthology.orchestra.run.smithi017.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:42:32.785 INFO:teuthology.orchestra.run.smithi017.stdout:Discarding blocks...Done. 2023-10-06T04:42:32.787 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi017.front.sepia.ceph.com -o noatime 2023-10-06T04:42:32.787 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-06T04:42:32.865 DEBUG:teuthology.orchestra.run.smithi017:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-06T04:42:32.934 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-06T04:42:33.000 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T04:42:33.008 INFO:tasks.ceph:role: osd.1 2023-10-06T04:42:33.008 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi017.front.sepia.ceph.com 2023-10-06T04:42:33.009 DEBUG:teuthology.orchestra.run.smithi017:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T04:42:33.065 INFO:teuthology.orchestra.run.smithi017.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:42:33.065 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:42:33.065 INFO:teuthology.orchestra.run.smithi017.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:42:33.065 INFO:teuthology.orchestra.run.smithi017.stdout: = reflink=1 2023-10-06T04:42:33.065 INFO:teuthology.orchestra.run.smithi017.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:42:33.065 INFO:teuthology.orchestra.run.smithi017.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:42:33.065 INFO:teuthology.orchestra.run.smithi017.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:42:33.066 INFO:teuthology.orchestra.run.smithi017.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:42:33.066 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:42:33.066 INFO:teuthology.orchestra.run.smithi017.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:42:33.087 INFO:teuthology.orchestra.run.smithi017.stdout:Discarding blocks...Done. 2023-10-06T04:42:33.089 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi017.front.sepia.ceph.com -o noatime 2023-10-06T04:42:33.089 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-06T04:42:33.167 DEBUG:teuthology.orchestra.run.smithi017:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-06T04:42:33.236 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-06T04:42:33.302 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T04:42:33.302 INFO:tasks.ceph:role: osd.2 2023-10-06T04:42:33.302 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi017.front.sepia.ceph.com 2023-10-06T04:42:33.302 DEBUG:teuthology.orchestra.run.smithi017:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T04:42:33.367 INFO:teuthology.orchestra.run.smithi017.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:42:33.367 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:42:33.367 INFO:teuthology.orchestra.run.smithi017.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:42:33.367 INFO:teuthology.orchestra.run.smithi017.stdout: = reflink=1 2023-10-06T04:42:33.367 INFO:teuthology.orchestra.run.smithi017.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:42:33.368 INFO:teuthology.orchestra.run.smithi017.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:42:33.368 INFO:teuthology.orchestra.run.smithi017.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:42:33.368 INFO:teuthology.orchestra.run.smithi017.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:42:33.368 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:42:33.368 INFO:teuthology.orchestra.run.smithi017.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:42:33.391 INFO:teuthology.orchestra.run.smithi017.stdout:Discarding blocks...Done. 2023-10-06T04:42:33.392 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi017.front.sepia.ceph.com -o noatime 2023-10-06T04:42:33.392 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-06T04:42:33.470 DEBUG:teuthology.orchestra.run.smithi017:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-06T04:42:33.539 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-06T04:42:33.605 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T04:42:33.605 INFO:tasks.ceph:role: osd.3 2023-10-06T04:42:33.605 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi017.front.sepia.ceph.com 2023-10-06T04:42:33.605 DEBUG:teuthology.orchestra.run.smithi017:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T04:42:33.670 INFO:teuthology.orchestra.run.smithi017.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:42:33.670 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:42:33.670 INFO:teuthology.orchestra.run.smithi017.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:42:33.670 INFO:teuthology.orchestra.run.smithi017.stdout: = reflink=1 2023-10-06T04:42:33.670 INFO:teuthology.orchestra.run.smithi017.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:42:33.670 INFO:teuthology.orchestra.run.smithi017.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:42:33.671 INFO:teuthology.orchestra.run.smithi017.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:42:33.671 INFO:teuthology.orchestra.run.smithi017.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:42:33.671 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:42:33.671 INFO:teuthology.orchestra.run.smithi017.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:42:33.693 INFO:teuthology.orchestra.run.smithi017.stdout:Discarding blocks...Done. 2023-10-06T04:42:33.695 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi017.front.sepia.ceph.com -o noatime 2023-10-06T04:42:33.695 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-06T04:42:33.773 DEBUG:teuthology.orchestra.run.smithi017:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-06T04:42:33.842 DEBUG:teuthology.orchestra.run.smithi017:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:42:33.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:42:33.927+0000 7fe7b4fc3540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-06T04:42:33.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:42:33.927+0000 7fe7b4fc3540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-06T04:42:33.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:42:33.927+0000 7fe7b4fc3540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T04:42:33.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:42:33.927+0000 7fe7b4fc3540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T04:42:33.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:42:33.927+0000 7fe7b4fc3540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T04:42:33.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:42:33.927+0000 7fe7b4fc3540 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-06T04:42:34.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:42:34.452+0000 7fe7b4fc3540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:42:35.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:42:35.213+0000 7fe7b4fc3540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:42:35.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:42:35.976+0000 7fe7b4fc3540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:42:36.774 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-06T04:42:36.804 DEBUG:teuthology.orchestra.run.smithi017:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:42:36.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:42:36.890+0000 7fbfc8b31540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-06T04:42:36.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:42:36.890+0000 7fbfc8b31540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-06T04:42:36.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:42:36.890+0000 7fbfc8b31540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T04:42:36.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:42:36.890+0000 7fbfc8b31540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T04:42:36.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:42:36.890+0000 7fbfc8b31540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T04:42:36.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:42:36.890+0000 7fbfc8b31540 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-06T04:42:37.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:42:37.417+0000 7fbfc8b31540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:42:38.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:42:38.179+0000 7fbfc8b31540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:42:38.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:42:38.942+0000 7fbfc8b31540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:42:39.741 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-06T04:42:39.772 DEBUG:teuthology.orchestra.run.smithi017:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:42:39.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:42:39.858+0000 7fe4fe544540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-06T04:42:39.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:42:39.858+0000 7fe4fe544540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-06T04:42:39.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:42:39.858+0000 7fe4fe544540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T04:42:39.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:42:39.858+0000 7fe4fe544540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T04:42:39.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:42:39.858+0000 7fe4fe544540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T04:42:39.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:42:39.858+0000 7fe4fe544540 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-06T04:42:40.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:42:40.382+0000 7fe4fe544540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:42:41.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:42:41.143+0000 7fe4fe544540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:42:41.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:42:41.905+0000 7fe4fe544540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:42:42.705 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-06T04:42:42.735 DEBUG:teuthology.orchestra.run.smithi017:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:42:42.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:42:42.820+0000 7f95a8f8b540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-06T04:42:42.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:42:42.821+0000 7f95a8f8b540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-06T04:42:42.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:42:42.821+0000 7f95a8f8b540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T04:42:42.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:42:42.821+0000 7f95a8f8b540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T04:42:42.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:42:42.821+0000 7f95a8f8b540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T04:42:42.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:42:42.821+0000 7f95a8f8b540 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-06T04:42:43.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:42:43.348+0000 7f95a8f8b540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:42:44.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:42:44.110+0000 7f95a8f8b540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:42:44.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:42:44.873+0000 7f95a8f8b540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:42:45.675 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-06T04:42:45.703 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-06T04:42:45.730 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T04:42:45.731 INFO:tasks.ceph:role: osd.4 2023-10-06T04:42:45.731 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi136.front.sepia.ceph.com 2023-10-06T04:42:45.731 DEBUG:teuthology.orchestra.run.smithi136:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T04:42:45.804 INFO:teuthology.orchestra.run.smithi136.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:42:45.804 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:42:45.804 INFO:teuthology.orchestra.run.smithi136.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:42:45.804 INFO:teuthology.orchestra.run.smithi136.stdout: = reflink=1 2023-10-06T04:42:45.805 INFO:teuthology.orchestra.run.smithi136.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:42:45.805 INFO:teuthology.orchestra.run.smithi136.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:42:45.805 INFO:teuthology.orchestra.run.smithi136.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:42:45.805 INFO:teuthology.orchestra.run.smithi136.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:42:45.805 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:42:45.805 INFO:teuthology.orchestra.run.smithi136.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:42:46.289 INFO:teuthology.orchestra.run.smithi136.stdout:Discarding blocks...Done. 2023-10-06T04:42:46.291 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi136.front.sepia.ceph.com -o noatime 2023-10-06T04:42:46.291 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-06T04:42:46.427 DEBUG:teuthology.orchestra.run.smithi136:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-06T04:42:46.458 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-06T04:42:46.525 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T04:42:46.525 INFO:tasks.ceph:role: osd.5 2023-10-06T04:42:46.525 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi136.front.sepia.ceph.com 2023-10-06T04:42:46.525 DEBUG:teuthology.orchestra.run.smithi136:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T04:42:46.598 INFO:teuthology.orchestra.run.smithi136.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:42:46.598 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:42:46.598 INFO:teuthology.orchestra.run.smithi136.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:42:46.598 INFO:teuthology.orchestra.run.smithi136.stdout: = reflink=1 2023-10-06T04:42:46.598 INFO:teuthology.orchestra.run.smithi136.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:42:46.599 INFO:teuthology.orchestra.run.smithi136.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:42:46.599 INFO:teuthology.orchestra.run.smithi136.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:42:46.599 INFO:teuthology.orchestra.run.smithi136.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:42:46.599 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:42:46.599 INFO:teuthology.orchestra.run.smithi136.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:42:47.062 INFO:teuthology.orchestra.run.smithi136.stdout:Discarding blocks...Done. 2023-10-06T04:42:47.064 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi136.front.sepia.ceph.com -o noatime 2023-10-06T04:42:47.064 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-06T04:42:47.181 DEBUG:teuthology.orchestra.run.smithi136:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-06T04:42:47.212 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-06T04:42:47.277 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T04:42:47.277 INFO:tasks.ceph:role: osd.6 2023-10-06T04:42:47.278 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi136.front.sepia.ceph.com 2023-10-06T04:42:47.278 DEBUG:teuthology.orchestra.run.smithi136:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T04:42:47.349 INFO:teuthology.orchestra.run.smithi136.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:42:47.350 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:42:47.350 INFO:teuthology.orchestra.run.smithi136.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:42:47.350 INFO:teuthology.orchestra.run.smithi136.stdout: = reflink=1 2023-10-06T04:42:47.350 INFO:teuthology.orchestra.run.smithi136.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:42:47.350 INFO:teuthology.orchestra.run.smithi136.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:42:47.350 INFO:teuthology.orchestra.run.smithi136.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:42:47.350 INFO:teuthology.orchestra.run.smithi136.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:42:47.350 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:42:47.350 INFO:teuthology.orchestra.run.smithi136.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:42:47.823 INFO:teuthology.orchestra.run.smithi136.stdout:Discarding blocks...Done. 2023-10-06T04:42:47.825 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi136.front.sepia.ceph.com -o noatime 2023-10-06T04:42:47.825 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-06T04:42:47.954 DEBUG:teuthology.orchestra.run.smithi136:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-06T04:42:47.983 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-06T04:42:48.048 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T04:42:48.048 INFO:tasks.ceph:role: osd.7 2023-10-06T04:42:48.048 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi136.front.sepia.ceph.com 2023-10-06T04:42:48.049 DEBUG:teuthology.orchestra.run.smithi136:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T04:42:48.120 INFO:teuthology.orchestra.run.smithi136.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:42:48.120 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:42:48.120 INFO:teuthology.orchestra.run.smithi136.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:42:48.121 INFO:teuthology.orchestra.run.smithi136.stdout: = reflink=1 2023-10-06T04:42:48.121 INFO:teuthology.orchestra.run.smithi136.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:42:48.121 INFO:teuthology.orchestra.run.smithi136.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:42:48.121 INFO:teuthology.orchestra.run.smithi136.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:42:48.121 INFO:teuthology.orchestra.run.smithi136.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:42:48.121 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:42:48.121 INFO:teuthology.orchestra.run.smithi136.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:42:48.605 INFO:teuthology.orchestra.run.smithi136.stdout:Discarding blocks...Done. 2023-10-06T04:42:48.607 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi136.front.sepia.ceph.com -o noatime 2023-10-06T04:42:48.607 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-06T04:42:48.757 DEBUG:teuthology.orchestra.run.smithi136:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-06T04:42:48.799 DEBUG:teuthology.orchestra.run.smithi136:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:42:48.937 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:42:48.935+0000 7f68502d6540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-06T04:42:48.940 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:42:48.938+0000 7f68502d6540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-06T04:42:48.941 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:42:48.938+0000 7f68502d6540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T04:42:48.941 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:42:48.938+0000 7f68502d6540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T04:42:48.941 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:42:48.938+0000 7f68502d6540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T04:42:48.941 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:42:48.939+0000 7f68502d6540 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-06T04:42:49.473 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:42:49.470+0000 7f68502d6540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:42:50.232 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:42:50.230+0000 7f68502d6540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:42:50.992 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:42:50.990+0000 7f68502d6540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:42:51.798 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-06T04:42:51.826 DEBUG:teuthology.orchestra.run.smithi136:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:42:51.911 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:42:51.909+0000 7ff709d27540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-06T04:42:51.912 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:42:51.909+0000 7ff709d27540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-06T04:42:51.912 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:42:51.909+0000 7ff709d27540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T04:42:51.912 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:42:51.909+0000 7ff709d27540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T04:42:51.912 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:42:51.909+0000 7ff709d27540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T04:42:51.912 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:42:51.910+0000 7ff709d27540 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-06T04:42:52.436 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:42:52.434+0000 7ff709d27540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:42:53.203 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:42:53.201+0000 7ff709d27540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:42:53.966 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:42:53.964+0000 7ff709d27540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:42:54.762 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-06T04:42:54.833 DEBUG:teuthology.orchestra.run.smithi136:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:42:54.949 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:42:54.947+0000 7f636667b540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-06T04:42:55.365 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:42:54.947+0000 7f636667b540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-06T04:42:55.365 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:42:54.947+0000 7f636667b540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T04:42:55.365 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:42:54.947+0000 7f636667b540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T04:42:55.365 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:42:54.947+0000 7f636667b540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T04:42:55.366 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:42:54.948+0000 7f636667b540 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-06T04:42:55.475 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:42:55.473+0000 7f636667b540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:42:56.235 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:42:56.233+0000 7f636667b540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:42:56.998 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:42:56.996+0000 7f636667b540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:42:57.788 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-06T04:42:57.815 DEBUG:teuthology.orchestra.run.smithi136:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:42:57.899 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:42:57.897+0000 7fb1f620a540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-06T04:42:57.899 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:42:57.897+0000 7fb1f620a540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-06T04:42:57.899 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:42:57.897+0000 7fb1f620a540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T04:42:57.900 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:42:57.897+0000 7fb1f620a540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T04:42:57.900 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:42:57.897+0000 7fb1f620a540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T04:42:57.900 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:42:57.898+0000 7fb1f620a540 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-06T04:42:58.425 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:42:58.423+0000 7fb1f620a540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:42:59.192 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:42:59.190+0000 7fb1f620a540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:42:59.499 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:42:59.502 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:42:59.955 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:42:59.953+0000 7fb1f620a540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:43:00.749 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-06T04:43:00.777 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-06T04:43:00.778 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-06T04:43:00.778 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-06T04:43:00.806 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-06T04:43:00.806 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-06T04:43:00.874 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-06T04:43:00.874 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-06T04:43:00.942 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-06T04:43:00.942 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-06T04:43:01.008 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-06T04:43:01.008 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-06T04:43:01.075 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-06T04:43:01.075 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-06T04:43:01.141 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-06T04:43:01.141 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-06T04:43:01.207 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-10-06T04:43:01.207 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-06T04:43:01.236 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-10-06T04:43:01.236 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-06T04:43:01.304 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-10-06T04:43:01.304 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-06T04:43:01.370 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-10-06T04:43:01.370 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-06T04:43:01.435 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-10-06T04:43:01.435 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-06T04:43:01.501 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-10-06T04:43:01.501 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-06T04:43:01.566 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-10-06T04:43:01.566 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-06T04:43:01.634 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-06T04:43:01.634 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-06T04:43:01.650 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-06T04:43:01.651 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-06T04:43:01.707 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-10-06T04:43:01.707 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-06T04:43:01.722 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-10-06T04:43:01.723 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-06T04:43:01.778 INFO:tasks.ceph:Adding keys to all mons... 2023-10-06T04:43:01.778 DEBUG:teuthology.orchestra.run.smithi017:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T04:43:01.780 DEBUG:teuthology.orchestra.run.smithi136:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T04:43:01.821 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr.y] 2023-10-06T04:43:01.821 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQA3kB9lXh2IOBAAvZDAmroP+EMMG3zXibVlUA== 2023-10-06T04:43:01.821 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.a] 2023-10-06T04:43:01.821 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQA4kB9lXdBsAxAA6fRUIR5ynZ+F2vjAKKVsGw== 2023-10-06T04:43:01.821 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.c] 2023-10-06T04:43:01.821 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQA4kB9lRMxQChAAAnrAIAcduaTBhlOc1iaGiw== 2023-10-06T04:43:01.822 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.0] 2023-10-06T04:43:01.822 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQA5kB9l6mtfNxAAETCAvqNWgLY8r5ydHqOzuA== 2023-10-06T04:43:01.822 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.1] 2023-10-06T04:43:01.822 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQA8kB9loWweNRAA2nU24vbVpIm7YI8YI9hIVg== 2023-10-06T04:43:01.822 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.2] 2023-10-06T04:43:01.822 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQA/kB9lRZI3MxAAKtPseh6IGMkGVesI2zOqkQ== 2023-10-06T04:43:01.822 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.3] 2023-10-06T04:43:01.822 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQBCkB9lCV76MBAAOjvQKfTBcT9kvcyJfXfcDg== 2023-10-06T04:43:01.822 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr.x] 2023-10-06T04:43:01.822 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQA4kB9lk5dJABAAdT9AgRCuNlJi0aXnxm563A== 2023-10-06T04:43:01.822 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.b] 2023-10-06T04:43:01.822 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQA4kB9lvsXCDhAArUD6ZmTH/PP8IPww5dyovg== 2023-10-06T04:43:01.823 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.d] 2023-10-06T04:43:01.823 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQA4kB9lPXqDFRAAoVkfsuGu0iWkL4H9o+c1sg== 2023-10-06T04:43:01.823 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.4] 2023-10-06T04:43:01.823 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQBIkB9lsazVNxAAGgACdFU9gIcv45/rtI/kIA== 2023-10-06T04:43:01.823 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.5] 2023-10-06T04:43:01.823 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQBLkB9l3zZHNhAAXdfolGZBT6tFi6vh609Y4A== 2023-10-06T04:43:01.823 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.6] 2023-10-06T04:43:01.823 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQBOkB9lCGGMOBAAGUQkyBgDH3Y0rDZCWLfj9A== 2023-10-06T04:43:01.823 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.7] 2023-10-06T04:43:01.823 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQBRkB9lkkCONRAAy3tQd1ontqlc+QNIahIfBg== 2023-10-06T04:43:01.823 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2023-10-06T04:43:01.823 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQA4kB9l079oGRAAmUjlIyaaMC2sImYSH/lXiw== 2023-10-06T04:43:01.824 INFO:teuthology.orchestra.run.smithi017.stdout:[client.2] 2023-10-06T04:43:01.824 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQA4kB9lVbzkHhAAYDQUlio3teu6amuS+9SFVg== 2023-10-06T04:43:01.824 INFO:teuthology.orchestra.run.smithi017.stdout:[client.1] 2023-10-06T04:43:01.824 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQA4kB9l8l7nIRAAMHeRz1/B4IPM9wmogZ3/GA== 2023-10-06T04:43:01.824 INFO:teuthology.orchestra.run.smithi017.stdout:[client.3] 2023-10-06T04:43:01.824 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQA4kB9lo1tFJxAANkgw2CGuDFlaf76loqaD+Q== 2023-10-06T04:43:01.841 INFO:teuthology.orchestra.run.smithi136.stdout:[mgr.y] 2023-10-06T04:43:01.841 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQA3kB9lXh2IOBAAvZDAmroP+EMMG3zXibVlUA== 2023-10-06T04:43:01.841 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.a] 2023-10-06T04:43:01.841 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQA4kB9lXdBsAxAA6fRUIR5ynZ+F2vjAKKVsGw== 2023-10-06T04:43:01.841 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.c] 2023-10-06T04:43:01.841 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQA4kB9lRMxQChAAAnrAIAcduaTBhlOc1iaGiw== 2023-10-06T04:43:01.842 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.0] 2023-10-06T04:43:01.842 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQA5kB9l6mtfNxAAETCAvqNWgLY8r5ydHqOzuA== 2023-10-06T04:43:01.842 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.1] 2023-10-06T04:43:01.842 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQA8kB9loWweNRAA2nU24vbVpIm7YI8YI9hIVg== 2023-10-06T04:43:01.842 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.2] 2023-10-06T04:43:01.842 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQA/kB9lRZI3MxAAKtPseh6IGMkGVesI2zOqkQ== 2023-10-06T04:43:01.842 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.3] 2023-10-06T04:43:01.842 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQBCkB9lCV76MBAAOjvQKfTBcT9kvcyJfXfcDg== 2023-10-06T04:43:01.842 INFO:teuthology.orchestra.run.smithi136.stdout:[mgr.x] 2023-10-06T04:43:01.842 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQA4kB9lk5dJABAAdT9AgRCuNlJi0aXnxm563A== 2023-10-06T04:43:01.842 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.b] 2023-10-06T04:43:01.842 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQA4kB9lvsXCDhAArUD6ZmTH/PP8IPww5dyovg== 2023-10-06T04:43:01.842 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.d] 2023-10-06T04:43:01.843 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQA4kB9lPXqDFRAAoVkfsuGu0iWkL4H9o+c1sg== 2023-10-06T04:43:01.843 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.4] 2023-10-06T04:43:01.843 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQBIkB9lsazVNxAAGgACdFU9gIcv45/rtI/kIA== 2023-10-06T04:43:01.843 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.5] 2023-10-06T04:43:01.843 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQBLkB9l3zZHNhAAXdfolGZBT6tFi6vh609Y4A== 2023-10-06T04:43:01.843 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.6] 2023-10-06T04:43:01.843 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQBOkB9lCGGMOBAAGUQkyBgDH3Y0rDZCWLfj9A== 2023-10-06T04:43:01.843 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.7] 2023-10-06T04:43:01.843 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQBRkB9lkkCONRAAy3tQd1ontqlc+QNIahIfBg== 2023-10-06T04:43:01.843 INFO:teuthology.orchestra.run.smithi136.stdout:[client.0] 2023-10-06T04:43:01.843 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQA4kB9l079oGRAAmUjlIyaaMC2sImYSH/lXiw== 2023-10-06T04:43:01.843 INFO:teuthology.orchestra.run.smithi136.stdout:[client.2] 2023-10-06T04:43:01.844 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQA4kB9lVbzkHhAAYDQUlio3teu6amuS+9SFVg== 2023-10-06T04:43:01.844 INFO:teuthology.orchestra.run.smithi136.stdout:[client.1] 2023-10-06T04:43:01.844 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQA4kB9l8l7nIRAAMHeRz1/B4IPM9wmogZ3/GA== 2023-10-06T04:43:01.844 INFO:teuthology.orchestra.run.smithi136.stdout:[client.3] 2023-10-06T04:43:01.844 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQA4kB9lo1tFJxAANkgw2CGuDFlaf76loqaD+Q== 2023-10-06T04:43:01.845 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T04:43:01.868 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T04:43:01.931 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:43:01.934 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:43:01.984 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:43:01.986 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:43:02.036 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:43:02.038 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:43:02.085 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:43:02.088 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:43:02.135 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:43:02.137 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:43:02.184 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:43:02.186 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:43:02.232 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T04:43:02.235 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T04:43:02.282 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:43:02.284 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:43:02.334 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:43:02.336 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:43:02.386 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:43:02.395 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:43:02.442 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:43:03.515 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:43:03.567 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:43:03.569 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:43:03.618 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:43:03.620 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:43:03.668 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:43:04.000 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:43:04.051 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:43:04.178 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:43:04.229 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:43:04.331 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:43:04.382 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:43:04.385 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:43:04.435 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-06T04:43:04.435 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-06T04:43:04.460 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T04:43:04.553 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-06T04:43:04.837 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-06T04:43:04.862 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T04:43:04.955 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-06T04:43:04.979 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-06T04:43:05.043 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T04:43:05.135 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-06T04:43:05.159 DEBUG:teuthology.orchestra.run.smithi017:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:43:05.162 DEBUG:teuthology.orchestra.run.smithi136:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:43:05.214 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-06T04:43:05.215 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-06T04:43:05.215 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-06T04:43:05.217 INFO:tasks.ceph.mon.a:Started 2023-10-06T04:43:05.217 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-06T04:43:05.217 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-06T04:43:05.257 INFO:tasks.ceph.mon.b:Started 2023-10-06T04:43:05.257 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-06T04:43:05.258 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-06T04:43:05.259 INFO:tasks.ceph.mon.c:Started 2023-10-06T04:43:05.259 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-06T04:43:05.260 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-06T04:43:05.260 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-06T04:43:05.262 INFO:tasks.ceph.mgr.y:Started 2023-10-06T04:43:05.262 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-06T04:43:05.262 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-06T04:43:05.264 INFO:tasks.ceph.mgr.x:Started 2023-10-06T04:43:05.264 INFO:tasks.ceph:Setting crush tunables to default 2023-10-06T04:43:05.265 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph osd crush tunables default 2023-10-06T04:43:05.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.383+0000 7f37aded5700 1 Processor -- start 2023-10-06T04:43:05.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.383+0000 7f37aded5700 1 -- start start 2023-10-06T04:43:05.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.384+0000 7f37aded5700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f37a80cabf0 0x7f37a80c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:05.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.384+0000 7f37aded5700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f37a8159b10 0x7f37a806f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:05.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.384+0000 7f37aded5700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37a806d140 0x7f37a806f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:05.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.384+0000 7f37aded5700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37a80d1120 con 0x7f37a80cabf0 2023-10-06T04:43:05.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.384+0000 7f37aded5700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37a80d1400 con 0x7f37a8159b10 2023-10-06T04:43:05.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.384+0000 7f37aded5700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a806e920 con 0x7f37a806d140 2023-10-06T04:43:05.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.384+0000 7f37a77fe700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f37a80cabf0 0x7f37a80c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:05.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.384+0000 7f37a77fe700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f37a80cabf0 0x7f37a80c7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53754/0 (socket says 172.21.15.17:53754) 2023-10-06T04:43:05.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.384+0000 7f37a77fe700 1 -- 172.21.15.17:0/723016673 learned_addr learned my addr 172.21.15.17:0/723016673 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:05.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.384+0000 7f37a6ffd700 1 --2- 172.21.15.17:0/723016673 >> v2:172.21.15.136:3300/0 conn(0x7f37a8159b10 0x7f37a806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:05.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.384+0000 7f37a77fe700 1 -- 172.21.15.17:0/723016673 >> v2:172.21.15.17:3300/0 conn(0x7f37a80cabf0 msgr2=0x7f37a80c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T04:43:05.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.384+0000 7f37a77fe700 1 -- 172.21.15.17:0/723016673 >> v2:172.21.15.17:3300/0 conn(0x7f37a80cabf0 msgr2=0x7f37a80c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T04:43:05.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.384+0000 7f37a77fe700 1 --2- 172.21.15.17:0/723016673 >> v2:172.21.15.17:3300/0 conn(0x7f37a80cabf0 0x7f37a80c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T04:43:05.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.384+0000 7f37a7fff700 1 --2- 172.21.15.17:0/723016673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37a806d140 0x7f37a806f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:05.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.384+0000 7f37a77fe700 1 --2- 172.21.15.17:0/723016673 >> v2:172.21.15.17:3300/0 conn(0x7f37a80cabf0 0x7f37a80c7660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T04:43:05.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.384+0000 7f37a6ffd700 1 -- 172.21.15.17:0/723016673 >> v2:172.21.15.136:3300/0 conn(0x7f37a8159b10 msgr2=0x7f37a806f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-06T04:43:05.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.384+0000 7f37a6ffd700 1 -- 172.21.15.17:0/723016673 >> v2:172.21.15.136:3300/0 conn(0x7f37a8159b10 msgr2=0x7f37a806f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T04:43:05.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.384+0000 7f37a6ffd700 1 --2- 172.21.15.17:0/723016673 >> v2:172.21.15.136:3300/0 conn(0x7f37a8159b10 0x7f37a806f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T04:43:05.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.384+0000 7f37a6ffd700 1 --2- 172.21.15.17:0/723016673 >> v2:172.21.15.136:3300/0 conn(0x7f37a8159b10 0x7f37a806f120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T04:43:05.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.384+0000 7f37a7fff700 1 -- 172.21.15.17:0/723016673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37a806d140 msgr2=0x7f37a806f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-06T04:43:05.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.384+0000 7f37a7fff700 1 -- 172.21.15.17:0/723016673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37a806d140 msgr2=0x7f37a806f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T04:43:05.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.384+0000 7f37a7fff700 1 --2- 172.21.15.17:0/723016673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37a806d140 0x7f37a806f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T04:43:05.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.384+0000 7f37a7fff700 1 --2- 172.21.15.17:0/723016673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37a806d140 0x7f37a806f660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T04:43:05.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.585+0000 7f37a77fe700 1 --2- 172.21.15.17:0/723016673 >> v2:172.21.15.17:3300/0 conn(0x7f37a80cabf0 0x7f37a80c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:05.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.585+0000 7f37a77fe700 1 -- 172.21.15.17:0/723016673 >> v2:172.21.15.17:3300/0 conn(0x7f37a80cabf0 msgr2=0x7f37a80c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T04:43:05.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.585+0000 7f37a77fe700 1 -- 172.21.15.17:0/723016673 >> v2:172.21.15.17:3300/0 conn(0x7f37a80cabf0 msgr2=0x7f37a80c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T04:43:05.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.585+0000 7f37a77fe700 1 --2- 172.21.15.17:0/723016673 >> v2:172.21.15.17:3300/0 conn(0x7f37a80cabf0 0x7f37a80c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T04:43:05.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.585+0000 7f37a77fe700 1 --2- 172.21.15.17:0/723016673 >> v2:172.21.15.17:3300/0 conn(0x7f37a80cabf0 0x7f37a80c7660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-06T04:43:05.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.585+0000 7f37a6ffd700 1 --2- 172.21.15.17:0/723016673 >> v2:172.21.15.136:3300/0 conn(0x7f37a8159b10 0x7f37a806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:05.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.585+0000 7f37a7fff700 1 --2- 172.21.15.17:0/723016673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37a806d140 0x7f37a806f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:05.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.585+0000 7f37a6ffd700 1 -- 172.21.15.17:0/723016673 >> v2:172.21.15.136:3300/0 conn(0x7f37a8159b10 msgr2=0x7f37a806f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-06T04:43:05.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.585+0000 7f37a7fff700 1 -- 172.21.15.17:0/723016673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37a806d140 msgr2=0x7f37a806f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-06T04:43:05.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.585+0000 7f37a6ffd700 1 -- 172.21.15.17:0/723016673 >> v2:172.21.15.136:3300/0 conn(0x7f37a8159b10 msgr2=0x7f37a806f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T04:43:05.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.585+0000 7f37a7fff700 1 -- 172.21.15.17:0/723016673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37a806d140 msgr2=0x7f37a806f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T04:43:05.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.585+0000 7f37a6ffd700 1 --2- 172.21.15.17:0/723016673 >> v2:172.21.15.136:3300/0 conn(0x7f37a8159b10 0x7f37a806f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T04:43:05.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.585+0000 7f37a7fff700 1 --2- 172.21.15.17:0/723016673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37a806d140 0x7f37a806f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T04:43:05.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.585+0000 7f37a6ffd700 1 --2- 172.21.15.17:0/723016673 >> v2:172.21.15.136:3300/0 conn(0x7f37a8159b10 0x7f37a806f120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-06T04:43:05.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.585+0000 7f37a7fff700 1 --2- 172.21.15.17:0/723016673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37a806d140 0x7f37a806f660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-06T04:43:05.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.986+0000 7f37a77fe700 1 --2- 172.21.15.17:0/723016673 >> v2:172.21.15.17:3300/0 conn(0x7f37a80cabf0 0x7f37a80c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:05.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.986+0000 7f37a77fe700 1 -- 172.21.15.17:0/723016673 >> v2:172.21.15.17:3300/0 conn(0x7f37a80cabf0 msgr2=0x7f37a80c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T04:43:05.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.986+0000 7f37a77fe700 1 -- 172.21.15.17:0/723016673 >> v2:172.21.15.17:3300/0 conn(0x7f37a80cabf0 msgr2=0x7f37a80c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T04:43:05.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.986+0000 7f37a77fe700 1 --2- 172.21.15.17:0/723016673 >> v2:172.21.15.17:3300/0 conn(0x7f37a80cabf0 0x7f37a80c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T04:43:05.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.986+0000 7f37a77fe700 1 --2- 172.21.15.17:0/723016673 >> v2:172.21.15.17:3300/0 conn(0x7f37a80cabf0 0x7f37a80c7660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-06T04:43:05.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.986+0000 7f37a6ffd700 1 --2- 172.21.15.17:0/723016673 >> v2:172.21.15.136:3300/0 conn(0x7f37a8159b10 0x7f37a806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:05.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.986+0000 7f37a7fff700 1 --2- 172.21.15.17:0/723016673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37a806d140 0x7f37a806f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:05.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.986+0000 7f37a6ffd700 1 -- 172.21.15.17:0/723016673 >> v2:172.21.15.136:3300/0 conn(0x7f37a8159b10 msgr2=0x7f37a806f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-06T04:43:05.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.986+0000 7f37a6ffd700 1 -- 172.21.15.17:0/723016673 >> v2:172.21.15.136:3300/0 conn(0x7f37a8159b10 msgr2=0x7f37a806f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T04:43:05.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.986+0000 7f37a6ffd700 1 --2- 172.21.15.17:0/723016673 >> v2:172.21.15.136:3300/0 conn(0x7f37a8159b10 0x7f37a806f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T04:43:05.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.986+0000 7f37a6ffd700 1 --2- 172.21.15.17:0/723016673 >> v2:172.21.15.136:3300/0 conn(0x7f37a8159b10 0x7f37a806f120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-06T04:43:05.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.986+0000 7f37a7fff700 1 -- 172.21.15.17:0/723016673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37a806d140 msgr2=0x7f37a806f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-06T04:43:05.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.986+0000 7f37a7fff700 1 -- 172.21.15.17:0/723016673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37a806d140 msgr2=0x7f37a806f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T04:43:05.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.986+0000 7f37a7fff700 1 --2- 172.21.15.17:0/723016673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37a806d140 0x7f37a806f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T04:43:05.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:05.986+0000 7f37a7fff700 1 --2- 172.21.15.17:0/723016673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37a806d140 0x7f37a806f660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-06T04:43:06.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:06.787+0000 7f37a77fe700 1 --2- 172.21.15.17:0/723016673 >> v2:172.21.15.17:3300/0 conn(0x7f37a80cabf0 0x7f37a80c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:06.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:06.787+0000 7f37a77fe700 1 -- 172.21.15.17:0/723016673 >> v2:172.21.15.17:3300/0 conn(0x7f37a80cabf0 msgr2=0x7f37a80c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T04:43:06.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:06.787+0000 7f37a77fe700 1 -- 172.21.15.17:0/723016673 >> v2:172.21.15.17:3300/0 conn(0x7f37a80cabf0 msgr2=0x7f37a80c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T04:43:06.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:06.787+0000 7f37a77fe700 1 --2- 172.21.15.17:0/723016673 >> v2:172.21.15.17:3300/0 conn(0x7f37a80cabf0 0x7f37a80c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T04:43:06.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:06.787+0000 7f37a77fe700 1 --2- 172.21.15.17:0/723016673 >> v2:172.21.15.17:3300/0 conn(0x7f37a80cabf0 0x7f37a80c7660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-06T04:43:06.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:06.787+0000 7f37a6ffd700 1 --2- 172.21.15.17:0/723016673 >> v2:172.21.15.136:3300/0 conn(0x7f37a8159b10 0x7f37a806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:06.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:06.787+0000 7f37a7fff700 1 --2- 172.21.15.17:0/723016673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37a806d140 0x7f37a806f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:06.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:06.787+0000 7f37a6ffd700 1 -- 172.21.15.17:0/723016673 >> v2:172.21.15.136:3300/0 conn(0x7f37a8159b10 msgr2=0x7f37a806f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-06T04:43:06.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:06.787+0000 7f37a6ffd700 1 -- 172.21.15.17:0/723016673 >> v2:172.21.15.136:3300/0 conn(0x7f37a8159b10 msgr2=0x7f37a806f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T04:43:06.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:06.787+0000 7f37a6ffd700 1 --2- 172.21.15.17:0/723016673 >> v2:172.21.15.136:3300/0 conn(0x7f37a8159b10 0x7f37a806f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T04:43:06.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:06.787+0000 7f37a6ffd700 1 --2- 172.21.15.17:0/723016673 >> v2:172.21.15.136:3300/0 conn(0x7f37a8159b10 0x7f37a806f120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-06T04:43:06.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:06.787+0000 7f37a7fff700 1 -- 172.21.15.17:0/723016673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37a806d140 msgr2=0x7f37a806f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-06T04:43:06.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:06.787+0000 7f37a7fff700 1 -- 172.21.15.17:0/723016673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37a806d140 msgr2=0x7f37a806f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T04:43:06.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:06.787+0000 7f37a7fff700 1 --2- 172.21.15.17:0/723016673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37a806d140 0x7f37a806f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T04:43:06.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:06.787+0000 7f37a7fff700 1 --2- 172.21.15.17:0/723016673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37a806d140 0x7f37a806f660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-06T04:43:08.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:08.384+0000 7f37a57fa700 1 -- 172.21.15.17:0/723016673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37a806d140 msgr2=0x7f37a806f660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T04:43:08.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:08.384+0000 7f37a57fa700 1 --2- 172.21.15.17:0/723016673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37a806d140 0x7f37a806f660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:08.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:08.384+0000 7f37a57fa700 1 -- 172.21.15.17:0/723016673 >> v2:172.21.15.136:3300/0 conn(0x7f37a8159b10 msgr2=0x7f37a806f120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T04:43:08.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:08.384+0000 7f37a57fa700 1 --2- 172.21.15.17:0/723016673 >> v2:172.21.15.136:3300/0 conn(0x7f37a8159b10 0x7f37a806f120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:08.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:08.384+0000 7f37a57fa700 1 -- 172.21.15.17:0/723016673 >> v2:172.21.15.17:3300/0 conn(0x7f37a80cabf0 msgr2=0x7f37a80c7660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T04:43:08.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:08.384+0000 7f37a57fa700 1 --2- 172.21.15.17:0/723016673 >> v2:172.21.15.17:3300/0 conn(0x7f37a80cabf0 0x7f37a80c7660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:08.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:08.384+0000 7f37a57fa700 1 -- 172.21.15.17:0/723016673 --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37a806ec00 con 0x7f3790007340 2023-10-06T04:43:08.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:08.384+0000 7f37a57fa700 1 -- 172.21.15.17:0/723016673 --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f379000c0b0 con 0x7f37900036c0 2023-10-06T04:43:10.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.600+0000 7f37a67fc700 1 -- 172.21.15.17:0/723016673 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 424655243 0 0) 0x7f37a806ec00 con 0x7f3790007340 2023-10-06T04:43:10.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.600+0000 7f37a67fc700 1 -- 172.21.15.17:0/723016673 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3794003570 con 0x7f3790007340 2023-10-06T04:43:10.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.600+0000 7f37a67fc700 1 -- 172.21.15.17:0/723016673 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2043167178 0 0) 0x7f379000c0b0 con 0x7f37900036c0 2023-10-06T04:43:10.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.600+0000 7f37a67fc700 1 -- 172.21.15.17:0/723016673 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37a806ec00 con 0x7f37900036c0 2023-10-06T04:43:10.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.601+0000 7f37a67fc700 1 -- 172.21.15.17:0/723016673 <== mon.1 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2717207623 0 0) 0x7f37a806ec00 con 0x7f37900036c0 2023-10-06T04:43:10.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.601+0000 7f37a67fc700 1 -- 172.21.15.17:0/723016673 >> v1:172.21.15.17:6789/0 conn(0x7f3790007340 legacy=0x7f37900097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:10.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.601+0000 7f37a67fc700 1 -- 172.21.15.17:0/723016673 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f379000d2b0 con 0x7f37900036c0 2023-10-06T04:43:10.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.601+0000 7f37a67fc700 1 -- 172.21.15.17:0/723016673 <== mon.1 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4268781140 0 0) 0x7f379800c340 con 0x7f37900036c0 2023-10-06T04:43:10.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.601+0000 7f37a67fc700 1 -- 172.21.15.17:0/723016673 >> v1:172.21.15.136:6789/0 conn(0x7f37900036c0 legacy=0x7f3790005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:10.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.601+0000 7f37a67fc700 1 --2- 172.21.15.17:0/723016673 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3794003c90 0x7f3794004060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:10.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.601+0000 7f37a67fc700 1 --2- 172.21.15.17:0/723016673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37a806d140 0x7f3794004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:10.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.601+0000 7f37a7fff700 1 -- 172.21.15.17:0/723016673 reap_dead start 2023-10-06T04:43:10.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.601+0000 7f37a67fc700 1 --2- 172.21.15.17:0/723016673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3794004f50 0x7f379400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:10.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.601+0000 7f37a67fc700 1 -- 172.21.15.17:0/723016673 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379400bfa0 con 0x7f3794004f50 2023-10-06T04:43:10.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.601+0000 7f37a67fc700 1 -- 172.21.15.17:0/723016673 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379400c0e0 con 0x7f3794003c90 2023-10-06T04:43:10.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.601+0000 7f37a67fc700 1 -- 172.21.15.17:0/723016673 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f379400c220 con 0x7f37a806d140 2023-10-06T04:43:10.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.601+0000 7f37a77fe700 1 --2- 172.21.15.17:0/723016673 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3794003c90 0x7f3794004060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:10.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.601+0000 7f37a6ffd700 1 --2- 172.21.15.17:0/723016673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37a806d140 0x7f3794004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:10.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.601+0000 7f37a7fff700 1 --2- 172.21.15.17:0/723016673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3794004f50 0x7f379400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:10.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.601+0000 7f37a77fe700 1 -- 172.21.15.17:0/723016673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37a806d140 msgr2=0x7f3794004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:10.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.601+0000 7f37a77fe700 1 --2- 172.21.15.17:0/723016673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37a806d140 0x7f3794004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:10.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.601+0000 7f37a77fe700 1 -- 172.21.15.17:0/723016673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3794004f50 msgr2=0x7f379400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:10.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.601+0000 7f37a77fe700 1 --2- 172.21.15.17:0/723016673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3794004f50 0x7f379400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:10.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.601+0000 7f37a77fe700 1 -- 172.21.15.17:0/723016673 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a806ec00 con 0x7f3794003c90 2023-10-06T04:43:10.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.602+0000 7f37a77fe700 1 --2- 172.21.15.17:0/723016673 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3794003c90 0x7f3794004060 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f37980145a0 tx=0x7f3798008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e7716badf0ffc9c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:10.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.602+0000 7f37a67fc700 1 -- 172.21.15.17:0/723016673 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3798014dd0 con 0x7f3794003c90 2023-10-06T04:43:10.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.602+0000 7f37a67fc700 1 -- 172.21.15.17:0/723016673 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f379800c040 con 0x7f3794003c90 2023-10-06T04:43:10.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.602+0000 7f37a67fc700 1 -- 172.21.15.17:0/723016673 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3798017470 con 0x7f3794003c90 2023-10-06T04:43:10.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.603+0000 7f37aded5700 1 -- 172.21.15.17:0/723016673 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3794003c90 msgr2=0x7f3794004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:10.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.603+0000 7f37aded5700 1 --2- 172.21.15.17:0/723016673 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3794003c90 0x7f3794004060 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f37980145a0 tx=0x7f3798008040 comp rx=0 tx=0).stop 2023-10-06T04:43:10.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.603+0000 7f37aded5700 1 -- 172.21.15.17:0/723016673 shutdown_connections 2023-10-06T04:43:10.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.603+0000 7f37aded5700 1 --2- 172.21.15.17:0/723016673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3794004f50 0x7f379400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:10.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.603+0000 7f37aded5700 1 --2- 172.21.15.17:0/723016673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37a806d140 0x7f3794004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:10.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.603+0000 7f37aded5700 1 --2- 172.21.15.17:0/723016673 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3794003c90 0x7f3794004060 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:10.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.603+0000 7f37aded5700 1 -- 172.21.15.17:0/723016673 >> 172.21.15.17:0/723016673 conn(0x7f37a806cd40 msgr2=0x7f37a80d0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:10.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.603+0000 7f37aded5700 1 -- 172.21.15.17:0/723016673 shutdown_connections 2023-10-06T04:43:10.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.603+0000 7f37aded5700 1 -- 172.21.15.17:0/723016673 wait complete. 2023-10-06T04:43:10.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.605+0000 7f37aded5700 1 Processor -- start 2023-10-06T04:43:10.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.605+0000 7f37aded5700 1 -- start start 2023-10-06T04:43:10.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.606+0000 7f37aded5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3794003c90 0x7f37a8157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:10.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.606+0000 7f37aded5700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3794004f50 0x7f37a8159f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:10.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.606+0000 7f37aded5700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37a806d140 0x7f37a809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:10.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.606+0000 7f37aded5700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a815dd40 con 0x7f37a806d140 2023-10-06T04:43:10.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.606+0000 7f37aded5700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a809e350 con 0x7f3794003c90 2023-10-06T04:43:10.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.606+0000 7f37aded5700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a815d6f0 con 0x7f3794004f50 2023-10-06T04:43:10.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.606+0000 7f37a7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37a806d140 0x7f37a809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:10.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.606+0000 7f37a7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37a806d140 0x7f37a809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53842/0 (socket says 172.21.15.17:53842) 2023-10-06T04:43:10.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.606+0000 7f37a7fff700 1 -- 172.21.15.17:0/3432737062 learned_addr learned my addr 172.21.15.17:0/3432737062 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:10.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.606+0000 7f37a77fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3794003c90 0x7f37a8157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:10.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.606+0000 7f37a6ffd700 1 --2- 172.21.15.17:0/3432737062 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3794004f50 0x7f37a8159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:10.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.607+0000 7f37a7fff700 1 -- 172.21.15.17:0/3432737062 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3794004f50 msgr2=0x7f37a8159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:10.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.607+0000 7f37a7fff700 1 --2- 172.21.15.17:0/3432737062 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3794004f50 0x7f37a8159f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:10.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.607+0000 7f37a7fff700 1 -- 172.21.15.17:0/3432737062 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3794003c90 msgr2=0x7f37a8157140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:10.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.607+0000 7f37a7fff700 1 --2- 172.21.15.17:0/3432737062 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3794003c90 0x7f37a8157140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:10.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.607+0000 7f37a7fff700 1 -- 172.21.15.17:0/3432737062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a815d9d0 con 0x7f37a806d140 2023-10-06T04:43:10.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.607+0000 7f37a77fe700 1 --2- 172.21.15.17:0/3432737062 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3794003c90 0x7f37a8157140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:43:10.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.607+0000 7f37a7fff700 1 --2- 172.21.15.17:0/3432737062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37a806d140 0x7f37a809dac0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f37a806d540 tx=0x7f37a000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:10.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.607+0000 7f378f7fe700 1 -- 172.21.15.17:0/3432737062 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a0014d40 con 0x7f37a806d140 2023-10-06T04:43:10.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.607+0000 7f378f7fe700 1 -- 172.21.15.17:0/3432737062 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a000f040 con 0x7f37a806d140 2023-10-06T04:43:10.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.607+0000 7f37aded5700 1 -- 172.21.15.17:0/3432737062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37a8157680 con 0x7f37a806d140 2023-10-06T04:43:10.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.607+0000 7f37aded5700 1 -- 172.21.15.17:0/3432737062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a809e000 con 0x7f37a806d140 2023-10-06T04:43:10.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.608+0000 7f378f7fe700 1 -- 172.21.15.17:0/3432737062 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a0014ee0 con 0x7f37a806d140 2023-10-06T04:43:10.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.608+0000 7f378f7fe700 1 -- 172.21.15.17:0/3432737062 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f37a0003040 con 0x7f37a806d140 2023-10-06T04:43:10.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.608+0000 7f378f7fe700 1 -- 172.21.15.17:0/3432737062 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f37a0018810 con 0x7f37a806d140 2023-10-06T04:43:10.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.608+0000 7f37aded5700 1 -- 172.21.15.17:0/3432737062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37880052b0 con 0x7f37a806d140 2023-10-06T04:43:10.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.611+0000 7f378f7fe700 1 -- 172.21.15.17:0/3432737062 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f37a001c070 con 0x7f37a806d140 2023-10-06T04:43:10.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.689+0000 7f37aded5700 1 -- 172.21.15.17:0/3432737062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f3788005830 con 0x7f37a806d140 2023-10-06T04:43:10.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.692+0000 7f378f7fe700 1 -- 172.21.15.17:0/3432737062 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f37a0030090 con 0x7f37a806d140 2023-10-06T04:43:10.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.693+0000 7f37aded5700 1 -- 172.21.15.17:0/3432737062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37a806d140 msgr2=0x7f37a809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:10.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.693+0000 7f37aded5700 1 --2- 172.21.15.17:0/3432737062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37a806d140 0x7f37a809dac0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f37a806d540 tx=0x7f37a000b040 comp rx=0 tx=0).stop 2023-10-06T04:43:10.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.693+0000 7f37aded5700 1 -- 172.21.15.17:0/3432737062 shutdown_connections 2023-10-06T04:43:10.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.693+0000 7f37aded5700 1 --2- 172.21.15.17:0/3432737062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37a806d140 0x7f37a809dac0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:10.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.694+0000 7f37aded5700 1 --2- 172.21.15.17:0/3432737062 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3794003c90 0x7f37a8157140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:10.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.694+0000 7f37aded5700 1 --2- 172.21.15.17:0/3432737062 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3794004f50 0x7f37a8159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:10.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.694+0000 7f37aded5700 1 -- 172.21.15.17:0/3432737062 >> 172.21.15.17:0/3432737062 conn(0x7f37a806cd40 msgr2=0x7f37a80c7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:10.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.694+0000 7f37aded5700 1 -- 172.21.15.17:0/3432737062 shutdown_connections 2023-10-06T04:43:10.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:10.694+0000 7f37aded5700 1 -- 172.21.15.17:0/3432737062 wait complete. 2023-10-06T04:43:10.697 INFO:teuthology.orchestra.run.smithi017.stderr:adjusted tunables profile to default 2023-10-06T04:43:10.708 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-06T04:43:10.708 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-06T04:43:10.708 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-06T04:43:10.734 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-06T04:43:10.734 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-06T04:43:10.799 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-06T04:43:10.799 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-06T04:43:10.864 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-06T04:43:10.865 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-06T04:43:10.930 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-10-06T04:43:10.930 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-06T04:43:10.960 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-10-06T04:43:10.960 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-06T04:43:11.030 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-10-06T04:43:11.030 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-06T04:43:11.098 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2023-10-06T04:43:11.098 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-06T04:43:11.164 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd new 84737b08-575c-46dd-9488-073ae8504494 0 2023-10-06T04:43:11.323 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.318+0000 7fec3eb8c700 1 Processor -- start 2023-10-06T04:43:11.323 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.318+0000 7fec3eb8c700 1 -- start start 2023-10-06T04:43:11.323 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.319+0000 7fec3eb8c700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fec380b04c0 0x7fec381581e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:11.323 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.319+0000 7fec3eb8c700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec380cc3d0 con 0x7fec38158720 2023-10-06T04:43:11.323 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.319+0000 7fec3eb8c700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec380cd210 con 0x7fec38157e10 2023-10-06T04:43:11.323 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.319+0000 7fec3eb8c700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec380b1f30 con 0x7fec380b04c0 2023-10-06T04:43:11.323 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.319+0000 7fec3c928700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fec38157e10 0x7fec380b1820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:58104/0 (socket says 172.21.15.136:58104) 2023-10-06T04:43:11.323 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.319+0000 7fec3c928700 1 -- 172.21.15.136:0/700330603 learned_addr learned my addr 172.21.15.136:0/700330603 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-10-06T04:43:11.323 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.319+0000 7fec2ffff700 1 --2- 172.21.15.136:0/700330603 >> v2:172.21.15.17:3300/0 conn(0x7fec380b04c0 0x7fec381581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:11.324 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.320+0000 7fec2f7fe700 1 -- 172.21.15.136:0/700330603 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 45837942 0 0) 0x7fec380cd210 con 0x7fec38157e10 2023-10-06T04:43:11.324 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.320+0000 7fec2f7fe700 1 -- 172.21.15.136:0/700330603 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec20003570 con 0x7fec38157e10 2023-10-06T04:43:11.324 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.320+0000 7fec2f7fe700 1 -- 172.21.15.136:0/700330603 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2231472831 0 0) 0x7fec380cc3d0 con 0x7fec38158720 2023-10-06T04:43:11.324 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.320+0000 7fec2f7fe700 1 -- 172.21.15.136:0/700330603 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec380cd210 con 0x7fec38158720 2023-10-06T04:43:11.324 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.320+0000 7fec2ffff700 1 -- 172.21.15.136:0/700330603 >> v1:172.21.15.136:6789/0 conn(0x7fec38157e10 legacy=0x7fec380b1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:11.324 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.320+0000 7fec2f7fe700 1 -- 172.21.15.136:0/700330603 <== mon.1 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2087542577 0 0) 0x7fec20003570 con 0x7fec38157e10 2023-10-06T04:43:11.324 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.320+0000 7fec2ffff700 1 -- 172.21.15.136:0/700330603 >> v1:172.21.15.17:6789/0 conn(0x7fec38158720 legacy=0x7fec380b39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:11.324 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.320+0000 7fec2ffff700 1 -- 172.21.15.136:0/700330603 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec380cc600 con 0x7fec380b04c0 2023-10-06T04:43:11.324 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.320+0000 7fec2ffff700 1 --2- 172.21.15.136:0/700330603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec380b04c0 0x7fec381581e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fec28009860 tx=0x7fec280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a42b44299865a615 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:11.324 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.320+0000 7fec2f7fe700 1 -- 172.21.15.136:0/700330603 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec340017f0 con 0x7fec380b04c0 2023-10-06T04:43:11.325 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.320+0000 7fec2f7fe700 1 -- 172.21.15.136:0/700330603 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec28011420 con 0x7fec380b04c0 2023-10-06T04:43:11.325 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.320+0000 7fec2f7fe700 1 -- 172.21.15.136:0/700330603 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec280117c0 con 0x7fec380b04c0 2023-10-06T04:43:11.325 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.321+0000 7fec3eb8c700 1 -- 172.21.15.136:0/700330603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec380b04c0 msgr2=0x7fec381581e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:11.325 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.321+0000 7fec3eb8c700 1 --2- 172.21.15.136:0/700330603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec380b04c0 0x7fec381581e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fec28009860 tx=0x7fec280091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:11.325 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.321+0000 7fec3eb8c700 1 -- 172.21.15.136:0/700330603 shutdown_connections 2023-10-06T04:43:11.325 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.321+0000 7fec3eb8c700 1 --2- 172.21.15.136:0/700330603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec380b04c0 0x7fec381581e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:11.325 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.321+0000 7fec3eb8c700 1 -- 172.21.15.136:0/700330603 >> 172.21.15.136:0/700330603 conn(0x7fec3806c560 msgr2=0x7fec3806c960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:11.325 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.321+0000 7fec3eb8c700 1 -- 172.21.15.136:0/700330603 shutdown_connections 2023-10-06T04:43:11.325 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.321+0000 7fec3eb8c700 1 -- 172.21.15.136:0/700330603 wait complete. 2023-10-06T04:43:11.328 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.322+0000 7fec3eb8c700 1 Processor -- start 2023-10-06T04:43:11.328 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.322+0000 7fec3eb8c700 1 -- start start 2023-10-06T04:43:11.328 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.323+0000 7fec3eb8c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec380b04c0 0x7fec38151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:11.328 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.323+0000 7fec3eb8c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec38157e10 0x7fec380c3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:11.328 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.323+0000 7fec3eb8c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fec38158720 0x7fec380ce320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:11.328 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.323+0000 7fec3eb8c700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec38151c90 con 0x7fec380b04c0 2023-10-06T04:43:11.328 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.323+0000 7fec3eb8c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec380c4890 con 0x7fec38157e10 2023-10-06T04:43:11.328 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.323+0000 7fec3eb8c700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec380c3c80 con 0x7fec38158720 2023-10-06T04:43:11.328 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.323+0000 7fec2ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec38157e10 0x7fec380c3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:11.328 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.323+0000 7fec2ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec38157e10 0x7fec380c3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:49970/0 (socket says 172.21.15.136:49970) 2023-10-06T04:43:11.328 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.323+0000 7fec2ffff700 1 -- 172.21.15.136:0/1408837186 learned_addr learned my addr 172.21.15.136:0/1408837186 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-10-06T04:43:11.329 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.323+0000 7fec3d129700 1 --2- 172.21.15.136:0/1408837186 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fec38158720 0x7fec380ce320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:11.329 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.323+0000 7fec3c928700 1 --2- 172.21.15.136:0/1408837186 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec380b04c0 0x7fec38151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:11.329 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.323+0000 7fec2ffff700 1 -- 172.21.15.136:0/1408837186 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fec38158720 msgr2=0x7fec380ce320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:11.329 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.323+0000 7fec2ffff700 1 --2- 172.21.15.136:0/1408837186 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fec38158720 0x7fec380ce320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:11.329 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.323+0000 7fec2ffff700 1 -- 172.21.15.136:0/1408837186 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec380b04c0 msgr2=0x7fec38151750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:11.329 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.323+0000 7fec2ffff700 1 --2- 172.21.15.136:0/1408837186 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec380b04c0 0x7fec38151750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:11.329 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.323+0000 7fec2ffff700 1 -- 172.21.15.136:0/1408837186 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec28009420 con 0x7fec38157e10 2023-10-06T04:43:11.329 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.323+0000 7fec2ffff700 1 --2- 172.21.15.136:0/1408837186 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec38157e10 0x7fec380c3230 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fec3806b9c0 tx=0x7fec28016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:11.329 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.323+0000 7fec2cff9700 1 -- 172.21.15.136:0/1408837186 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2801cb30 con 0x7fec38157e10 2023-10-06T04:43:11.329 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.323+0000 7fec2cff9700 1 -- 172.21.15.136:0/1408837186 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec2801cc90 con 0x7fec38157e10 2023-10-06T04:43:11.329 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.323+0000 7fec2cff9700 1 -- 172.21.15.136:0/1408837186 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2801a6a0 con 0x7fec38157e10 2023-10-06T04:43:11.330 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.323+0000 7fec3eb8c700 1 -- 172.21.15.136:0/1408837186 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec380c3f60 con 0x7fec38157e10 2023-10-06T04:43:11.330 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.323+0000 7fec3eb8c700 1 -- 172.21.15.136:0/1408837186 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec380c4520 con 0x7fec38157e10 2023-10-06T04:43:11.330 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.323+0000 7fec2cff9700 1 -- 172.21.15.136:0/1408837186 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fec2801ac90 con 0x7fec38157e10 2023-10-06T04:43:11.330 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.323+0000 7fec2cff9700 1 -- 172.21.15.136:0/1408837186 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7fec2802eb30 con 0x7fec38157e10 2023-10-06T04:43:11.330 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.324+0000 7fec3eb8c700 1 -- 172.21.15.136:0/1408837186 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec3804c380 con 0x7fec38157e10 2023-10-06T04:43:11.330 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.326+0000 7fec2cff9700 1 -- 172.21.15.136:0/1408837186 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fec28029070 con 0x7fec38157e10 2023-10-06T04:43:11.412 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.410+0000 7fec3eb8c700 1 -- 172.21.15.136:0/1408837186 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd new", "uuid": "84737b08-575c-46dd-9488-073ae8504494", "id": 0} v 0) v1 -- 0x7fec38159d00 con 0x7fec38157e10 2023-10-06T04:43:11.415 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.413+0000 7fec2cff9700 1 -- 172.21.15.136:0/1408837186 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "84737b08-575c-46dd-9488-073ae8504494", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fec2801ce00 con 0x7fec38157e10 2023-10-06T04:43:11.415 INFO:teuthology.orchestra.run.smithi136.stdout:0 2023-10-06T04:43:11.416 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.414+0000 7fec3eb8c700 1 -- 172.21.15.136:0/1408837186 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec38157e10 msgr2=0x7fec380c3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:11.416 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.414+0000 7fec3eb8c700 1 --2- 172.21.15.136:0/1408837186 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec38157e10 0x7fec380c3230 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fec3806b9c0 tx=0x7fec28016000 comp rx=0 tx=0).stop 2023-10-06T04:43:11.416 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.414+0000 7fec3eb8c700 1 -- 172.21.15.136:0/1408837186 shutdown_connections 2023-10-06T04:43:11.416 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.414+0000 7fec3eb8c700 1 --2- 172.21.15.136:0/1408837186 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fec38158720 0x7fec380ce320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:11.417 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.414+0000 7fec3eb8c700 1 --2- 172.21.15.136:0/1408837186 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec380b04c0 0x7fec38151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:11.417 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.414+0000 7fec3eb8c700 1 --2- 172.21.15.136:0/1408837186 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec38157e10 0x7fec380c3230 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:11.417 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.414+0000 7fec3eb8c700 1 -- 172.21.15.136:0/1408837186 >> 172.21.15.136:0/1408837186 conn(0x7fec3806c560 msgr2=0x7fec380b2700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:11.417 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.414+0000 7fec3eb8c700 1 -- 172.21.15.136:0/1408837186 shutdown_connections 2023-10-06T04:43:11.417 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.414+0000 7fec3eb8c700 1 -- 172.21.15.136:0/1408837186 wait complete. 2023-10-06T04:43:11.428 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd new dffeb740-58a2-4fd6-8ff1-a0a11a2cc709 1 2023-10-06T04:43:11.544 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.541+0000 7f5d15e30700 1 Processor -- start 2023-10-06T04:43:11.544 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.542+0000 7f5d15e30700 1 -- start start 2023-10-06T04:43:11.547 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.543+0000 7f5d15e30700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5d100b0a60 0x7f5d1006a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:11.547 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.543+0000 7f5d15e30700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f5d1006a960 0x7f5d101557a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:11.547 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.543+0000 7f5d15e30700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d1006aea0 con 0x7f5d100b0e30 2023-10-06T04:43:11.547 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.543+0000 7f5d15e30700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d1006b180 con 0x7f5d1006a960 2023-10-06T04:43:11.547 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.543+0000 7f5d15e30700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1006b460 con 0x7f5d100b0a60 2023-10-06T04:43:11.547 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.543+0000 7f5d0ffff700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f5d100b0e30 0x7f5d10155ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:58122/0 (socket says 172.21.15.136:58122) 2023-10-06T04:43:11.547 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.543+0000 7f5d0ffff700 1 -- 172.21.15.136:0/3313701940 learned_addr learned my addr 172.21.15.136:0/3313701940 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-10-06T04:43:11.547 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.543+0000 7f5d0f7fe700 1 --2- 172.21.15.136:0/3313701940 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5d100b0a60 0x7f5d1006a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:11.547 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.543+0000 7f5d0effd700 1 --2- 172.21.15.136:0/3313701940 >> v2:172.21.15.17:3300/0 conn(0x7f5d1006a960 0x7f5d101557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:11.548 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.543+0000 7f5d0e7fc700 1 -- 172.21.15.136:0/3313701940 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2956555573 0 0) 0x7f5d1006aea0 con 0x7f5d100b0e30 2023-10-06T04:43:11.548 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.543+0000 7f5d0e7fc700 1 -- 172.21.15.136:0/3313701940 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cf8003570 con 0x7f5d100b0e30 2023-10-06T04:43:11.548 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.543+0000 7f5d0f7fe700 1 -- 172.21.15.136:0/3313701940 >> v2:172.21.15.17:3300/0 conn(0x7f5d1006a960 msgr2=0x7f5d101557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:11.548 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.543+0000 7f5d0f7fe700 1 --2- 172.21.15.136:0/3313701940 >> v2:172.21.15.17:3300/0 conn(0x7f5d1006a960 0x7f5d101557a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:11.548 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.543+0000 7f5d0f7fe700 1 -- 172.21.15.136:0/3313701940 >> v1:172.21.15.136:6789/0 conn(0x7f5d100b0e30 legacy=0x7f5d10155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:11.548 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.543+0000 7f5d0f7fe700 1 -- 172.21.15.136:0/3313701940 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d1006c700 con 0x7f5d100b0a60 2023-10-06T04:43:11.548 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.544+0000 7f5d0f7fe700 1 --2- 172.21.15.136:0/3313701940 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5d100b0a60 0x7f5d1006a420 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5d040098e0 tx=0x7f5d040091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1b39eb5e8261824 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:11.548 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.544+0000 7f5d0e7fc700 1 -- 172.21.15.136:0/3313701940 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d04011630 con 0x7f5d100b0a60 2023-10-06T04:43:11.548 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.544+0000 7f5d0e7fc700 1 -- 172.21.15.136:0/3313701940 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d04011790 con 0x7f5d100b0a60 2023-10-06T04:43:11.548 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.544+0000 7f5d0e7fc700 1 -- 172.21.15.136:0/3313701940 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d04011b30 con 0x7f5d100b0a60 2023-10-06T04:43:11.548 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.544+0000 7f5d15e30700 1 -- 172.21.15.136:0/3313701940 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5d100b0a60 msgr2=0x7f5d1006a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:11.548 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.544+0000 7f5d15e30700 1 --2- 172.21.15.136:0/3313701940 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5d100b0a60 0x7f5d1006a420 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5d040098e0 tx=0x7f5d040091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:11.549 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.545+0000 7f5d15e30700 1 -- 172.21.15.136:0/3313701940 shutdown_connections 2023-10-06T04:43:11.549 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.545+0000 7f5d15e30700 1 --2- 172.21.15.136:0/3313701940 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5d100b0a60 0x7f5d1006a420 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:11.549 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.545+0000 7f5d15e30700 1 --2- 172.21.15.136:0/3313701940 >> v2:172.21.15.17:3300/0 conn(0x7f5d1006a960 0x7f5d101557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:11.549 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.545+0000 7f5d15e30700 1 -- 172.21.15.136:0/3313701940 >> 172.21.15.136:0/3313701940 conn(0x7f5d1006f7b0 msgr2=0x7f5d100ae590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:11.549 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.545+0000 7f5d15e30700 1 -- 172.21.15.136:0/3313701940 shutdown_connections 2023-10-06T04:43:11.549 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.545+0000 7f5d15e30700 1 -- 172.21.15.136:0/3313701940 wait complete. 2023-10-06T04:43:11.551 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.546+0000 7f5d15e30700 1 Processor -- start 2023-10-06T04:43:11.551 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.546+0000 7f5d15e30700 1 -- start start 2023-10-06T04:43:11.552 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.547+0000 7f5d15e30700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5d1006a960 0x7f5d100cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:11.552 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.547+0000 7f5d15e30700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d100b0a60 0x7f5d100ab3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:11.552 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.547+0000 7f5d15e30700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d100b0e30 0x7f5d100ab920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:11.552 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.547+0000 7f5d15e30700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d100c3b20 con 0x7f5d100b0e30 2023-10-06T04:43:11.552 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.547+0000 7f5d15e30700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d100c31f0 con 0x7f5d100b0a60 2023-10-06T04:43:11.552 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.547+0000 7f5d15e30700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d100c34d0 con 0x7f5d1006a960 2023-10-06T04:43:11.552 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.547+0000 7f5d0effd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d100b0a60 0x7f5d100ab3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:11.552 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.547+0000 7f5d0f7fe700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5d1006a960 0x7f5d100cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:11.552 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.547+0000 7f5d0effd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d100b0a60 0x7f5d100ab3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:49990/0 (socket says 172.21.15.136:49990) 2023-10-06T04:43:11.552 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.547+0000 7f5d0f7fe700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5d1006a960 0x7f5d100cbc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.136:34352/0 (socket says 172.21.15.136:34352) 2023-10-06T04:43:11.553 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.547+0000 7f5d0effd700 1 -- 172.21.15.136:0/3265884587 learned_addr learned my addr 172.21.15.136:0/3265884587 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-10-06T04:43:11.553 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.547+0000 7f5d0ffff700 1 --2- 172.21.15.136:0/3265884587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d100b0e30 0x7f5d100ab920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:11.553 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.547+0000 7f5d0effd700 1 -- 172.21.15.136:0/3265884587 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5d1006a960 msgr2=0x7f5d100cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:11.553 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.547+0000 7f5d0effd700 1 --2- 172.21.15.136:0/3265884587 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5d1006a960 0x7f5d100cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:11.553 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.547+0000 7f5d0effd700 1 -- 172.21.15.136:0/3265884587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d100b0e30 msgr2=0x7f5d100ab920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:11.553 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.547+0000 7f5d0effd700 1 --2- 172.21.15.136:0/3265884587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d100b0e30 0x7f5d100ab920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:11.553 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.547+0000 7f5d0effd700 1 -- 172.21.15.136:0/3265884587 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d04009420 con 0x7f5d100b0a60 2023-10-06T04:43:11.553 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.547+0000 7f5d0effd700 1 --2- 172.21.15.136:0/3265884587 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d100b0a60 0x7f5d100ab3e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5d0000e9f0 tx=0x7f5d0000a330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:11.553 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.547+0000 7f5cf77fe700 1 -- 172.21.15.136:0/3265884587 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0000a7a0 con 0x7f5d100b0a60 2023-10-06T04:43:11.553 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.548+0000 7f5d15e30700 1 -- 172.21.15.136:0/3265884587 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d100c37b0 con 0x7f5d100b0a60 2023-10-06T04:43:11.553 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.548+0000 7f5cf77fe700 1 -- 172.21.15.136:0/3265884587 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d0000c770 con 0x7f5d100b0a60 2023-10-06T04:43:11.553 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.548+0000 7f5cf77fe700 1 -- 172.21.15.136:0/3265884587 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0000cb10 con 0x7f5d100b0a60 2023-10-06T04:43:11.554 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.548+0000 7f5d15e30700 1 -- 172.21.15.136:0/3265884587 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d100cc1b0 con 0x7f5d100b0a60 2023-10-06T04:43:11.554 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.548+0000 7f5cf77fe700 1 -- 172.21.15.136:0/3265884587 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f5d00005c80 con 0x7f5d100b0a60 2023-10-06T04:43:11.554 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.548+0000 7f5cf77fe700 1 -- 172.21.15.136:0/3265884587 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f5d00015030 con 0x7f5d100b0a60 2023-10-06T04:43:11.554 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.548+0000 7f5d15e30700 1 -- 172.21.15.136:0/3265884587 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d100c3c90 con 0x7f5d100b0a60 2023-10-06T04:43:11.554 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.551+0000 7f5cf77fe700 1 -- 172.21.15.136:0/3265884587 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f5d0001f060 con 0x7f5d100b0a60 2023-10-06T04:43:11.636 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.633+0000 7f5d15e30700 1 -- 172.21.15.136:0/3265884587 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd new", "uuid": "dffeb740-58a2-4fd6-8ff1-a0a11a2cc709", "id": 1} v 0) v1 -- 0x7f5d1004c380 con 0x7f5d100b0a60 2023-10-06T04:43:11.638 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.637+0000 7f5cf77fe700 1 -- 172.21.15.136:0/3265884587 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dffeb740-58a2-4fd6-8ff1-a0a11a2cc709", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5d00028020 con 0x7f5d100b0a60 2023-10-06T04:43:11.639 INFO:teuthology.orchestra.run.smithi136.stdout:1 2023-10-06T04:43:11.640 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.638+0000 7f5d15e30700 1 -- 172.21.15.136:0/3265884587 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d100b0a60 msgr2=0x7f5d100ab3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:11.640 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.638+0000 7f5d15e30700 1 --2- 172.21.15.136:0/3265884587 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d100b0a60 0x7f5d100ab3e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5d0000e9f0 tx=0x7f5d0000a330 comp rx=0 tx=0).stop 2023-10-06T04:43:11.640 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.638+0000 7f5d15e30700 1 -- 172.21.15.136:0/3265884587 shutdown_connections 2023-10-06T04:43:11.640 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.638+0000 7f5d15e30700 1 --2- 172.21.15.136:0/3265884587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d100b0e30 0x7f5d100ab920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:11.641 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.638+0000 7f5d15e30700 1 --2- 172.21.15.136:0/3265884587 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5d1006a960 0x7f5d100cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:11.641 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.638+0000 7f5d15e30700 1 --2- 172.21.15.136:0/3265884587 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d100b0a60 0x7f5d100ab3e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:11.641 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.638+0000 7f5d15e30700 1 -- 172.21.15.136:0/3265884587 >> 172.21.15.136:0/3265884587 conn(0x7f5d1006f7b0 msgr2=0x7f5d10157140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:11.641 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.638+0000 7f5d15e30700 1 -- 172.21.15.136:0/3265884587 shutdown_connections 2023-10-06T04:43:11.641 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.638+0000 7f5d15e30700 1 -- 172.21.15.136:0/3265884587 wait complete. 2023-10-06T04:43:11.652 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd new 48bd6831-763d-48c2-b515-e02c216d608b 2 2023-10-06T04:43:11.767 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.765+0000 7f2f9f272700 1 Processor -- start 2023-10-06T04:43:11.767 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.765+0000 7f2f9f272700 1 -- start start 2023-10-06T04:43:11.770 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.766+0000 7f2f9f272700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f980cabf0 0x7f2f980c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:11.770 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.766+0000 7f2f9f272700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2f98159b10 0x7f2f9806f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:11.770 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.766+0000 7f2f9f272700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2f9806d140 0x7f2f9806f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:11.770 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.766+0000 7f2f9f272700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f980d1120 con 0x7f2f98159b10 2023-10-06T04:43:11.770 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.766+0000 7f2f9f272700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f980d1400 con 0x7f2f9806d140 2023-10-06T04:43:11.770 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.766+0000 7f2f9f272700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9806e920 con 0x7f2f980cabf0 2023-10-06T04:43:11.771 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.766+0000 7f2f9d80f700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2f9806d140 0x7f2f9806f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:11.771 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.766+0000 7f2f9d00e700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f980cabf0 0x7f2f980c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:11.771 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.766+0000 7f2f9d80f700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2f9806d140 0x7f2f9806f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:49992/0 (socket says 172.21.15.136:49992) 2023-10-06T04:43:11.771 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.766+0000 7f2f9d00e700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f980cabf0 0x7f2f980c7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.136:34360/0 (socket says 172.21.15.136:34360) 2023-10-06T04:43:11.771 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.766+0000 7f2f9d80f700 1 -- 172.21.15.136:0/4017536224 learned_addr learned my addr 172.21.15.136:0/4017536224 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-10-06T04:43:11.771 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.766+0000 7f2f9c80d700 1 --2- 172.21.15.136:0/4017536224 >> v2:172.21.15.17:3300/0 conn(0x7f2f98159b10 0x7f2f9806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:11.771 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.766+0000 7f2f9d80f700 1 -- 172.21.15.136:0/4017536224 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f980cabf0 msgr2=0x7f2f980c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:11.771 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.766+0000 7f2f9d80f700 1 --2- 172.21.15.136:0/4017536224 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f980cabf0 0x7f2f980c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:11.772 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.766+0000 7f2f9d80f700 1 -- 172.21.15.136:0/4017536224 >> v2:172.21.15.17:3300/0 conn(0x7f2f98159b10 msgr2=0x7f2f9806f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:11.772 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.766+0000 7f2f9d80f700 1 --2- 172.21.15.136:0/4017536224 >> v2:172.21.15.17:3300/0 conn(0x7f2f98159b10 0x7f2f9806f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:11.772 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.766+0000 7f2f9d80f700 1 -- 172.21.15.136:0/4017536224 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9806ec00 con 0x7f2f9806d140 2023-10-06T04:43:11.772 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.767+0000 7f2f9d80f700 1 --2- 172.21.15.136:0/4017536224 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f9806d140 0x7f2f9806f660 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2f980d0620 tx=0x7f2f90009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=255b4d83050f1a7c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:11.772 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.767+0000 7f2f8ffff700 1 -- 172.21.15.136:0/4017536224 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9000e070 con 0x7f2f9806d140 2023-10-06T04:43:11.772 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.767+0000 7f2f8ffff700 1 -- 172.21.15.136:0/4017536224 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9000ba20 con 0x7f2f9806d140 2023-10-06T04:43:11.772 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.767+0000 7f2f8ffff700 1 -- 172.21.15.136:0/4017536224 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f900092e0 con 0x7f2f9806d140 2023-10-06T04:43:11.772 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.767+0000 7f2f9f272700 1 -- 172.21.15.136:0/4017536224 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f9806d140 msgr2=0x7f2f9806f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:11.773 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.767+0000 7f2f9f272700 1 --2- 172.21.15.136:0/4017536224 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f9806d140 0x7f2f9806f660 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2f980d0620 tx=0x7f2f90009840 comp rx=0 tx=0).stop 2023-10-06T04:43:11.773 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.767+0000 7f2f9f272700 1 -- 172.21.15.136:0/4017536224 shutdown_connections 2023-10-06T04:43:11.773 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.767+0000 7f2f9f272700 1 --2- 172.21.15.136:0/4017536224 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f9806d140 0x7f2f9806f660 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:11.773 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.767+0000 7f2f9f272700 1 --2- 172.21.15.136:0/4017536224 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f980cabf0 0x7f2f980c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:11.773 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.767+0000 7f2f9f272700 1 --2- 172.21.15.136:0/4017536224 >> v2:172.21.15.17:3300/0 conn(0x7f2f98159b10 0x7f2f9806f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:11.773 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.767+0000 7f2f9f272700 1 -- 172.21.15.136:0/4017536224 >> 172.21.15.136:0/4017536224 conn(0x7f2f9806cd40 msgr2=0x7f2f980d0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:11.773 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.767+0000 7f2f9f272700 1 -- 172.21.15.136:0/4017536224 shutdown_connections 2023-10-06T04:43:11.773 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.767+0000 7f2f9f272700 1 -- 172.21.15.136:0/4017536224 wait complete. 2023-10-06T04:43:11.776 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.768+0000 7f2f9f272700 1 Processor -- start 2023-10-06T04:43:11.776 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.769+0000 7f2f9f272700 1 -- start start 2023-10-06T04:43:11.776 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.769+0000 7f2f9f272700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f9806d140 0x7f2f9809dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:11.777 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.769+0000 7f2f9f272700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f980cabf0 0x7f2f98157af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:11.777 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.769+0000 7f2f9f272700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f98159b10 0x7f2f9809a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:11.777 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.769+0000 7f2f9f272700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9809e1a0 con 0x7f2f9806d140 2023-10-06T04:43:11.777 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.769+0000 7f2f9f272700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f980c6ba0 con 0x7f2f98159b10 2023-10-06T04:43:11.777 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.769+0000 7f2f9f272700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f980c5f90 con 0x7f2f980cabf0 2023-10-06T04:43:11.777 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.769+0000 7f2f9d80f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f98159b10 0x7f2f9809a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:11.777 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.769+0000 7f2f9c80d700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f980cabf0 0x7f2f98157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:11.777 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.770+0000 7f2f9d80f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f98159b10 0x7f2f9809a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:50002/0 (socket says 172.21.15.136:50002) 2023-10-06T04:43:11.777 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.770+0000 7f2f9c80d700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f980cabf0 0x7f2f98157af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.136:34374/0 (socket says 172.21.15.136:34374) 2023-10-06T04:43:11.777 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.770+0000 7f2f9d80f700 1 -- 172.21.15.136:0/1404623183 learned_addr learned my addr 172.21.15.136:0/1404623183 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-10-06T04:43:11.778 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.770+0000 7f2f9d00e700 1 --2- 172.21.15.136:0/1404623183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f9806d140 0x7f2f9809dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:11.778 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.770+0000 7f2f9d80f700 1 -- 172.21.15.136:0/1404623183 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f980cabf0 msgr2=0x7f2f98157af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:11.778 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.770+0000 7f2f9d80f700 1 --2- 172.21.15.136:0/1404623183 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f980cabf0 0x7f2f98157af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:11.778 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.770+0000 7f2f9d80f700 1 -- 172.21.15.136:0/1404623183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f9806d140 msgr2=0x7f2f9809dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:11.778 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.770+0000 7f2f9d80f700 1 --2- 172.21.15.136:0/1404623183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f9806d140 0x7f2f9809dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:11.778 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.770+0000 7f2f9d80f700 1 -- 172.21.15.136:0/1404623183 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f90009ae0 con 0x7f2f98159b10 2023-10-06T04:43:11.778 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.770+0000 7f2f9d80f700 1 --2- 172.21.15.136:0/1404623183 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f98159b10 0x7f2f9809a580 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2f90012000 tx=0x7f2f90018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:11.778 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.770+0000 7f2f8d7fa700 1 -- 172.21.15.136:0/1404623183 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f900032f0 con 0x7f2f98159b10 2023-10-06T04:43:11.779 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.770+0000 7f2f8d7fa700 1 -- 172.21.15.136:0/1404623183 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f90008e50 con 0x7f2f98159b10 2023-10-06T04:43:11.779 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.770+0000 7f2f8d7fa700 1 -- 172.21.15.136:0/1404623183 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f900266b0 con 0x7f2f98159b10 2023-10-06T04:43:11.779 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.770+0000 7f2f9f272700 1 -- 172.21.15.136:0/1404623183 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f980c6270 con 0x7f2f98159b10 2023-10-06T04:43:11.779 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.770+0000 7f2f9f272700 1 -- 172.21.15.136:0/1404623183 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f980c6830 con 0x7f2f98159b10 2023-10-06T04:43:11.779 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.770+0000 7f2f8d7fa700 1 -- 172.21.15.136:0/1404623183 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f2f90003040 con 0x7f2f98159b10 2023-10-06T04:43:11.779 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.770+0000 7f2f8d7fa700 1 -- 172.21.15.136:0/1404623183 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f2f9001d850 con 0x7f2f98159b10 2023-10-06T04:43:11.779 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.771+0000 7f2f9f272700 1 -- 172.21.15.136:0/1404623183 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f9804c380 con 0x7f2f98159b10 2023-10-06T04:43:11.779 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.773+0000 7f2f8d7fa700 1 -- 172.21.15.136:0/1404623183 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f2f9002b020 con 0x7f2f98159b10 2023-10-06T04:43:11.824 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-06T04:43:11.822+0000 7f1181156180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T04:43:11.857 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.855+0000 7f2f9f272700 1 -- 172.21.15.136:0/1404623183 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd new", "uuid": "48bd6831-763d-48c2-b515-e02c216d608b", "id": 2} v 0) v1 -- 0x7f2f980c6ce0 con 0x7f2f98159b10 2023-10-06T04:43:11.860 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.858+0000 7f2f8d7fa700 1 -- 172.21.15.136:0/1404623183 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "48bd6831-763d-48c2-b515-e02c216d608b", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2f90021070 con 0x7f2f98159b10 2023-10-06T04:43:11.860 INFO:teuthology.orchestra.run.smithi136.stdout:2 2023-10-06T04:43:11.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.859+0000 7f2f9f272700 1 -- 172.21.15.136:0/1404623183 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f98159b10 msgr2=0x7f2f9809a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:11.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.859+0000 7f2f9f272700 1 --2- 172.21.15.136:0/1404623183 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f98159b10 0x7f2f9809a580 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2f90012000 tx=0x7f2f90018000 comp rx=0 tx=0).stop 2023-10-06T04:43:11.861 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.859+0000 7f2f9f272700 1 -- 172.21.15.136:0/1404623183 shutdown_connections 2023-10-06T04:43:11.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.859+0000 7f2f9f272700 1 --2- 172.21.15.136:0/1404623183 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f98159b10 0x7f2f9809a580 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:11.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.859+0000 7f2f9f272700 1 --2- 172.21.15.136:0/1404623183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f9806d140 0x7f2f9809dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:11.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.859+0000 7f2f9f272700 1 --2- 172.21.15.136:0/1404623183 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f980cabf0 0x7f2f98157af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:11.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.859+0000 7f2f9f272700 1 -- 172.21.15.136:0/1404623183 >> 172.21.15.136:0/1404623183 conn(0x7f2f9806cd40 msgr2=0x7f2f980cfec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:11.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.859+0000 7f2f9f272700 1 -- 172.21.15.136:0/1404623183 shutdown_connections 2023-10-06T04:43:11.862 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.859+0000 7f2f9f272700 1 -- 172.21.15.136:0/1404623183 wait complete. 2023-10-06T04:43:11.873 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd new ae7dbb23-abe7-4bd3-a4df-6f5963d6804c 3 2023-10-06T04:43:11.962 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-06T04:43:11.960+0000 7f1181156180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T04:43:11.987 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.985+0000 7f77a35df700 1 Processor -- start 2023-10-06T04:43:11.987 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.985+0000 7f77a35df700 1 -- start start 2023-10-06T04:43:11.990 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.986+0000 7f77a35df700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f779c157e10 0x7f779c0b1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:11.990 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.986+0000 7f77a35df700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f779c0b39c0 0x7f779c0b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:11.990 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.986+0000 7f77a35df700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f779c0cc3d0 con 0x7f779c0b04c0 2023-10-06T04:43:11.990 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.986+0000 7f77a35df700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f779c0cd210 con 0x7f779c157e10 2023-10-06T04:43:11.990 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.986+0000 7f77a35df700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f779c0b4360 con 0x7f779c0b39c0 2023-10-06T04:43:11.990 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.986+0000 7f77a1b7c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f779c0b39c0 0x7f779c0b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:11.990 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.986+0000 7f77a0b7a700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f779c0b04c0 0x7f779c1581e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:58134/0 (socket says 172.21.15.136:58134) 2023-10-06T04:43:11.990 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.986+0000 7f77a0b7a700 1 -- 172.21.15.136:0/2285052507 learned_addr learned my addr 172.21.15.136:0/2285052507 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-10-06T04:43:11.991 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.987+0000 7f77a137b700 1 --2- 172.21.15.136:0/2285052507 >> v2:172.21.15.17:3300/0 conn(0x7f779c157e10 0x7f779c0b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:11.991 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.987+0000 7f77a1b7c700 1 -- 172.21.15.136:0/2285052507 >> v2:172.21.15.17:3300/0 conn(0x7f779c157e10 msgr2=0x7f779c0b1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:11.991 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.987+0000 7f77a1b7c700 1 --2- 172.21.15.136:0/2285052507 >> v2:172.21.15.17:3300/0 conn(0x7f779c157e10 0x7f779c0b1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:11.991 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.987+0000 7f7793fff700 1 -- 172.21.15.136:0/2285052507 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3204454882 0 0) 0x7f779c0cc3d0 con 0x7f779c0b04c0 2023-10-06T04:43:11.991 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.987+0000 7f77a1b7c700 1 -- 172.21.15.136:0/2285052507 >> v1:172.21.15.136:6789/0 conn(0x7f779c0b04c0 legacy=0x7f779c1581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:11.991 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.987+0000 7f77a1b7c700 1 -- 172.21.15.136:0/2285052507 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f779c0cc600 con 0x7f779c0b39c0 2023-10-06T04:43:11.991 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.987+0000 7f77a1b7c700 1 --2- 172.21.15.136:0/2285052507 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f779c0b39c0 0x7f779c0b3e20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7794009e60 tx=0x7f7794009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca31545ab070118c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:11.991 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.987+0000 7f7793fff700 1 -- 172.21.15.136:0/2285052507 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779400e070 con 0x7f779c0b39c0 2023-10-06T04:43:11.991 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.987+0000 7f7793fff700 1 -- 172.21.15.136:0/2285052507 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779400bb60 con 0x7f779c0b39c0 2023-10-06T04:43:11.991 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.987+0000 7f7793fff700 1 -- 172.21.15.136:0/2285052507 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7794012430 con 0x7f779c0b39c0 2023-10-06T04:43:11.991 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.988+0000 7f77a35df700 1 -- 172.21.15.136:0/2285052507 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f779c0b39c0 msgr2=0x7f779c0b3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:11.991 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.988+0000 7f77a35df700 1 --2- 172.21.15.136:0/2285052507 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f779c0b39c0 0x7f779c0b3e20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7794009e60 tx=0x7f7794009780 comp rx=0 tx=0).stop 2023-10-06T04:43:11.992 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.988+0000 7f77a35df700 1 -- 172.21.15.136:0/2285052507 shutdown_connections 2023-10-06T04:43:11.992 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.988+0000 7f77a35df700 1 --2- 172.21.15.136:0/2285052507 >> v2:172.21.15.17:3300/0 conn(0x7f779c157e10 0x7f779c0b1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:11.992 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.988+0000 7f77a35df700 1 --2- 172.21.15.136:0/2285052507 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f779c0b39c0 0x7f779c0b3e20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:11.992 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.988+0000 7f77a35df700 1 -- 172.21.15.136:0/2285052507 >> 172.21.15.136:0/2285052507 conn(0x7f779c06c560 msgr2=0x7f779c06c960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:11.992 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.988+0000 7f77a35df700 1 -- 172.21.15.136:0/2285052507 shutdown_connections 2023-10-06T04:43:11.992 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.988+0000 7f77a35df700 1 -- 172.21.15.136:0/2285052507 wait complete. 2023-10-06T04:43:11.994 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.989+0000 7f77a35df700 1 Processor -- start 2023-10-06T04:43:11.994 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.989+0000 7f77a35df700 1 -- start start 2023-10-06T04:43:11.994 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.990+0000 7f77a35df700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f779c0b04c0 0x7f779c150080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:11.994 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.990+0000 7f77a35df700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f779c0b39c0 0x7f779c14dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:11.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.990+0000 7f77a35df700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f779c157e10 0x7f779c15d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:11.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.990+0000 7f77a35df700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779c1505c0 con 0x7f779c0b39c0 2023-10-06T04:43:11.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.990+0000 7f77a35df700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779c14e150 con 0x7f779c0b04c0 2023-10-06T04:43:11.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.990+0000 7f77a35df700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f779c15b010 con 0x7f779c157e10 2023-10-06T04:43:11.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.990+0000 7f77a137b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f779c0b04c0 0x7f779c150080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:11.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.990+0000 7f77a1b7c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f779c157e10 0x7f779c15d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:11.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.990+0000 7f77a137b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f779c0b04c0 0x7f779c150080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:50010/0 (socket says 172.21.15.136:50010) 2023-10-06T04:43:11.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.990+0000 7f77a137b700 1 -- 172.21.15.136:0/1014997146 learned_addr learned my addr 172.21.15.136:0/1014997146 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-10-06T04:43:11.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.990+0000 7f77a0b7a700 1 --2- 172.21.15.136:0/1014997146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f779c0b39c0 0x7f779c14dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:11.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.990+0000 7f77a1b7c700 1 -- 172.21.15.136:0/1014997146 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f779c0b04c0 msgr2=0x7f779c150080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:11.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.990+0000 7f77a1b7c700 1 --2- 172.21.15.136:0/1014997146 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f779c0b04c0 0x7f779c150080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:11.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.990+0000 7f77a1b7c700 1 -- 172.21.15.136:0/1014997146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f779c0b39c0 msgr2=0x7f779c14dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:11.995 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.990+0000 7f77a1b7c700 1 --2- 172.21.15.136:0/1014997146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f779c0b39c0 0x7f779c14dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:11.996 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.990+0000 7f77a1b7c700 1 -- 172.21.15.136:0/1014997146 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7794009a20 con 0x7f779c157e10 2023-10-06T04:43:11.996 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.990+0000 7f77a137b700 1 --2- 172.21.15.136:0/1014997146 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f779c0b04c0 0x7f779c150080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:43:11.996 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.990+0000 7f77a1b7c700 1 --2- 172.21.15.136:0/1014997146 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f779c157e10 0x7f779c15d120 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7794016000 tx=0x7f7794019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:11.996 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.990+0000 7f77917fa700 1 -- 172.21.15.136:0/1014997146 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7794012ea0 con 0x7f779c157e10 2023-10-06T04:43:11.996 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.990+0000 7f77917fa700 1 -- 172.21.15.136:0/1014997146 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7794027470 con 0x7f779c157e10 2023-10-06T04:43:11.996 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.990+0000 7f77a35df700 1 -- 172.21.15.136:0/1014997146 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f779c15b2f0 con 0x7f779c157e10 2023-10-06T04:43:11.996 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.990+0000 7f77917fa700 1 -- 172.21.15.136:0/1014997146 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7794027830 con 0x7f779c157e10 2023-10-06T04:43:11.996 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.990+0000 7f77a35df700 1 -- 172.21.15.136:0/1014997146 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f779c150a90 con 0x7f779c157e10 2023-10-06T04:43:11.996 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.991+0000 7f77917fa700 1 -- 172.21.15.136:0/1014997146 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f7794024070 con 0x7f779c157e10 2023-10-06T04:43:11.996 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.991+0000 7f77917fa700 1 -- 172.21.15.136:0/1014997146 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f779401d960 con 0x7f779c157e10 2023-10-06T04:43:11.996 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.991+0000 7f77a35df700 1 -- 172.21.15.136:0/1014997146 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f779c15b480 con 0x7f779c157e10 2023-10-06T04:43:11.997 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:11.994+0000 7f77917fa700 1 -- 172.21.15.136:0/1014997146 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f7794027ba0 con 0x7f779c157e10 2023-10-06T04:43:12.040 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-06T04:43:12.039+0000 7f1181156180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T04:43:12.078 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.076+0000 7f77a35df700 1 -- 172.21.15.136:0/1014997146 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ae7dbb23-abe7-4bd3-a4df-6f5963d6804c", "id": 3} v 0) v1 -- 0x7f779c04c380 con 0x7f779c157e10 2023-10-06T04:43:12.084 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.082+0000 7f77917fa700 1 -- 172.21.15.136:0/1014997146 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ae7dbb23-abe7-4bd3-a4df-6f5963d6804c", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f779401dbc0 con 0x7f779c157e10 2023-10-06T04:43:12.084 INFO:teuthology.orchestra.run.smithi136.stdout:3 2023-10-06T04:43:12.085 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.083+0000 7f77a35df700 1 -- 172.21.15.136:0/1014997146 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f779c157e10 msgr2=0x7f779c15d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:12.085 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.083+0000 7f77a35df700 1 --2- 172.21.15.136:0/1014997146 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f779c157e10 0x7f779c15d120 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7794016000 tx=0x7f7794019000 comp rx=0 tx=0).stop 2023-10-06T04:43:12.085 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.083+0000 7f77a35df700 1 -- 172.21.15.136:0/1014997146 shutdown_connections 2023-10-06T04:43:12.085 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.083+0000 7f77a35df700 1 --2- 172.21.15.136:0/1014997146 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f779c157e10 0x7f779c15d120 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:12.086 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.083+0000 7f77a35df700 1 --2- 172.21.15.136:0/1014997146 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f779c0b04c0 0x7f779c150080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:12.086 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.083+0000 7f77a35df700 1 --2- 172.21.15.136:0/1014997146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f779c0b39c0 0x7f779c14dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:12.086 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.083+0000 7f77a35df700 1 -- 172.21.15.136:0/1014997146 >> 172.21.15.136:0/1014997146 conn(0x7f779c06c560 msgr2=0x7f779c0b1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:12.086 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.083+0000 7f77a35df700 1 -- 172.21.15.136:0/1014997146 shutdown_connections 2023-10-06T04:43:12.086 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.083+0000 7f77a35df700 1 -- 172.21.15.136:0/1014997146 wait complete. 2023-10-06T04:43:12.097 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd new 29991fb4-1667-4ea3-aca0-d55db27f3bfe 4 2023-10-06T04:43:12.211 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.209+0000 7fc89569b700 1 Processor -- start 2023-10-06T04:43:12.212 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.209+0000 7fc89569b700 1 -- start start 2023-10-06T04:43:12.214 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.210+0000 7fc89569b700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc890159320 0x7fc8901596f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:12.214 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.210+0000 7fc89569b700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc89006f140 0x7fc89006c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:12.214 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.210+0000 7fc89569b700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc890070b30 con 0x7fc89015dc00 2023-10-06T04:43:12.214 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.210+0000 7fc89569b700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8900aa820 con 0x7fc890159320 2023-10-06T04:43:12.214 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.210+0000 7fc89569b700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8900aa260 con 0x7fc89006f140 2023-10-06T04:43:12.214 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.210+0000 7fc88f7fe700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc89006f140 0x7fc89006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:12.214 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.210+0000 7fc88e7fc700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fc89015dc00 0x7fc89006ea30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:58144/0 (socket says 172.21.15.136:58144) 2023-10-06T04:43:12.215 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.210+0000 7fc88e7fc700 1 -- 172.21.15.136:0/3170901122 learned_addr learned my addr 172.21.15.136:0/3170901122 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-10-06T04:43:12.215 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.210+0000 7fc88effd700 1 --2- 172.21.15.136:0/3170901122 >> v2:172.21.15.17:3300/0 conn(0x7fc890159320 0x7fc8901596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:12.215 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.211+0000 7fc88dffb700 1 -- 172.21.15.136:0/3170901122 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1423901049 0 0) 0x7fc880001110 con 0x7fc89015dc00 2023-10-06T04:43:12.215 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.211+0000 7fc88dffb700 1 -- 172.21.15.136:0/3170901122 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc878003570 con 0x7fc89015dc00 2023-10-06T04:43:12.215 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.211+0000 7fc88f7fe700 1 -- 172.21.15.136:0/3170901122 >> v2:172.21.15.17:3300/0 conn(0x7fc890159320 msgr2=0x7fc8901596f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:12.215 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.211+0000 7fc88f7fe700 1 --2- 172.21.15.136:0/3170901122 >> v2:172.21.15.17:3300/0 conn(0x7fc890159320 0x7fc8901596f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:12.215 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.211+0000 7fc88f7fe700 1 -- 172.21.15.136:0/3170901122 >> v1:172.21.15.136:6789/0 conn(0x7fc89015dc00 legacy=0x7fc89006ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:12.215 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.211+0000 7fc88f7fe700 1 -- 172.21.15.136:0/3170901122 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8900aa540 con 0x7fc89006f140 2023-10-06T04:43:12.215 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.211+0000 7fc88f7fe700 1 --2- 172.21.15.136:0/3170901122 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc89006f140 0x7fc89006c940 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc888009e60 tx=0x7fc888009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbdff2e9280d2606 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:12.215 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.211+0000 7fc88dffb700 1 -- 172.21.15.136:0/3170901122 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88800e070 con 0x7fc89006f140 2023-10-06T04:43:12.215 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.211+0000 7fc88dffb700 1 -- 172.21.15.136:0/3170901122 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88800bab0 con 0x7fc89006f140 2023-10-06T04:43:12.215 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.211+0000 7fc88dffb700 1 -- 172.21.15.136:0/3170901122 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88800be70 con 0x7fc89006f140 2023-10-06T04:43:12.216 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.212+0000 7fc89569b700 1 -- 172.21.15.136:0/3170901122 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc89006f140 msgr2=0x7fc89006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:12.216 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.212+0000 7fc89569b700 1 --2- 172.21.15.136:0/3170901122 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc89006f140 0x7fc89006c940 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc888009e60 tx=0x7fc888009780 comp rx=0 tx=0).stop 2023-10-06T04:43:12.216 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.212+0000 7fc89569b700 1 -- 172.21.15.136:0/3170901122 shutdown_connections 2023-10-06T04:43:12.216 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.212+0000 7fc89569b700 1 --2- 172.21.15.136:0/3170901122 >> v2:172.21.15.17:3300/0 conn(0x7fc890159320 0x7fc8901596f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:12.216 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.212+0000 7fc89569b700 1 --2- 172.21.15.136:0/3170901122 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc89006f140 0x7fc89006c940 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:12.216 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.212+0000 7fc89569b700 1 -- 172.21.15.136:0/3170901122 >> 172.21.15.136:0/3170901122 conn(0x7fc8900cc970 msgr2=0x7fc8900ccd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:12.216 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.212+0000 7fc89569b700 1 -- 172.21.15.136:0/3170901122 shutdown_connections 2023-10-06T04:43:12.216 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.212+0000 7fc89569b700 1 -- 172.21.15.136:0/3170901122 wait complete. 2023-10-06T04:43:12.219 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.213+0000 7fc89569b700 1 Processor -- start 2023-10-06T04:43:12.219 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.213+0000 7fc89569b700 1 -- start start 2023-10-06T04:43:12.219 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.214+0000 7fc89569b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc89006f140 0x7fc890143400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:12.219 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.214+0000 7fc89569b700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc890159320 0x7fc8901573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:12.219 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.214+0000 7fc89569b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc89015dc00 0x7fc890154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:12.219 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.214+0000 7fc89569b700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc890143940 con 0x7fc89006f140 2023-10-06T04:43:12.219 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.214+0000 7fc89569b700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8901558a0 con 0x7fc89015dc00 2023-10-06T04:43:12.219 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.214+0000 7fc89569b700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc890156900 con 0x7fc890159320 2023-10-06T04:43:12.219 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.214+0000 7fc88e7fc700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc890159320 0x7fc8901573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:12.219 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.214+0000 7fc88e7fc700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc890159320 0x7fc8901573f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.136:34422/0 (socket says 172.21.15.136:34422) 2023-10-06T04:43:12.219 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.214+0000 7fc88e7fc700 1 -- 172.21.15.136:0/1440073334 learned_addr learned my addr 172.21.15.136:0/1440073334 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-10-06T04:43:12.220 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.214+0000 7fc88f7fe700 1 --2- 172.21.15.136:0/1440073334 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc89015dc00 0x7fc890154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:12.220 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.214+0000 7fc88effd700 1 --2- 172.21.15.136:0/1440073334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc89006f140 0x7fc890143400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:12.220 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.214+0000 7fc88e7fc700 1 -- 172.21.15.136:0/1440073334 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc89015dc00 msgr2=0x7fc890154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:12.220 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.214+0000 7fc88e7fc700 1 --2- 172.21.15.136:0/1440073334 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc89015dc00 0x7fc890154a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:12.220 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.214+0000 7fc88e7fc700 1 -- 172.21.15.136:0/1440073334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc89006f140 msgr2=0x7fc890143400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:12.220 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.214+0000 7fc88e7fc700 1 --2- 172.21.15.136:0/1440073334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc89006f140 0x7fc890143400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:12.220 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.214+0000 7fc88e7fc700 1 -- 172.21.15.136:0/1440073334 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc888009a20 con 0x7fc890159320 2023-10-06T04:43:12.220 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.214+0000 7fc88f7fe700 1 --2- 172.21.15.136:0/1440073334 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc89015dc00 0x7fc890154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:43:12.220 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.214+0000 7fc88e7fc700 1 --2- 172.21.15.136:0/1440073334 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc890159320 0x7fc8901573f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc88000c590 tx=0x7fc880007c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:12.220 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.214+0000 7fc876ffd700 1 -- 172.21.15.136:0/1440073334 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc880005b30 con 0x7fc890159320 2023-10-06T04:43:12.220 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.214+0000 7fc876ffd700 1 -- 172.21.15.136:0/1440073334 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc880005cb0 con 0x7fc890159320 2023-10-06T04:43:12.220 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.214+0000 7fc89569b700 1 -- 172.21.15.136:0/1440073334 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc890155b40 con 0x7fc890159320 2023-10-06T04:43:12.221 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.214+0000 7fc876ffd700 1 -- 172.21.15.136:0/1440073334 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc880007320 con 0x7fc890159320 2023-10-06T04:43:12.221 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.215+0000 7fc89569b700 1 -- 172.21.15.136:0/1440073334 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc890156100 con 0x7fc890159320 2023-10-06T04:43:12.221 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.215+0000 7fc876ffd700 1 -- 172.21.15.136:0/1440073334 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fc88001c6c0 con 0x7fc890159320 2023-10-06T04:43:12.221 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.215+0000 7fc876ffd700 1 -- 172.21.15.136:0/1440073334 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fc880005e20 con 0x7fc890159320 2023-10-06T04:43:12.221 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.216+0000 7fc89569b700 1 -- 172.21.15.136:0/1440073334 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc89004c380 con 0x7fc890159320 2023-10-06T04:43:12.221 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.218+0000 7fc876ffd700 1 -- 172.21.15.136:0/1440073334 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fc880017070 con 0x7fc890159320 2023-10-06T04:43:12.232 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-06T04:43:12.231+0000 7f1181156180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T04:43:12.302 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.300+0000 7fc89569b700 1 -- 172.21.15.136:0/1440073334 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd new", "uuid": "29991fb4-1667-4ea3-aca0-d55db27f3bfe", "id": 4} v 0) v1 -- 0x7fc890070570 con 0x7fc890159320 2023-10-06T04:43:12.307 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.305+0000 7fc876ffd700 1 -- 172.21.15.136:0/1440073334 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "29991fb4-1667-4ea3-aca0-d55db27f3bfe", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc890070b30 con 0x7fc890159320 2023-10-06T04:43:12.307 INFO:teuthology.orchestra.run.smithi136.stdout:4 2023-10-06T04:43:12.308 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.306+0000 7fc89569b700 1 -- 172.21.15.136:0/1440073334 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc890159320 msgr2=0x7fc8901573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:12.308 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.306+0000 7fc89569b700 1 --2- 172.21.15.136:0/1440073334 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc890159320 0x7fc8901573f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc88000c590 tx=0x7fc880007c70 comp rx=0 tx=0).stop 2023-10-06T04:43:12.308 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.306+0000 7fc89569b700 1 -- 172.21.15.136:0/1440073334 shutdown_connections 2023-10-06T04:43:12.308 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.306+0000 7fc89569b700 1 --2- 172.21.15.136:0/1440073334 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc89015dc00 0x7fc890154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:12.308 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.306+0000 7fc89569b700 1 --2- 172.21.15.136:0/1440073334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc89006f140 0x7fc890143400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:12.308 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.306+0000 7fc89569b700 1 --2- 172.21.15.136:0/1440073334 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc890159320 0x7fc8901573f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:12.309 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.306+0000 7fc89569b700 1 -- 172.21.15.136:0/1440073334 >> 172.21.15.136:0/1440073334 conn(0x7fc8900cc970 msgr2=0x7fc8900af8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:12.309 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.306+0000 7fc89569b700 1 -- 172.21.15.136:0/1440073334 shutdown_connections 2023-10-06T04:43:12.309 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.306+0000 7fc89569b700 1 -- 172.21.15.136:0/1440073334 wait complete. 2023-10-06T04:43:12.319 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd new 398b4ff9-03fc-421f-882c-ba12aa088eeb 5 2023-10-06T04:43:12.413 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-06T04:43:12.411+0000 7f1181156180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T04:43:12.434 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.432+0000 7f2dde155700 1 Processor -- start 2023-10-06T04:43:12.434 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.432+0000 7f2dde155700 1 -- start start 2023-10-06T04:43:12.437 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.433+0000 7f2dde155700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2dd80af540 0x7f2dd80af910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:12.437 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.433+0000 7f2dde155700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2dd80cd5e0 0x7f2dd815d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:12.437 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.433+0000 7f2dde155700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dd815d660 con 0x7f2dd815a650 2023-10-06T04:43:12.437 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.433+0000 7f2dde155700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dd80ce890 con 0x7f2dd80af540 2023-10-06T04:43:12.437 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.433+0000 7f2dde155700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd815aac0 con 0x7f2dd80cd5e0 2023-10-06T04:43:12.437 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.433+0000 7f2ddd153700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2dd80af540 0x7f2dd80af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:12.437 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.433+0000 7f2ddd954700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2dd80cd5e0 0x7f2dd815d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:12.438 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.433+0000 7f2ddc952700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f2dd815a650 0x7f2dd80cced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:58154/0 (socket says 172.21.15.136:58154) 2023-10-06T04:43:12.438 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.433+0000 7f2ddd153700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2dd80af540 0x7f2dd80af910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:50040/0 (socket says 172.21.15.136:50040) 2023-10-06T04:43:12.438 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.433+0000 7f2ddd954700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2dd80cd5e0 0x7f2dd815d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.136:34438/0 (socket says 172.21.15.136:34438) 2023-10-06T04:43:12.438 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.433+0000 7f2ddc952700 1 -- 172.21.15.136:0/863987093 learned_addr learned my addr 172.21.15.136:0/863987093 (peer_addr_for_me v1:172.21.15.136:0/0) 2023-10-06T04:43:12.438 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.434+0000 7f2ddd153700 1 -- 172.21.15.136:0/863987093 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2dd80cd5e0 msgr2=0x7f2dd815d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:12.438 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.434+0000 7f2ddd153700 1 --2- 172.21.15.136:0/863987093 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2dd80cd5e0 0x7f2dd815d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:12.438 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.434+0000 7f2ddd153700 1 -- 172.21.15.136:0/863987093 >> v1:172.21.15.136:6789/0 conn(0x7f2dd815a650 legacy=0x7f2dd80cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:12.438 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.434+0000 7f2ddd153700 1 -- 172.21.15.136:0/863987093 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd815d890 con 0x7f2dd80af540 2023-10-06T04:43:12.438 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.434+0000 7f2dcffff700 1 -- 172.21.15.136:0/863987093 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3647411687 0 0) 0x7f2dd815d660 con 0x7f2dd815a650 2023-10-06T04:43:12.438 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.434+0000 7f2ddd954700 1 --2- 172.21.15.136:0/863987093 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2dd80cd5e0 0x7f2dd815d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:43:12.438 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.434+0000 7f2ddd153700 1 --2- 172.21.15.136:0/863987093 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2dd80af540 0x7f2dd80af910 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2dc80098e0 tx=0x7f2dc80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc989d659cab8021 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:12.439 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.434+0000 7f2dcffff700 1 -- 172.21.15.136:0/863987093 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc800b640 con 0x7f2dd80af540 2023-10-06T04:43:12.439 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.434+0000 7f2dcffff700 1 -- 172.21.15.136:0/863987093 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc800b7a0 con 0x7f2dd80af540 2023-10-06T04:43:12.439 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.434+0000 7f2dcffff700 1 -- 172.21.15.136:0/863987093 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc800bb40 con 0x7f2dd80af540 2023-10-06T04:43:12.439 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.434+0000 7f2dde155700 1 -- 172.21.15.136:0/863987093 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2dd80af540 msgr2=0x7f2dd80af910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:12.439 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.434+0000 7f2dde155700 1 --2- 172.21.15.136:0/863987093 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2dd80af540 0x7f2dd80af910 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2dc80098e0 tx=0x7f2dc80091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:12.439 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.435+0000 7f2dde155700 1 -- 172.21.15.136:0/863987093 shutdown_connections 2023-10-06T04:43:12.439 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.435+0000 7f2dde155700 1 --2- 172.21.15.136:0/863987093 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2dd80af540 0x7f2dd80af910 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:12.439 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.435+0000 7f2dde155700 1 --2- 172.21.15.136:0/863987093 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2dd80cd5e0 0x7f2dd815d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:12.439 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.435+0000 7f2dde155700 1 -- 172.21.15.136:0/863987093 >> 172.21.15.136:0/863987093 conn(0x7f2dd806d9b0 msgr2=0x7f2dd806ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:12.439 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.435+0000 7f2dde155700 1 -- 172.21.15.136:0/863987093 shutdown_connections 2023-10-06T04:43:12.439 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.435+0000 7f2dde155700 1 -- 172.21.15.136:0/863987093 wait complete. 2023-10-06T04:43:12.442 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.436+0000 7f2dde155700 1 Processor -- start 2023-10-06T04:43:12.442 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.436+0000 7f2dde155700 1 -- start start 2023-10-06T04:43:12.442 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.437+0000 7f2dde155700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2dd80af540 0x7f2dd8157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:12.442 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.437+0000 7f2dde155700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2dd80cd5e0 0x7f2dd80b2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:12.442 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.437+0000 7f2dde155700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dd815a650 0x7f2dd80b25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:12.442 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.437+0000 7f2dde155700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd80c8590 con 0x7f2dd815a650 2023-10-06T04:43:12.442 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.437+0000 7f2dde155700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd80c7580 con 0x7f2dd80cd5e0 2023-10-06T04:43:12.442 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.437+0000 7f2dde155700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd80c77d0 con 0x7f2dd80af540 2023-10-06T04:43:12.442 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.437+0000 7f2ddd153700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2dd80af540 0x7f2dd8157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:12.442 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.437+0000 7f2ddc952700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2dd80cd5e0 0x7f2dd80b2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:12.443 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.437+0000 7f2ddd153700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2dd80af540 0x7f2dd8157630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.136:34440/0 (socket says 172.21.15.136:34440) 2023-10-06T04:43:12.443 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.437+0000 7f2ddd153700 1 -- 172.21.15.136:0/2577282384 learned_addr learned my addr 172.21.15.136:0/2577282384 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-10-06T04:43:12.443 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.437+0000 7f2ddd954700 1 --2- 172.21.15.136:0/2577282384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dd815a650 0x7f2dd80b25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:12.443 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.437+0000 7f2ddc952700 1 -- 172.21.15.136:0/2577282384 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2dd80af540 msgr2=0x7f2dd8157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:12.443 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.437+0000 7f2ddc952700 1 --2- 172.21.15.136:0/2577282384 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2dd80af540 0x7f2dd8157630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:12.443 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.437+0000 7f2ddc952700 1 -- 172.21.15.136:0/2577282384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dd815a650 msgr2=0x7f2dd80b25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:12.443 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.437+0000 7f2ddc952700 1 --2- 172.21.15.136:0/2577282384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dd815a650 0x7f2dd80b25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:12.443 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.437+0000 7f2ddc952700 1 -- 172.21.15.136:0/2577282384 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd0009a20 con 0x7f2dd80cd5e0 2023-10-06T04:43:12.443 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.437+0000 7f2ddd954700 1 --2- 172.21.15.136:0/2577282384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dd815a650 0x7f2dd80b25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:43:12.443 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.437+0000 7f2ddd153700 1 --2- 172.21.15.136:0/2577282384 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2dd80af540 0x7f2dd8157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:43:12.443 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.437+0000 7f2ddc952700 1 --2- 172.21.15.136:0/2577282384 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2dd80cd5e0 0x7f2dd80b2070 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40011e0 tx=0x7f2dd4007d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:12.444 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.437+0000 7f2dcd7fa700 1 -- 172.21.15.136:0/2577282384 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd4005b30 con 0x7f2dd80cd5e0 2023-10-06T04:43:12.444 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.437+0000 7f2dcd7fa700 1 -- 172.21.15.136:0/2577282384 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd4005c90 con 0x7f2dd80cd5e0 2023-10-06T04:43:12.444 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.437+0000 7f2dde155700 1 -- 172.21.15.136:0/2577282384 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dc8009420 con 0x7f2dd80cd5e0 2023-10-06T04:43:12.444 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.437+0000 7f2dcd7fa700 1 -- 172.21.15.136:0/2577282384 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd4007300 con 0x7f2dd80cd5e0 2023-10-06T04:43:12.444 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.437+0000 7f2dde155700 1 -- 172.21.15.136:0/2577282384 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dd80c7e10 con 0x7f2dd80cd5e0 2023-10-06T04:43:12.444 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.438+0000 7f2dcd7fa700 1 -- 172.21.15.136:0/2577282384 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f2dd401c6c0 con 0x7f2dd80cd5e0 2023-10-06T04:43:12.444 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.438+0000 7f2dcd7fa700 1 -- 172.21.15.136:0/2577282384 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f2dd40076f0 con 0x7f2dd80cd5e0 2023-10-06T04:43:12.444 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.438+0000 7f2dde155700 1 -- 172.21.15.136:0/2577282384 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dd804c380 con 0x7f2dd80cd5e0 2023-10-06T04:43:12.444 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.440+0000 7f2dcd7fa700 1 -- 172.21.15.136:0/2577282384 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f2dd4017070 con 0x7f2dd80cd5e0 2023-10-06T04:43:12.493 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-06T04:43:12.491+0000 7f1181156180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T04:43:12.524 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.522+0000 7f2dde155700 1 -- 172.21.15.136:0/2577282384 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd new", "uuid": "398b4ff9-03fc-421f-882c-ba12aa088eeb", "id": 5} v 0) v1 -- 0x7f2dd815db70 con 0x7f2dd80cd5e0 2023-10-06T04:43:12.532 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.530+0000 7f2dcd7fa700 1 -- 172.21.15.136:0/2577282384 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "398b4ff9-03fc-421f-882c-ba12aa088eeb", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2dd4005e50 con 0x7f2dd80cd5e0 2023-10-06T04:43:12.532 INFO:teuthology.orchestra.run.smithi136.stdout:5 2023-10-06T04:43:12.533 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.531+0000 7f2dde155700 1 -- 172.21.15.136:0/2577282384 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2dd80cd5e0 msgr2=0x7f2dd80b2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:12.533 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.531+0000 7f2dde155700 1 --2- 172.21.15.136:0/2577282384 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2dd80cd5e0 0x7f2dd80b2070 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40011e0 tx=0x7f2dd4007d30 comp rx=0 tx=0).stop 2023-10-06T04:43:12.534 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.531+0000 7f2dde155700 1 -- 172.21.15.136:0/2577282384 shutdown_connections 2023-10-06T04:43:12.534 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.531+0000 7f2dde155700 1 --2- 172.21.15.136:0/2577282384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dd815a650 0x7f2dd80b25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:12.534 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.531+0000 7f2dde155700 1 --2- 172.21.15.136:0/2577282384 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2dd80af540 0x7f2dd8157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:12.534 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.531+0000 7f2dde155700 1 --2- 172.21.15.136:0/2577282384 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2dd80cd5e0 0x7f2dd80b2070 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:12.534 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.531+0000 7f2dde155700 1 -- 172.21.15.136:0/2577282384 >> 172.21.15.136:0/2577282384 conn(0x7f2dd806d9b0 msgr2=0x7f2dd80cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:12.534 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.531+0000 7f2dde155700 1 -- 172.21.15.136:0/2577282384 shutdown_connections 2023-10-06T04:43:12.534 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.531+0000 7f2dde155700 1 -- 172.21.15.136:0/2577282384 wait complete. 2023-10-06T04:43:12.544 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd new 1bb91a72-4dab-4cdb-aa1d-2b8a9edf1ad0 6 2023-10-06T04:43:12.547 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-10-06T04:43:12.544+0000 7fa7d3342180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T04:43:12.633 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-06T04:43:12.632+0000 7f1181156180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T04:43:12.662 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.659+0000 7f7fb31d4700 1 Processor -- start 2023-10-06T04:43:12.662 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.660+0000 7f7fb31d4700 1 -- start start 2023-10-06T04:43:12.669 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.660+0000 7f7fb31d4700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7fac157e10 0x7f7fac0b1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:12.669 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.660+0000 7f7fb31d4700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f7fac0b04c0 0x7f7fac1581e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:12.669 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.660+0000 7f7fb31d4700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7fac158720 0x7f7fac0b39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:12.669 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.660+0000 7f7fb31d4700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fac0cc3d0 con 0x7f7fac157e10 2023-10-06T04:43:12.669 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.660+0000 7f7fb31d4700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fac0cd210 con 0x7f7fac0b04c0 2023-10-06T04:43:12.669 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.660+0000 7f7fb31d4700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac0cc600 con 0x7f7fac158720 2023-10-06T04:43:12.669 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.660+0000 7f7fabfff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f7fac0b04c0 0x7f7fac1581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:12.670 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.660+0000 7f7fb1771700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7fac158720 0x7f7fac0b39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:12.670 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.661+0000 7f7fabfff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f7fac0b04c0 0x7f7fac1581e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:50054/0 (socket says 172.21.15.136:50054) 2023-10-06T04:43:12.670 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.661+0000 7f7fb1771700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7fac158720 0x7f7fac0b39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.136:34444/0 (socket says 172.21.15.136:34444) 2023-10-06T04:43:12.670 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.661+0000 7f7fabfff700 1 -- 172.21.15.136:0/3385325354 learned_addr learned my addr 172.21.15.136:0/3385325354 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-10-06T04:43:12.670 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.661+0000 7f7fb0f70700 1 --2- 172.21.15.136:0/3385325354 >> v2:172.21.15.17:3300/0 conn(0x7f7fac157e10 0x7f7fac0b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:12.670 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.661+0000 7f7fabfff700 1 -- 172.21.15.136:0/3385325354 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7fac158720 msgr2=0x7f7fac0b39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:12.670 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.661+0000 7f7fabfff700 1 --2- 172.21.15.136:0/3385325354 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7fac158720 0x7f7fac0b39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:12.670 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.661+0000 7f7fabfff700 1 -- 172.21.15.136:0/3385325354 >> v2:172.21.15.17:3300/0 conn(0x7f7fac157e10 msgr2=0x7f7fac0b1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:12.670 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.661+0000 7f7fabfff700 1 --2- 172.21.15.136:0/3385325354 >> v2:172.21.15.17:3300/0 conn(0x7f7fac157e10 0x7f7fac0b1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:12.670 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.661+0000 7f7fabfff700 1 -- 172.21.15.136:0/3385325354 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fac0cc8e0 con 0x7f7fac0b04c0 2023-10-06T04:43:12.671 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.661+0000 7f7fb1771700 1 --2- 172.21.15.136:0/3385325354 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7fac158720 0x7f7fac0b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:43:12.671 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.661+0000 7f7fabfff700 1 --2- 172.21.15.136:0/3385325354 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7fac0b04c0 0x7f7fac1581e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7fac15afe0 tx=0x7f7f98009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=771b0592c1ab97e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:12.671 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.661+0000 7f7fab7fe700 1 -- 172.21.15.136:0/3385325354 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9800b640 con 0x7f7fac0b04c0 2023-10-06T04:43:12.671 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.661+0000 7f7fab7fe700 1 -- 172.21.15.136:0/3385325354 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9800b7a0 con 0x7f7fac0b04c0 2023-10-06T04:43:12.671 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.661+0000 7f7fab7fe700 1 -- 172.21.15.136:0/3385325354 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9800bb60 con 0x7f7fac0b04c0 2023-10-06T04:43:12.671 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.662+0000 7f7fb31d4700 1 -- 172.21.15.136:0/3385325354 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7fac0b04c0 msgr2=0x7f7fac1581e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:12.671 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.662+0000 7f7fb31d4700 1 --2- 172.21.15.136:0/3385325354 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7fac0b04c0 0x7f7fac1581e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7fac15afe0 tx=0x7f7f98009250 comp rx=0 tx=0).stop 2023-10-06T04:43:12.671 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.662+0000 7f7fb31d4700 1 -- 172.21.15.136:0/3385325354 shutdown_connections 2023-10-06T04:43:12.671 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.662+0000 7f7fb31d4700 1 --2- 172.21.15.136:0/3385325354 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7fac158720 0x7f7fac0b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:12.671 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.662+0000 7f7fb31d4700 1 --2- 172.21.15.136:0/3385325354 >> v2:172.21.15.17:3300/0 conn(0x7f7fac157e10 0x7f7fac0b1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:12.671 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.662+0000 7f7fb31d4700 1 --2- 172.21.15.136:0/3385325354 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7fac0b04c0 0x7f7fac1581e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:12.672 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.662+0000 7f7fb31d4700 1 -- 172.21.15.136:0/3385325354 >> 172.21.15.136:0/3385325354 conn(0x7f7fac06c560 msgr2=0x7f7fac06c960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:12.672 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.662+0000 7f7fb31d4700 1 -- 172.21.15.136:0/3385325354 shutdown_connections 2023-10-06T04:43:12.672 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.662+0000 7f7fb31d4700 1 -- 172.21.15.136:0/3385325354 wait complete. 2023-10-06T04:43:12.672 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.663+0000 7f7fb31d4700 1 Processor -- start 2023-10-06T04:43:12.672 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.663+0000 7f7fb31d4700 1 -- start start 2023-10-06T04:43:12.672 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.664+0000 7f7fb31d4700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7fac0b04c0 0x7f7fac06f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:12.672 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.664+0000 7f7fb31d4700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fac157e10 0x7f7fac06d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:12.672 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.664+0000 7f7fb31d4700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7fac158720 0x7f7fac152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:12.672 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.664+0000 7f7fb31d4700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac06e680 con 0x7f7fac157e10 2023-10-06T04:43:12.672 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.664+0000 7f7fb31d4700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac06dbb0 con 0x7f7fac158720 2023-10-06T04:43:12.672 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.664+0000 7f7fb31d4700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac0c7870 con 0x7f7fac0b04c0 2023-10-06T04:43:12.673 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.664+0000 7f7fb1771700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7fac158720 0x7f7fac152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:12.673 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.664+0000 7f7fb0f70700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7fac0b04c0 0x7f7fac06f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:12.673 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.664+0000 7f7fb1771700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7fac158720 0x7f7fac152aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:50058/0 (socket says 172.21.15.136:50058) 2023-10-06T04:43:12.673 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.664+0000 7f7fb0f70700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7fac0b04c0 0x7f7fac06f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.136:34448/0 (socket says 172.21.15.136:34448) 2023-10-06T04:43:12.673 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.664+0000 7f7fb1771700 1 -- 172.21.15.136:0/3767759557 learned_addr learned my addr 172.21.15.136:0/3767759557 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-10-06T04:43:12.673 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.664+0000 7f7fabfff700 1 --2- 172.21.15.136:0/3767759557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fac157e10 0x7f7fac06d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:12.673 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.664+0000 7f7fb1771700 1 -- 172.21.15.136:0/3767759557 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7fac0b04c0 msgr2=0x7f7fac06f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:12.674 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.664+0000 7f7fb1771700 1 --2- 172.21.15.136:0/3767759557 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7fac0b04c0 0x7f7fac06f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:12.674 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.664+0000 7f7fb1771700 1 -- 172.21.15.136:0/3767759557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fac157e10 msgr2=0x7f7fac06d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:12.674 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.664+0000 7f7fb1771700 1 --2- 172.21.15.136:0/3767759557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fac157e10 0x7f7fac06d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:12.674 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.664+0000 7f7fb1771700 1 -- 172.21.15.136:0/3767759557 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa4009a20 con 0x7f7fac158720 2023-10-06T04:43:12.674 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.664+0000 7f7fb0f70700 1 --2- 172.21.15.136:0/3767759557 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7fac0b04c0 0x7f7fac06f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:43:12.674 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.664+0000 7f7fb1771700 1 --2- 172.21.15.136:0/3767759557 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7fac158720 0x7f7fac152aa0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4009fc0 tx=0x7f7fa400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:12.674 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.665+0000 7f7fa8ff9700 1 -- 172.21.15.136:0/3767759557 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa400cbd0 con 0x7f7fac158720 2023-10-06T04:43:12.675 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.665+0000 7f7fa8ff9700 1 -- 172.21.15.136:0/3767759557 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa400f040 con 0x7f7fac158720 2023-10-06T04:43:12.675 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.665+0000 7f7fa8ff9700 1 -- 172.21.15.136:0/3767759557 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa4014480 con 0x7f7fac158720 2023-10-06T04:43:12.675 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.665+0000 7f7fb31d4700 1 -- 172.21.15.136:0/3767759557 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f980094f0 con 0x7f7fac158720 2023-10-06T04:43:12.675 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.665+0000 7f7fb31d4700 1 -- 172.21.15.136:0/3767759557 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fac06e0c0 con 0x7f7fac158720 2023-10-06T04:43:12.675 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.665+0000 7f7fa8ff9700 1 -- 172.21.15.136:0/3767759557 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f7fa4003020 con 0x7f7fac158720 2023-10-06T04:43:12.675 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.665+0000 7f7fa8ff9700 1 -- 172.21.15.136:0/3767759557 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f7fa40139e0 con 0x7f7fac158720 2023-10-06T04:43:12.675 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.666+0000 7f7fb31d4700 1 -- 172.21.15.136:0/3767759557 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fac04c380 con 0x7f7fac158720 2023-10-06T04:43:12.676 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.668+0000 7f7fa8ff9700 1 -- 172.21.15.136:0/3767759557 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f7fa4018030 con 0x7f7fac158720 2023-10-06T04:43:12.687 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-10-06T04:43:12.685+0000 7fa7d3342180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T04:43:12.733 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-06T04:43:12.731+0000 7f1181156180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T04:43:12.752 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.750+0000 7f7fb31d4700 1 -- 172.21.15.136:0/3767759557 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1bb91a72-4dab-4cdb-aa1d-2b8a9edf1ad0", "id": 6} v 0) v1 -- 0x7f7fac0c79b0 con 0x7f7fac158720 2023-10-06T04:43:12.757 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.755+0000 7f7fa8ff9700 1 -- 172.21.15.136:0/3767759557 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1bb91a72-4dab-4cdb-aa1d-2b8a9edf1ad0", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7fa4013c80 con 0x7f7fac158720 2023-10-06T04:43:12.758 INFO:teuthology.orchestra.run.smithi136.stdout:6 2023-10-06T04:43:12.759 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.756+0000 7f7fb31d4700 1 -- 172.21.15.136:0/3767759557 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7fac158720 msgr2=0x7f7fac152aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:12.759 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.756+0000 7f7fb31d4700 1 --2- 172.21.15.136:0/3767759557 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7fac158720 0x7f7fac152aa0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4009fc0 tx=0x7f7fa400b040 comp rx=0 tx=0).stop 2023-10-06T04:43:12.759 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.756+0000 7f7fb31d4700 1 -- 172.21.15.136:0/3767759557 shutdown_connections 2023-10-06T04:43:12.759 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.756+0000 7f7fb31d4700 1 --2- 172.21.15.136:0/3767759557 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7fac158720 0x7f7fac152aa0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:12.759 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.756+0000 7f7fb31d4700 1 --2- 172.21.15.136:0/3767759557 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7fac0b04c0 0x7f7fac06f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:12.759 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.756+0000 7f7fb31d4700 1 --2- 172.21.15.136:0/3767759557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fac157e10 0x7f7fac06d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:12.760 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.756+0000 7f7fb31d4700 1 -- 172.21.15.136:0/3767759557 >> 172.21.15.136:0/3767759557 conn(0x7f7fac06c560 msgr2=0x7f7fac153ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:12.760 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.757+0000 7f7fb31d4700 1 -- 172.21.15.136:0/3767759557 shutdown_connections 2023-10-06T04:43:12.760 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.757+0000 7f7fb31d4700 1 -- 172.21.15.136:0/3767759557 wait complete. 2023-10-06T04:43:12.767 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-10-06T04:43:12.765+0000 7fa7d3342180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T04:43:12.770 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd new 719b654e-010d-4aa4-8c13-83fdde242b47 7 2023-10-06T04:43:12.888 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.886+0000 7fd7fe167700 1 Processor -- start 2023-10-06T04:43:12.888 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.886+0000 7fd7fe167700 1 -- start start 2023-10-06T04:43:12.890 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.886+0000 7fd7fe167700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd7f80b0a60 0x7fd7f806a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:12.891 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.886+0000 7fd7fe167700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd7f80b0e30 0x7fd7f8155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:12.891 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.886+0000 7fd7fe167700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7f806aea0 con 0x7fd7f806a960 2023-10-06T04:43:12.891 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.886+0000 7fd7fe167700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7f806b180 con 0x7fd7f80b0a60 2023-10-06T04:43:12.891 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.886+0000 7fd7fe167700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f806b460 con 0x7fd7f80b0e30 2023-10-06T04:43:12.891 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.887+0000 7fd7f77fe700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd7f80b0a60 0x7fd7f806a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:12.891 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.887+0000 7fd7f7fff700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd7f80b0e30 0x7fd7f8155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:12.891 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.887+0000 7fd7f77fe700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd7f80b0a60 0x7fd7f806a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:50060/0 (socket says 172.21.15.136:50060) 2023-10-06T04:43:12.891 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.887+0000 7fd7f7fff700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd7f80b0e30 0x7fd7f8155eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.136:34454/0 (socket says 172.21.15.136:34454) 2023-10-06T04:43:12.891 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.887+0000 7fd7f77fe700 1 -- 172.21.15.136:0/1370221300 learned_addr learned my addr 172.21.15.136:0/1370221300 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-10-06T04:43:12.891 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.887+0000 7fd7f7fff700 1 -- 172.21.15.136:0/1370221300 >> v2:172.21.15.136:3300/0 conn(0x7fd7f80b0a60 msgr2=0x7fd7f806a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:12.892 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.887+0000 7fd7f7fff700 1 --2- 172.21.15.136:0/1370221300 >> v2:172.21.15.136:3300/0 conn(0x7fd7f80b0a60 0x7fd7f806a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:12.892 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.887+0000 7fd7f7fff700 1 -- 172.21.15.136:0/1370221300 >> v1:172.21.15.17:6789/0 conn(0x7fd7f806a960 legacy=0x7fd7f81557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:12.892 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.887+0000 7fd7f7fff700 1 -- 172.21.15.136:0/1370221300 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f806c700 con 0x7fd7f80b0e30 2023-10-06T04:43:12.892 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.887+0000 7fd7f77fe700 1 --2- 172.21.15.136:0/1370221300 >> v2:172.21.15.136:3300/0 conn(0x7fd7f80b0a60 0x7fd7f806a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:43:12.892 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.887+0000 7fd7f7fff700 1 --2- 172.21.15.136:0/1370221300 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd7f80b0e30 0x7fd7f8155eb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0009e60 tx=0x7fd7f0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b996cdffd117d4e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:12.892 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.887+0000 7fd7f67fc700 1 -- 172.21.15.136:0/1370221300 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f000e070 con 0x7fd7f80b0e30 2023-10-06T04:43:12.893 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.887+0000 7fd7f67fc700 1 -- 172.21.15.136:0/1370221300 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f000bb20 con 0x7fd7f80b0e30 2023-10-06T04:43:12.893 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.887+0000 7fd7f67fc700 1 -- 172.21.15.136:0/1370221300 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f0012430 con 0x7fd7f80b0e30 2023-10-06T04:43:12.893 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.888+0000 7fd7fe167700 1 -- 172.21.15.136:0/1370221300 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd7f80b0e30 msgr2=0x7fd7f8155eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:12.893 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.888+0000 7fd7fe167700 1 --2- 172.21.15.136:0/1370221300 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd7f80b0e30 0x7fd7f8155eb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0009e60 tx=0x7fd7f0009780 comp rx=0 tx=0).stop 2023-10-06T04:43:12.893 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.888+0000 7fd7fe167700 1 -- 172.21.15.136:0/1370221300 shutdown_connections 2023-10-06T04:43:12.893 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.888+0000 7fd7fe167700 1 --2- 172.21.15.136:0/1370221300 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd7f80b0e30 0x7fd7f8155eb0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:12.893 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.888+0000 7fd7fe167700 1 --2- 172.21.15.136:0/1370221300 >> v2:172.21.15.136:3300/0 conn(0x7fd7f80b0a60 0x7fd7f806a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:12.893 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.888+0000 7fd7fe167700 1 -- 172.21.15.136:0/1370221300 >> 172.21.15.136:0/1370221300 conn(0x7fd7f806f7b0 msgr2=0x7fd7f80ae590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:12.893 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.888+0000 7fd7fe167700 1 -- 172.21.15.136:0/1370221300 shutdown_connections 2023-10-06T04:43:12.894 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.888+0000 7fd7fe167700 1 -- 172.21.15.136:0/1370221300 wait complete. 2023-10-06T04:43:12.896 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.889+0000 7fd7fe167700 1 Processor -- start 2023-10-06T04:43:12.897 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.889+0000 7fd7fe167700 1 -- start start 2023-10-06T04:43:12.897 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.890+0000 7fd7fe167700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd7f806a960 0x7fd7f80c2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:12.897 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.890+0000 7fd7fe167700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7f80b0a60 0x7fd7f8151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:12.897 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.890+0000 7fd7fe167700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7f80b0e30 0x7fd7f8151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:12.897 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.890+0000 7fd7fe167700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f80c3520 con 0x7fd7f80b0a60 2023-10-06T04:43:12.897 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.890+0000 7fd7fe167700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f80a5e50 con 0x7fd7f80b0e30 2023-10-06T04:43:12.897 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.890+0000 7fd7fe167700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f816aff0 con 0x7fd7f806a960 2023-10-06T04:43:12.897 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.890+0000 7fd7f77fe700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd7f806a960 0x7fd7f80c2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:12.897 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.890+0000 7fd7f77fe700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd7f806a960 0x7fd7f80c2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.136:34462/0 (socket says 172.21.15.136:34462) 2023-10-06T04:43:12.897 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.890+0000 7fd7f7fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7f80b0e30 0x7fd7f8151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:12.898 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.890+0000 7fd7f77fe700 1 -- 172.21.15.136:0/2907234677 learned_addr learned my addr 172.21.15.136:0/2907234677 (peer_addr_for_me v2:172.21.15.136:0/0) 2023-10-06T04:43:12.898 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.890+0000 7fd7f6ffd700 1 --2- 172.21.15.136:0/2907234677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7f80b0a60 0x7fd7f8151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:12.898 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.890+0000 7fd7f77fe700 1 -- 172.21.15.136:0/2907234677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7f80b0e30 msgr2=0x7fd7f8151fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:12.898 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.890+0000 7fd7f77fe700 1 --2- 172.21.15.136:0/2907234677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7f80b0e30 0x7fd7f8151fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:12.898 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.890+0000 7fd7f77fe700 1 -- 172.21.15.136:0/2907234677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7f80b0a60 msgr2=0x7fd7f8151a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:12.898 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.890+0000 7fd7f77fe700 1 --2- 172.21.15.136:0/2907234677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7f80b0a60 0x7fd7f8151a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:12.898 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.890+0000 7fd7f77fe700 1 -- 172.21.15.136:0/2907234677 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e800a690 con 0x7fd7f806a960 2023-10-06T04:43:12.898 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.890+0000 7fd7f6ffd700 1 --2- 172.21.15.136:0/2907234677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7f80b0a60 0x7fd7f8151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:43:12.898 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.890+0000 7fd7f7fff700 1 --2- 172.21.15.136:0/2907234677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7f80b0e30 0x7fd7f8151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:43:12.899 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.890+0000 7fd7f77fe700 1 --2- 172.21.15.136:0/2907234677 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd7f806a960 0x7fd7f80c2fe0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8006e80 tx=0x7fd7e800a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:12.899 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.891+0000 7fd7ef7fe700 1 -- 172.21.15.136:0/2907234677 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e800c920 con 0x7fd7f806a960 2023-10-06T04:43:12.899 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.891+0000 7fd7ef7fe700 1 -- 172.21.15.136:0/2907234677 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e800ca80 con 0x7fd7f806a960 2023-10-06T04:43:12.899 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.891+0000 7fd7fe167700 1 -- 172.21.15.136:0/2907234677 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7f0009a20 con 0x7fd7f806a960 2023-10-06T04:43:12.899 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.891+0000 7fd7ef7fe700 1 -- 172.21.15.136:0/2907234677 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e800ce00 con 0x7fd7f806a960 2023-10-06T04:43:12.899 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.891+0000 7fd7fe167700 1 -- 172.21.15.136:0/2907234677 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f80a5800 con 0x7fd7f806a960 2023-10-06T04:43:12.899 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.891+0000 7fd7ef7fe700 1 -- 172.21.15.136:0/2907234677 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fd7e8017030 con 0x7fd7f806a960 2023-10-06T04:43:12.899 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.891+0000 7fd7ef7fe700 1 -- 172.21.15.136:0/2907234677 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7fd7e8015070 con 0x7fd7f806a960 2023-10-06T04:43:12.899 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.891+0000 7fd7fe167700 1 -- 172.21.15.136:0/2907234677 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7f80a6130 con 0x7fd7f806a960 2023-10-06T04:43:12.899 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.894+0000 7fd7ef7fe700 1 -- 172.21.15.136:0/2907234677 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fd7e801f060 con 0x7fd7f806a960 2023-10-06T04:43:12.962 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-10-06T04:43:12.960+0000 7fa7d3342180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T04:43:12.978 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.976+0000 7fd7fe167700 1 -- 172.21.15.136:0/2907234677 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd new", "uuid": "719b654e-010d-4aa4-8c13-83fdde242b47", "id": 7} v 0) v1 -- 0x7fd7f804c380 con 0x7fd7f806a960 2023-10-06T04:43:12.986 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.984+0000 7fd7ef7fe700 1 -- 172.21.15.136:0/2907234677 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "719b654e-010d-4aa4-8c13-83fdde242b47", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd7e80280b0 con 0x7fd7f806a960 2023-10-06T04:43:12.986 INFO:teuthology.orchestra.run.smithi136.stdout:7 2023-10-06T04:43:12.987 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.985+0000 7fd7fe167700 1 -- 172.21.15.136:0/2907234677 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd7f806a960 msgr2=0x7fd7f80c2fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:12.987 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.985+0000 7fd7fe167700 1 --2- 172.21.15.136:0/2907234677 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd7f806a960 0x7fd7f80c2fe0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8006e80 tx=0x7fd7e800a3f0 comp rx=0 tx=0).stop 2023-10-06T04:43:12.987 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.985+0000 7fd7fe167700 1 -- 172.21.15.136:0/2907234677 shutdown_connections 2023-10-06T04:43:12.987 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.985+0000 7fd7fe167700 1 --2- 172.21.15.136:0/2907234677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7f80b0e30 0x7fd7f8151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:12.988 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.985+0000 7fd7fe167700 1 --2- 172.21.15.136:0/2907234677 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd7f806a960 0x7fd7f80c2fe0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:12.988 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.985+0000 7fd7fe167700 1 --2- 172.21.15.136:0/2907234677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7f80b0a60 0x7fd7f8151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:12.988 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.985+0000 7fd7fe167700 1 -- 172.21.15.136:0/2907234677 >> 172.21.15.136:0/2907234677 conn(0x7fd7f806f7b0 msgr2=0x7fd7f8154a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:12.988 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.985+0000 7fd7fe167700 1 -- 172.21.15.136:0/2907234677 shutdown_connections 2023-10-06T04:43:12.988 INFO:teuthology.orchestra.run.smithi136.stderr:2023-10-06T04:43:12.985+0000 7fd7fe167700 1 -- 172.21.15.136:0/2907234677 wait complete. 2023-10-06T04:43:12.999 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-06T04:43:12.999 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-06T04:43:13.001 INFO:tasks.ceph.osd.0:Started 2023-10-06T04:43:13.001 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-06T04:43:13.001 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-06T04:43:13.003 INFO:tasks.ceph.osd.1:Started 2023-10-06T04:43:13.003 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-06T04:43:13.003 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-06T04:43:13.005 INFO:tasks.ceph.osd.2:Started 2023-10-06T04:43:13.005 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-06T04:43:13.005 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-06T04:43:13.007 INFO:tasks.ceph.osd.3:Started 2023-10-06T04:43:13.007 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-06T04:43:13.008 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-06T04:43:13.009 INFO:tasks.ceph.osd.4:Started 2023-10-06T04:43:13.009 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-06T04:43:13.010 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-06T04:43:13.012 INFO:tasks.ceph.osd.5:Started 2023-10-06T04:43:13.012 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-06T04:43:13.012 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-06T04:43:13.014 INFO:tasks.ceph.osd.6:Started 2023-10-06T04:43:13.014 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-06T04:43:13.014 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-06T04:43:13.016 INFO:tasks.ceph.osd.7:Started 2023-10-06T04:43:13.017 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:43:13.156 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-10-06T04:43:13.154+0000 7fa7d3342180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T04:43:13.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.162+0000 7f7e75dd3700 1 Processor -- start 2023-10-06T04:43:13.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.162+0000 7f7e75dd3700 1 -- start start 2023-10-06T04:43:13.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.163+0000 7f7e75dd3700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7e700cd310 0x7f7e700b2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:13.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.163+0000 7f7e75dd3700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e7015b070 con 0x7f7e701515a0 2023-10-06T04:43:13.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.163+0000 7f7e75dd3700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e70157f70 con 0x7f7e70157a70 2023-10-06T04:43:13.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.163+0000 7f7e75dd3700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e7006afb0 con 0x7f7e700cd310 2023-10-06T04:43:13.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.163+0000 7f7e6ffff700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7e700cd310 0x7f7e700b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:13.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.163+0000 7f7e6f7fe700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f7e701515a0 0x7f7e70151970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:39750/0 (socket says 172.21.15.17:39750) 2023-10-06T04:43:13.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.163+0000 7f7e6f7fe700 1 -- 172.21.15.17:0/1667784980 learned_addr learned my addr 172.21.15.17:0/1667784980 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:13.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.164+0000 7f7e6ffff700 1 -- 172.21.15.17:0/1667784980 >> v1:172.21.15.136:6789/0 conn(0x7f7e70157a70 legacy=0x7f7e7006ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:13.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.164+0000 7f7e6ffff700 1 -- 172.21.15.17:0/1667784980 >> v1:172.21.15.17:6789/0 conn(0x7f7e701515a0 legacy=0x7f7e70151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:13.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.164+0000 7f7e6e7fc700 1 -- 172.21.15.17:0/1667784980 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1207017652 0 0) 0x7f7e7015b070 con 0x7f7e701515a0 2023-10-06T04:43:13.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.164+0000 7f7e6ffff700 1 -- 172.21.15.17:0/1667784980 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e70158250 con 0x7f7e700cd310 2023-10-06T04:43:13.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.164+0000 7f7e6ffff700 1 --2- 172.21.15.17:0/1667784980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e700cd310 0x7f7e700b2440 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7e68009e60 tx=0x7f7e68009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c3bbada59e389ed server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:13.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.164+0000 7f7e6e7fc700 1 -- 172.21.15.17:0/1667784980 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6800e070 con 0x7f7e700cd310 2023-10-06T04:43:13.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.164+0000 7f7e6e7fc700 1 -- 172.21.15.17:0/1667784980 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6800bc30 con 0x7f7e700cd310 2023-10-06T04:43:13.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.164+0000 7f7e6e7fc700 1 -- 172.21.15.17:0/1667784980 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e68012430 con 0x7f7e700cd310 2023-10-06T04:43:13.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.165+0000 7f7e75dd3700 1 -- 172.21.15.17:0/1667784980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e700cd310 msgr2=0x7f7e700b2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:13.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.165+0000 7f7e75dd3700 1 --2- 172.21.15.17:0/1667784980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e700cd310 0x7f7e700b2440 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7e68009e60 tx=0x7f7e68009780 comp rx=0 tx=0).stop 2023-10-06T04:43:13.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.165+0000 7f7e75dd3700 1 -- 172.21.15.17:0/1667784980 shutdown_connections 2023-10-06T04:43:13.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.165+0000 7f7e75dd3700 1 --2- 172.21.15.17:0/1667784980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e700cd310 0x7f7e700b2440 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:13.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.165+0000 7f7e75dd3700 1 -- 172.21.15.17:0/1667784980 >> 172.21.15.17:0/1667784980 conn(0x7f7e700675f0 msgr2=0x7f7e700679f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:13.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.165+0000 7f7e75dd3700 1 -- 172.21.15.17:0/1667784980 shutdown_connections 2023-10-06T04:43:13.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.165+0000 7f7e75dd3700 1 -- 172.21.15.17:0/1667784980 wait complete. 2023-10-06T04:43:13.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.166+0000 7f7e75dd3700 1 Processor -- start 2023-10-06T04:43:13.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.166+0000 7f7e75dd3700 1 -- start start 2023-10-06T04:43:13.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.167+0000 7f7e75dd3700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e700cd310 0x7f7e70150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:13.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.167+0000 7f7e75dd3700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e701515a0 0x7f7e70154c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:13.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.167+0000 7f7e75dd3700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7e70157a70 0x7f7e70153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:13.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.167+0000 7f7e75dd3700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e70153640 con 0x7f7e701515a0 2023-10-06T04:43:13.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.167+0000 7f7e75dd3700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e70152a70 con 0x7f7e700cd310 2023-10-06T04:43:13.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.167+0000 7f7e75dd3700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e70152d10 con 0x7f7e70157a70 2023-10-06T04:43:13.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.167+0000 7f7e6effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e701515a0 0x7f7e70154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:13.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.167+0000 7f7e6f7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e700cd310 0x7f7e70150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:13.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.167+0000 7f7e6effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e701515a0 0x7f7e70154c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46986/0 (socket says 172.21.15.17:46986) 2023-10-06T04:43:13.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.167+0000 7f7e6effd700 1 -- 172.21.15.17:0/419846958 learned_addr learned my addr 172.21.15.17:0/419846958 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:13.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.167+0000 7f7e6ffff700 1 --2- 172.21.15.17:0/419846958 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7e70157a70 0x7f7e70153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:13.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.167+0000 7f7e6effd700 1 -- 172.21.15.17:0/419846958 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7e70157a70 msgr2=0x7f7e70153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:13.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.167+0000 7f7e6effd700 1 --2- 172.21.15.17:0/419846958 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7e70157a70 0x7f7e70153ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:13.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.167+0000 7f7e6effd700 1 -- 172.21.15.17:0/419846958 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e700cd310 msgr2=0x7f7e70150f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:13.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.167+0000 7f7e6effd700 1 --2- 172.21.15.17:0/419846958 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e700cd310 0x7f7e70150f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:13.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.167+0000 7f7e6effd700 1 -- 172.21.15.17:0/419846958 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e68009a20 con 0x7f7e701515a0 2023-10-06T04:43:13.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.167+0000 7f7e6f7fe700 1 --2- 172.21.15.17:0/419846958 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e700cd310 0x7f7e70150f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:43:13.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.167+0000 7f7e6effd700 1 --2- 172.21.15.17:0/419846958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e701515a0 0x7f7e70154c60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7e6400c590 tx=0x7f7e64007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:13.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.167+0000 7f7e577fe700 1 -- 172.21.15.17:0/419846958 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e64011590 con 0x7f7e701515a0 2023-10-06T04:43:13.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.168+0000 7f7e577fe700 1 -- 172.21.15.17:0/419846958 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e64011710 con 0x7f7e701515a0 2023-10-06T04:43:13.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.168+0000 7f7e577fe700 1 -- 172.21.15.17:0/419846958 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e64011ad0 con 0x7f7e701515a0 2023-10-06T04:43:13.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.168+0000 7f7e75dd3700 1 -- 172.21.15.17:0/419846958 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e70152ff0 con 0x7f7e701515a0 2023-10-06T04:43:13.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.168+0000 7f7e75dd3700 1 -- 172.21.15.17:0/419846958 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e701551a0 con 0x7f7e701515a0 2023-10-06T04:43:13.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.168+0000 7f7e577fe700 1 -- 172.21.15.17:0/419846958 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f7e64006aa0 con 0x7f7e701515a0 2023-10-06T04:43:13.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.168+0000 7f7e577fe700 1 -- 172.21.15.17:0/419846958 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f7e6401aa40 con 0x7f7e701515a0 2023-10-06T04:43:13.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.169+0000 7f7e75dd3700 1 -- 172.21.15.17:0/419846958 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e7004c380 con 0x7f7e701515a0 2023-10-06T04:43:13.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.171+0000 7f7e577fe700 1 -- 172.21.15.17:0/419846958 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f7e64017070 con 0x7f7e701515a0 2023-10-06T04:43:13.234 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-10-06T04:43:13.232+0000 7fa7d3342180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T04:43:13.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.262+0000 7f7e75dd3700 1 -- 172.21.15.17:0/419846958 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e70158530 con 0x7f7e701515a0 2023-10-06T04:43:13.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.263+0000 7f7e577fe700 1 -- 172.21.15.17:0/419846958 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f7e64006d50 con 0x7f7e701515a0 2023-10-06T04:43:13.264 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:43:13.265 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":10,"fsid":"780777c4-2b25-4d35-9058-c9f2d62e3ad9","created":"2023-10-06T04:43:10.578520+0000","modified":"2023-10-06T04:43:12.978917+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T04:43:12.978917+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"84737b08-575c-46dd-9488-073ae8504494","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"dffeb740-58a2-4fd6-8ff1-a0a11a2cc709","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"48bd6831-763d-48c2-b515-e02c216d608b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ae7dbb23-abe7-4bd3-a4df-6f5963d6804c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"29991fb4-1667-4ea3-aca0-d55db27f3bfe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"398b4ff9-03fc-421f-882c-ba12aa088eeb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1bb91a72-4dab-4cdb-aa1d-2b8a9edf1ad0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"719b654e-010d-4aa4-8c13-83fdde242b47","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:43:13.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.264+0000 7f7e75dd3700 1 -- 172.21.15.17:0/419846958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e701515a0 msgr2=0x7f7e70154c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:13.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.264+0000 7f7e75dd3700 1 --2- 172.21.15.17:0/419846958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e701515a0 0x7f7e70154c60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7e6400c590 tx=0x7f7e64007f50 comp rx=0 tx=0).stop 2023-10-06T04:43:13.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.264+0000 7f7e75dd3700 1 -- 172.21.15.17:0/419846958 shutdown_connections 2023-10-06T04:43:13.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.264+0000 7f7e75dd3700 1 --2- 172.21.15.17:0/419846958 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7e70157a70 0x7f7e70153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:13.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.264+0000 7f7e75dd3700 1 --2- 172.21.15.17:0/419846958 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e700cd310 0x7f7e70150f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:13.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.264+0000 7f7e75dd3700 1 --2- 172.21.15.17:0/419846958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e701515a0 0x7f7e70154c60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:13.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.264+0000 7f7e75dd3700 1 -- 172.21.15.17:0/419846958 >> 172.21.15.17:0/419846958 conn(0x7f7e700675f0 msgr2=0x7f7e700aeda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:13.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.264+0000 7f7e75dd3700 1 -- 172.21.15.17:0/419846958 shutdown_connections 2023-10-06T04:43:13.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:13.264+0000 7f7e75dd3700 1 -- 172.21.15.17:0/419846958 wait complete. 2023-10-06T04:43:13.278 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-06T04:43:13.278 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-06T04:43:13.323 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-06T04:43:13.322+0000 7f1181156180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T04:43:13.370 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-10-06T04:43:13.368+0000 7fa7d3342180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T04:43:13.405 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-06T04:43:13.403+0000 7f1181156180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T04:43:13.466 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-10-06T04:43:13.464+0000 7fa7d3342180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T04:43:13.485 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-06T04:43:13.484+0000 7f1181156180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T04:43:13.608 INFO:tasks.ceph.osd.4.smithi136.stderr:2023-10-06T04:43:13.606+0000 7fa6c74ab540 -1 Falling back to public interface 2023-10-06T04:43:13.610 INFO:tasks.ceph.osd.1.smithi017.stderr:2023-10-06T04:43:13.608+0000 7fb25e4f4540 -1 Falling back to public interface 2023-10-06T04:43:13.612 INFO:tasks.ceph.osd.5.smithi136.stderr:2023-10-06T04:43:13.610+0000 7f64cb648540 -1 Falling back to public interface 2023-10-06T04:43:13.614 INFO:tasks.ceph.osd.2.smithi017.stderr:2023-10-06T04:43:13.613+0000 7feba5d94540 -1 Falling back to public interface 2023-10-06T04:43:13.615 INFO:tasks.ceph.osd.0.smithi017.stderr:2023-10-06T04:43:13.613+0000 7f1de4285540 -1 Falling back to public interface 2023-10-06T04:43:13.615 INFO:tasks.ceph.osd.0.smithi017.stderr:2023-10-06T04:43:13.613+0000 7f1dde6ae700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6808/0: (98) Address already in use 2023-10-06T04:43:13.615 INFO:tasks.ceph.osd.0.smithi017.stderr:2023-10-06T04:43:13.613+0000 7f1dde6ae700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6810/0: (98) Address already in use 2023-10-06T04:43:13.615 INFO:tasks.ceph.osd.2.smithi017.stderr:2023-10-06T04:43:13.613+0000 7feba01bd700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6812/0: (98) Address already in use 2023-10-06T04:43:13.641 INFO:tasks.ceph.osd.7.smithi136.stderr:2023-10-06T04:43:13.639+0000 7f7463ed7540 -1 Falling back to public interface 2023-10-06T04:43:13.643 INFO:tasks.ceph.osd.3.smithi017.stderr:2023-10-06T04:43:13.641+0000 7f64d0555540 -1 Falling back to public interface 2023-10-06T04:43:13.643 INFO:tasks.ceph.osd.6.smithi136.stderr:2023-10-06T04:43:13.641+0000 7f2dae56a540 -1 Falling back to public interface 2023-10-06T04:43:13.976 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-10-06T04:43:13.974+0000 7fa7d3342180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T04:43:14.052 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-10-06T04:43:14.050+0000 7fa7d3342180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T04:43:14.083 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T04:43:14.087 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-06T04:43:14.085+0000 7f1181156180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T04:43:14.129 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-10-06T04:43:14.127+0000 7fa7d3342180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T04:43:14.193 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.191+0000 7fad076de700 1 Processor -- start 2023-10-06T04:43:14.193 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.191+0000 7fad076de700 1 -- start start 2023-10-06T04:43:14.196 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.193+0000 7fad076de700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fad0006ba20 0x7fad0006bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:14.197 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.193+0000 7fad076de700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad000cdd50 con 0x7fad0013fdd0 2023-10-06T04:43:14.197 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.193+0000 7fad076de700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad000c8860 con 0x7fad000cc100 2023-10-06T04:43:14.197 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.193+0000 7fad076de700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad0006c8e0 con 0x7fad0006ba20 2023-10-06T04:43:14.197 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.193+0000 7fad0547a700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fad0013fdd0 0x7fad000c9570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:39762/0 (socket says 172.21.15.17:39762) 2023-10-06T04:43:14.197 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.193+0000 7fad0547a700 1 -- 172.21.15.17:0/712378793 learned_addr learned my addr 172.21.15.17:0/712378793 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:14.197 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.193+0000 7fad04c79700 1 --2- 172.21.15.17:0/712378793 >> v2:172.21.15.136:3300/0 conn(0x7fad0006ba20 0x7fad0006bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:14.197 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.193+0000 7facf7fff700 1 -- 172.21.15.17:0/712378793 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2766843886 0 0) 0x7fad000cdd50 con 0x7fad0013fdd0 2023-10-06T04:43:14.197 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.193+0000 7facf7fff700 1 -- 172.21.15.17:0/712378793 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facec003570 con 0x7fad0013fdd0 2023-10-06T04:43:14.197 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.193+0000 7facf7fff700 1 -- 172.21.15.17:0/712378793 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1287301672 0 0) 0x7fad000c8860 con 0x7fad000cc100 2023-10-06T04:43:14.198 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.193+0000 7facf7fff700 1 -- 172.21.15.17:0/712378793 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad000cdd50 con 0x7fad000cc100 2023-10-06T04:43:14.198 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.193+0000 7fad04c79700 1 -- 172.21.15.17:0/712378793 >> v1:172.21.15.136:6789/0 conn(0x7fad000cc100 legacy=0x7fad000b00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:14.198 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.193+0000 7fad04c79700 1 -- 172.21.15.17:0/712378793 >> v1:172.21.15.17:6789/0 conn(0x7fad0013fdd0 legacy=0x7fad000c9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:14.198 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.193+0000 7fad04c79700 1 -- 172.21.15.17:0/712378793 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad000c90e0 con 0x7fad0006ba20 2023-10-06T04:43:14.198 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.194+0000 7fad04c79700 1 --2- 172.21.15.17:0/712378793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fad0006ba20 0x7fad0006bec0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7facfc0098e0 tx=0x7facfc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51742619fb13abaa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:14.198 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.194+0000 7facf7fff700 1 -- 172.21.15.17:0/712378793 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc011630 con 0x7fad0006ba20 2023-10-06T04:43:14.198 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.194+0000 7facf7fff700 1 -- 172.21.15.17:0/712378793 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facfc011790 con 0x7fad0006ba20 2023-10-06T04:43:14.198 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.194+0000 7facf7fff700 1 -- 172.21.15.17:0/712378793 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc011b30 con 0x7fad0006ba20 2023-10-06T04:43:14.198 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.195+0000 7fad076de700 1 -- 172.21.15.17:0/712378793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fad0006ba20 msgr2=0x7fad0006bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:14.198 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.195+0000 7fad076de700 1 --2- 172.21.15.17:0/712378793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fad0006ba20 0x7fad0006bec0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7facfc0098e0 tx=0x7facfc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:14.198 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.195+0000 7fad076de700 1 -- 172.21.15.17:0/712378793 shutdown_connections 2023-10-06T04:43:14.198 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.195+0000 7fad076de700 1 --2- 172.21.15.17:0/712378793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fad0006ba20 0x7fad0006bec0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:14.199 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.195+0000 7fad076de700 1 -- 172.21.15.17:0/712378793 >> 172.21.15.17:0/712378793 conn(0x7fad0006b200 msgr2=0x7fad000cd310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:14.199 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.195+0000 7fad076de700 1 -- 172.21.15.17:0/712378793 shutdown_connections 2023-10-06T04:43:14.199 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.195+0000 7fad076de700 1 -- 172.21.15.17:0/712378793 wait complete. 2023-10-06T04:43:14.201 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.196+0000 7fad076de700 1 Processor -- start 2023-10-06T04:43:14.201 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.197+0000 7fad076de700 1 -- start start 2023-10-06T04:43:14.201 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.198+0000 7fad076de700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad0006ba20 0x7fad000c7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:14.201 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.198+0000 7fad076de700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fad000cc100 0x7fad0013eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:14.201 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.198+0000 7fad076de700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fad0013fdd0 0x7fad000c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:14.202 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.198+0000 7fad076de700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad000a5750 con 0x7fad0006ba20 2023-10-06T04:43:14.202 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.198+0000 7fad076de700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad000c6380 con 0x7fad0013fdd0 2023-10-06T04:43:14.202 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.198+0000 7fad076de700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad000c6660 con 0x7fad000cc100 2023-10-06T04:43:14.202 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.198+0000 7fad0547a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad0006ba20 0x7fad000c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:14.202 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.198+0000 7fad04c79700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fad000cc100 0x7fad0013eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:14.202 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.198+0000 7fad0547a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad0006ba20 0x7fad000c7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46996/0 (socket says 172.21.15.17:46996) 2023-10-06T04:43:14.202 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.198+0000 7fad05c7b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fad0013fdd0 0x7fad000c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:14.202 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.198+0000 7fad0547a700 1 -- 172.21.15.17:0/3320260964 learned_addr learned my addr 172.21.15.17:0/3320260964 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:14.202 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.198+0000 7fad05c7b700 1 -- 172.21.15.17:0/3320260964 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fad000cc100 msgr2=0x7fad0013eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:14.202 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.198+0000 7fad05c7b700 1 --2- 172.21.15.17:0/3320260964 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fad000cc100 0x7fad0013eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:14.202 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.198+0000 7fad05c7b700 1 -- 172.21.15.17:0/3320260964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad0006ba20 msgr2=0x7fad000c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:14.203 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.198+0000 7fad05c7b700 1 --2- 172.21.15.17:0/3320260964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad0006ba20 0x7fad000c7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:14.203 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.198+0000 7fad05c7b700 1 -- 172.21.15.17:0/3320260964 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facfc009420 con 0x7fad0013fdd0 2023-10-06T04:43:14.203 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.198+0000 7fad0547a700 1 --2- 172.21.15.17:0/3320260964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad0006ba20 0x7fad000c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:43:14.203 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.199+0000 7fad05c7b700 1 --2- 172.21.15.17:0/3320260964 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fad0013fdd0 0x7fad000c57c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7facf800c810 tx=0x7facf8002650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:14.203 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.199+0000 7facf57fa700 1 -- 172.21.15.17:0/3320260964 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf8012630 con 0x7fad0013fdd0 2023-10-06T04:43:14.203 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.199+0000 7facf57fa700 1 -- 172.21.15.17:0/3320260964 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf80127b0 con 0x7fad0013fdd0 2023-10-06T04:43:14.203 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.199+0000 7fad076de700 1 -- 172.21.15.17:0/3320260964 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad000c6940 con 0x7fad0013fdd0 2023-10-06T04:43:14.203 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.199+0000 7facf57fa700 1 -- 172.21.15.17:0/3320260964 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf8012b70 con 0x7fad0013fdd0 2023-10-06T04:43:14.203 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.199+0000 7fad076de700 1 -- 172.21.15.17:0/3320260964 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad000c6f00 con 0x7fad0013fdd0 2023-10-06T04:43:14.203 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.199+0000 7facf57fa700 1 -- 172.21.15.17:0/3320260964 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7facf801b680 con 0x7fad0013fdd0 2023-10-06T04:43:14.204 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.199+0000 7facf57fa700 1 -- 172.21.15.17:0/3320260964 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7facf801aa90 con 0x7fad0013fdd0 2023-10-06T04:43:14.204 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.200+0000 7fad076de700 1 -- 172.21.15.17:0/3320260964 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad00063e90 con 0x7fad0013fdd0 2023-10-06T04:43:14.204 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.202+0000 7facf57fa700 1 -- 172.21.15.17:0/3320260964 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7facf803a6d0 con 0x7fad0013fdd0 2023-10-06T04:43:14.236 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-06T04:43:14.234+0000 7f1181156180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T04:43:14.273 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.272+0000 7fad076de700 1 -- 172.21.15.17:0/3320260964 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad000c70f0 con 0x7fad0013fdd0 2023-10-06T04:43:14.274 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.272+0000 7facf57fa700 1 -- 172.21.15.17:0/3320260964 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7facf8029070 con 0x7fad0013fdd0 2023-10-06T04:43:14.274 INFO:teuthology.misc.health.smithi017.stdout: 2023-10-06T04:43:14.274 INFO:teuthology.misc.health.smithi017.stdout:{"epoch":10,"fsid":"780777c4-2b25-4d35-9058-c9f2d62e3ad9","created":"2023-10-06T04:43:10.578520+0000","modified":"2023-10-06T04:43:12.978917+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T04:43:12.978917+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"84737b08-575c-46dd-9488-073ae8504494","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"dffeb740-58a2-4fd6-8ff1-a0a11a2cc709","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"48bd6831-763d-48c2-b515-e02c216d608b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ae7dbb23-abe7-4bd3-a4df-6f5963d6804c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"29991fb4-1667-4ea3-aca0-d55db27f3bfe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"398b4ff9-03fc-421f-882c-ba12aa088eeb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1bb91a72-4dab-4cdb-aa1d-2b8a9edf1ad0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"719b654e-010d-4aa4-8c13-83fdde242b47","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:43:14.275 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.273+0000 7fad076de700 1 -- 172.21.15.17:0/3320260964 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fad0013fdd0 msgr2=0x7fad000c57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:14.276 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.273+0000 7fad076de700 1 --2- 172.21.15.17:0/3320260964 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fad0013fdd0 0x7fad000c57c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7facf800c810 tx=0x7facf8002650 comp rx=0 tx=0).stop 2023-10-06T04:43:14.276 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.274+0000 7fad076de700 1 -- 172.21.15.17:0/3320260964 shutdown_connections 2023-10-06T04:43:14.276 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.274+0000 7fad076de700 1 --2- 172.21.15.17:0/3320260964 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fad0013fdd0 0x7fad000c57c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:14.276 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.274+0000 7fad076de700 1 --2- 172.21.15.17:0/3320260964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad0006ba20 0x7fad000c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:14.276 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.274+0000 7fad076de700 1 --2- 172.21.15.17:0/3320260964 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fad000cc100 0x7fad0013eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:14.276 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.274+0000 7fad076de700 1 -- 172.21.15.17:0/3320260964 >> 172.21.15.17:0/3320260964 conn(0x7fad0006b200 msgr2=0x7fad000b00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:14.276 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.274+0000 7fad076de700 1 -- 172.21.15.17:0/3320260964 shutdown_connections 2023-10-06T04:43:14.276 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:14.274+0000 7fad076de700 1 -- 172.21.15.17:0/3320260964 wait complete. 2023-10-06T04:43:14.286 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-06T04:43:14.327 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-06T04:43:14.325+0000 7f1181156180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T04:43:14.586 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-06T04:43:14.584+0000 7f1181156180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T04:43:14.666 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-06T04:43:14.665+0000 7f1181156180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T04:43:14.715 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-10-06T04:43:14.713+0000 7fa7d3342180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T04:43:14.854 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-10-06T04:43:14.852+0000 7fa7d3342180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T04:43:14.947 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-10-06T04:43:14.945+0000 7fa7d3342180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T04:43:15.199 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-10-06T04:43:15.197+0000 7fa7d3342180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T04:43:15.276 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-10-06T04:43:15.274+0000 7fa7d3342180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T04:43:15.530 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-06T04:43:15.529+0000 7f1181156180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T04:43:15.607 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-06T04:43:15.606+0000 7f1181156180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T04:43:15.684 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-06T04:43:15.683+0000 7f1181156180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T04:43:15.822 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-06T04:43:15.821+0000 7f1181156180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T04:43:15.911 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-06T04:43:15.909+0000 7f1181156180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T04:43:16.076 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-06T04:43:16.075+0000 7f1181156180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T04:43:16.108 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-10-06T04:43:16.106+0000 7fa7d3342180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T04:43:16.158 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-06T04:43:16.157+0000 7f1181156180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T04:43:16.183 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-10-06T04:43:16.181+0000 7fa7d3342180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T04:43:16.236 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-06T04:43:16.234+0000 7f1181156180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T04:43:16.257 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-10-06T04:43:16.255+0000 7fa7d3342180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T04:43:16.315 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-06T04:43:16.313+0000 7f1181156180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T04:43:16.457 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-10-06T04:43:16.455+0000 7fa7d3342180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T04:43:16.585 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-10-06T04:43:16.582+0000 7fa7d3342180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T04:43:16.737 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-10-06T04:43:16.735+0000 7fa7d3342180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T04:43:16.812 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-10-06T04:43:16.810+0000 7fa7d3342180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T04:43:16.896 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-10-06T04:43:16.894+0000 7fa7d3342180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T04:43:16.971 INFO:tasks.ceph.mgr.x.smithi136.stderr:2023-10-06T04:43:16.969+0000 7fa7d3342180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T04:43:17.095 INFO:tasks.ceph.osd.1.smithi017.stderr:2023-10-06T04:43:17.093+0000 7fb25e4f4540 -1 osd.1 0 log_to_monitors true 2023-10-06T04:43:17.137 INFO:tasks.ceph.osd.0.smithi017.stderr:2023-10-06T04:43:17.135+0000 7f1de4285540 -1 osd.0 0 log_to_monitors true 2023-10-06T04:43:17.140 INFO:tasks.ceph.osd.5.smithi136.stderr:2023-10-06T04:43:17.138+0000 7f64cb648540 -1 osd.5 0 log_to_monitors true 2023-10-06T04:43:17.143 INFO:tasks.ceph.osd.2.smithi017.stderr:2023-10-06T04:43:17.141+0000 7feba5d94540 -1 osd.2 0 log_to_monitors true 2023-10-06T04:43:17.157 INFO:tasks.ceph.osd.4.smithi136.stderr:2023-10-06T04:43:17.155+0000 7fa6c74ab540 -1 osd.4 0 log_to_monitors true 2023-10-06T04:43:17.160 INFO:tasks.ceph.osd.7.smithi136.stderr:2023-10-06T04:43:17.159+0000 7f7463ed7540 -1 osd.7 0 log_to_monitors true 2023-10-06T04:43:17.165 INFO:tasks.ceph.osd.6.smithi136.stderr:2023-10-06T04:43:17.163+0000 7f2dae56a540 -1 osd.6 0 log_to_monitors true 2023-10-06T04:43:17.194 INFO:tasks.ceph.osd.3.smithi017.stderr:2023-10-06T04:43:17.193+0000 7f64d0555540 -1 osd.3 0 log_to_monitors true 2023-10-06T04:43:17.339 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-06T04:43:17.337+0000 7f113a559700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-06T04:43:17.339 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-06T04:43:17.338+0000 7f113a559700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-06T04:43:19.677 INFO:tasks.ceph.osd.1.smithi017.stderr:2023-10-06T04:43:19.675+0000 7fb255116700 -1 osd.1 0 waiting for initial osdmap 2023-10-06T04:43:19.684 INFO:tasks.ceph.osd.1.smithi017.stderr:2023-10-06T04:43:19.681+0000 7fb24df0d700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:43:19.727 INFO:tasks.ceph.osd.0.smithi017.stderr:2023-10-06T04:43:19.725+0000 7f1ddaea7700 -1 osd.0 0 waiting for initial osdmap 2023-10-06T04:43:19.732 INFO:tasks.ceph.osd.0.smithi017.stderr:2023-10-06T04:43:19.730+0000 7f1dd3c9e700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:43:19.748 INFO:tasks.ceph.osd.3.smithi017.stderr:2023-10-06T04:43:19.746+0000 7f64c7177700 -1 osd.3 0 waiting for initial osdmap 2023-10-06T04:43:19.753 INFO:tasks.ceph.osd.3.smithi017.stderr:2023-10-06T04:43:19.751+0000 7f64bff6e700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:43:19.820 INFO:tasks.ceph.osd.5.smithi136.stderr:2023-10-06T04:43:19.818+0000 7f64c3a6d700 -1 osd.5 0 waiting for initial osdmap 2023-10-06T04:43:19.828 INFO:tasks.ceph.osd.5.smithi136.stderr:2023-10-06T04:43:19.822+0000 7f64bb061700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:43:19.830 INFO:tasks.ceph.osd.2.smithi017.stderr:2023-10-06T04:43:19.828+0000 7feb9e1b9700 -1 osd.2 0 waiting for initial osdmap 2023-10-06T04:43:19.830 INFO:tasks.ceph.osd.6.smithi136.stderr:2023-10-06T04:43:19.826+0000 7f2da518c700 -1 osd.6 0 waiting for initial osdmap 2023-10-06T04:43:19.831 INFO:tasks.ceph.osd.6.smithi136.stderr:2023-10-06T04:43:19.830+0000 7f2d9df83700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:43:19.839 INFO:tasks.ceph.osd.2.smithi017.stderr:2023-10-06T04:43:19.834+0000 7feb957ad700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:43:19.870 INFO:tasks.ceph.osd.4.smithi136.stderr:2023-10-06T04:43:19.864+0000 7fa6be0cd700 -1 osd.4 0 waiting for initial osdmap 2023-10-06T04:43:19.871 INFO:tasks.ceph.osd.4.smithi136.stderr:2023-10-06T04:43:19.869+0000 7fa6b6ec4700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:43:19.884 INFO:tasks.ceph.osd.7.smithi136.stderr:2023-10-06T04:43:19.880+0000 7f745aaf9700 -1 osd.7 0 waiting for initial osdmap 2023-10-06T04:43:19.887 INFO:tasks.ceph.osd.7.smithi136.stderr:2023-10-06T04:43:19.884+0000 7f74538f0700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:43:21.092 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T04:43:21.215 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.213+0000 7f0ba359e700 1 Processor -- start 2023-10-06T04:43:21.215 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.213+0000 7f0ba359e700 1 -- start start 2023-10-06T04:43:21.217 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.214+0000 7f0ba359e700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0ba4159380 0x7f0ba415db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:21.217 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.214+0000 7f0ba359e700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0ba4159750 0x7f0ba40c6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:21.218 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.214+0000 7f0ba359e700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ba4067620 con 0x7f0ba40c74d0 2023-10-06T04:43:21.218 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.214+0000 7f0ba359e700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ba40681a0 con 0x7f0ba4159380 2023-10-06T04:43:21.218 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.214+0000 7f0ba359e700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba40ca100 con 0x7f0ba4159750 2023-10-06T04:43:21.218 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.214+0000 7f0ba259c700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0ba4159380 0x7f0ba415db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:21.218 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.214+0000 7f0ba2d9d700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f0ba40c74d0 0x7f0ba4068630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:32840/0 (socket says 172.21.15.17:32840) 2023-10-06T04:43:21.218 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.214+0000 7f0ba2d9d700 1 -- 172.21.15.17:0/2036485297 learned_addr learned my addr 172.21.15.17:0/2036485297 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:21.218 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.214+0000 7f0ba1d9b700 1 --2- 172.21.15.17:0/2036485297 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0ba4159750 0x7f0ba40c6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:21.218 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.215+0000 7f0ba159a700 1 -- 172.21.15.17:0/2036485297 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2783638271 0 0) 0x7f0ba4067620 con 0x7f0ba40c74d0 2023-10-06T04:43:21.218 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.215+0000 7f0ba159a700 1 -- 172.21.15.17:0/2036485297 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b90003570 con 0x7f0ba40c74d0 2023-10-06T04:43:21.218 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.215+0000 7f0ba259c700 1 -- 172.21.15.17:0/2036485297 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0ba4159750 msgr2=0x7f0ba40c6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:21.218 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.215+0000 7f0ba259c700 1 --2- 172.21.15.17:0/2036485297 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0ba4159750 0x7f0ba40c6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:21.219 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.215+0000 7f0ba259c700 1 -- 172.21.15.17:0/2036485297 >> v1:172.21.15.17:6789/0 conn(0x7f0ba40c74d0 legacy=0x7f0ba4068630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:21.219 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.215+0000 7f0ba259c700 1 -- 172.21.15.17:0/2036485297 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba4067870 con 0x7f0ba4159380 2023-10-06T04:43:21.219 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.215+0000 7f0ba259c700 1 --2- 172.21.15.17:0/2036485297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ba4159380 0x7f0ba415db10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c0098e0 tx=0x7f0b9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=717d0e59cc7ff0ac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:21.219 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.215+0000 7f0ba159a700 1 -- 172.21.15.17:0/2036485297 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c011630 con 0x7f0ba4159380 2023-10-06T04:43:21.219 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.215+0000 7f0ba159a700 1 -- 172.21.15.17:0/2036485297 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b9c011790 con 0x7f0ba4159380 2023-10-06T04:43:21.219 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.215+0000 7f0ba159a700 1 -- 172.21.15.17:0/2036485297 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c011b30 con 0x7f0ba4159380 2023-10-06T04:43:21.219 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.216+0000 7f0ba359e700 1 -- 172.21.15.17:0/2036485297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ba4159380 msgr2=0x7f0ba415db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:21.219 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.216+0000 7f0ba359e700 1 --2- 172.21.15.17:0/2036485297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ba4159380 0x7f0ba415db10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c0098e0 tx=0x7f0b9c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:21.219 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.216+0000 7f0ba359e700 1 -- 172.21.15.17:0/2036485297 shutdown_connections 2023-10-06T04:43:21.219 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.216+0000 7f0ba359e700 1 --2- 172.21.15.17:0/2036485297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ba4159380 0x7f0ba415db10 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:21.219 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.216+0000 7f0ba359e700 1 --2- 172.21.15.17:0/2036485297 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0ba4159750 0x7f0ba40c6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:21.219 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.216+0000 7f0ba359e700 1 -- 172.21.15.17:0/2036485297 >> 172.21.15.17:0/2036485297 conn(0x7f0ba40c93c0 msgr2=0x7f0ba40c97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:21.220 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.216+0000 7f0ba359e700 1 -- 172.21.15.17:0/2036485297 shutdown_connections 2023-10-06T04:43:21.220 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.216+0000 7f0ba359e700 1 -- 172.21.15.17:0/2036485297 wait complete. 2023-10-06T04:43:21.222 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.217+0000 7f0ba359e700 1 Processor -- start 2023-10-06T04:43:21.222 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.217+0000 7f0ba359e700 1 -- start start 2023-10-06T04:43:21.222 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.218+0000 7f0ba359e700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0ba40c74d0 0x7f0ba4146da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:21.223 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.218+0000 7f0ba359e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ba4159380 0x7f0ba415c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:21.223 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.218+0000 7f0ba359e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ba4159750 0x7f0ba415c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:21.223 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.218+0000 7f0ba359e700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba40c4d30 con 0x7f0ba4159750 2023-10-06T04:43:21.223 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.218+0000 7f0ba359e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba40c5010 con 0x7f0ba4159380 2023-10-06T04:43:21.223 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.218+0000 7f0ba359e700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba40c52f0 con 0x7f0ba40c74d0 2023-10-06T04:43:21.223 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.218+0000 7f0ba2d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ba4159750 0x7f0ba415c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:21.223 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.218+0000 7f0ba2d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ba4159750 0x7f0ba415c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32878/0 (socket says 172.21.15.17:32878) 2023-10-06T04:43:21.223 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.218+0000 7f0ba2d9d700 1 -- 172.21.15.17:0/3117074678 learned_addr learned my addr 172.21.15.17:0/3117074678 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:21.223 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.218+0000 7f0ba259c700 1 --2- 172.21.15.17:0/3117074678 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0ba40c74d0 0x7f0ba4146da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:21.223 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.218+0000 7f0ba1d9b700 1 --2- 172.21.15.17:0/3117074678 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ba4159380 0x7f0ba415c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:21.223 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.218+0000 7f0ba2d9d700 1 -- 172.21.15.17:0/3117074678 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0ba40c74d0 msgr2=0x7f0ba4146da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:21.224 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.218+0000 7f0ba2d9d700 1 --2- 172.21.15.17:0/3117074678 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0ba40c74d0 0x7f0ba4146da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:21.224 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.218+0000 7f0ba2d9d700 1 -- 172.21.15.17:0/3117074678 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ba4159380 msgr2=0x7f0ba415c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:21.224 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.218+0000 7f0ba2d9d700 1 --2- 172.21.15.17:0/3117074678 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ba4159380 0x7f0ba415c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:21.224 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.218+0000 7f0ba2d9d700 1 -- 172.21.15.17:0/3117074678 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b9c009420 con 0x7f0ba4159750 2023-10-06T04:43:21.224 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.218+0000 7f0ba2d9d700 1 --2- 172.21.15.17:0/3117074678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ba4159750 0x7f0ba415c930 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0b94001460 tx=0x7f0b94001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:21.224 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.218+0000 7f0b9a7fc700 1 -- 172.21.15.17:0/3117074678 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9400a890 con 0x7f0ba4159750 2023-10-06T04:43:21.224 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.218+0000 7f0b9a7fc700 1 -- 172.21.15.17:0/3117074678 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b9400a9f0 con 0x7f0ba4159750 2023-10-06T04:43:21.224 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.218+0000 7f0ba359e700 1 -- 172.21.15.17:0/3117074678 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ba40c55d0 con 0x7f0ba4159750 2023-10-06T04:43:21.224 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.218+0000 7f0b9a7fc700 1 -- 172.21.15.17:0/3117074678 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9400ad70 con 0x7f0ba4159750 2023-10-06T04:43:21.224 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.218+0000 7f0ba359e700 1 -- 172.21.15.17:0/3117074678 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba41472e0 con 0x7f0ba4159750 2023-10-06T04:43:21.225 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.219+0000 7f0ba359e700 1 -- 172.21.15.17:0/3117074678 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ba404c380 con 0x7f0ba4159750 2023-10-06T04:43:21.225 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.220+0000 7f0b9a7fc700 1 -- 172.21.15.17:0/3117074678 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f0b94007300 con 0x7f0ba4159750 2023-10-06T04:43:21.225 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.220+0000 7f0b9a7fc700 1 --2- 172.21.15.17:0/3117074678 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0b84066ea0 0x7f0b84069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:21.225 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.220+0000 7f0b9a7fc700 1 -- 172.21.15.17:0/3117074678 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f0b94084250 con 0x7f0ba4159750 2023-10-06T04:43:21.225 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.220+0000 7f0ba259c700 1 --2- 172.21.15.17:0/3117074678 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0b84066ea0 0x7f0b84069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:21.225 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.221+0000 7f0ba259c700 1 --2- 172.21.15.17:0/3117074678 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0b84066ea0 0x7f0b84069350 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c0091e0 tx=0x7f0b9c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:21.226 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.225+0000 7f0b9a7fc700 1 -- 172.21.15.17:0/3117074678 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0b94051af0 con 0x7f0ba4159750 2023-10-06T04:43:21.426 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.425+0000 7f0ba359e700 1 -- 172.21.15.17:0/3117074678 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ba40b2520 con 0x7f0ba4159750 2023-10-06T04:43:21.427 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.425+0000 7f0b9a7fc700 1 -- 172.21.15.17:0/3117074678 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10396 (secure 0 0 0) 0x7f0b94055110 con 0x7f0ba4159750 2023-10-06T04:43:21.427 INFO:teuthology.misc.health.smithi017.stdout: 2023-10-06T04:43:21.427 INFO:teuthology.misc.health.smithi017.stdout:{"epoch":13,"fsid":"780777c4-2b25-4d35-9058-c9f2d62e3ad9","created":"2023-10-06T04:43:10.578520+0000","modified":"2023-10-06T04:43:20.682958+0000","last_up_change":"2023-10-06T04:43:20.682958+0000","last_in_change":"2023-10-06T04:43:12.978917+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"84737b08-575c-46dd-9488-073ae8504494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6809","nonce":90656},{"type":"v1","addr":"172.21.15.17:6811","nonce":90656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":90656},{"type":"v1","addr":"172.21.15.17:6814","nonce":90656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":90656},{"type":"v1","addr":"172.21.15.17:6822","nonce":90656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":90656},{"type":"v1","addr":"172.21.15.17:6818","nonce":90656}]},"public_addr":"172.21.15.17:6811/90656","cluster_addr":"172.21.15.17:6814/90656","heartbeat_back_addr":"172.21.15.17:6822/90656","heartbeat_front_addr":"172.21.15.17:6818/90656","state":["exists","up"]},{"osd":1,"uuid":"dffeb740-58a2-4fd6-8ff1-a0a11a2cc709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":90655},{"type":"v1","addr":"172.21.15.17:6801","nonce":90655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":90655},{"type":"v1","addr":"172.21.15.17:6803","nonce":90655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":90655},{"type":"v1","addr":"172.21.15.17:6807","nonce":90655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":90655},{"type":"v1","addr":"172.21.15.17:6805","nonce":90655}]},"public_addr":"172.21.15.17:6801/90655","cluster_addr":"172.21.15.17:6803/90655","heartbeat_back_addr":"172.21.15.17:6807/90655","heartbeat_front_addr":"172.21.15.17:6805/90655","state":["exists","up"]},{"osd":2,"uuid":"48bd6831-763d-48c2-b515-e02c216d608b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":90657},{"type":"v1","addr":"172.21.15.17:6810","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":90657},{"type":"v1","addr":"172.21.15.17:6815","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":90657},{"type":"v1","addr":"172.21.15.17:6823","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":90657},{"type":"v1","addr":"172.21.15.17:6819","nonce":90657}]},"public_addr":"172.21.15.17:6810/90657","cluster_addr":"172.21.15.17:6815/90657","heartbeat_back_addr":"172.21.15.17:6823/90657","heartbeat_front_addr":"172.21.15.17:6819/90657","state":["exists","up"]},{"osd":3,"uuid":"ae7dbb23-abe7-4bd3-a4df-6f5963d6804c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":90688},{"type":"v1","addr":"172.21.15.17:6825","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":90688},{"type":"v1","addr":"172.21.15.17:6827","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":90688},{"type":"v1","addr":"172.21.15.17:6831","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":90688},{"type":"v1","addr":"172.21.15.17:6829","nonce":90688}]},"public_addr":"172.21.15.17:6825/90688","cluster_addr":"172.21.15.17:6827/90688","heartbeat_back_addr":"172.21.15.17:6831/90688","heartbeat_front_addr":"172.21.15.17:6829/90688","state":["exists","up"]},{"osd":4,"uuid":"29991fb4-1667-4ea3-aca0-d55db27f3bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":90902},{"type":"v1","addr":"172.21.15.136:6801","nonce":90902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":90902},{"type":"v1","addr":"172.21.15.136:6803","nonce":90902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":90902},{"type":"v1","addr":"172.21.15.136:6807","nonce":90902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":90902},{"type":"v1","addr":"172.21.15.136:6805","nonce":90902}]},"public_addr":"172.21.15.136:6801/90902","cluster_addr":"172.21.15.136:6803/90902","heartbeat_back_addr":"172.21.15.136:6807/90902","heartbeat_front_addr":"172.21.15.136:6805/90902","state":["exists","up"]},{"osd":5,"uuid":"398b4ff9-03fc-421f-882c-ba12aa088eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":90901},{"type":"v1","addr":"172.21.15.136:6809","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":90901},{"type":"v1","addr":"172.21.15.136:6811","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":90901},{"type":"v1","addr":"172.21.15.136:6815","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":90901},{"type":"v1","addr":"172.21.15.136:6813","nonce":90901}]},"public_addr":"172.21.15.136:6809/90901","cluster_addr":"172.21.15.136:6811/90901","heartbeat_back_addr":"172.21.15.136:6815/90901","heartbeat_front_addr":"172.21.15.136:6813/90901","state":["exists","up"]},{"osd":6,"uuid":"1bb91a72-4dab-4cdb-aa1d-2b8a9edf1ad0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":90927},{"type":"v1","addr":"172.21.15.136:6825","nonce":90927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":90927},{"type":"v1","addr":"172.21.15.136:6827","nonce":90927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":90927},{"type":"v1","addr":"172.21.15.136:6831","nonce":90927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":90927},{"type":"v1","addr":"172.21.15.136:6829","nonce":90927}]},"public_addr":"172.21.15.136:6825/90927","cluster_addr":"172.21.15.136:6827/90927","heartbeat_back_addr":"172.21.15.136:6831/90927","heartbeat_front_addr":"172.21.15.136:6829/90927","state":["exists","up"]},{"osd":7,"uuid":"719b654e-010d-4aa4-8c13-83fdde242b47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":90934},{"type":"v1","addr":"172.21.15.136:6817","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":90934},{"type":"v1","addr":"172.21.15.136:6819","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":90934},{"type":"v1","addr":"172.21.15.136:6824","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":90934},{"type":"v1","addr":"172.21.15.136:6821","nonce":90934}]},"public_addr":"172.21.15.136:6817/90934","cluster_addr":"172.21.15.136:6819/90934","heartbeat_back_addr":"172.21.15.136:6824/90934","heartbeat_front_addr":"172.21.15.136:6821/90934","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:43:21.429 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.427+0000 7f0ba359e700 1 -- 172.21.15.17:0/3117074678 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0b84066ea0 msgr2=0x7f0b84069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:21.430 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.427+0000 7f0ba359e700 1 --2- 172.21.15.17:0/3117074678 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0b84066ea0 0x7f0b84069350 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c0091e0 tx=0x7f0b9c017000 comp rx=0 tx=0).stop 2023-10-06T04:43:21.430 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.427+0000 7f0ba359e700 1 -- 172.21.15.17:0/3117074678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ba4159750 msgr2=0x7f0ba415c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:21.430 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.427+0000 7f0ba359e700 1 --2- 172.21.15.17:0/3117074678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ba4159750 0x7f0ba415c930 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0b94001460 tx=0x7f0b94001ae0 comp rx=0 tx=0).stop 2023-10-06T04:43:21.430 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.428+0000 7f0ba359e700 1 -- 172.21.15.17:0/3117074678 shutdown_connections 2023-10-06T04:43:21.430 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.428+0000 7f0ba359e700 1 --2- 172.21.15.17:0/3117074678 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0b84066ea0 0x7f0b84069350 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:21.430 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.428+0000 7f0ba359e700 1 --2- 172.21.15.17:0/3117074678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ba4159750 0x7f0ba415c930 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:21.430 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.428+0000 7f0ba359e700 1 --2- 172.21.15.17:0/3117074678 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0ba40c74d0 0x7f0ba4146da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:21.430 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.428+0000 7f0ba359e700 1 --2- 172.21.15.17:0/3117074678 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ba4159380 0x7f0ba415c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:21.430 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.428+0000 7f0ba359e700 1 -- 172.21.15.17:0/3117074678 >> 172.21.15.17:0/3117074678 conn(0x7f0ba40c93c0 msgr2=0x7f0ba406b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:21.431 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.428+0000 7f0ba359e700 1 -- 172.21.15.17:0/3117074678 shutdown_connections 2023-10-06T04:43:21.431 INFO:teuthology.misc.health.smithi017.stderr:2023-10-06T04:43:21.428+0000 7f0ba359e700 1 -- 172.21.15.17:0/3117074678 wait complete. 2023-10-06T04:43:21.440 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-06T04:43:21.440 INFO:tasks.ceph:Creating RBD pool 2023-10-06T04:43:21.441 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-06T04:43:21.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.557+0000 7f944a6a1700 1 Processor -- start 2023-10-06T04:43:21.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.557+0000 7f944a6a1700 1 -- start start 2023-10-06T04:43:21.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.558+0000 7f944a6a1700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f94440af540 0x7f94440af910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:21.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.558+0000 7f944a6a1700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f94440cd5e0 0x7f944415d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:21.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.558+0000 7f944a6a1700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f944415d660 con 0x7f944415a650 2023-10-06T04:43:21.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.558+0000 7f944a6a1700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94440ce890 con 0x7f94440af540 2023-10-06T04:43:21.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.558+0000 7f944a6a1700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f944415aac0 con 0x7f94440cd5e0 2023-10-06T04:43:21.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.558+0000 7f9448e9e700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f944415a650 0x7f94440cced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:32846/0 (socket says 172.21.15.17:32846) 2023-10-06T04:43:21.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.558+0000 7f9448e9e700 1 -- 172.21.15.17:0/3825393776 learned_addr learned my addr 172.21.15.17:0/3825393776 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:21.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.558+0000 7f944969f700 1 --2- 172.21.15.17:0/3825393776 >> v2:172.21.15.136:3300/0 conn(0x7f94440af540 0x7f94440af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:21.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.558+0000 7f9449ea0700 1 --2- 172.21.15.17:0/3825393776 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f94440cd5e0 0x7f944415d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:21.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.558+0000 7f9443fff700 1 -- 172.21.15.17:0/3825393776 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1704521140 0 0) 0x7f944415d660 con 0x7f944415a650 2023-10-06T04:43:21.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.558+0000 7f9443fff700 1 -- 172.21.15.17:0/3825393776 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f942c003570 con 0x7f944415a650 2023-10-06T04:43:21.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.559+0000 7f9443fff700 1 -- 172.21.15.17:0/3825393776 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3551569870 0 0) 0x7f942c003570 con 0x7f944415a650 2023-10-06T04:43:21.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.559+0000 7f9443fff700 1 -- 172.21.15.17:0/3825393776 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f94440cd5e0 msgr2=0x7f944415d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:21.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.559+0000 7f9443fff700 1 --2- 172.21.15.17:0/3825393776 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f94440cd5e0 0x7f944415d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:21.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.559+0000 7f9443fff700 1 -- 172.21.15.17:0/3825393776 >> v2:172.21.15.136:3300/0 conn(0x7f94440af540 msgr2=0x7f94440af910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:21.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.559+0000 7f9443fff700 1 --2- 172.21.15.17:0/3825393776 >> v2:172.21.15.136:3300/0 conn(0x7f94440af540 0x7f94440af910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:21.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.559+0000 7f9443fff700 1 -- 172.21.15.17:0/3825393776 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f944415d890 con 0x7f944415a650 2023-10-06T04:43:21.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.559+0000 7f9443fff700 1 -- 172.21.15.17:0/3825393776 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4268781140 0 0) 0x7f9438001470 con 0x7f944415a650 2023-10-06T04:43:21.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.559+0000 7f9443fff700 1 -- 172.21.15.17:0/3825393776 >> v1:172.21.15.17:6789/0 conn(0x7f944415a650 legacy=0x7f94440cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:21.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.559+0000 7f9443fff700 1 --2- 172.21.15.17:0/3825393776 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f94440cd5e0 0x7f942c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:21.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.559+0000 7f9443fff700 1 --2- 172.21.15.17:0/3825393776 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f942c003fe0 0x7f942c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:21.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.559+0000 7f9443fff700 1 --2- 172.21.15.17:0/3825393776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f942c004d50 0x7f942c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:21.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.559+0000 7f9443fff700 1 -- 172.21.15.17:0/3825393776 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94440ce890 con 0x7f942c004d50 2023-10-06T04:43:21.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.559+0000 7f9443fff700 1 -- 172.21.15.17:0/3825393776 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944415aac0 con 0x7f942c003fe0 2023-10-06T04:43:21.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.559+0000 7f9443fff700 1 -- 172.21.15.17:0/3825393776 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f942c00ba90 con 0x7f94440cd5e0 2023-10-06T04:43:21.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.559+0000 7f9449ea0700 1 --2- 172.21.15.17:0/3825393776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f942c004d50 0x7f942c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:21.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.559+0000 7f9448e9e700 1 --2- 172.21.15.17:0/3825393776 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f942c003fe0 0x7f942c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:21.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.559+0000 7f944969f700 1 --2- 172.21.15.17:0/3825393776 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f94440cd5e0 0x7f942c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:21.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.559+0000 7f9449ea0700 1 -- 172.21.15.17:0/3825393776 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f94440cd5e0 msgr2=0x7f942c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:21.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.559+0000 7f9449ea0700 1 --2- 172.21.15.17:0/3825393776 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f94440cd5e0 0x7f942c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:21.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.559+0000 7f9449ea0700 1 -- 172.21.15.17:0/3825393776 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f942c003fe0 msgr2=0x7f942c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:21.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.559+0000 7f9449ea0700 1 --2- 172.21.15.17:0/3825393776 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f942c003fe0 0x7f942c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:21.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.559+0000 7f9449ea0700 1 -- 172.21.15.17:0/3825393776 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f942c003570 con 0x7f942c004d50 2023-10-06T04:43:21.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.559+0000 7f9449ea0700 1 --2- 172.21.15.17:0/3825393776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f942c004d50 0x7f942c0051c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f94440895f0 tx=0x7f94340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9acd3ad3446fa5f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:21.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.559+0000 7f9443fff700 1 -- 172.21.15.17:0/3825393776 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943400e680 con 0x7f942c004d50 2023-10-06T04:43:21.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.559+0000 7f9443fff700 1 -- 172.21.15.17:0/3825393776 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943400e7e0 con 0x7f942c004d50 2023-10-06T04:43:21.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.559+0000 7f9443fff700 1 -- 172.21.15.17:0/3825393776 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943400eba0 con 0x7f942c004d50 2023-10-06T04:43:21.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.560+0000 7f944a6a1700 1 -- 172.21.15.17:0/3825393776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f942c004d50 msgr2=0x7f942c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:21.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.560+0000 7f944a6a1700 1 --2- 172.21.15.17:0/3825393776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f942c004d50 0x7f942c0051c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f94440895f0 tx=0x7f94340091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:21.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.560+0000 7f9449ea0700 1 -- 172.21.15.17:0/3825393776 reap_dead start 2023-10-06T04:43:21.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.560+0000 7f944a6a1700 1 -- 172.21.15.17:0/3825393776 shutdown_connections 2023-10-06T04:43:21.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.560+0000 7f944a6a1700 1 -- 172.21.15.17:0/3825393776 >> 172.21.15.17:0/3825393776 conn(0x7f944406d9b0 msgr2=0x7f944406ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:21.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.560+0000 7f944a6a1700 1 -- 172.21.15.17:0/3825393776 shutdown_connections 2023-10-06T04:43:21.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.560+0000 7f944a6a1700 1 -- 172.21.15.17:0/3825393776 wait complete. 2023-10-06T04:43:21.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.561+0000 7f944a6a1700 1 Processor -- start 2023-10-06T04:43:21.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.561+0000 7f944a6a1700 1 -- start start 2023-10-06T04:43:21.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.562+0000 7f944a6a1700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f942c004d50 0x7f944416d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:21.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.562+0000 7f944a6a1700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f94440ca190 0x7f9444144360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:21.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.562+0000 7f944a6a1700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f94440c7ed0 0x7f94440b2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:21.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.562+0000 7f944a6a1700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944416dc30 con 0x7f942c004d50 2023-10-06T04:43:21.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.562+0000 7f944a6a1700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94440b5290 con 0x7f94440ca190 2023-10-06T04:43:21.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.562+0000 7f944a6a1700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94440c7720 con 0x7f94440c7ed0 2023-10-06T04:43:21.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.562+0000 7f944969f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f942c004d50 0x7f944416d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:21.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.562+0000 7f944969f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f942c004d50 0x7f944416d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32892/0 (socket says 172.21.15.17:32892) 2023-10-06T04:43:21.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.562+0000 7f944969f700 1 -- 172.21.15.17:0/3323595181 learned_addr learned my addr 172.21.15.17:0/3323595181 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:21.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.562+0000 7f9448e9e700 1 --2- 172.21.15.17:0/3323595181 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f94440ca190 0x7f9444144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:21.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.562+0000 7f9449ea0700 1 --2- 172.21.15.17:0/3323595181 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f94440c7ed0 0x7f94440b2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:21.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.562+0000 7f944969f700 1 -- 172.21.15.17:0/3323595181 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f94440c7ed0 msgr2=0x7f94440b2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:21.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.562+0000 7f944969f700 1 --2- 172.21.15.17:0/3323595181 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f94440c7ed0 0x7f94440b2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:21.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.562+0000 7f944969f700 1 -- 172.21.15.17:0/3323595181 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f94440ca190 msgr2=0x7f9444144360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:21.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.562+0000 7f944969f700 1 --2- 172.21.15.17:0/3323595181 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f94440ca190 0x7f9444144360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:21.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.562+0000 7f944969f700 1 -- 172.21.15.17:0/3323595181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94440c7a00 con 0x7f942c004d50 2023-10-06T04:43:21.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.563+0000 7f944969f700 1 --2- 172.21.15.17:0/3323595181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f942c004d50 0x7f944416d6f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f943c009fd0 tx=0x7f943c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:21.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.563+0000 7f94417fa700 1 -- 172.21.15.17:0/3323595181 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c00e040 con 0x7f942c004d50 2023-10-06T04:43:21.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.563+0000 7f94417fa700 1 -- 172.21.15.17:0/3323595181 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943c00f040 con 0x7f942c004d50 2023-10-06T04:43:21.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.563+0000 7f944a6a1700 1 -- 172.21.15.17:0/3323595181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94440b4f20 con 0x7f942c004d50 2023-10-06T04:43:21.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.563+0000 7f94417fa700 1 -- 172.21.15.17:0/3323595181 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c00fda0 con 0x7f942c004d50 2023-10-06T04:43:21.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.563+0000 7f944a6a1700 1 -- 172.21.15.17:0/3323595181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94441448a0 con 0x7f942c004d50 2023-10-06T04:43:21.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.564+0000 7f944a6a1700 1 -- 172.21.15.17:0/3323595181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94440b4d90 con 0x7f942c004d50 2023-10-06T04:43:21.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.564+0000 7f94417fa700 1 -- 172.21.15.17:0/3323595181 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f943c015640 con 0x7f942c004d50 2023-10-06T04:43:21.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.564+0000 7f94417fa700 1 --2- 172.21.15.17:0/3323595181 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9430066ea0 0x7f9430069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:21.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.565+0000 7f94417fa700 1 -- 172.21.15.17:0/3323595181 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f943c084a00 con 0x7f942c004d50 2023-10-06T04:43:21.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.565+0000 7f9448e9e700 1 --2- 172.21.15.17:0/3323595181 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9430066ea0 0x7f9430069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:21.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.565+0000 7f9448e9e700 1 --2- 172.21.15.17:0/3323595181 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9430066ea0 0x7f9430069350 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9438007fd0 tx=0x7f94440ce800 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:21.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.569+0000 7f94417fa700 1 -- 172.21.15.17:0/3323595181 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f943c052220 con 0x7f942c004d50 2023-10-06T04:43:21.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:21.765+0000 7f944a6a1700 1 -- 172.21.15.17:0/3323595181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f944404c380 con 0x7f942c004d50 2023-10-06T04:43:22.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.699+0000 7f94417fa700 1 -- 172.21.15.17:0/3323595181 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) v1 ==== 109+0+0 (secure 0 0 0) 0x7f943c055840 con 0x7f942c004d50 2023-10-06T04:43:22.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.702+0000 7f944a6a1700 1 -- 172.21.15.17:0/3323595181 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9430066ea0 msgr2=0x7f9430069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:22.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.702+0000 7f944a6a1700 1 --2- 172.21.15.17:0/3323595181 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9430066ea0 0x7f9430069350 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9438007fd0 tx=0x7f94440ce800 comp rx=0 tx=0).stop 2023-10-06T04:43:22.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.702+0000 7f944a6a1700 1 -- 172.21.15.17:0/3323595181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f942c004d50 msgr2=0x7f944416d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:22.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.702+0000 7f944a6a1700 1 --2- 172.21.15.17:0/3323595181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f942c004d50 0x7f944416d6f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f943c009fd0 tx=0x7f943c00b040 comp rx=0 tx=0).stop 2023-10-06T04:43:22.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.702+0000 7f944a6a1700 1 -- 172.21.15.17:0/3323595181 shutdown_connections 2023-10-06T04:43:22.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.702+0000 7f944a6a1700 1 --2- 172.21.15.17:0/3323595181 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9430066ea0 0x7f9430069350 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:22.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.702+0000 7f944a6a1700 1 --2- 172.21.15.17:0/3323595181 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f94440c7ed0 0x7f94440b2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:22.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.702+0000 7f944a6a1700 1 --2- 172.21.15.17:0/3323595181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f942c004d50 0x7f944416d6f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:22.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.702+0000 7f944a6a1700 1 --2- 172.21.15.17:0/3323595181 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f94440ca190 0x7f9444144360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:22.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.702+0000 7f944a6a1700 1 -- 172.21.15.17:0/3323595181 >> 172.21.15.17:0/3323595181 conn(0x7f944406d9b0 msgr2=0x7f944415e810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:22.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.702+0000 7f944a6a1700 1 -- 172.21.15.17:0/3323595181 shutdown_connections 2023-10-06T04:43:22.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.702+0000 7f944a6a1700 1 -- 172.21.15.17:0/3323595181 wait complete. 2023-10-06T04:43:22.705 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'rbd' created 2023-10-06T04:43:22.718 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-06T04:43:22.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.840+0000 7fd82b6fb700 1 Processor -- start 2023-10-06T04:43:22.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.841+0000 7fd82b6fb700 1 -- start start 2023-10-06T04:43:22.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.841+0000 7fd82b6fb700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd824150360 0x7fd824150730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:22.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.841+0000 7fd82b6fb700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd8240cb6b0 0x7fd8240cd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:22.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.841+0000 7fd82b6fb700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd8240cbb50 0x7fd8240cd590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:22.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.841+0000 7fd82b6fb700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8240cc330 con 0x7fd8240cb6b0 2023-10-06T04:43:22.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.841+0000 7fd82b6fb700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8240cdad0 con 0x7fd8240cbb50 2023-10-06T04:43:22.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.841+0000 7fd82b6fb700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8240cc050 con 0x7fd824150360 2023-10-06T04:43:22.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.841+0000 7fd828c96700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd8240cb6b0 0x7fd8240cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:22.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.842+0000 7fd828c96700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd8240cb6b0 0x7fd8240cd050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32900/0 (socket says 172.21.15.17:32900) 2023-10-06T04:43:22.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.842+0000 7fd828c96700 1 -- 172.21.15.17:0/1610247442 learned_addr learned my addr 172.21.15.17:0/1610247442 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:22.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.842+0000 7fd829c98700 1 --2- 172.21.15.17:0/1610247442 >> v2:172.21.15.136:3300/0 conn(0x7fd8240cbb50 0x7fd8240cd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:22.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.842+0000 7fd829497700 1 --2- 172.21.15.17:0/1610247442 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd824150360 0x7fd824150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:22.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.842+0000 7fd828c96700 1 -- 172.21.15.17:0/1610247442 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd824150360 msgr2=0x7fd824150730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:22.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.842+0000 7fd828c96700 1 --2- 172.21.15.17:0/1610247442 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd824150360 0x7fd824150730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:22.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.842+0000 7fd828c96700 1 -- 172.21.15.17:0/1610247442 >> v2:172.21.15.136:3300/0 conn(0x7fd8240cbb50 msgr2=0x7fd8240cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:22.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.842+0000 7fd828c96700 1 --2- 172.21.15.17:0/1610247442 >> v2:172.21.15.136:3300/0 conn(0x7fd8240cbb50 0x7fd8240cd590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:22.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.842+0000 7fd828c96700 1 -- 172.21.15.17:0/1610247442 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82415b130 con 0x7fd8240cb6b0 2023-10-06T04:43:22.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.842+0000 7fd829c98700 1 --2- 172.21.15.17:0/1610247442 >> v2:172.21.15.136:3300/0 conn(0x7fd8240cbb50 0x7fd8240cd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:43:22.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.842+0000 7fd828c96700 1 --2- 172.21.15.17:0/1610247442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8240cb6b0 0x7fd8240cd050 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd824154400 tx=0x7fd818009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84acadf0b6eeaca7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:22.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.842+0000 7fd823fff700 1 -- 172.21.15.17:0/1610247442 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81800b860 con 0x7fd8240cb6b0 2023-10-06T04:43:22.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.842+0000 7fd823fff700 1 -- 172.21.15.17:0/1610247442 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd81800b9c0 con 0x7fd8240cb6b0 2023-10-06T04:43:22.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.842+0000 7fd823fff700 1 -- 172.21.15.17:0/1610247442 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81800bd60 con 0x7fd8240cb6b0 2023-10-06T04:43:22.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.843+0000 7fd82b6fb700 1 -- 172.21.15.17:0/1610247442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8240cb6b0 msgr2=0x7fd8240cd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:22.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.843+0000 7fd82b6fb700 1 --2- 172.21.15.17:0/1610247442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8240cb6b0 0x7fd8240cd050 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd824154400 tx=0x7fd818009250 comp rx=0 tx=0).stop 2023-10-06T04:43:22.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.843+0000 7fd82b6fb700 1 -- 172.21.15.17:0/1610247442 shutdown_connections 2023-10-06T04:43:22.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.843+0000 7fd82b6fb700 1 --2- 172.21.15.17:0/1610247442 >> v2:172.21.15.136:3300/0 conn(0x7fd8240cbb50 0x7fd8240cd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:22.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.843+0000 7fd82b6fb700 1 --2- 172.21.15.17:0/1610247442 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd824150360 0x7fd824150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:22.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.843+0000 7fd82b6fb700 1 --2- 172.21.15.17:0/1610247442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8240cb6b0 0x7fd8240cd050 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:22.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.843+0000 7fd82b6fb700 1 -- 172.21.15.17:0/1610247442 >> 172.21.15.17:0/1610247442 conn(0x7fd82408a180 msgr2=0x7fd824099aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:22.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.843+0000 7fd82b6fb700 1 -- 172.21.15.17:0/1610247442 shutdown_connections 2023-10-06T04:43:22.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.843+0000 7fd82b6fb700 1 -- 172.21.15.17:0/1610247442 wait complete. 2023-10-06T04:43:22.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.844+0000 7fd82b6fb700 1 Processor -- start 2023-10-06T04:43:22.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.844+0000 7fd82b6fb700 1 -- start start 2023-10-06T04:43:22.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.845+0000 7fd82b6fb700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8240cb6b0 0x7fd82416daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:22.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.845+0000 7fd82b6fb700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd8240cbb50 0x7fd82414eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:22.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.845+0000 7fd82b6fb700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd824150360 0x7fd8240cce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:22.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.845+0000 7fd82b6fb700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8240c4f90 con 0x7fd824150360 2023-10-06T04:43:22.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.845+0000 7fd82b6fb700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82416dfe0 con 0x7fd8240cb6b0 2023-10-06T04:43:22.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.845+0000 7fd82b6fb700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8240b5ce0 con 0x7fd8240cbb50 2023-10-06T04:43:22.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.845+0000 7fd829c98700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd824150360 0x7fd8240cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:22.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.845+0000 7fd829c98700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd824150360 0x7fd8240cce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32906/0 (socket says 172.21.15.17:32906) 2023-10-06T04:43:22.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.845+0000 7fd829c98700 1 -- 172.21.15.17:0/1963829862 learned_addr learned my addr 172.21.15.17:0/1963829862 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:22.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.845+0000 7fd829497700 1 --2- 172.21.15.17:0/1963829862 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8240cb6b0 0x7fd82416daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:22.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.845+0000 7fd828c96700 1 --2- 172.21.15.17:0/1963829862 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd8240cbb50 0x7fd82414eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:22.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.845+0000 7fd829c98700 1 -- 172.21.15.17:0/1963829862 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd8240cbb50 msgr2=0x7fd82414eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:22.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.845+0000 7fd829c98700 1 --2- 172.21.15.17:0/1963829862 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd8240cbb50 0x7fd82414eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:22.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.845+0000 7fd829c98700 1 -- 172.21.15.17:0/1963829862 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8240cb6b0 msgr2=0x7fd82416daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:22.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.845+0000 7fd829c98700 1 --2- 172.21.15.17:0/1963829862 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8240cb6b0 0x7fd82416daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:22.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.845+0000 7fd829c98700 1 -- 172.21.15.17:0/1963829862 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8180094f0 con 0x7fd824150360 2023-10-06T04:43:22.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.845+0000 7fd829c98700 1 --2- 172.21.15.17:0/1963829862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd824150360 0x7fd8240cce10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd81400d180 tx=0x7fd814009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:22.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.846+0000 7fd8217fa700 1 -- 172.21.15.17:0/1963829862 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81400dcc0 con 0x7fd824150360 2023-10-06T04:43:22.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.846+0000 7fd8217fa700 1 -- 172.21.15.17:0/1963829862 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd81400f040 con 0x7fd824150360 2023-10-06T04:43:22.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.846+0000 7fd82b6fb700 1 -- 172.21.15.17:0/1963829862 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8240c4940 con 0x7fd824150360 2023-10-06T04:43:22.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.846+0000 7fd8217fa700 1 -- 172.21.15.17:0/1963829862 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd814015690 con 0x7fd824150360 2023-10-06T04:43:22.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.846+0000 7fd82b6fb700 1 -- 172.21.15.17:0/1963829862 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8240c45f0 con 0x7fd824150360 2023-10-06T04:43:22.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.846+0000 7fd82b6fb700 1 -- 172.21.15.17:0/1963829862 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8240c5100 con 0x7fd824150360 2023-10-06T04:43:22.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.847+0000 7fd8217fa700 1 -- 172.21.15.17:0/1963829862 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7fd81401e3b0 con 0x7fd824150360 2023-10-06T04:43:22.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.847+0000 7fd8217fa700 1 --2- 172.21.15.17:0/1963829862 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd810066ea0 0x7fd810069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:22.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.848+0000 7fd829497700 1 --2- 172.21.15.17:0/1963829862 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd810066ea0 0x7fd810069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:22.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.848+0000 7fd8217fa700 1 -- 172.21.15.17:0/1963829862 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5184+0+0 (secure 0 0 0) 0x7fd8140846c0 con 0x7fd824150360 2023-10-06T04:43:22.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.848+0000 7fd829497700 1 --2- 172.21.15.17:0/1963829862 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd810066ea0 0x7fd810069350 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd81c006fd0 tx=0x7fd81c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:22.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:22.852+0000 7fd8217fa700 1 -- 172.21.15.17:0/1963829862 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd814051c20 con 0x7fd824150360 2023-10-06T04:43:23.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.047+0000 7fd82b6fb700 1 -- 172.21.15.17:0/1963829862 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd8240718b0 con 0x7fd824150360 2023-10-06T04:43:23.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.700+0000 7fd8217fa700 1 -- 172.21.15.17:0/1963829862 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v16) v1 ==== 173+0+0 (secure 0 0 0) 0x7fd814055240 con 0x7fd824150360 2023-10-06T04:43:23.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.704+0000 7fd82b6fb700 1 -- 172.21.15.17:0/1963829862 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd810066ea0 msgr2=0x7fd810069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:23.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.704+0000 7fd82b6fb700 1 --2- 172.21.15.17:0/1963829862 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd810066ea0 0x7fd810069350 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd81c006fd0 tx=0x7fd81c008040 comp rx=0 tx=0).stop 2023-10-06T04:43:23.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.704+0000 7fd82b6fb700 1 -- 172.21.15.17:0/1963829862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd824150360 msgr2=0x7fd8240cce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:23.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.704+0000 7fd82b6fb700 1 --2- 172.21.15.17:0/1963829862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd824150360 0x7fd8240cce10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd81400d180 tx=0x7fd814009a50 comp rx=0 tx=0).stop 2023-10-06T04:43:23.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.704+0000 7fd82b6fb700 1 -- 172.21.15.17:0/1963829862 shutdown_connections 2023-10-06T04:43:23.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.704+0000 7fd82b6fb700 1 --2- 172.21.15.17:0/1963829862 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd810066ea0 0x7fd810069350 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:23.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.704+0000 7fd82b6fb700 1 --2- 172.21.15.17:0/1963829862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd824150360 0x7fd8240cce10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:23.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.704+0000 7fd82b6fb700 1 --2- 172.21.15.17:0/1963829862 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8240cb6b0 0x7fd82416daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:23.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.704+0000 7fd82b6fb700 1 --2- 172.21.15.17:0/1963829862 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd8240cbb50 0x7fd82414eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:23.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.704+0000 7fd82b6fb700 1 -- 172.21.15.17:0/1963829862 >> 172.21.15.17:0/1963829862 conn(0x7fd82408a180 msgr2=0x7fd82415d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:23.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.704+0000 7fd82b6fb700 1 -- 172.21.15.17:0/1963829862 shutdown_connections 2023-10-06T04:43:23.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.704+0000 7fd82b6fb700 1 -- 172.21.15.17:0/1963829862 wait complete. 2023-10-06T04:43:23.709 INFO:teuthology.orchestra.run.smithi017.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-06T04:43:23.723 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-06T04:43:23.723 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T04:43:23.723 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T04:43:23.725 INFO:tasks.ceph.mds.a:Started 2023-10-06T04:43:23.726 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T04:43:23.726 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T04:43:23.728 INFO:tasks.ceph.mds.c:Started 2023-10-06T04:43:23.728 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T04:43:23.728 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T04:43:23.730 INFO:tasks.ceph.mds.b:Started 2023-10-06T04:43:23.731 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T04:43:23.731 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T04:43:23.733 INFO:tasks.ceph.mds.d:Started 2023-10-06T04:43:23.733 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-06T04:43:23.733 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:43:23.813 INFO:tasks.ceph.mds.b.smithi136.stdout:starting mds.b at 2023-10-06T04:43:23.814 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2023-10-06T04:43:23.815 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2023-10-06T04:43:23.817 INFO:tasks.ceph.mds.d.smithi136.stdout:starting mds.d at 2023-10-06T04:43:23.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.871+0000 7f8b67215700 1 Processor -- start 2023-10-06T04:43:23.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.872+0000 7f8b67215700 1 -- start start 2023-10-06T04:43:23.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.873+0000 7f8b67215700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8b600caf00 0x7f8b601569d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:23.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.873+0000 7f8b67215700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b600c20d0 0x7f8b600c35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:23.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.874+0000 7f8b67215700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b600c3f40 con 0x7f8b600c3b00 2023-10-06T04:43:23.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.874+0000 7f8b67215700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b60156fb0 con 0x7f8b600caf00 2023-10-06T04:43:23.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.874+0000 7f8b67215700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b60157290 con 0x7f8b600c20d0 2023-10-06T04:43:23.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.874+0000 7f8b64fb1700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8b600caf00 0x7f8b601569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:23.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.874+0000 7f8b657b2700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f8b600c3b00 0x7f8b6006ab70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:32864/0 (socket says 172.21.15.17:32864) 2023-10-06T04:43:23.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.874+0000 7f8b657b2700 1 -- 172.21.15.17:0/3170913205 learned_addr learned my addr 172.21.15.17:0/3170913205 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:23.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.874+0000 7f8b5ffff700 1 --2- 172.21.15.17:0/3170913205 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b600c20d0 0x7f8b600c35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:23.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.874+0000 7f8b5f7fe700 1 -- 172.21.15.17:0/3170913205 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 222271899 0 0) 0x7f8b600c3f40 con 0x7f8b600c3b00 2023-10-06T04:43:23.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.874+0000 7f8b5f7fe700 1 -- 172.21.15.17:0/3170913205 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b50003570 con 0x7f8b600c3b00 2023-10-06T04:43:23.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.874+0000 7f8b64fb1700 1 -- 172.21.15.17:0/3170913205 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b600c20d0 msgr2=0x7f8b600c35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:23.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.874+0000 7f8b64fb1700 1 --2- 172.21.15.17:0/3170913205 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b600c20d0 0x7f8b600c35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:23.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.874+0000 7f8b64fb1700 1 -- 172.21.15.17:0/3170913205 >> v1:172.21.15.17:6789/0 conn(0x7f8b600c3b00 legacy=0x7f8b6006ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:23.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.874+0000 7f8b64fb1700 1 -- 172.21.15.17:0/3170913205 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b60157570 con 0x7f8b600caf00 2023-10-06T04:43:23.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.874+0000 7f8b5ffff700 1 --2- 172.21.15.17:0/3170913205 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b600c20d0 0x7f8b600c35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:43:23.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.874+0000 7f8b64fb1700 1 --2- 172.21.15.17:0/3170913205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b600caf00 0x7f8b601569d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8b540098e0 tx=0x7f8b540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9156b62f6277ea8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:23.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.874+0000 7f8b5f7fe700 1 -- 172.21.15.17:0/3170913205 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5400b640 con 0x7f8b600caf00 2023-10-06T04:43:23.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.874+0000 7f8b5f7fe700 1 -- 172.21.15.17:0/3170913205 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5400b7a0 con 0x7f8b600caf00 2023-10-06T04:43:23.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.874+0000 7f8b5f7fe700 1 -- 172.21.15.17:0/3170913205 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5400bb40 con 0x7f8b600caf00 2023-10-06T04:43:23.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.876+0000 7f8b67215700 1 -- 172.21.15.17:0/3170913205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b600caf00 msgr2=0x7f8b601569d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:23.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.876+0000 7f8b67215700 1 --2- 172.21.15.17:0/3170913205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b600caf00 0x7f8b601569d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8b540098e0 tx=0x7f8b540091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:23.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.876+0000 7f8b67215700 1 -- 172.21.15.17:0/3170913205 shutdown_connections 2023-10-06T04:43:23.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.876+0000 7f8b67215700 1 --2- 172.21.15.17:0/3170913205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b600caf00 0x7f8b601569d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:23.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.876+0000 7f8b67215700 1 --2- 172.21.15.17:0/3170913205 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b600c20d0 0x7f8b600c35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:23.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.876+0000 7f8b67215700 1 -- 172.21.15.17:0/3170913205 >> 172.21.15.17:0/3170913205 conn(0x7f8b6006e140 msgr2=0x7f8b600cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:23.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.876+0000 7f8b67215700 1 -- 172.21.15.17:0/3170913205 shutdown_connections 2023-10-06T04:43:23.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.876+0000 7f8b67215700 1 -- 172.21.15.17:0/3170913205 wait complete. 2023-10-06T04:43:23.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.878+0000 7f8b67215700 1 Processor -- start 2023-10-06T04:43:23.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.879+0000 7f8b67215700 1 -- start start 2023-10-06T04:43:23.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.880+0000 7f8b67215700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b600c20d0 0x7f8b6013a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:23.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.880+0000 7f8b67215700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b600c3b00 0x7f8b600b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:23.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.880+0000 7f8b67215700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b600caf00 0x7f8b600c6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:23.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.880+0000 7f8b67215700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6013b270 con 0x7f8b600caf00 2023-10-06T04:43:23.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.880+0000 7f8b67215700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b600c6580 con 0x7f8b600c3b00 2023-10-06T04:43:23.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.880+0000 7f8b67215700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b600c4fc0 con 0x7f8b600c20d0 2023-10-06T04:43:23.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.880+0000 7f8b657b2700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b600caf00 0x7f8b600c6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:23.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.880+0000 7f8b64fb1700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b600c20d0 0x7f8b6013a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:23.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.880+0000 7f8b64fb1700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b600c20d0 0x7f8b6013a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.17:48746/0 (socket says 172.21.15.17:48746) 2023-10-06T04:43:23.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.880+0000 7f8b657b2700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b600caf00 0x7f8b600c6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32966/0 (socket says 172.21.15.17:32966) 2023-10-06T04:43:23.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.880+0000 7f8b64fb1700 1 -- 172.21.15.17:0/1871892495 learned_addr learned my addr 172.21.15.17:0/1871892495 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:23.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.880+0000 7f8b5ffff700 1 --2- 172.21.15.17:0/1871892495 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b600c3b00 0x7f8b600b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:23.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.881+0000 7f8b657b2700 1 -- 172.21.15.17:0/1871892495 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b600c20d0 msgr2=0x7f8b6013a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:23.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.881+0000 7f8b657b2700 1 --2- 172.21.15.17:0/1871892495 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b600c20d0 0x7f8b6013a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:23.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.881+0000 7f8b657b2700 1 -- 172.21.15.17:0/1871892495 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b600c3b00 msgr2=0x7f8b600b00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:23.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.881+0000 7f8b657b2700 1 --2- 172.21.15.17:0/1871892495 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b600c3b00 0x7f8b600b00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:23.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.881+0000 7f8b657b2700 1 -- 172.21.15.17:0/1871892495 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b54009420 con 0x7f8b600caf00 2023-10-06T04:43:23.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.881+0000 7f8b64fb1700 1 --2- 172.21.15.17:0/1871892495 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b600c20d0 0x7f8b6013a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:43:23.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.881+0000 7f8b657b2700 1 --2- 172.21.15.17:0/1871892495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b600caf00 0x7f8b600c6a10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8b5800cbc0 tx=0x7f8b58001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:23.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.881+0000 7f8b5cff9700 1 -- 172.21.15.17:0/1871892495 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5800a7e0 con 0x7f8b600caf00 2023-10-06T04:43:23.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.881+0000 7f8b5cff9700 1 -- 172.21.15.17:0/1871892495 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5800a940 con 0x7f8b600caf00 2023-10-06T04:43:23.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.881+0000 7f8b67215700 1 -- 172.21.15.17:0/1871892495 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b600c52a0 con 0x7f8b600caf00 2023-10-06T04:43:23.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.881+0000 7f8b5cff9700 1 -- 172.21.15.17:0/1871892495 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5800acc0 con 0x7f8b600caf00 2023-10-06T04:43:23.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.881+0000 7f8b67215700 1 -- 172.21.15.17:0/1871892495 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b600c6210 con 0x7f8b600caf00 2023-10-06T04:43:23.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.882+0000 7f8b67215700 1 -- 172.21.15.17:0/1871892495 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b60063ff0 con 0x7f8b600caf00 2023-10-06T04:43:23.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.882+0000 7f8b5cff9700 1 -- 172.21.15.17:0/1871892495 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f8b58007300 con 0x7f8b600caf00 2023-10-06T04:43:23.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.883+0000 7f8b5cff9700 1 --2- 172.21.15.17:0/1871892495 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8b44066ea0 0x7f8b44069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:23.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.883+0000 7f8b5cff9700 1 -- 172.21.15.17:0/1871892495 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f8b58084530 con 0x7f8b600caf00 2023-10-06T04:43:23.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.883+0000 7f8b64fb1700 1 --2- 172.21.15.17:0/1871892495 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8b44066ea0 0x7f8b44069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:23.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.883+0000 7f8b64fb1700 1 --2- 172.21.15.17:0/1871892495 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8b44066ea0 0x7f8b44069350 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8b54003080 tx=0x7f8b54017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:23.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:23.887+0000 7f8b5cff9700 1 -- 172.21.15.17:0/1871892495 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8b58051a60 con 0x7f8b600caf00 2023-10-06T04:43:24.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.092+0000 7f8b67215700 1 -- 172.21.15.17:0/1871892495 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b60157850 con 0x7f8b600caf00 2023-10-06T04:43:24.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.092+0000 7f8b5cff9700 1 -- 172.21.15.17:0/1871892495 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+13674 (secure 0 0 0) 0x7f8b58055080 con 0x7f8b600caf00 2023-10-06T04:43:24.095 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:43:24.095 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":16,"fsid":"780777c4-2b25-4d35-9058-c9f2d62e3ad9","created":"2023-10-06T04:43:10.578520+0000","modified":"2023-10-06T04:43:23.697675+0000","last_up_change":"2023-10-06T04:43:20.682958+0000","last_in_change":"2023-10-06T04:43:12.978917+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:43:21.795733+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:43:22.389592+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"84737b08-575c-46dd-9488-073ae8504494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6809","nonce":90656},{"type":"v1","addr":"172.21.15.17:6811","nonce":90656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":90656},{"type":"v1","addr":"172.21.15.17:6814","nonce":90656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":90656},{"type":"v1","addr":"172.21.15.17:6822","nonce":90656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":90656},{"type":"v1","addr":"172.21.15.17:6818","nonce":90656}]},"public_addr":"172.21.15.17:6811/90656","cluster_addr":"172.21.15.17:6814/90656","heartbeat_back_addr":"172.21.15.17:6822/90656","heartbeat_front_addr":"172.21.15.17:6818/90656","state":["exists","up"]},{"osd":1,"uuid":"dffeb740-58a2-4fd6-8ff1-a0a11a2cc709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":90655},{"type":"v1","addr":"172.21.15.17:6801","nonce":90655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":90655},{"type":"v1","addr":"172.21.15.17:6803","nonce":90655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":90655},{"type":"v1","addr":"172.21.15.17:6807","nonce":90655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":90655},{"type":"v1","addr":"172.21.15.17:6805","nonce":90655}]},"public_addr":"172.21.15.17:6801/90655","cluster_addr":"172.21.15.17:6803/90655","heartbeat_back_addr":"172.21.15.17:6807/90655","heartbeat_front_addr":"172.21.15.17:6805/90655","state":["exists","up"]},{"osd":2,"uuid":"48bd6831-763d-48c2-b515-e02c216d608b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":90657},{"type":"v1","addr":"172.21.15.17:6810","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":90657},{"type":"v1","addr":"172.21.15.17:6815","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":90657},{"type":"v1","addr":"172.21.15.17:6823","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":90657},{"type":"v1","addr":"172.21.15.17:6819","nonce":90657}]},"public_addr":"172.21.15.17:6810/90657","cluster_addr":"172.21.15.17:6815/90657","heartbeat_back_addr":"172.21.15.17:6823/90657","heartbeat_front_addr":"172.21.15.17:6819/90657","state":["exists","up"]},{"osd":3,"uuid":"ae7dbb23-abe7-4bd3-a4df-6f5963d6804c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":90688},{"type":"v1","addr":"172.21.15.17:6825","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":90688},{"type":"v1","addr":"172.21.15.17:6827","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":90688},{"type":"v1","addr":"172.21.15.17:6831","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":90688},{"type":"v1","addr":"172.21.15.17:6829","nonce":90688}]},"public_addr":"172.21.15.17:6825/90688","cluster_addr":"172.21.15.17:6827/90688","heartbeat_back_addr":"172.21.15.17:6831/90688","heartbeat_front_addr":"172.21.15.17:6829/90688","state":["exists","up"]},{"osd":4,"uuid":"29991fb4-1667-4ea3-aca0-d55db27f3bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":90902},{"type":"v1","addr":"172.21.15.136:6801","nonce":90902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":90902},{"type":"v1","addr":"172.21.15.136:6803","nonce":90902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":90902},{"type":"v1","addr":"172.21.15.136:6807","nonce":90902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":90902},{"type":"v1","addr":"172.21.15.136:6805","nonce":90902}]},"public_addr":"172.21.15.136:6801/90902","cluster_addr":"172.21.15.136:6803/90902","heartbeat_back_addr":"172.21.15.136:6807/90902","heartbeat_front_addr":"172.21.15.136:6805/90902","state":["exists","up"]},{"osd":5,"uuid":"398b4ff9-03fc-421f-882c-ba12aa088eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":90901},{"type":"v1","addr":"172.21.15.136:6809","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":90901},{"type":"v1","addr":"172.21.15.136:6811","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":90901},{"type":"v1","addr":"172.21.15.136:6815","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":90901},{"type":"v1","addr":"172.21.15.136:6813","nonce":90901}]},"public_addr":"172.21.15.136:6809/90901","cluster_addr":"172.21.15.136:6811/90901","heartbeat_back_addr":"172.21.15.136:6815/90901","heartbeat_front_addr":"172.21.15.136:6813/90901","state":["exists","up"]},{"osd":6,"uuid":"1bb91a72-4dab-4cdb-aa1d-2b8a9edf1ad0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":90927},{"type":"v1","addr":"172.21.15.136:6825","nonce":90927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":90927},{"type":"v1","addr":"172.21.15.136:6827","nonce":90927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":90927},{"type":"v1","addr":"172.21.15.136:6831","nonce":90927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":90927},{"type":"v1","addr":"172.21.15.136:6829","nonce":90927}]},"public_addr":"172.21.15.136:6825/90927","cluster_addr":"172.21.15.136:6827/90927","heartbeat_back_addr":"172.21.15.136:6831/90927","heartbeat_front_addr":"172.21.15.136:6829/90927","state":["exists","up"]},{"osd":7,"uuid":"719b654e-010d-4aa4-8c13-83fdde242b47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":90934},{"type":"v1","addr":"172.21.15.136:6817","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":90934},{"type":"v1","addr":"172.21.15.136:6819","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":90934},{"type":"v1","addr":"172.21.15.136:6824","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":90934},{"type":"v1","addr":"172.21.15.136:6821","nonce":90934}]},"public_addr":"172.21.15.136:6817/90934","cluster_addr":"172.21.15.136:6819/90934","heartbeat_back_addr":"172.21.15.136:6824/90934","heartbeat_front_addr":"172.21.15.136:6821/90934","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.157479+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.140520+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.190743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.231396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.156510+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.145822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.202888+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.139532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:43:24.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.095+0000 7f8b67215700 1 -- 172.21.15.17:0/1871892495 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8b44066ea0 msgr2=0x7f8b44069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:24.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.095+0000 7f8b67215700 1 --2- 172.21.15.17:0/1871892495 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8b44066ea0 0x7f8b44069350 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8b54003080 tx=0x7f8b54017000 comp rx=0 tx=0).stop 2023-10-06T04:43:24.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.095+0000 7f8b67215700 1 -- 172.21.15.17:0/1871892495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b600caf00 msgr2=0x7f8b600c6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:24.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.095+0000 7f8b67215700 1 --2- 172.21.15.17:0/1871892495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b600caf00 0x7f8b600c6a10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8b5800cbc0 tx=0x7f8b58001a20 comp rx=0 tx=0).stop 2023-10-06T04:43:24.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.095+0000 7f8b67215700 1 -- 172.21.15.17:0/1871892495 shutdown_connections 2023-10-06T04:43:24.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.095+0000 7f8b67215700 1 --2- 172.21.15.17:0/1871892495 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8b44066ea0 0x7f8b44069350 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:24.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.095+0000 7f8b67215700 1 --2- 172.21.15.17:0/1871892495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b600caf00 0x7f8b600c6a10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:24.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.095+0000 7f8b67215700 1 --2- 172.21.15.17:0/1871892495 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b600c20d0 0x7f8b6013a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:24.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.095+0000 7f8b67215700 1 --2- 172.21.15.17:0/1871892495 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b600c3b00 0x7f8b600b00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:24.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.095+0000 7f8b67215700 1 -- 172.21.15.17:0/1871892495 >> 172.21.15.17:0/1871892495 conn(0x7f8b6006e140 msgr2=0x7f8b600c25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:24.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.095+0000 7f8b67215700 1 -- 172.21.15.17:0/1871892495 shutdown_connections 2023-10-06T04:43:24.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.095+0000 7f8b67215700 1 -- 172.21.15.17:0/1871892495 wait complete. 2023-10-06T04:43:24.109 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:43:21.795733+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:43:22.389592+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T04:43:24.109 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:43:24.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.234+0000 7fecda425700 1 Processor -- start 2023-10-06T04:43:24.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.234+0000 7fecda425700 1 -- start start 2023-10-06T04:43:24.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.234+0000 7fecda425700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fecd41567d0 0x7fecd40aefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:24.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.234+0000 7fecda425700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fecd40b1660 0x7fecd406c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:24.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.234+0000 7fecda425700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd40af920 con 0x7fecd415a450 2023-10-06T04:43:24.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.234+0000 7fecda425700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd406dab0 con 0x7fecd40b1660 2023-10-06T04:43:24.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.234+0000 7fecda425700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd40b01c0 con 0x7fecd41567d0 2023-10-06T04:43:24.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.235+0000 7fecd3fff700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fecd415a450 0x7fecd41560c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:32870/0 (socket says 172.21.15.17:32870) 2023-10-06T04:43:24.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.235+0000 7fecd3fff700 1 -- 172.21.15.17:0/1830302270 learned_addr learned my addr 172.21.15.17:0/1830302270 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:24.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.235+0000 7fecd37fe700 1 --2- 172.21.15.17:0/1830302270 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fecd41567d0 0x7fecd40aefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:24.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.235+0000 7fecd89c2700 1 --2- 172.21.15.17:0/1830302270 >> v2:172.21.15.136:3300/0 conn(0x7fecd40b1660 0x7fecd406c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:24.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.235+0000 7fecd2ffd700 1 -- 172.21.15.17:0/1830302270 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3909277742 0 0) 0x7fecd40af920 con 0x7fecd415a450 2023-10-06T04:43:24.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.235+0000 7fecd2ffd700 1 -- 172.21.15.17:0/1830302270 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecbc003570 con 0x7fecd415a450 2023-10-06T04:43:24.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.235+0000 7fecd37fe700 1 -- 172.21.15.17:0/1830302270 >> v2:172.21.15.136:3300/0 conn(0x7fecd40b1660 msgr2=0x7fecd406c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:24.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.235+0000 7fecd37fe700 1 --2- 172.21.15.17:0/1830302270 >> v2:172.21.15.136:3300/0 conn(0x7fecd40b1660 0x7fecd406c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:24.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.235+0000 7fecd37fe700 1 -- 172.21.15.17:0/1830302270 >> v1:172.21.15.17:6789/0 conn(0x7fecd415a450 legacy=0x7fecd41560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:24.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.235+0000 7fecd37fe700 1 -- 172.21.15.17:0/1830302270 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd406dce0 con 0x7fecd41567d0 2023-10-06T04:43:24.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.235+0000 7fecd89c2700 1 --2- 172.21.15.17:0/1830302270 >> v2:172.21.15.136:3300/0 conn(0x7fecd40b1660 0x7fecd406c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:43:24.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.235+0000 7fecd37fe700 1 --2- 172.21.15.17:0/1830302270 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fecd41567d0 0x7fecd40aefb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fecc40098e0 tx=0x7fecc40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=485180299c259946 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:24.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.235+0000 7fecd2ffd700 1 -- 172.21.15.17:0/1830302270 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc4011630 con 0x7fecd41567d0 2023-10-06T04:43:24.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.235+0000 7fecd2ffd700 1 -- 172.21.15.17:0/1830302270 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc4011790 con 0x7fecd41567d0 2023-10-06T04:43:24.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.235+0000 7fecd2ffd700 1 -- 172.21.15.17:0/1830302270 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc4011b30 con 0x7fecd41567d0 2023-10-06T04:43:24.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.236+0000 7fecda425700 1 -- 172.21.15.17:0/1830302270 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fecd41567d0 msgr2=0x7fecd40aefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:24.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.236+0000 7fecda425700 1 --2- 172.21.15.17:0/1830302270 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fecd41567d0 0x7fecd40aefb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fecc40098e0 tx=0x7fecc40091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:24.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.236+0000 7fecda425700 1 -- 172.21.15.17:0/1830302270 shutdown_connections 2023-10-06T04:43:24.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.236+0000 7fecda425700 1 --2- 172.21.15.17:0/1830302270 >> v2:172.21.15.136:3300/0 conn(0x7fecd40b1660 0x7fecd406c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:24.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.236+0000 7fecda425700 1 --2- 172.21.15.17:0/1830302270 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fecd41567d0 0x7fecd40aefb0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:24.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.236+0000 7fecda425700 1 -- 172.21.15.17:0/1830302270 >> 172.21.15.17:0/1830302270 conn(0x7fecd406f7b0 msgr2=0x7fecd40ae590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:24.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.236+0000 7fecda425700 1 -- 172.21.15.17:0/1830302270 shutdown_connections 2023-10-06T04:43:24.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.236+0000 7fecda425700 1 -- 172.21.15.17:0/1830302270 wait complete. 2023-10-06T04:43:24.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.237+0000 7fecda425700 1 Processor -- start 2023-10-06T04:43:24.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.237+0000 7fecda425700 1 -- start start 2023-10-06T04:43:24.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.238+0000 7fecda425700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecd40b1660 0x7fecd40c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:24.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.238+0000 7fecda425700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fecd41567d0 0x7fecd414f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:24.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.238+0000 7fecda425700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fecd415a450 0x7fecd4158b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:24.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.238+0000 7fecda425700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd40c79f0 con 0x7fecd40b1660 2023-10-06T04:43:24.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.238+0000 7fecda425700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd41577b0 con 0x7fecd41567d0 2023-10-06T04:43:24.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.238+0000 7fecda425700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd416b690 con 0x7fecd415a450 2023-10-06T04:43:24.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.238+0000 7fecd3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecd40b1660 0x7fecd40c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:24.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.238+0000 7fecd3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecd40b1660 0x7fecd40c74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32982/0 (socket says 172.21.15.17:32982) 2023-10-06T04:43:24.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.238+0000 7fecd3fff700 1 -- 172.21.15.17:0/2369900394 learned_addr learned my addr 172.21.15.17:0/2369900394 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:24.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.238+0000 7fecd89c2700 1 --2- 172.21.15.17:0/2369900394 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fecd415a450 0x7fecd4158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:24.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.238+0000 7fecd37fe700 1 --2- 172.21.15.17:0/2369900394 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fecd41567d0 0x7fecd414f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:24.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.238+0000 7fecd3fff700 1 -- 172.21.15.17:0/2369900394 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fecd415a450 msgr2=0x7fecd4158b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:24.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.238+0000 7fecd3fff700 1 --2- 172.21.15.17:0/2369900394 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fecd415a450 0x7fecd4158b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:24.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.238+0000 7fecd3fff700 1 -- 172.21.15.17:0/2369900394 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fecd41567d0 msgr2=0x7fecd414f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:24.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.238+0000 7fecd3fff700 1 --2- 172.21.15.17:0/2369900394 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fecd41567d0 0x7fecd414f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:24.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.238+0000 7fecd3fff700 1 -- 172.21.15.17:0/2369900394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feccc009a20 con 0x7fecd40b1660 2023-10-06T04:43:24.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.238+0000 7fecd3fff700 1 --2- 172.21.15.17:0/2369900394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecd40b1660 0x7fecd40c74b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fecc800c590 tx=0x7fecc8007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:24.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.239+0000 7fecbbfff700 1 -- 172.21.15.17:0/2369900394 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc8005cd0 con 0x7fecd40b1660 2023-10-06T04:43:24.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.239+0000 7fecbbfff700 1 -- 172.21.15.17:0/2369900394 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc8005e50 con 0x7fecd40b1660 2023-10-06T04:43:24.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.239+0000 7fecda425700 1 -- 172.21.15.17:0/2369900394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecc4009420 con 0x7fecd40b1660 2023-10-06T04:43:24.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.239+0000 7fecbbfff700 1 -- 172.21.15.17:0/2369900394 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc8007320 con 0x7fecd40b1660 2023-10-06T04:43:24.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.239+0000 7fecda425700 1 -- 172.21.15.17:0/2369900394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd416bc50 con 0x7fecd40b1660 2023-10-06T04:43:24.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.240+0000 7fecda425700 1 -- 172.21.15.17:0/2369900394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd404c380 con 0x7fecd40b1660 2023-10-06T04:43:24.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.240+0000 7fecbbfff700 1 -- 172.21.15.17:0/2369900394 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7fecc801b3b0 con 0x7fecd40b1660 2023-10-06T04:43:24.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.240+0000 7fecbbfff700 1 --2- 172.21.15.17:0/2369900394 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fecc0066ea0 0x7fecc0069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:24.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.241+0000 7fecbbfff700 1 -- 172.21.15.17:0/2369900394 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fecc8083890 con 0x7fecd40b1660 2023-10-06T04:43:24.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.245+0000 7fecbbfff700 1 -- 172.21.15.17:0/2369900394 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fecc8050e90 con 0x7fecd40b1660 2023-10-06T04:43:24.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.252+0000 7fecd37fe700 1 --2- 172.21.15.17:0/2369900394 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fecc0066ea0 0x7fecc0069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:24.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.252+0000 7fecd37fe700 1 --2- 172.21.15.17:0/2369900394 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fecc0066ea0 0x7fecc0069350 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fecc40098e0 tx=0x7fecc4017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:24.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.442+0000 7fecda425700 1 -- 172.21.15.17:0/2369900394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fecd40afb70 con 0x7fecd40b1660 2023-10-06T04:43:24.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.442+0000 7fecbbfff700 1 -- 172.21.15.17:0/2369900394 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7fecc8017070 con 0x7fecd40b1660 2023-10-06T04:43:24.444 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-10-06T04:43:24.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.444+0000 7fecda425700 1 -- 172.21.15.17:0/2369900394 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fecc0066ea0 msgr2=0x7fecc0069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:24.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.444+0000 7fecda425700 1 --2- 172.21.15.17:0/2369900394 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fecc0066ea0 0x7fecc0069350 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fecc40098e0 tx=0x7fecc4017000 comp rx=0 tx=0).stop 2023-10-06T04:43:24.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.444+0000 7fecda425700 1 -- 172.21.15.17:0/2369900394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecd40b1660 msgr2=0x7fecd40c74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:24.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.444+0000 7fecda425700 1 --2- 172.21.15.17:0/2369900394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecd40b1660 0x7fecd40c74b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fecc800c590 tx=0x7fecc8007e00 comp rx=0 tx=0).stop 2023-10-06T04:43:24.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.444+0000 7fecda425700 1 -- 172.21.15.17:0/2369900394 shutdown_connections 2023-10-06T04:43:24.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.444+0000 7fecda425700 1 --2- 172.21.15.17:0/2369900394 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fecc0066ea0 0x7fecc0069350 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:24.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.444+0000 7fecda425700 1 --2- 172.21.15.17:0/2369900394 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fecd415a450 0x7fecd4158b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:24.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.444+0000 7fecda425700 1 --2- 172.21.15.17:0/2369900394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecd40b1660 0x7fecd40c74b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:24.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.444+0000 7fecda425700 1 --2- 172.21.15.17:0/2369900394 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fecd41567d0 0x7fecd414f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:24.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.444+0000 7fecda425700 1 -- 172.21.15.17:0/2369900394 >> 172.21.15.17:0/2369900394 conn(0x7fecd406f7b0 msgr2=0x7fecd40cb440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:24.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.444+0000 7fecda425700 1 -- 172.21.15.17:0/2369900394 shutdown_connections 2023-10-06T04:43:24.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.444+0000 7fecda425700 1 -- 172.21.15.17:0/2369900394 wait complete. 2023-10-06T04:43:24.458 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:43:24.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.578+0000 7f4844c37700 1 Processor -- start 2023-10-06T04:43:24.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.578+0000 7f4844c37700 1 -- start start 2023-10-06T04:43:24.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.579+0000 7f4844c37700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4840159800 0x7f48400af520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:24.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.579+0000 7f4844c37700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f484006bb60 0x7f4840159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:24.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.579+0000 7f4844c37700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48400aec30 con 0x7f48400af0c0 2023-10-06T04:43:24.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.579+0000 7f4844c37700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48400ae300 con 0x7f4840159800 2023-10-06T04:43:24.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.579+0000 7f4844c37700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48400ae5e0 con 0x7f484006bb60 2023-10-06T04:43:24.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.580+0000 7f483e59c700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4840159800 0x7f48400af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:24.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.580+0000 7f483ed9d700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f484006bb60 0x7f4840159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:24.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.580+0000 7f483ed9d700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f484006bb60 0x7f4840159bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.17:57242/0 (socket says 172.21.15.17:57242) 2023-10-06T04:43:24.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.580+0000 7f483ed9d700 1 -- 172.21.15.17:0/3949451752 learned_addr learned my addr 172.21.15.17:0/3949451752 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:24.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.580+0000 7f483dd9b700 1 --1- 172.21.15.17:0/3949451752 >> v1:172.21.15.136:6789/0 conn(0x7f48400af0c0 0x7f484006b450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.17:34346/0 (socket says 172.21.15.17:34346) 2023-10-06T04:43:24.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.580+0000 7f483ed9d700 1 -- 172.21.15.17:0/3949451752 >> v2:172.21.15.17:3300/0 conn(0x7f4840159800 msgr2=0x7f48400af520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:24.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.580+0000 7f483ed9d700 1 --2- 172.21.15.17:0/3949451752 >> v2:172.21.15.17:3300/0 conn(0x7f4840159800 0x7f48400af520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:24.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.580+0000 7f483ed9d700 1 -- 172.21.15.17:0/3949451752 >> v1:172.21.15.136:6789/0 conn(0x7f48400af0c0 legacy=0x7f484006b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:24.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.580+0000 7f483ed9d700 1 -- 172.21.15.17:0/3949451752 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48400ae8c0 con 0x7f484006bb60 2023-10-06T04:43:24.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.580+0000 7f483ed9d700 1 --2- 172.21.15.17:0/3949451752 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f484006bb60 0x7f4840159bd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f484006fcc0 tx=0x7f4838009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=758eda2e14f25c20 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:24.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.580+0000 7f483d59a700 1 -- 172.21.15.17:0/3949451752 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4838009e70 con 0x7f484006bb60 2023-10-06T04:43:24.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.581+0000 7f483d59a700 1 -- 172.21.15.17:0/3949451752 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483800b860 con 0x7f484006bb60 2023-10-06T04:43:24.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.581+0000 7f483d59a700 1 -- 172.21.15.17:0/3949451752 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483800bc20 con 0x7f484006bb60 2023-10-06T04:43:24.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.581+0000 7f4844c37700 1 -- 172.21.15.17:0/3949451752 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f484006bb60 msgr2=0x7f4840159bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:24.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.581+0000 7f4844c37700 1 --2- 172.21.15.17:0/3949451752 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f484006bb60 0x7f4840159bd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f484006fcc0 tx=0x7f4838009250 comp rx=0 tx=0).stop 2023-10-06T04:43:24.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.581+0000 7f4844c37700 1 -- 172.21.15.17:0/3949451752 shutdown_connections 2023-10-06T04:43:24.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.581+0000 7f4844c37700 1 --2- 172.21.15.17:0/3949451752 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f484006bb60 0x7f4840159bd0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:24.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.581+0000 7f4844c37700 1 --2- 172.21.15.17:0/3949451752 >> v2:172.21.15.17:3300/0 conn(0x7f4840159800 0x7f48400af520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:24.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.581+0000 7f4844c37700 1 -- 172.21.15.17:0/3949451752 >> 172.21.15.17:0/3949451752 conn(0x7f48400cde20 msgr2=0x7f484006ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:24.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.581+0000 7f4844c37700 1 -- 172.21.15.17:0/3949451752 shutdown_connections 2023-10-06T04:43:24.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.581+0000 7f4844c37700 1 -- 172.21.15.17:0/3949451752 wait complete. 2023-10-06T04:43:24.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.582+0000 7f4844c37700 1 Processor -- start 2023-10-06T04:43:24.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.582+0000 7f4844c37700 1 -- start start 2023-10-06T04:43:24.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.583+0000 7f4844c37700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f484006bb60 0x7f4840154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:24.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.583+0000 7f4844c37700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48400af0c0 0x7f48400ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:24.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.583+0000 7f4844c37700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4840159800 0x7f484015bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:24.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.583+0000 7f4844c37700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4840154680 con 0x7f484006bb60 2023-10-06T04:43:24.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.583+0000 7f4844c37700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48400cd0c0 con 0x7f4840159800 2023-10-06T04:43:24.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.583+0000 7f4844c37700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4840169bc0 con 0x7f48400af0c0 2023-10-06T04:43:24.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.583+0000 7f483e59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f484006bb60 0x7f4840154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:24.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.583+0000 7f483e59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f484006bb60 0x7f4840154140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33000/0 (socket says 172.21.15.17:33000) 2023-10-06T04:43:24.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.583+0000 7f483e59c700 1 -- 172.21.15.17:0/493102268 learned_addr learned my addr 172.21.15.17:0/493102268 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:24.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.583+0000 7f483dd9b700 1 --2- 172.21.15.17:0/493102268 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48400af0c0 0x7f48400ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:24.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.583+0000 7f483ed9d700 1 --2- 172.21.15.17:0/493102268 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4840159800 0x7f484015bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:24.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.583+0000 7f483ed9d700 1 -- 172.21.15.17:0/493102268 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48400af0c0 msgr2=0x7f48400ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:24.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.583+0000 7f483ed9d700 1 --2- 172.21.15.17:0/493102268 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48400af0c0 0x7f48400ccb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:24.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.584+0000 7f483ed9d700 1 -- 172.21.15.17:0/493102268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f484006bb60 msgr2=0x7f4840154140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:24.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.584+0000 7f483ed9d700 1 --2- 172.21.15.17:0/493102268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f484006bb60 0x7f4840154140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:24.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.584+0000 7f483ed9d700 1 -- 172.21.15.17:0/493102268 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48380094f0 con 0x7f4840159800 2023-10-06T04:43:24.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.584+0000 7f483e59c700 1 --2- 172.21.15.17:0/493102268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f484006bb60 0x7f4840154140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:43:24.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.584+0000 7f483ed9d700 1 --2- 172.21.15.17:0/493102268 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4840159800 0x7f484015bef0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f48400ce460 tx=0x7f4838017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:24.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.584+0000 7f482e7fc700 1 -- 172.21.15.17:0/493102268 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483801f070 con 0x7f4840159800 2023-10-06T04:43:24.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.584+0000 7f482e7fc700 1 -- 172.21.15.17:0/493102268 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4838009e70 con 0x7f4840159800 2023-10-06T04:43:24.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.584+0000 7f4844c37700 1 -- 172.21.15.17:0/493102268 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4840169ea0 con 0x7f4840159800 2023-10-06T04:43:24.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.584+0000 7f482e7fc700 1 -- 172.21.15.17:0/493102268 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4838011630 con 0x7f4840159800 2023-10-06T04:43:24.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.584+0000 7f4844c37700 1 -- 172.21.15.17:0/493102268 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f484016a460 con 0x7f4840159800 2023-10-06T04:43:24.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.585+0000 7f4844c37700 1 -- 172.21.15.17:0/493102268 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f484004c380 con 0x7f4840159800 2023-10-06T04:43:24.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.585+0000 7f482e7fc700 1 -- 172.21.15.17:0/493102268 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f48380119a0 con 0x7f4840159800 2023-10-06T04:43:24.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.586+0000 7f482e7fc700 1 --2- 172.21.15.17:0/493102268 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f4820066ea0 0x7f4820069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:24.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.586+0000 7f483e59c700 1 --2- 172.21.15.17:0/493102268 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f4820066ea0 0x7f4820069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:24.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.586+0000 7f482e7fc700 1 -- 172.21.15.17:0/493102268 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f48380856d0 con 0x7f4840159800 2023-10-06T04:43:24.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.586+0000 7f483e59c700 1 --2- 172.21.15.17:0/493102268 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f4820066ea0 0x7f4820069350 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4830009fd0 tx=0x7f483000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:24.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.590+0000 7f482e7fc700 1 -- 172.21.15.17:0/493102268 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4838052bf0 con 0x7f4840159800 2023-10-06T04:43:24.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.789+0000 7f4844c37700 1 -- 172.21.15.17:0/493102268 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f48401552c0 con 0x7f4840159800 2023-10-06T04:43:24.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.789+0000 7f482e7fc700 1 -- 172.21.15.17:0/493102268 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f483800bbe0 con 0x7f4840159800 2023-10-06T04:43:24.791 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-10-06T04:43:24.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.792+0000 7f4844c37700 1 -- 172.21.15.17:0/493102268 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f4820066ea0 msgr2=0x7f4820069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:24.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.792+0000 7f4844c37700 1 --2- 172.21.15.17:0/493102268 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f4820066ea0 0x7f4820069350 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4830009fd0 tx=0x7f483000b040 comp rx=0 tx=0).stop 2023-10-06T04:43:24.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.792+0000 7f4844c37700 1 -- 172.21.15.17:0/493102268 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4840159800 msgr2=0x7f484015bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:24.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.792+0000 7f4844c37700 1 --2- 172.21.15.17:0/493102268 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4840159800 0x7f484015bef0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f48400ce460 tx=0x7f4838017000 comp rx=0 tx=0).stop 2023-10-06T04:43:24.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.792+0000 7f4844c37700 1 -- 172.21.15.17:0/493102268 shutdown_connections 2023-10-06T04:43:24.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.792+0000 7f4844c37700 1 --2- 172.21.15.17:0/493102268 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f4820066ea0 0x7f4820069350 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:24.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.792+0000 7f4844c37700 1 --2- 172.21.15.17:0/493102268 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4840159800 0x7f484015bef0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:24.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.792+0000 7f4844c37700 1 --2- 172.21.15.17:0/493102268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f484006bb60 0x7f4840154140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:24.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.792+0000 7f4844c37700 1 --2- 172.21.15.17:0/493102268 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48400af0c0 0x7f48400ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:24.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.792+0000 7f4844c37700 1 -- 172.21.15.17:0/493102268 >> 172.21.15.17:0/493102268 conn(0x7f48400cde20 msgr2=0x7f484006ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:24.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.792+0000 7f4844c37700 1 -- 172.21.15.17:0/493102268 shutdown_connections 2023-10-06T04:43:24.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.792+0000 7f4844c37700 1 -- 172.21.15.17:0/493102268 wait complete. 2023-10-06T04:43:24.806 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:43:24.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.924+0000 7f2e68f83700 1 Processor -- start 2023-10-06T04:43:24.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.924+0000 7f2e68f83700 1 -- start start 2023-10-06T04:43:24.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.925+0000 7f2e68f83700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2e640ccfc0 0x7f2e640cc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:24.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.925+0000 7f2e68f83700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2e640cc750 0x7f2e640b0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:24.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.925+0000 7f2e68f83700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e640cbd80 con 0x7f2e640cf3b0 2023-10-06T04:43:24.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.925+0000 7f2e68f83700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e640af5f0 con 0x7f2e640cc750 2023-10-06T04:43:24.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.925+0000 7f2e68f83700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e640af8d0 con 0x7f2e640ccfc0 2023-10-06T04:43:24.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.925+0000 7f2e62ffd700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f2e640cf3b0 0x7f2e641594a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:32874/0 (socket says 172.21.15.17:32874) 2023-10-06T04:43:24.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.925+0000 7f2e62ffd700 1 -- 172.21.15.17:0/1893753196 learned_addr learned my addr 172.21.15.17:0/1893753196 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:24.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.925+0000 7f2e63fff700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2e640cc750 0x7f2e640b0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:24.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.925+0000 7f2e637fe700 1 --2- 172.21.15.17:0/1893753196 >> v2:172.21.15.136:3300/0 conn(0x7f2e640ccfc0 0x7f2e640cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:24.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.925+0000 7f2e63fff700 1 -- 172.21.15.17:0/1893753196 >> v2:172.21.15.136:3300/0 conn(0x7f2e640ccfc0 msgr2=0x7f2e640cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:24.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.925+0000 7f2e63fff700 1 --2- 172.21.15.17:0/1893753196 >> v2:172.21.15.136:3300/0 conn(0x7f2e640ccfc0 0x7f2e640cc210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:24.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.925+0000 7f2e63fff700 1 -- 172.21.15.17:0/1893753196 >> v1:172.21.15.17:6789/0 conn(0x7f2e640cf3b0 legacy=0x7f2e641594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:24.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.925+0000 7f2e627fc700 1 -- 172.21.15.17:0/1893753196 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3345351876 0 0) 0x7f2e640cbd80 con 0x7f2e640cf3b0 2023-10-06T04:43:24.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.925+0000 7f2e63fff700 1 -- 172.21.15.17:0/1893753196 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e640afbb0 con 0x7f2e640cc750 2023-10-06T04:43:24.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.926+0000 7f2e63fff700 1 --2- 172.21.15.17:0/1893753196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e640cc750 0x7f2e640b0460 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c009e60 tx=0x7f2e5c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c99f2fa5bd68d5a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:24.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.926+0000 7f2e627fc700 1 -- 172.21.15.17:0/1893753196 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c00e070 con 0x7f2e640cc750 2023-10-06T04:43:24.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.926+0000 7f2e627fc700 1 -- 172.21.15.17:0/1893753196 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5c00bb20 con 0x7f2e640cc750 2023-10-06T04:43:24.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.926+0000 7f2e627fc700 1 -- 172.21.15.17:0/1893753196 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c012430 con 0x7f2e640cc750 2023-10-06T04:43:24.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.926+0000 7f2e68f83700 1 -- 172.21.15.17:0/1893753196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e640cc750 msgr2=0x7f2e640b0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:24.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.926+0000 7f2e68f83700 1 --2- 172.21.15.17:0/1893753196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e640cc750 0x7f2e640b0460 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c009e60 tx=0x7f2e5c009780 comp rx=0 tx=0).stop 2023-10-06T04:43:24.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.926+0000 7f2e68f83700 1 -- 172.21.15.17:0/1893753196 shutdown_connections 2023-10-06T04:43:24.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.926+0000 7f2e68f83700 1 --2- 172.21.15.17:0/1893753196 >> v2:172.21.15.136:3300/0 conn(0x7f2e640ccfc0 0x7f2e640cc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:24.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.926+0000 7f2e68f83700 1 --2- 172.21.15.17:0/1893753196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e640cc750 0x7f2e640b0460 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:24.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.926+0000 7f2e68f83700 1 -- 172.21.15.17:0/1893753196 >> 172.21.15.17:0/1893753196 conn(0x7f2e6406cff0 msgr2=0x7f2e6406da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:24.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.926+0000 7f2e68f83700 1 -- 172.21.15.17:0/1893753196 shutdown_connections 2023-10-06T04:43:24.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.926+0000 7f2e68f83700 1 -- 172.21.15.17:0/1893753196 wait complete. 2023-10-06T04:43:24.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.928+0000 7f2e68f83700 1 Processor -- start 2023-10-06T04:43:24.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.928+0000 7f2e68f83700 1 -- start start 2023-10-06T04:43:24.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.928+0000 7f2e68f83700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e640cc750 0x7f2e640b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:24.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.928+0000 7f2e68f83700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2e640ccfc0 0x7f2e640c9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:24.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.928+0000 7f2e68f83700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e64154270 0x7f2e6416a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:24.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.928+0000 7f2e68f83700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e640c97d0 con 0x7f2e640cc750 2023-10-06T04:43:24.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.928+0000 7f2e68f83700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e640b32a0 con 0x7f2e64154270 2023-10-06T04:43:24.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.928+0000 7f2e68f83700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e64154710 con 0x7f2e640ccfc0 2023-10-06T04:43:24.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.928+0000 7f2e637fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e640cc750 0x7f2e640b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:24.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.929+0000 7f2e637fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e640cc750 0x7f2e640b4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33016/0 (socket says 172.21.15.17:33016) 2023-10-06T04:43:24.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.929+0000 7f2e637fe700 1 -- 172.21.15.17:0/3238086999 learned_addr learned my addr 172.21.15.17:0/3238086999 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:24.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.929+0000 7f2e63fff700 1 --2- 172.21.15.17:0/3238086999 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e64154270 0x7f2e6416a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:24.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.929+0000 7f2e62ffd700 1 --2- 172.21.15.17:0/3238086999 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2e640ccfc0 0x7f2e640c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:24.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.929+0000 7f2e637fe700 1 -- 172.21.15.17:0/3238086999 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2e640ccfc0 msgr2=0x7f2e640c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:24.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.929+0000 7f2e637fe700 1 --2- 172.21.15.17:0/3238086999 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2e640ccfc0 0x7f2e640c9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:24.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.929+0000 7f2e637fe700 1 -- 172.21.15.17:0/3238086999 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e64154270 msgr2=0x7f2e6416a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:24.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.929+0000 7f2e637fe700 1 --2- 172.21.15.17:0/3238086999 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e64154270 0x7f2e6416a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:24.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.929+0000 7f2e637fe700 1 -- 172.21.15.17:0/3238086999 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5c009a20 con 0x7f2e640cc750 2023-10-06T04:43:24.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.929+0000 7f2e637fe700 1 --2- 172.21.15.17:0/3238086999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e640cc750 0x7f2e640b4ae0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2e5400ec80 tx=0x7f2e540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:24.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.929+0000 7f2e4b7fe700 1 -- 172.21.15.17:0/3238086999 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5400c9d0 con 0x7f2e640cc750 2023-10-06T04:43:24.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.929+0000 7f2e4b7fe700 1 -- 172.21.15.17:0/3238086999 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5400cb30 con 0x7f2e640cc750 2023-10-06T04:43:24.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.929+0000 7f2e68f83700 1 -- 172.21.15.17:0/3238086999 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e640b51a0 con 0x7f2e640cc750 2023-10-06T04:43:24.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.929+0000 7f2e4b7fe700 1 -- 172.21.15.17:0/3238086999 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e54013470 con 0x7f2e640cc750 2023-10-06T04:43:24.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.929+0000 7f2e68f83700 1 -- 172.21.15.17:0/3238086999 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e640b34f0 con 0x7f2e640cc750 2023-10-06T04:43:24.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.930+0000 7f2e68f83700 1 -- 172.21.15.17:0/3238086999 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e640b56c0 con 0x7f2e640cc750 2023-10-06T04:43:24.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.931+0000 7f2e4b7fe700 1 -- 172.21.15.17:0/3238086999 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f2e54013820 con 0x7f2e640cc750 2023-10-06T04:43:24.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.931+0000 7f2e4b7fe700 1 --2- 172.21.15.17:0/3238086999 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2e50066ea0 0x7f2e50069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:24.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.931+0000 7f2e4b7fe700 1 -- 172.21.15.17:0/3238086999 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f2e54084610 con 0x7f2e640cc750 2023-10-06T04:43:24.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.931+0000 7f2e62ffd700 1 --2- 172.21.15.17:0/3238086999 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2e50066ea0 0x7f2e50069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:24.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.932+0000 7f2e62ffd700 1 --2- 172.21.15.17:0/3238086999 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2e50066ea0 0x7f2e50069350 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2e640b64c0 tx=0x7f2e58009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:24.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:24.936+0000 7f2e4b7fe700 1 -- 172.21.15.17:0/3238086999 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2e54051b50 con 0x7f2e640cc750 2023-10-06T04:43:25.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.173+0000 7f2e68f83700 1 -- 172.21.15.17:0/3238086999 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e64159bb0 con 0x7f2e640cc750 2023-10-06T04:43:25.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.173+0000 7f2e4b7fe700 1 -- 172.21.15.17:0/3238086999 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7f2e54017de0 con 0x7f2e640cc750 2023-10-06T04:43:25.175 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:43:25.175 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/3001699743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3001699743},{"type":"v1","addr":"172.21.15.136:6833","nonce":3001699743}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/1891609455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1891609455},{"type":"v1","addr":"172.21.15.17:6835","nonce":1891609455}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/2697752124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":2697752124},{"type":"v1","addr":"172.21.15.17:6837","nonce":2697752124}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/1496795591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":1496795591},{"type":"v1","addr":"172.21.15.136:6835","nonce":1496795591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-10-06T04:43:25.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.175+0000 7f2e68f83700 1 -- 172.21.15.17:0/3238086999 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2e50066ea0 msgr2=0x7f2e50069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:25.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.175+0000 7f2e68f83700 1 --2- 172.21.15.17:0/3238086999 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2e50066ea0 0x7f2e50069350 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2e640b64c0 tx=0x7f2e58009040 comp rx=0 tx=0).stop 2023-10-06T04:43:25.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.175+0000 7f2e68f83700 1 -- 172.21.15.17:0/3238086999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e640cc750 msgr2=0x7f2e640b4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:25.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.175+0000 7f2e68f83700 1 --2- 172.21.15.17:0/3238086999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e640cc750 0x7f2e640b4ae0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2e5400ec80 tx=0x7f2e540091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:25.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.175+0000 7f2e68f83700 1 -- 172.21.15.17:0/3238086999 shutdown_connections 2023-10-06T04:43:25.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.175+0000 7f2e68f83700 1 --2- 172.21.15.17:0/3238086999 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2e50066ea0 0x7f2e50069350 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:25.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.175+0000 7f2e68f83700 1 --2- 172.21.15.17:0/3238086999 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e64154270 0x7f2e6416a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:25.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.175+0000 7f2e68f83700 1 --2- 172.21.15.17:0/3238086999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e640cc750 0x7f2e640b4ae0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:25.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.175+0000 7f2e68f83700 1 --2- 172.21.15.17:0/3238086999 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2e640ccfc0 0x7f2e640c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:25.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.175+0000 7f2e68f83700 1 -- 172.21.15.17:0/3238086999 >> 172.21.15.17:0/3238086999 conn(0x7f2e6406cff0 msgr2=0x7f2e640cb320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:25.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.175+0000 7f2e68f83700 1 -- 172.21.15.17:0/3238086999 shutdown_connections 2023-10-06T04:43:25.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.175+0000 7f2e68f83700 1 -- 172.21.15.17:0/3238086999 wait complete. 2023-10-06T04:43:25.178 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 3 2023-10-06T04:43:25.189 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:43:25.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.306+0000 7fe822ff4700 1 Processor -- start 2023-10-06T04:43:25.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.306+0000 7fe822ff4700 1 -- start start 2023-10-06T04:43:25.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.307+0000 7fe822ff4700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe81c15ca80 0x7fe81c06e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:25.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.307+0000 7fe822ff4700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe81c0ab250 con 0x7fe81c15ce50 2023-10-06T04:43:25.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.307+0000 7fe822ff4700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe81c06e660 con 0x7fe81c15dae0 2023-10-06T04:43:25.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.307+0000 7fe822ff4700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe81c06e940 con 0x7fe81c15ca80 2023-10-06T04:43:25.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.307+0000 7fe81bfff700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fe81c15ce50 0x7fe81c15d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:32888/0 (socket says 172.21.15.17:32888) 2023-10-06T04:43:25.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.307+0000 7fe81bfff700 1 -- 172.21.15.17:0/3498158566 learned_addr learned my addr 172.21.15.17:0/3498158566 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:25.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.307+0000 7fe820d90700 1 --2- 172.21.15.17:0/3498158566 >> v2:172.21.15.136:3300/0 conn(0x7fe81c15ca80 0x7fe81c06e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:25.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.308+0000 7fe81b7fe700 1 -- 172.21.15.17:0/3498158566 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 143076059 0 0) 0x7fe81c0ab250 con 0x7fe81c15ce50 2023-10-06T04:43:25.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.308+0000 7fe81b7fe700 1 -- 172.21.15.17:0/3498158566 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe80c003570 con 0x7fe81c15ce50 2023-10-06T04:43:25.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.308+0000 7fe81b7fe700 1 -- 172.21.15.17:0/3498158566 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2749443029 0 0) 0x7fe80c003570 con 0x7fe81c15ce50 2023-10-06T04:43:25.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.308+0000 7fe81b7fe700 1 -- 172.21.15.17:0/3498158566 >> v2:172.21.15.136:3300/0 conn(0x7fe81c15ca80 msgr2=0x7fe81c06e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:25.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.308+0000 7fe81b7fe700 1 --2- 172.21.15.17:0/3498158566 >> v2:172.21.15.136:3300/0 conn(0x7fe81c15ca80 0x7fe81c06e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:25.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.308+0000 7fe81b7fe700 1 -- 172.21.15.17:0/3498158566 >> v1:172.21.15.136:6789/0 conn(0x7fe81c15dae0 legacy=0x7fe81c0ab6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:25.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.308+0000 7fe81b7fe700 1 -- 172.21.15.17:0/3498158566 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81c06ec20 con 0x7fe81c15ce50 2023-10-06T04:43:25.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.308+0000 7fe81b7fe700 1 -- 172.21.15.17:0/3498158566 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4268781140 0 0) 0x7fe808001470 con 0x7fe81c15ce50 2023-10-06T04:43:25.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.308+0000 7fe81b7fe700 1 -- 172.21.15.17:0/3498158566 >> v1:172.21.15.17:6789/0 conn(0x7fe81c15ce50 legacy=0x7fe81c15d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:25.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.308+0000 7fe81b7fe700 1 --2- 172.21.15.17:0/3498158566 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe80c003a60 0x7fe80c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:25.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.308+0000 7fe81b7fe700 1 --2- 172.21.15.17:0/3498158566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe80c004810 0x7fe80c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:25.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.308+0000 7fe81b7fe700 1 --2- 172.21.15.17:0/3498158566 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe80c0051c0 0x7fe80c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:25.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.308+0000 7fe81b7fe700 1 -- 172.21.15.17:0/3498158566 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c06e940 con 0x7fe80c004810 2023-10-06T04:43:25.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.308+0000 7fe81b7fe700 1 -- 172.21.15.17:0/3498158566 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c00c160 con 0x7fe80c0051c0 2023-10-06T04:43:25.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.308+0000 7fe81b7fe700 1 -- 172.21.15.17:0/3498158566 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c00c320 con 0x7fe80c003a60 2023-10-06T04:43:25.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.308+0000 7fe81bfff700 1 --2- 172.21.15.17:0/3498158566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe80c004810 0x7fe80c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:25.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.308+0000 7fe820d90700 1 --2- 172.21.15.17:0/3498158566 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe80c003a60 0x7fe80c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:25.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.308+0000 7fe821591700 1 --2- 172.21.15.17:0/3498158566 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe80c0051c0 0x7fe80c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:25.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.308+0000 7fe81bfff700 1 -- 172.21.15.17:0/3498158566 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe80c003a60 msgr2=0x7fe80c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:25.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.308+0000 7fe81bfff700 1 --2- 172.21.15.17:0/3498158566 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe80c003a60 0x7fe80c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:25.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.308+0000 7fe81bfff700 1 -- 172.21.15.17:0/3498158566 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe80c0051c0 msgr2=0x7fe80c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:25.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.308+0000 7fe81bfff700 1 --2- 172.21.15.17:0/3498158566 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe80c0051c0 0x7fe80c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:25.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.308+0000 7fe81bfff700 1 -- 172.21.15.17:0/3498158566 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe80c003570 con 0x7fe80c004810 2023-10-06T04:43:25.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.308+0000 7fe821591700 1 -- 172.21.15.17:0/3498158566 reap_dead start 2023-10-06T04:43:25.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.308+0000 7fe81bfff700 1 --2- 172.21.15.17:0/3498158566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe80c004810 0x7fe80c004c80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe80800c3c0 tx=0x7fe808001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d556d1c71892a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:25.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.309+0000 7fe81b7fe700 1 -- 172.21.15.17:0/3498158566 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80800cc90 con 0x7fe80c004810 2023-10-06T04:43:25.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.309+0000 7fe81b7fe700 1 -- 172.21.15.17:0/3498158566 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80800cdf0 con 0x7fe80c004810 2023-10-06T04:43:25.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.309+0000 7fe81b7fe700 1 -- 172.21.15.17:0/3498158566 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe808005b50 con 0x7fe80c004810 2023-10-06T04:43:25.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.309+0000 7fe822ff4700 1 -- 172.21.15.17:0/3498158566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe80c004810 msgr2=0x7fe80c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:25.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.309+0000 7fe822ff4700 1 --2- 172.21.15.17:0/3498158566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe80c004810 0x7fe80c004c80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe80800c3c0 tx=0x7fe808001e50 comp rx=0 tx=0).stop 2023-10-06T04:43:25.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.309+0000 7fe822ff4700 1 -- 172.21.15.17:0/3498158566 shutdown_connections 2023-10-06T04:43:25.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.309+0000 7fe822ff4700 1 --2- 172.21.15.17:0/3498158566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe80c004810 0x7fe80c004c80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:25.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.309+0000 7fe822ff4700 1 -- 172.21.15.17:0/3498158566 >> 172.21.15.17:0/3498158566 conn(0x7fe81c06cd40 msgr2=0x7fe81c087fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:25.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.309+0000 7fe822ff4700 1 -- 172.21.15.17:0/3498158566 shutdown_connections 2023-10-06T04:43:25.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.309+0000 7fe822ff4700 1 -- 172.21.15.17:0/3498158566 wait complete. 2023-10-06T04:43:25.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.310+0000 7fe822ff4700 1 Processor -- start 2023-10-06T04:43:25.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.311+0000 7fe822ff4700 1 -- start start 2023-10-06T04:43:25.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.311+0000 7fe822ff4700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe80c004810 0x7fe81c16cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:25.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.311+0000 7fe822ff4700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe81c16b190 0x7fe81c15ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:25.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.311+0000 7fe822ff4700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe81c15b1a0 0x7fe81c16a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:25.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.311+0000 7fe822ff4700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c15b610 con 0x7fe81c16b190 2023-10-06T04:43:25.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.311+0000 7fe822ff4700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c16af60 con 0x7fe80c004810 2023-10-06T04:43:25.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.311+0000 7fe822ff4700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c16b600 con 0x7fe81c15b1a0 2023-10-06T04:43:25.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.311+0000 7fe81bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe81c16b190 0x7fe81c15ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:25.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.311+0000 7fe81bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe81c16b190 0x7fe81c15ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33028/0 (socket says 172.21.15.17:33028) 2023-10-06T04:43:25.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.311+0000 7fe81bfff700 1 -- 172.21.15.17:0/1708735961 learned_addr learned my addr 172.21.15.17:0/1708735961 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:25.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.311+0000 7fe820d90700 1 --2- 172.21.15.17:0/1708735961 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe80c004810 0x7fe81c16cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:25.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.311+0000 7fe821591700 1 --2- 172.21.15.17:0/1708735961 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe81c15b1a0 0x7fe81c16a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:25.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.312+0000 7fe81bfff700 1 -- 172.21.15.17:0/1708735961 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe81c15b1a0 msgr2=0x7fe81c16a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:25.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.312+0000 7fe81bfff700 1 --2- 172.21.15.17:0/1708735961 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe81c15b1a0 0x7fe81c16a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:25.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.312+0000 7fe81bfff700 1 -- 172.21.15.17:0/1708735961 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe80c004810 msgr2=0x7fe81c16cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:25.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.312+0000 7fe81bfff700 1 --2- 172.21.15.17:0/1708735961 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe80c004810 0x7fe81c16cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:25.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.312+0000 7fe81bfff700 1 -- 172.21.15.17:0/1708735961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81c098e40 con 0x7fe81c16b190 2023-10-06T04:43:25.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.312+0000 7fe81bfff700 1 --2- 172.21.15.17:0/1708735961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe81c16b190 0x7fe81c15ac60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe80c00c130 tx=0x7fe808015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:25.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.312+0000 7fe818ff9700 1 -- 172.21.15.17:0/1708735961 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe808001430 con 0x7fe81c16b190 2023-10-06T04:43:25.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.312+0000 7fe818ff9700 1 -- 172.21.15.17:0/1708735961 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8080070d0 con 0x7fe81c16b190 2023-10-06T04:43:25.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.312+0000 7fe822ff4700 1 -- 172.21.15.17:0/1708735961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe81c099120 con 0x7fe81c16b190 2023-10-06T04:43:25.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.312+0000 7fe818ff9700 1 -- 172.21.15.17:0/1708735961 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe808007490 con 0x7fe81c16b190 2023-10-06T04:43:25.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.312+0000 7fe822ff4700 1 -- 172.21.15.17:0/1708735961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe81c0996e0 con 0x7fe81c16b190 2023-10-06T04:43:25.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.313+0000 7fe822ff4700 1 -- 172.21.15.17:0/1708735961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe81c063ff0 con 0x7fe81c16b190 2023-10-06T04:43:25.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.313+0000 7fe818ff9700 1 -- 172.21.15.17:0/1708735961 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7fe8080273b0 con 0x7fe81c16b190 2023-10-06T04:43:25.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.314+0000 7fe818ff9700 1 --2- 172.21.15.17:0/1708735961 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe800066ea0 0x7fe800069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:25.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.314+0000 7fe818ff9700 1 -- 172.21.15.17:0/1708735961 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fe808084b20 con 0x7fe81c16b190 2023-10-06T04:43:25.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.314+0000 7fe820d90700 1 --2- 172.21.15.17:0/1708735961 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe800066ea0 0x7fe800069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:25.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.314+0000 7fe820d90700 1 --2- 172.21.15.17:0/1708735961 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe800066ea0 0x7fe800069350 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe81c066050 tx=0x7fe8100091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:25.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.318+0000 7fe818ff9700 1 -- 172.21.15.17:0/1708735961 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe808052060 con 0x7fe81c16b190 2023-10-06T04:43:25.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.331+0000 7fe818ff9700 1 -- 172.21.15.17:0/1708735961 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe808052430 con 0x7fe81c16b190 2023-10-06T04:43:25.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.516+0000 7fe822ff4700 1 -- 172.21.15.17:0/1708735961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe81c06ef00 con 0x7fe81c16b190 2023-10-06T04:43:25.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.517+0000 7fe818ff9700 1 -- 172.21.15.17:0/1708735961 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+13648 (secure 0 0 0) 0x7fe80805cf10 con 0x7fe81c16b190 2023-10-06T04:43:25.518 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:43:25.519 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":17,"fsid":"780777c4-2b25-4d35-9058-c9f2d62e3ad9","created":"2023-10-06T04:43:10.578520+0000","modified":"2023-10-06T04:43:24.705533+0000","last_up_change":"2023-10-06T04:43:20.682958+0000","last_in_change":"2023-10-06T04:43:12.978917+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:43:21.795733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:43:22.389592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"84737b08-575c-46dd-9488-073ae8504494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6809","nonce":90656},{"type":"v1","addr":"172.21.15.17:6811","nonce":90656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":90656},{"type":"v1","addr":"172.21.15.17:6814","nonce":90656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":90656},{"type":"v1","addr":"172.21.15.17:6822","nonce":90656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":90656},{"type":"v1","addr":"172.21.15.17:6818","nonce":90656}]},"public_addr":"172.21.15.17:6811/90656","cluster_addr":"172.21.15.17:6814/90656","heartbeat_back_addr":"172.21.15.17:6822/90656","heartbeat_front_addr":"172.21.15.17:6818/90656","state":["exists","up"]},{"osd":1,"uuid":"dffeb740-58a2-4fd6-8ff1-a0a11a2cc709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":90655},{"type":"v1","addr":"172.21.15.17:6801","nonce":90655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":90655},{"type":"v1","addr":"172.21.15.17:6803","nonce":90655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":90655},{"type":"v1","addr":"172.21.15.17:6807","nonce":90655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":90655},{"type":"v1","addr":"172.21.15.17:6805","nonce":90655}]},"public_addr":"172.21.15.17:6801/90655","cluster_addr":"172.21.15.17:6803/90655","heartbeat_back_addr":"172.21.15.17:6807/90655","heartbeat_front_addr":"172.21.15.17:6805/90655","state":["exists","up"]},{"osd":2,"uuid":"48bd6831-763d-48c2-b515-e02c216d608b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":90657},{"type":"v1","addr":"172.21.15.17:6810","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":90657},{"type":"v1","addr":"172.21.15.17:6815","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":90657},{"type":"v1","addr":"172.21.15.17:6823","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":90657},{"type":"v1","addr":"172.21.15.17:6819","nonce":90657}]},"public_addr":"172.21.15.17:6810/90657","cluster_addr":"172.21.15.17:6815/90657","heartbeat_back_addr":"172.21.15.17:6823/90657","heartbeat_front_addr":"172.21.15.17:6819/90657","state":["exists","up"]},{"osd":3,"uuid":"ae7dbb23-abe7-4bd3-a4df-6f5963d6804c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":90688},{"type":"v1","addr":"172.21.15.17:6825","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":90688},{"type":"v1","addr":"172.21.15.17:6827","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":90688},{"type":"v1","addr":"172.21.15.17:6831","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":90688},{"type":"v1","addr":"172.21.15.17:6829","nonce":90688}]},"public_addr":"172.21.15.17:6825/90688","cluster_addr":"172.21.15.17:6827/90688","heartbeat_back_addr":"172.21.15.17:6831/90688","heartbeat_front_addr":"172.21.15.17:6829/90688","state":["exists","up"]},{"osd":4,"uuid":"29991fb4-1667-4ea3-aca0-d55db27f3bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":90902},{"type":"v1","addr":"172.21.15.136:6801","nonce":90902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":90902},{"type":"v1","addr":"172.21.15.136:6803","nonce":90902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":90902},{"type":"v1","addr":"172.21.15.136:6807","nonce":90902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":90902},{"type":"v1","addr":"172.21.15.136:6805","nonce":90902}]},"public_addr":"172.21.15.136:6801/90902","cluster_addr":"172.21.15.136:6803/90902","heartbeat_back_addr":"172.21.15.136:6807/90902","heartbeat_front_addr":"172.21.15.136:6805/90902","state":["exists","up"]},{"osd":5,"uuid":"398b4ff9-03fc-421f-882c-ba12aa088eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":90901},{"type":"v1","addr":"172.21.15.136:6809","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":90901},{"type":"v1","addr":"172.21.15.136:6811","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":90901},{"type":"v1","addr":"172.21.15.136:6815","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":90901},{"type":"v1","addr":"172.21.15.136:6813","nonce":90901}]},"public_addr":"172.21.15.136:6809/90901","cluster_addr":"172.21.15.136:6811/90901","heartbeat_back_addr":"172.21.15.136:6815/90901","heartbeat_front_addr":"172.21.15.136:6813/90901","state":["exists","up"]},{"osd":6,"uuid":"1bb91a72-4dab-4cdb-aa1d-2b8a9edf1ad0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":90927},{"type":"v1","addr":"172.21.15.136:6825","nonce":90927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":90927},{"type":"v1","addr":"172.21.15.136:6827","nonce":90927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":90927},{"type":"v1","addr":"172.21.15.136:6831","nonce":90927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":90927},{"type":"v1","addr":"172.21.15.136:6829","nonce":90927}]},"public_addr":"172.21.15.136:6825/90927","cluster_addr":"172.21.15.136:6827/90927","heartbeat_back_addr":"172.21.15.136:6831/90927","heartbeat_front_addr":"172.21.15.136:6829/90927","state":["exists","up"]},{"osd":7,"uuid":"719b654e-010d-4aa4-8c13-83fdde242b47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":90934},{"type":"v1","addr":"172.21.15.136:6817","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":90934},{"type":"v1","addr":"172.21.15.136:6819","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":90934},{"type":"v1","addr":"172.21.15.136:6824","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":90934},{"type":"v1","addr":"172.21.15.136:6821","nonce":90934}]},"public_addr":"172.21.15.136:6817/90934","cluster_addr":"172.21.15.136:6819/90934","heartbeat_back_addr":"172.21.15.136:6824/90934","heartbeat_front_addr":"172.21.15.136:6821/90934","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.157479+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.140520+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.190743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.231396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.156510+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.145822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.202888+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.139532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:43:25.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.518+0000 7fe822ff4700 1 -- 172.21.15.17:0/1708735961 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe800066ea0 msgr2=0x7fe800069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:25.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.518+0000 7fe822ff4700 1 --2- 172.21.15.17:0/1708735961 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe800066ea0 0x7fe800069350 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe81c066050 tx=0x7fe8100091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:25.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.518+0000 7fe822ff4700 1 -- 172.21.15.17:0/1708735961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe81c16b190 msgr2=0x7fe81c15ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:25.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.518+0000 7fe822ff4700 1 --2- 172.21.15.17:0/1708735961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe81c16b190 0x7fe81c15ac60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe80c00c130 tx=0x7fe808015000 comp rx=0 tx=0).stop 2023-10-06T04:43:25.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.518+0000 7fe822ff4700 1 -- 172.21.15.17:0/1708735961 shutdown_connections 2023-10-06T04:43:25.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.518+0000 7fe822ff4700 1 --2- 172.21.15.17:0/1708735961 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe800066ea0 0x7fe800069350 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:25.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.518+0000 7fe822ff4700 1 --2- 172.21.15.17:0/1708735961 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe81c15b1a0 0x7fe81c16a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:25.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.518+0000 7fe822ff4700 1 --2- 172.21.15.17:0/1708735961 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe80c004810 0x7fe81c16cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:25.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.518+0000 7fe822ff4700 1 --2- 172.21.15.17:0/1708735961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe81c16b190 0x7fe81c15ac60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:25.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.518+0000 7fe822ff4700 1 -- 172.21.15.17:0/1708735961 >> 172.21.15.17:0/1708735961 conn(0x7fe81c06cd40 msgr2=0x7fe81c0b39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:25.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.519+0000 7fe822ff4700 1 -- 172.21.15.17:0/1708735961 shutdown_connections 2023-10-06T04:43:25.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.519+0000 7fe822ff4700 1 -- 172.21.15.17:0/1708735961 wait complete. 2023-10-06T04:43:25.532 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:43:21.795733+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:43:22.389592+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T04:43:25.533 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:43:25.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.652+0000 7f9556c06700 1 Processor -- start 2023-10-06T04:43:25.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.652+0000 7f9556c06700 1 -- start start 2023-10-06T04:43:25.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.653+0000 7f9556c06700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f955006d140 0x7f955006f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:25.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.653+0000 7f9556c06700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95500d1120 con 0x7f9550159b10 2023-10-06T04:43:25.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.653+0000 7f9556c06700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95500d1400 con 0x7f95500cabf0 2023-10-06T04:43:25.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.653+0000 7f9556c06700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f955006e920 con 0x7f955006d140 2023-10-06T04:43:25.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.653+0000 7f954ffff700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f9550159b10 0x7f955006f120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:32898/0 (socket says 172.21.15.17:32898) 2023-10-06T04:43:25.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.653+0000 7f954ffff700 1 -- 172.21.15.17:0/3476706961 learned_addr learned my addr 172.21.15.17:0/3476706961 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:25.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.653+0000 7f954f7fe700 1 -- 172.21.15.17:0/3476706961 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3852737836 0 0) 0x7f95500d1120 con 0x7f9550159b10 2023-10-06T04:43:25.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.653+0000 7f954f7fe700 1 -- 172.21.15.17:0/3476706961 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9540003570 con 0x7f9550159b10 2023-10-06T04:43:25.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.653+0000 7f95551a3700 1 --2- 172.21.15.17:0/3476706961 >> v2:172.21.15.136:3300/0 conn(0x7f955006d140 0x7f955006f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:25.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.653+0000 7f954f7fe700 1 -- 172.21.15.17:0/3476706961 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 255647259 0 0) 0x7f9540003570 con 0x7f9550159b10 2023-10-06T04:43:25.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.653+0000 7f954f7fe700 1 -- 172.21.15.17:0/3476706961 >> v2:172.21.15.136:3300/0 conn(0x7f955006d140 msgr2=0x7f955006f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:25.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.653+0000 7f954f7fe700 1 --2- 172.21.15.17:0/3476706961 >> v2:172.21.15.136:3300/0 conn(0x7f955006d140 0x7f955006f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:25.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.653+0000 7f954f7fe700 1 -- 172.21.15.17:0/3476706961 >> v1:172.21.15.136:6789/0 conn(0x7f95500cabf0 legacy=0x7f95500c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:25.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.653+0000 7f954f7fe700 1 -- 172.21.15.17:0/3476706961 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f955006ec00 con 0x7f9550159b10 2023-10-06T04:43:25.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.653+0000 7f954f7fe700 1 -- 172.21.15.17:0/3476706961 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4268781140 0 0) 0x7f953c001470 con 0x7f9550159b10 2023-10-06T04:43:25.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.653+0000 7f954f7fe700 1 -- 172.21.15.17:0/3476706961 >> v1:172.21.15.17:6789/0 conn(0x7f9550159b10 legacy=0x7f955006f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:25.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.653+0000 7f954f7fe700 1 --2- 172.21.15.17:0/3476706961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9540003a60 0x7f9540003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:25.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.653+0000 7f954f7fe700 1 --2- 172.21.15.17:0/3476706961 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9540004810 0x7f9540004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:25.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.653+0000 7f954f7fe700 1 --2- 172.21.15.17:0/3476706961 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95400052e0 0x7f954000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:25.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.653+0000 7f954f7fe700 1 -- 172.21.15.17:0/3476706961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955006e920 con 0x7f9540003a60 2023-10-06T04:43:25.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.653+0000 7f954f7fe700 1 -- 172.21.15.17:0/3476706961 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954000c230 con 0x7f95400052e0 2023-10-06T04:43:25.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.653+0000 7f954f7fe700 1 -- 172.21.15.17:0/3476706961 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f954000c3f0 con 0x7f9540004810 2023-10-06T04:43:25.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.653+0000 7f95549a2700 1 --2- 172.21.15.17:0/3476706961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9540003a60 0x7f9540003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:25.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.654+0000 7f954ffff700 1 --2- 172.21.15.17:0/3476706961 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9540004810 0x7f9540004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:25.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.654+0000 7f95551a3700 1 --2- 172.21.15.17:0/3476706961 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95400052e0 0x7f954000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:25.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.654+0000 7f95549a2700 1 -- 172.21.15.17:0/3476706961 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9540004810 msgr2=0x7f9540004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:25.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.654+0000 7f95549a2700 1 --2- 172.21.15.17:0/3476706961 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9540004810 0x7f9540004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:25.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.654+0000 7f95549a2700 1 -- 172.21.15.17:0/3476706961 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95400052e0 msgr2=0x7f954000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:25.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.654+0000 7f95549a2700 1 --2- 172.21.15.17:0/3476706961 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95400052e0 0x7f954000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:25.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.654+0000 7f95549a2700 1 -- 172.21.15.17:0/3476706961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9540003570 con 0x7f9540003a60 2023-10-06T04:43:25.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.654+0000 7f95551a3700 1 --2- 172.21.15.17:0/3476706961 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95400052e0 0x7f954000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:43:25.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.654+0000 7f95551a3700 1 -- 172.21.15.17:0/3476706961 reap_dead start 2023-10-06T04:43:25.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.654+0000 7f95549a2700 1 --2- 172.21.15.17:0/3476706961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9540003a60 0x7f9540003e70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f95440018d0 tx=0x7f9544007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9f4d3f9494162ae server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:25.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.654+0000 7f954f7fe700 1 -- 172.21.15.17:0/3476706961 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9544001290 con 0x7f9540003a60 2023-10-06T04:43:25.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.654+0000 7f954f7fe700 1 -- 172.21.15.17:0/3476706961 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9544012420 con 0x7f9540003a60 2023-10-06T04:43:25.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.654+0000 7f954f7fe700 1 -- 172.21.15.17:0/3476706961 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95440127e0 con 0x7f9540003a60 2023-10-06T04:43:25.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.655+0000 7f9556c06700 1 -- 172.21.15.17:0/3476706961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9540003a60 msgr2=0x7f9540003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:25.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.655+0000 7f9556c06700 1 --2- 172.21.15.17:0/3476706961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9540003a60 0x7f9540003e70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f95440018d0 tx=0x7f9544007d80 comp rx=0 tx=0).stop 2023-10-06T04:43:25.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.655+0000 7f9556c06700 1 -- 172.21.15.17:0/3476706961 shutdown_connections 2023-10-06T04:43:25.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.655+0000 7f9556c06700 1 --2- 172.21.15.17:0/3476706961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9540003a60 0x7f9540003e70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:25.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.655+0000 7f9556c06700 1 -- 172.21.15.17:0/3476706961 >> 172.21.15.17:0/3476706961 conn(0x7f955006cd40 msgr2=0x7f95500d0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:25.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.655+0000 7f9556c06700 1 -- 172.21.15.17:0/3476706961 shutdown_connections 2023-10-06T04:43:25.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.655+0000 7f9556c06700 1 -- 172.21.15.17:0/3476706961 wait complete. 2023-10-06T04:43:25.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.656+0000 7f9556c06700 1 Processor -- start 2023-10-06T04:43:25.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.656+0000 7f9556c06700 1 -- start start 2023-10-06T04:43:25.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.657+0000 7f9556c06700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9540003a60 0x7f955015e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:25.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.657+0000 7f9556c06700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f955015e9c0 0x7f9550159f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:25.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.657+0000 7f9556c06700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f955015a440 0x7f95500b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:25.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.657+0000 7f9556c06700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95501573e0 con 0x7f955015e9c0 2023-10-06T04:43:25.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.657+0000 7f9556c06700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95500d0120 con 0x7f955015a440 2023-10-06T04:43:25.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.657+0000 7f9556c06700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f955015dff0 con 0x7f9540003a60 2023-10-06T04:43:25.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.657+0000 7f954ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f955015e9c0 0x7f9550159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:25.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.657+0000 7f954ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f955015e9c0 0x7f9550159f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33044/0 (socket says 172.21.15.17:33044) 2023-10-06T04:43:25.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.657+0000 7f954ffff700 1 -- 172.21.15.17:0/809292010 learned_addr learned my addr 172.21.15.17:0/809292010 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:25.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.657+0000 7f95549a2700 1 --2- 172.21.15.17:0/809292010 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9540003a60 0x7f955015e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:25.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.657+0000 7f95551a3700 1 --2- 172.21.15.17:0/809292010 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f955015a440 0x7f95500b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:25.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.657+0000 7f954ffff700 1 -- 172.21.15.17:0/809292010 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9540003a60 msgr2=0x7f955015e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:25.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.657+0000 7f954ffff700 1 --2- 172.21.15.17:0/809292010 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9540003a60 0x7f955015e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:25.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.657+0000 7f954ffff700 1 -- 172.21.15.17:0/809292010 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f955015a440 msgr2=0x7f95500b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:25.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.657+0000 7f954ffff700 1 --2- 172.21.15.17:0/809292010 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f955015a440 0x7f95500b54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:25.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.657+0000 7f954ffff700 1 -- 172.21.15.17:0/809292010 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95500b6120 con 0x7f955015e9c0 2023-10-06T04:43:25.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.657+0000 7f954ffff700 1 --2- 172.21.15.17:0/809292010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f955015e9c0 0x7f9550159f00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f953c0073f0 tx=0x7f953c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:25.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.657+0000 7f954cff9700 1 -- 172.21.15.17:0/809292010 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953c018030 con 0x7f955015e9c0 2023-10-06T04:43:25.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.657+0000 7f954cff9700 1 -- 172.21.15.17:0/809292010 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f953c0077d0 con 0x7f955015e9c0 2023-10-06T04:43:25.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.657+0000 7f9556c06700 1 -- 172.21.15.17:0/809292010 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f955015d420 con 0x7f955015e9c0 2023-10-06T04:43:25.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.657+0000 7f954cff9700 1 -- 172.21.15.17:0/809292010 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953c00fb00 con 0x7f955015e9c0 2023-10-06T04:43:25.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.657+0000 7f9556c06700 1 -- 172.21.15.17:0/809292010 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f955015d9a0 con 0x7f955015e9c0 2023-10-06T04:43:25.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.658+0000 7f9556c06700 1 -- 172.21.15.17:0/809292010 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f955015e1a0 con 0x7f955015e9c0 2023-10-06T04:43:25.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.659+0000 7f954cff9700 1 -- 172.21.15.17:0/809292010 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f953c01b070 con 0x7f955015e9c0 2023-10-06T04:43:25.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.659+0000 7f954cff9700 1 --2- 172.21.15.17:0/809292010 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9534066f30 0x7f95340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:25.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.659+0000 7f954cff9700 1 -- 172.21.15.17:0/809292010 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f953c019070 con 0x7f955015e9c0 2023-10-06T04:43:25.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.659+0000 7f95549a2700 1 --2- 172.21.15.17:0/809292010 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9534066f30 0x7f95340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:25.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.660+0000 7f95549a2700 1 --2- 172.21.15.17:0/809292010 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9534066f30 0x7f95340693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9544001060 tx=0x7f9544015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:25.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.664+0000 7f954cff9700 1 -- 172.21.15.17:0/809292010 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f955015e1a0 con 0x7f955015e9c0 2023-10-06T04:43:25.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.856+0000 7f9556c06700 1 -- 172.21.15.17:0/809292010 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f955015a810 con 0x7f955015e9c0 2023-10-06T04:43:25.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.856+0000 7f954cff9700 1 -- 172.21.15.17:0/809292010 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f953c051500 con 0x7f955015e9c0 2023-10-06T04:43:25.859 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-10-06T04:43:25.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.858+0000 7f9556c06700 1 -- 172.21.15.17:0/809292010 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9534066f30 msgr2=0x7f95340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:25.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.858+0000 7f9556c06700 1 --2- 172.21.15.17:0/809292010 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9534066f30 0x7f95340693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9544001060 tx=0x7f9544015000 comp rx=0 tx=0).stop 2023-10-06T04:43:25.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.858+0000 7f9556c06700 1 -- 172.21.15.17:0/809292010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f955015e9c0 msgr2=0x7f9550159f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:25.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.858+0000 7f9556c06700 1 --2- 172.21.15.17:0/809292010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f955015e9c0 0x7f9550159f00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f953c0073f0 tx=0x7f953c001e50 comp rx=0 tx=0).stop 2023-10-06T04:43:25.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.858+0000 7f9556c06700 1 -- 172.21.15.17:0/809292010 shutdown_connections 2023-10-06T04:43:25.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.858+0000 7f9556c06700 1 --2- 172.21.15.17:0/809292010 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9534066f30 0x7f95340693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:25.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.858+0000 7f9556c06700 1 --2- 172.21.15.17:0/809292010 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f955015a440 0x7f95500b54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:25.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.858+0000 7f9556c06700 1 --2- 172.21.15.17:0/809292010 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9540003a60 0x7f955015e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:25.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.858+0000 7f9556c06700 1 --2- 172.21.15.17:0/809292010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f955015e9c0 0x7f9550159f00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:25.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.858+0000 7f9556c06700 1 -- 172.21.15.17:0/809292010 >> 172.21.15.17:0/809292010 conn(0x7f955006cd40 msgr2=0x7f9550158be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:25.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.859+0000 7f9556c06700 1 -- 172.21.15.17:0/809292010 shutdown_connections 2023-10-06T04:43:25.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.859+0000 7f9556c06700 1 -- 172.21.15.17:0/809292010 wait complete. 2023-10-06T04:43:25.872 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:43:25.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.992+0000 7f5339876700 1 Processor -- start 2023-10-06T04:43:25.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.992+0000 7f5339876700 1 -- start start 2023-10-06T04:43:25.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.993+0000 7f5339876700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f5334159b10 0x7f533406f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:25.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.993+0000 7f5339876700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53340d1120 con 0x7f53340cabf0 2023-10-06T04:43:25.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.993+0000 7f5339876700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53340d1400 con 0x7f533406d140 2023-10-06T04:43:25.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.993+0000 7f5339876700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f533406e920 con 0x7f5334159b10 2023-10-06T04:43:25.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.993+0000 7f5332ffd700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f53340cabf0 0x7f53340c7660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:32914/0 (socket says 172.21.15.17:32914) 2023-10-06T04:43:25.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.993+0000 7f5332ffd700 1 -- 172.21.15.17:0/4148359111 learned_addr learned my addr 172.21.15.17:0/4148359111 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:26.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.994+0000 7f53327fc700 1 --2- 172.21.15.17:0/4148359111 >> v2:172.21.15.136:3300/0 conn(0x7f5334159b10 0x7f533406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:26.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.994+0000 7f5331ffb700 1 -- 172.21.15.17:0/4148359111 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 663606295 0 0) 0x7f53340d1120 con 0x7f53340cabf0 2023-10-06T04:43:26.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.994+0000 7f5331ffb700 1 -- 172.21.15.17:0/4148359111 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5320003570 con 0x7f53340cabf0 2023-10-06T04:43:26.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.994+0000 7f5331ffb700 1 -- 172.21.15.17:0/4148359111 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2341005125 0 0) 0x7f53340d1400 con 0x7f533406d140 2023-10-06T04:43:26.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.994+0000 7f5331ffb700 1 -- 172.21.15.17:0/4148359111 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53340d1120 con 0x7f533406d140 2023-10-06T04:43:26.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.994+0000 7f5331ffb700 1 -- 172.21.15.17:0/4148359111 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1988039932 0 0) 0x7f5320003570 con 0x7f53340cabf0 2023-10-06T04:43:26.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.994+0000 7f5331ffb700 1 -- 172.21.15.17:0/4148359111 >> v2:172.21.15.136:3300/0 conn(0x7f5334159b10 msgr2=0x7f533406f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:26.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.994+0000 7f5331ffb700 1 --2- 172.21.15.17:0/4148359111 >> v2:172.21.15.136:3300/0 conn(0x7f5334159b10 0x7f533406f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:26.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.994+0000 7f5331ffb700 1 -- 172.21.15.17:0/4148359111 >> v1:172.21.15.136:6789/0 conn(0x7f533406d140 legacy=0x7f533406f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:26.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.994+0000 7f5331ffb700 1 -- 172.21.15.17:0/4148359111 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f533406ec00 con 0x7f53340cabf0 2023-10-06T04:43:26.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.994+0000 7f5331ffb700 1 -- 172.21.15.17:0/4148359111 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4268781140 0 0) 0x7f53240018f0 con 0x7f53340cabf0 2023-10-06T04:43:26.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.994+0000 7f5331ffb700 1 -- 172.21.15.17:0/4148359111 >> v1:172.21.15.17:6789/0 conn(0x7f53340cabf0 legacy=0x7f53340c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:26.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.994+0000 7f5331ffb700 1 --2- 172.21.15.17:0/4148359111 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5320003c40 0x7f5320004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:26.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.994+0000 7f5331ffb700 1 --2- 172.21.15.17:0/4148359111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5320004810 0x7f5320004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:26.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.994+0000 7f5331ffb700 1 --2- 172.21.15.17:0/4148359111 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5320005210 0x7f532000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:26.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.994+0000 7f5331ffb700 1 -- 172.21.15.17:0/4148359111 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533406e920 con 0x7f5320004810 2023-10-06T04:43:26.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.994+0000 7f5331ffb700 1 -- 172.21.15.17:0/4148359111 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532000c1b0 con 0x7f5320003c40 2023-10-06T04:43:26.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.994+0000 7f5331ffb700 1 -- 172.21.15.17:0/4148359111 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f532000c370 con 0x7f5320005210 2023-10-06T04:43:26.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.994+0000 7f53327fc700 1 --2- 172.21.15.17:0/4148359111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5320004810 0x7f5320004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:26.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.994+0000 7f5332ffd700 1 --2- 172.21.15.17:0/4148359111 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5320003c40 0x7f5320004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:26.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.994+0000 7f53337fe700 1 --2- 172.21.15.17:0/4148359111 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5320005210 0x7f532000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:26.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.994+0000 7f53327fc700 1 -- 172.21.15.17:0/4148359111 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5320005210 msgr2=0x7f532000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:26.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.994+0000 7f53327fc700 1 --2- 172.21.15.17:0/4148359111 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5320005210 0x7f532000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:26.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.994+0000 7f53327fc700 1 -- 172.21.15.17:0/4148359111 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5320003c40 msgr2=0x7f5320004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:26.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.994+0000 7f53327fc700 1 --2- 172.21.15.17:0/4148359111 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5320003c40 0x7f5320004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:26.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.994+0000 7f53327fc700 1 -- 172.21.15.17:0/4148359111 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5320003570 con 0x7f5320004810 2023-10-06T04:43:26.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.994+0000 7f53337fe700 1 -- 172.21.15.17:0/4148359111 reap_dead start 2023-10-06T04:43:26.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.995+0000 7f53327fc700 1 --2- 172.21.15.17:0/4148359111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5320004810 0x7f5320004c80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f531c006f00 tx=0x7f531c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62a66b622d0fddc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:26.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.995+0000 7f5331ffb700 1 -- 172.21.15.17:0/4148359111 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c00e6e0 con 0x7f5320004810 2023-10-06T04:43:26.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.995+0000 7f5331ffb700 1 -- 172.21.15.17:0/4148359111 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531c00e840 con 0x7f5320004810 2023-10-06T04:43:26.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.995+0000 7f5331ffb700 1 -- 172.21.15.17:0/4148359111 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c00ec00 con 0x7f5320004810 2023-10-06T04:43:26.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.995+0000 7f5339876700 1 -- 172.21.15.17:0/4148359111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5320004810 msgr2=0x7f5320004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:26.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.995+0000 7f5339876700 1 --2- 172.21.15.17:0/4148359111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5320004810 0x7f5320004c80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f531c006f00 tx=0x7f531c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:26.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.995+0000 7f5339876700 1 -- 172.21.15.17:0/4148359111 shutdown_connections 2023-10-06T04:43:26.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.995+0000 7f5339876700 1 --2- 172.21.15.17:0/4148359111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5320004810 0x7f5320004c80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:26.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.995+0000 7f5339876700 1 -- 172.21.15.17:0/4148359111 >> 172.21.15.17:0/4148359111 conn(0x7f533406cd40 msgr2=0x7f53340d0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:26.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.995+0000 7f5339876700 1 -- 172.21.15.17:0/4148359111 shutdown_connections 2023-10-06T04:43:26.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.995+0000 7f5339876700 1 -- 172.21.15.17:0/4148359111 wait complete. 2023-10-06T04:43:26.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.997+0000 7f5339876700 1 Processor -- start 2023-10-06T04:43:26.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.997+0000 7f5339876700 1 -- start start 2023-10-06T04:43:26.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.997+0000 7f5339876700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5320004810 0x7f53341564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:26.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.997+0000 7f5339876700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5334156b70 0x7f53340c52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:26.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.997+0000 7f5339876700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f53340c40b0 0x7f53340c4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:26.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.997+0000 7f5339876700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53340c4a60 con 0x7f5334156b70 2023-10-06T04:43:26.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.997+0000 7f5339876700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53340c67a0 con 0x7f5320004810 2023-10-06T04:43:26.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.997+0000 7f5339876700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53340c5b90 con 0x7f53340c40b0 2023-10-06T04:43:26.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.997+0000 7f53327fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5334156b70 0x7f53340c52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:26.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.997+0000 7f53327fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5334156b70 0x7f53340c52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33062/0 (socket says 172.21.15.17:33062) 2023-10-06T04:43:26.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.997+0000 7f53327fc700 1 -- 172.21.15.17:0/3394297066 learned_addr learned my addr 172.21.15.17:0/3394297066 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:26.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.998+0000 7f53327fc700 1 -- 172.21.15.17:0/3394297066 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f53340c40b0 msgr2=0x7f53340c4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:26.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.998+0000 7f53327fc700 1 --2- 172.21.15.17:0/3394297066 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f53340c40b0 0x7f53340c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:26.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.998+0000 7f53327fc700 1 -- 172.21.15.17:0/3394297066 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5320004810 msgr2=0x7f53341564c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:26.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.998+0000 7f53327fc700 1 --2- 172.21.15.17:0/3394297066 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5320004810 0x7f53341564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:26.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.998+0000 7f53327fc700 1 -- 172.21.15.17:0/3394297066 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53340c5e70 con 0x7f5334156b70 2023-10-06T04:43:26.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.998+0000 7f53327fc700 1 --2- 172.21.15.17:0/3394297066 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5334156b70 0x7f53340c52d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f531c00f010 tx=0x7f531c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:26.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.998+0000 7f532affd700 1 -- 172.21.15.17:0/3394297066 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c022070 con 0x7f5334156b70 2023-10-06T04:43:26.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.998+0000 7f532affd700 1 -- 172.21.15.17:0/3394297066 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531c013c50 con 0x7f5334156b70 2023-10-06T04:43:26.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.998+0000 7f532affd700 1 -- 172.21.15.17:0/3394297066 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c01c450 con 0x7f5334156b70 2023-10-06T04:43:26.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.998+0000 7f5339876700 1 -- 172.21.15.17:0/3394297066 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53340c6150 con 0x7f5334156b70 2023-10-06T04:43:26.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.998+0000 7f5339876700 1 -- 172.21.15.17:0/3394297066 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53340c5810 con 0x7f5334156b70 2023-10-06T04:43:26.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.999+0000 7f5339876700 1 -- 172.21.15.17:0/3394297066 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53340c65f0 con 0x7f5334156b70 2023-10-06T04:43:26.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:25.999+0000 7f532affd700 1 -- 172.21.15.17:0/3394297066 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f531c01c8a0 con 0x7f5334156b70 2023-10-06T04:43:26.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.000+0000 7f532affd700 1 --2- 172.21.15.17:0/3394297066 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5314066f60 0x7f5314069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:26.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.000+0000 7f532affd700 1 -- 172.21.15.17:0/3394297066 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f531c085930 con 0x7f5334156b70 2023-10-06T04:43:26.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.000+0000 7f5332ffd700 1 --2- 172.21.15.17:0/3394297066 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5314066f60 0x7f5314069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:26.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.000+0000 7f5332ffd700 1 --2- 172.21.15.17:0/3394297066 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5314066f60 0x7f5314069410 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5334066050 tx=0x7f5324009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:26.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.004+0000 7f532affd700 1 -- 172.21.15.17:0/3394297066 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f531c052e40 con 0x7f5334156b70 2023-10-06T04:43:26.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.197+0000 7f5339876700 1 -- 172.21.15.17:0/3394297066 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f53340c3ec0 con 0x7f5334156b70 2023-10-06T04:43:26.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.198+0000 7f532affd700 1 -- 172.21.15.17:0/3394297066 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f531c02b0a0 con 0x7f5334156b70 2023-10-06T04:43:26.199 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-10-06T04:43:26.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.200+0000 7f5339876700 1 -- 172.21.15.17:0/3394297066 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5314066f60 msgr2=0x7f5314069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:26.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.200+0000 7f5339876700 1 --2- 172.21.15.17:0/3394297066 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5314066f60 0x7f5314069410 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5334066050 tx=0x7f5324009040 comp rx=0 tx=0).stop 2023-10-06T04:43:26.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.200+0000 7f5339876700 1 -- 172.21.15.17:0/3394297066 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5334156b70 msgr2=0x7f53340c52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:26.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.200+0000 7f5339876700 1 --2- 172.21.15.17:0/3394297066 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5334156b70 0x7f53340c52d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f531c00f010 tx=0x7f531c01a000 comp rx=0 tx=0).stop 2023-10-06T04:43:26.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.200+0000 7f5339876700 1 -- 172.21.15.17:0/3394297066 shutdown_connections 2023-10-06T04:43:26.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.200+0000 7f5339876700 1 --2- 172.21.15.17:0/3394297066 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5314066f60 0x7f5314069410 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:26.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.200+0000 7f5339876700 1 --2- 172.21.15.17:0/3394297066 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f53340c40b0 0x7f53340c4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:26.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.200+0000 7f5339876700 1 --2- 172.21.15.17:0/3394297066 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5320004810 0x7f53341564c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:26.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.200+0000 7f5339876700 1 --2- 172.21.15.17:0/3394297066 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5334156b70 0x7f53340c52d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:26.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.200+0000 7f5339876700 1 -- 172.21.15.17:0/3394297066 >> 172.21.15.17:0/3394297066 conn(0x7f533406cd40 msgr2=0x7f5334158be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:26.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.200+0000 7f5339876700 1 -- 172.21.15.17:0/3394297066 shutdown_connections 2023-10-06T04:43:26.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.200+0000 7f5339876700 1 -- 172.21.15.17:0/3394297066 wait complete. 2023-10-06T04:43:26.213 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T04:43:26.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.331+0000 7f005eecb700 1 Processor -- start 2023-10-06T04:43:26.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.331+0000 7f005eecb700 1 -- start start 2023-10-06T04:43:26.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.332+0000 7f005eecb700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f00580ccfc0 0x7f00580cc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:26.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.332+0000 7f005eecb700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f00580cf3b0 0x7f00581594a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:26.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.332+0000 7f005eecb700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f00580cc750 0x7f00581599e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:26.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.332+0000 7f005eecb700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00580cbd80 con 0x7f00580cf3b0 2023-10-06T04:43:26.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.332+0000 7f005eecb700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00580af5f0 con 0x7f00580cc750 2023-10-06T04:43:26.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.332+0000 7f005eecb700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00580af8d0 con 0x7f00580ccfc0 2023-10-06T04:43:26.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.332+0000 7f005d6c8700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f00580cf3b0 0x7f00581594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:26.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.332+0000 7f005d6c8700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f00580cf3b0 0x7f00581594a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33078/0 (socket says 172.21.15.17:33078) 2023-10-06T04:43:26.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.332+0000 7f005d6c8700 1 -- 172.21.15.17:0/3024099424 learned_addr learned my addr 172.21.15.17:0/3024099424 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:26.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.332+0000 7f005dec9700 1 --2- 172.21.15.17:0/3024099424 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f00580ccfc0 0x7f00580cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:26.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.332+0000 7f005e6ca700 1 --2- 172.21.15.17:0/3024099424 >> v2:172.21.15.136:3300/0 conn(0x7f00580cc750 0x7f00581599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:26.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.332+0000 7f005d6c8700 1 -- 172.21.15.17:0/3024099424 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f00580ccfc0 msgr2=0x7f00580cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:26.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.332+0000 7f005d6c8700 1 --2- 172.21.15.17:0/3024099424 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f00580ccfc0 0x7f00580cc210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:26.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.332+0000 7f005d6c8700 1 -- 172.21.15.17:0/3024099424 >> v2:172.21.15.136:3300/0 conn(0x7f00580cc750 msgr2=0x7f00581599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:26.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.332+0000 7f005d6c8700 1 --2- 172.21.15.17:0/3024099424 >> v2:172.21.15.136:3300/0 conn(0x7f00580cc750 0x7f00581599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:26.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.333+0000 7f005d6c8700 1 -- 172.21.15.17:0/3024099424 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00580afbb0 con 0x7f00580cf3b0 2023-10-06T04:43:26.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.333+0000 7f005d6c8700 1 --2- 172.21.15.17:0/3024099424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00580cf3b0 0x7f00581594a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f00580cdb60 tx=0x7f004c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5882bbfbfbfdac3b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:26.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.333+0000 7f005cec7700 1 -- 172.21.15.17:0/3024099424 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c00b640 con 0x7f00580cf3b0 2023-10-06T04:43:26.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.333+0000 7f005cec7700 1 -- 172.21.15.17:0/3024099424 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004c00b7a0 con 0x7f00580cf3b0 2023-10-06T04:43:26.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.333+0000 7f005cec7700 1 -- 172.21.15.17:0/3024099424 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c00bb60 con 0x7f00580cf3b0 2023-10-06T04:43:26.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.333+0000 7f005eecb700 1 -- 172.21.15.17:0/3024099424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00580cf3b0 msgr2=0x7f00581594a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:26.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.333+0000 7f005eecb700 1 --2- 172.21.15.17:0/3024099424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00580cf3b0 0x7f00581594a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f00580cdb60 tx=0x7f004c009250 comp rx=0 tx=0).stop 2023-10-06T04:43:26.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.333+0000 7f005eecb700 1 -- 172.21.15.17:0/3024099424 shutdown_connections 2023-10-06T04:43:26.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.333+0000 7f005eecb700 1 --2- 172.21.15.17:0/3024099424 >> v2:172.21.15.136:3300/0 conn(0x7f00580cc750 0x7f00581599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:26.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.333+0000 7f005eecb700 1 --2- 172.21.15.17:0/3024099424 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f00580ccfc0 0x7f00580cc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:26.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.333+0000 7f005eecb700 1 --2- 172.21.15.17:0/3024099424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00580cf3b0 0x7f00581594a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:26.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.333+0000 7f005eecb700 1 -- 172.21.15.17:0/3024099424 >> 172.21.15.17:0/3024099424 conn(0x7f005806cff0 msgr2=0x7f005806da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:26.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.333+0000 7f005eecb700 1 -- 172.21.15.17:0/3024099424 shutdown_connections 2023-10-06T04:43:26.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.334+0000 7f005eecb700 1 -- 172.21.15.17:0/3024099424 wait complete. 2023-10-06T04:43:26.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.335+0000 7f005eecb700 1 Processor -- start 2023-10-06T04:43:26.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.335+0000 7f005eecb700 1 -- start start 2023-10-06T04:43:26.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.335+0000 7f005eecb700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00580cc750 0x7f0058153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:26.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.335+0000 7f005eecb700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f00580ccfc0 0x7f00580c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:26.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.335+0000 7f005eecb700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f00580c9920 0x7f00580c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:26.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.335+0000 7f005eecb700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00580c9dc0 con 0x7f00580cc750 2023-10-06T04:43:26.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.335+0000 7f005eecb700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00580b3f50 con 0x7f00580c9920 2023-10-06T04:43:26.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.335+0000 7f005eecb700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0058154490 con 0x7f00580ccfc0 2023-10-06T04:43:26.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.335+0000 7f005dec9700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00580cc750 0x7f0058153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:26.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.335+0000 7f005dec9700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00580cc750 0x7f0058153f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33080/0 (socket says 172.21.15.17:33080) 2023-10-06T04:43:26.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.335+0000 7f005dec9700 1 -- 172.21.15.17:0/2812507489 learned_addr learned my addr 172.21.15.17:0/2812507489 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:26.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.336+0000 7f005dec9700 1 -- 172.21.15.17:0/2812507489 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f00580ccfc0 msgr2=0x7f00580c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:26.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.336+0000 7f005dec9700 1 --2- 172.21.15.17:0/2812507489 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f00580ccfc0 0x7f00580c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:26.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.336+0000 7f005dec9700 1 -- 172.21.15.17:0/2812507489 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f00580c9920 msgr2=0x7f00580c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:26.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.336+0000 7f005dec9700 1 --2- 172.21.15.17:0/2812507489 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f00580c9920 0x7f00580c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:26.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.336+0000 7f005dec9700 1 -- 172.21.15.17:0/2812507489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f004c0094f0 con 0x7f00580cc750 2023-10-06T04:43:26.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.336+0000 7f005dec9700 1 --2- 172.21.15.17:0/2812507489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00580cc750 0x7f0058153f50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f005000ecb0 tx=0x7f00500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:26.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.336+0000 7f0055ffb700 1 -- 172.21.15.17:0/2812507489 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005000c9d0 con 0x7f00580cc750 2023-10-06T04:43:26.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.336+0000 7f0055ffb700 1 -- 172.21.15.17:0/2812507489 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005000cb30 con 0x7f00580cc750 2023-10-06T04:43:26.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.336+0000 7f0055ffb700 1 -- 172.21.15.17:0/2812507489 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0050013470 con 0x7f00580cc750 2023-10-06T04:43:26.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.336+0000 7f005eecb700 1 -- 172.21.15.17:0/2812507489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00580b3340 con 0x7f00580cc750 2023-10-06T04:43:26.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.336+0000 7f005eecb700 1 -- 172.21.15.17:0/2812507489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00580b3900 con 0x7f00580cc750 2023-10-06T04:43:26.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.337+0000 7f005eecb700 1 -- 172.21.15.17:0/2812507489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f005804c380 con 0x7f00580cc750 2023-10-06T04:43:26.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.338+0000 7f0055ffb700 1 -- 172.21.15.17:0/2812507489 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f00500137e0 con 0x7f00580cc750 2023-10-06T04:43:26.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.338+0000 7f0055ffb700 1 --2- 172.21.15.17:0/2812507489 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0044066f30 0x7f00440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:26.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.338+0000 7f0055ffb700 1 -- 172.21.15.17:0/2812507489 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f0050084730 con 0x7f00580cc750 2023-10-06T04:43:26.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.338+0000 7f005d6c8700 1 --2- 172.21.15.17:0/2812507489 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0044066f30 0x7f00440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:26.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.338+0000 7f005d6c8700 1 --2- 172.21.15.17:0/2812507489 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0044066f30 0x7f00440693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f00580b0250 tx=0x7f004c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:26.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.342+0000 7f0055ffb700 1 -- 172.21.15.17:0/2812507489 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0050051b90 con 0x7f00580cc750 2023-10-06T04:43:26.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.540+0000 7f005eecb700 1 -- 172.21.15.17:0/2812507489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f005806bfe0 con 0x7f00580cc750 2023-10-06T04:43:26.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.541+0000 7f0055ffb700 1 -- 172.21.15.17:0/2812507489 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+126 (secure 0 0 0) 0x7f00500551b0 con 0x7f00580cc750 2023-10-06T04:43:26.543 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:43:26.543 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2023-10-06T04:43:26.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:43:26.543 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2023-10-06T04:43:26.544 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": "rbd" 2023-10-06T04:43:26.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-06T04:43:26.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:43:26.544 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 2, 2023-10-06T04:43:26.544 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2023-10-06T04:43:26.545 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-06T04:43:26.545 INFO:teuthology.orchestra.run.smithi017.stdout:] 2023-10-06T04:43:26.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.543+0000 7f005eecb700 1 -- 172.21.15.17:0/2812507489 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0044066f30 msgr2=0x7f00440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:26.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.543+0000 7f005eecb700 1 --2- 172.21.15.17:0/2812507489 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0044066f30 0x7f00440693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f00580b0250 tx=0x7f004c017000 comp rx=0 tx=0).stop 2023-10-06T04:43:26.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.543+0000 7f005eecb700 1 -- 172.21.15.17:0/2812507489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00580cc750 msgr2=0x7f0058153f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:26.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.543+0000 7f005eecb700 1 --2- 172.21.15.17:0/2812507489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00580cc750 0x7f0058153f50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f005000ecb0 tx=0x7f00500091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:26.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.543+0000 7f005eecb700 1 -- 172.21.15.17:0/2812507489 shutdown_connections 2023-10-06T04:43:26.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.543+0000 7f005eecb700 1 --2- 172.21.15.17:0/2812507489 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0044066f30 0x7f00440693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:26.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.543+0000 7f005eecb700 1 --2- 172.21.15.17:0/2812507489 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f00580c9920 0x7f00580c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:26.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.543+0000 7f005eecb700 1 --2- 172.21.15.17:0/2812507489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00580cc750 0x7f0058153f50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:26.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.543+0000 7f005eecb700 1 --2- 172.21.15.17:0/2812507489 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f00580ccfc0 0x7f00580c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:26.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.543+0000 7f005eecb700 1 -- 172.21.15.17:0/2812507489 >> 172.21.15.17:0/2812507489 conn(0x7f005806cff0 msgr2=0x7f00580ca7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:26.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.543+0000 7f005eecb700 1 -- 172.21.15.17:0/2812507489 shutdown_connections 2023-10-06T04:43:26.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.543+0000 7f005eecb700 1 -- 172.21.15.17:0/2812507489 wait complete. 2023-10-06T04:43:26.557 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T04:43:26.557 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T04:43:26.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.678+0000 7f827c955700 1 Processor -- start 2023-10-06T04:43:26.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.678+0000 7f827c955700 1 -- start start 2023-10-06T04:43:26.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.679+0000 7f827c955700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8278150360 0x7f8278150730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:26.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.679+0000 7f827c955700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f82780cb6b0 0x7f82780cd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:26.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.679+0000 7f827c955700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82780cc050 con 0x7f82780cbb30 2023-10-06T04:43:26.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.679+0000 7f827c955700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82780cc330 con 0x7f8278150360 2023-10-06T04:43:26.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.679+0000 7f827c955700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f827815b130 con 0x7f82780cb6b0 2023-10-06T04:43:26.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.679+0000 7f827659c700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8278150360 0x7f8278150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:26.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.679+0000 7f827659c700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8278150360 0x7f8278150730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33094/0 (socket says 172.21.15.17:33094) 2023-10-06T04:43:26.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.679+0000 7f827659c700 1 -- 172.21.15.17:0/41262987 learned_addr learned my addr 172.21.15.17:0/41262987 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:26.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.680+0000 7f8275d9b700 1 --2- 172.21.15.17:0/41262987 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f82780cb6b0 0x7f82780cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:26.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.680+0000 7f827659c700 1 -- 172.21.15.17:0/41262987 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f82780cb6b0 msgr2=0x7f82780cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:26.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.680+0000 7f827659c700 1 --2- 172.21.15.17:0/41262987 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f82780cb6b0 0x7f82780cd050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:26.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.680+0000 7f827659c700 1 -- 172.21.15.17:0/41262987 >> v1:172.21.15.136:6789/0 conn(0x7f82780cbb30 legacy=0x7f827815d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:26.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.680+0000 7f827659c700 1 -- 172.21.15.17:0/41262987 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f827815b410 con 0x7f8278150360 2023-10-06T04:43:26.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.680+0000 7f8275d9b700 1 --2- 172.21.15.17:0/41262987 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f82780cb6b0 0x7f82780cd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:43:26.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.680+0000 7f827659c700 1 --2- 172.21.15.17:0/41262987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8278150360 0x7f8278150730 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f82700099b0 tx=0x7f8270009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9777c083102315c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:26.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.680+0000 7f827559a700 1 -- 172.21.15.17:0/41262987 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827000b860 con 0x7f8278150360 2023-10-06T04:43:26.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.680+0000 7f827559a700 1 -- 172.21.15.17:0/41262987 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827000b9c0 con 0x7f8278150360 2023-10-06T04:43:26.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.680+0000 7f827559a700 1 -- 172.21.15.17:0/41262987 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827000bd60 con 0x7f8278150360 2023-10-06T04:43:26.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.680+0000 7f827c955700 1 -- 172.21.15.17:0/41262987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8278150360 msgr2=0x7f8278150730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:26.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.680+0000 7f827c955700 1 --2- 172.21.15.17:0/41262987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8278150360 0x7f8278150730 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f82700099b0 tx=0x7f8270009250 comp rx=0 tx=0).stop 2023-10-06T04:43:26.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.681+0000 7f827c955700 1 -- 172.21.15.17:0/41262987 shutdown_connections 2023-10-06T04:43:26.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.681+0000 7f827c955700 1 --2- 172.21.15.17:0/41262987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8278150360 0x7f8278150730 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:26.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.681+0000 7f827c955700 1 --2- 172.21.15.17:0/41262987 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f82780cb6b0 0x7f82780cd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:26.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.681+0000 7f827c955700 1 -- 172.21.15.17:0/41262987 >> 172.21.15.17:0/41262987 conn(0x7f827808a180 msgr2=0x7f8278099aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:26.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.681+0000 7f827c955700 1 -- 172.21.15.17:0/41262987 shutdown_connections 2023-10-06T04:43:26.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.681+0000 7f827c955700 1 -- 172.21.15.17:0/41262987 wait complete. 2023-10-06T04:43:26.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.682+0000 7f827c955700 1 Processor -- start 2023-10-06T04:43:26.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.682+0000 7f827c955700 1 -- start start 2023-10-06T04:43:26.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.682+0000 7f827c955700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82780cb6b0 0x7f827814ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:26.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.682+0000 7f827c955700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f82780cbb30 0x7f8278156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:26.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.682+0000 7f827c955700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8278150360 0x7f82780c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:26.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.682+0000 7f827c955700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8278154430 con 0x7f82780cb6b0 2023-10-06T04:43:26.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.682+0000 7f827c955700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82781549f0 con 0x7f8278150360 2023-10-06T04:43:26.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.682+0000 7f827c955700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f827814f140 con 0x7f82780cbb30 2023-10-06T04:43:26.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.682+0000 7f827659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82780cb6b0 0x7f827814ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:26.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.683+0000 7f827659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82780cb6b0 0x7f827814ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33104/0 (socket says 172.21.15.17:33104) 2023-10-06T04:43:26.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.683+0000 7f827659c700 1 -- 172.21.15.17:0/114316003 learned_addr learned my addr 172.21.15.17:0/114316003 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:26.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.683+0000 7f8276d9d700 1 --2- 172.21.15.17:0/114316003 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8278150360 0x7f82780c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:26.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.683+0000 7f8275d9b700 1 --2- 172.21.15.17:0/114316003 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f82780cbb30 0x7f8278156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:26.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.683+0000 7f827659c700 1 -- 172.21.15.17:0/114316003 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f82780cbb30 msgr2=0x7f8278156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:26.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.683+0000 7f827659c700 1 --2- 172.21.15.17:0/114316003 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f82780cbb30 0x7f8278156ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:26.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.683+0000 7f827659c700 1 -- 172.21.15.17:0/114316003 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8278150360 msgr2=0x7f82780c77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:26.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.683+0000 7f827659c700 1 --2- 172.21.15.17:0/114316003 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8278150360 0x7f82780c77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:26.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.683+0000 7f827659c700 1 -- 172.21.15.17:0/114316003 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82700094f0 con 0x7f82780cb6b0 2023-10-06T04:43:26.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.683+0000 7f8276d9d700 1 --2- 172.21.15.17:0/114316003 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8278150360 0x7f82780c77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:43:26.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.683+0000 7f827659c700 1 --2- 172.21.15.17:0/114316003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82780cb6b0 0x7f827814ec00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f82700090b0 tx=0x7f8270017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:26.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.683+0000 7f826e7fc700 1 -- 172.21.15.17:0/114316003 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8270026480 con 0x7f82780cb6b0 2023-10-06T04:43:26.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.683+0000 7f826e7fc700 1 -- 172.21.15.17:0/114316003 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827001f070 con 0x7f82780cb6b0 2023-10-06T04:43:26.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.683+0000 7f827c955700 1 -- 172.21.15.17:0/114316003 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82780c9a10 con 0x7f82780cb6b0 2023-10-06T04:43:26.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.683+0000 7f826e7fc700 1 -- 172.21.15.17:0/114316003 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8270026830 con 0x7f82780cb6b0 2023-10-06T04:43:26.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.683+0000 7f827c955700 1 -- 172.21.15.17:0/114316003 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8278154680 con 0x7f82780cb6b0 2023-10-06T04:43:26.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.684+0000 7f827c955700 1 -- 172.21.15.17:0/114316003 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82780718b0 con 0x7f82780cb6b0 2023-10-06T04:43:26.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.684+0000 7f826e7fc700 1 -- 172.21.15.17:0/114316003 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8270026ba0 con 0x7f82780cb6b0 2023-10-06T04:43:26.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.685+0000 7f826e7fc700 1 --2- 172.21.15.17:0/114316003 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8258066f30 0x7f82580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:26.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.685+0000 7f826e7fc700 1 -- 172.21.15.17:0/114316003 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f8270021070 con 0x7f82780cb6b0 2023-10-06T04:43:26.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.685+0000 7f8275d9b700 1 --2- 172.21.15.17:0/114316003 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8258066f30 0x7f82580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:26.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.685+0000 7f8275d9b700 1 --2- 172.21.15.17:0/114316003 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8258066f30 0x7f82580693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8260006f00 tx=0x7f8260008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:26.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.689+0000 7f826e7fc700 1 -- 172.21.15.17:0/114316003 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8270053650 con 0x7f82780cb6b0 2023-10-06T04:43:26.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:26.884+0000 7f827c955700 1 -- 172.21.15.17:0/114316003 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f827806f850 con 0x7f82780cb6b0 2023-10-06T04:43:27.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.785+0000 7f826e7fc700 1 -- 172.21.15.17:0/114316003 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8270056c70 con 0x7f82780cb6b0 2023-10-06T04:43:27.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.787+0000 7f827c955700 1 -- 172.21.15.17:0/114316003 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8258066f30 msgr2=0x7f82580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:27.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.787+0000 7f827c955700 1 --2- 172.21.15.17:0/114316003 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8258066f30 0x7f82580693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8260006f00 tx=0x7f8260008040 comp rx=0 tx=0).stop 2023-10-06T04:43:27.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.787+0000 7f827c955700 1 -- 172.21.15.17:0/114316003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82780cb6b0 msgr2=0x7f827814ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:27.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.787+0000 7f827c955700 1 --2- 172.21.15.17:0/114316003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82780cb6b0 0x7f827814ec00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f82700090b0 tx=0x7f8270017000 comp rx=0 tx=0).stop 2023-10-06T04:43:27.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.787+0000 7f827c955700 1 -- 172.21.15.17:0/114316003 shutdown_connections 2023-10-06T04:43:27.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.787+0000 7f827c955700 1 --2- 172.21.15.17:0/114316003 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8258066f30 0x7f82580693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:27.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.787+0000 7f827c955700 1 --2- 172.21.15.17:0/114316003 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8278150360 0x7f82780c77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:27.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.787+0000 7f827c955700 1 --2- 172.21.15.17:0/114316003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82780cb6b0 0x7f827814ec00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:27.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.787+0000 7f827c955700 1 --2- 172.21.15.17:0/114316003 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f82780cbb30 0x7f8278156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:27.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.787+0000 7f827c955700 1 -- 172.21.15.17:0/114316003 >> 172.21.15.17:0/114316003 conn(0x7f827808a180 msgr2=0x7f8278153c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:27.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.788+0000 7f827c955700 1 -- 172.21.15.17:0/114316003 shutdown_connections 2023-10-06T04:43:27.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.788+0000 7f827c955700 1 -- 172.21.15.17:0/114316003 wait complete. 2023-10-06T04:43:27.796 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2023-10-06T04:43:27.808 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T04:43:27.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.939+0000 7f3e34e86700 1 Processor -- start 2023-10-06T04:43:27.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.939+0000 7f3e34e86700 1 -- start start 2023-10-06T04:43:27.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.940+0000 7f3e34e86700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3e300af540 0x7f3e300af910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:27.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.940+0000 7f3e34e86700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3e300cced0 0x7f3e300cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:27.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.940+0000 7f3e34e86700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e3015ddb0 con 0x7f3e3015a7d0 2023-10-06T04:43:27.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.940+0000 7f3e34e86700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e300cd890 con 0x7f3e300af540 2023-10-06T04:43:27.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.940+0000 7f3e34e86700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3015d1a0 con 0x7f3e300cced0 2023-10-06T04:43:27.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.940+0000 7f3e2f7fe700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3e300af540 0x7f3e300af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:27.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.940+0000 7f3e2effd700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f3e3015a7d0 0x7f3e300cb520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:32920/0 (socket says 172.21.15.17:32920) 2023-10-06T04:43:27.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.940+0000 7f3e2effd700 1 -- 172.21.15.17:0/4126270496 learned_addr learned my addr 172.21.15.17:0/4126270496 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:27.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.940+0000 7f3e2ffff700 1 --2- 172.21.15.17:0/4126270496 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3e300cced0 0x7f3e300cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:27.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.941+0000 7f3e2f7fe700 1 -- 172.21.15.17:0/4126270496 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3e300cced0 msgr2=0x7f3e300cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:27.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.941+0000 7f3e2f7fe700 1 --2- 172.21.15.17:0/4126270496 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3e300cced0 0x7f3e300cd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:27.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.941+0000 7f3e2f7fe700 1 -- 172.21.15.17:0/4126270496 >> v1:172.21.15.17:6789/0 conn(0x7f3e3015a7d0 legacy=0x7f3e300cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:27.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.941+0000 7f3e2f7fe700 1 -- 172.21.15.17:0/4126270496 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3015d480 con 0x7f3e300af540 2023-10-06T04:43:27.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.941+0000 7f3e2e7fc700 1 -- 172.21.15.17:0/4126270496 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4027653034 0 0) 0x7f3e3015ddb0 con 0x7f3e3015a7d0 2023-10-06T04:43:27.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.941+0000 7f3e2f7fe700 1 --2- 172.21.15.17:0/4126270496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e300af540 0x7f3e300af910 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3e200098e0 tx=0x7f3e200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baa81138f567f221 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:27.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.941+0000 7f3e2e7fc700 1 -- 172.21.15.17:0/4126270496 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e20009e80 con 0x7f3e300af540 2023-10-06T04:43:27.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.941+0000 7f3e2e7fc700 1 -- 172.21.15.17:0/4126270496 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2000b860 con 0x7f3e300af540 2023-10-06T04:43:27.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.941+0000 7f3e2e7fc700 1 -- 172.21.15.17:0/4126270496 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2000bbe0 con 0x7f3e300af540 2023-10-06T04:43:27.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.941+0000 7f3e34e86700 1 -- 172.21.15.17:0/4126270496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e300af540 msgr2=0x7f3e300af910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:27.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.941+0000 7f3e34e86700 1 --2- 172.21.15.17:0/4126270496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e300af540 0x7f3e300af910 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3e200098e0 tx=0x7f3e200091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:27.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.941+0000 7f3e34e86700 1 -- 172.21.15.17:0/4126270496 shutdown_connections 2023-10-06T04:43:27.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.941+0000 7f3e34e86700 1 --2- 172.21.15.17:0/4126270496 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3e300cced0 0x7f3e300cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:27.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.941+0000 7f3e34e86700 1 --2- 172.21.15.17:0/4126270496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e300af540 0x7f3e300af910 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:27.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.941+0000 7f3e34e86700 1 -- 172.21.15.17:0/4126270496 >> 172.21.15.17:0/4126270496 conn(0x7f3e3006d9b0 msgr2=0x7f3e3006ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:27.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.941+0000 7f3e34e86700 1 -- 172.21.15.17:0/4126270496 shutdown_connections 2023-10-06T04:43:27.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.942+0000 7f3e34e86700 1 -- 172.21.15.17:0/4126270496 wait complete. 2023-10-06T04:43:27.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.943+0000 7f3e34e86700 1 Processor -- start 2023-10-06T04:43:27.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.943+0000 7f3e34e86700 1 -- start start 2023-10-06T04:43:27.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.943+0000 7f3e34e86700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e300af540 0x7f3e300c59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:27.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.943+0000 7f3e34e86700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e300cced0 0x7f3e300b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:27.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.943+0000 7f3e34e86700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3e3015a7d0 0x7f3e300b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:27.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.943+0000 7f3e34e86700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e30152200 con 0x7f3e300cced0 2023-10-06T04:43:27.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.943+0000 7f3e34e86700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e300c5f30 con 0x7f3e300af540 2023-10-06T04:43:27.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.943+0000 7f3e34e86700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e30155e50 con 0x7f3e3015a7d0 2023-10-06T04:43:27.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.944+0000 7f3e2effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e300cced0 0x7f3e300b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:27.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.944+0000 7f3e2effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e300cced0 0x7f3e300b49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33124/0 (socket says 172.21.15.17:33124) 2023-10-06T04:43:27.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.944+0000 7f3e2effd700 1 -- 172.21.15.17:0/2705528174 learned_addr learned my addr 172.21.15.17:0/2705528174 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:27.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.944+0000 7f3e2ffff700 1 --2- 172.21.15.17:0/2705528174 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3e3015a7d0 0x7f3e300b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:27.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.944+0000 7f3e2f7fe700 1 --2- 172.21.15.17:0/2705528174 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e300af540 0x7f3e300c59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:27.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.944+0000 7f3e2effd700 1 -- 172.21.15.17:0/2705528174 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3e3015a7d0 msgr2=0x7f3e300b4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:27.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.944+0000 7f3e2effd700 1 --2- 172.21.15.17:0/2705528174 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3e3015a7d0 0x7f3e300b4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:27.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.944+0000 7f3e2effd700 1 -- 172.21.15.17:0/2705528174 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e300af540 msgr2=0x7f3e300c59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:27.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.944+0000 7f3e2effd700 1 --2- 172.21.15.17:0/2705528174 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e300af540 0x7f3e300c59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:27.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.944+0000 7f3e2effd700 1 -- 172.21.15.17:0/2705528174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e20009420 con 0x7f3e300cced0 2023-10-06T04:43:27.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.944+0000 7f3e2effd700 1 --2- 172.21.15.17:0/2705528174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e300cced0 0x7f3e300b49f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3e2400c7e0 tx=0x7f3e24007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:27.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.944+0000 7f3e177fe700 1 -- 172.21.15.17:0/2705528174 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e24005b30 con 0x7f3e300cced0 2023-10-06T04:43:27.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.944+0000 7f3e177fe700 1 -- 172.21.15.17:0/2705528174 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e24005c90 con 0x7f3e300cced0 2023-10-06T04:43:27.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.944+0000 7f3e34e86700 1 -- 172.21.15.17:0/2705528174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e301552d0 con 0x7f3e300cced0 2023-10-06T04:43:27.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.944+0000 7f3e177fe700 1 -- 172.21.15.17:0/2705528174 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e24007300 con 0x7f3e300cced0 2023-10-06T04:43:27.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.944+0000 7f3e34e86700 1 -- 172.21.15.17:0/2705528174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e30155890 con 0x7f3e300cced0 2023-10-06T04:43:27.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.945+0000 7f3e34e86700 1 -- 172.21.15.17:0/2705528174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e30152340 con 0x7f3e300cced0 2023-10-06T04:43:27.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.946+0000 7f3e177fe700 1 -- 172.21.15.17:0/2705528174 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3e2401b400 con 0x7f3e300cced0 2023-10-06T04:43:27.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.946+0000 7f3e177fe700 1 --2- 172.21.15.17:0/2705528174 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3e1c066f30 0x7f3e1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:27.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.946+0000 7f3e177fe700 1 -- 172.21.15.17:0/2705528174 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f3e24084060 con 0x7f3e300cced0 2023-10-06T04:43:27.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.946+0000 7f3e2f7fe700 1 --2- 172.21.15.17:0/2705528174 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3e1c066f30 0x7f3e1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:27.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.947+0000 7f3e2f7fe700 1 --2- 172.21.15.17:0/2705528174 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3e1c066f30 0x7f3e1c0693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3e200091e0 tx=0x7f3e20017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:27.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:27.951+0000 7f3e177fe700 1 -- 172.21.15.17:0/2705528174 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3e24051330 con 0x7f3e300cced0 2023-10-06T04:43:28.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.143+0000 7f3e34e86700 1 -- 172.21.15.17:0/2705528174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3e3004c380 con 0x7f3e300cced0 2023-10-06T04:43:28.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.790+0000 7f3e177fe700 1 -- 172.21.15.17:0/2705528174 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3e24054950 con 0x7f3e300cced0 2023-10-06T04:43:28.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.795+0000 7f3e34e86700 1 -- 172.21.15.17:0/2705528174 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3e1c066f30 msgr2=0x7f3e1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:28.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.795+0000 7f3e34e86700 1 --2- 172.21.15.17:0/2705528174 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3e1c066f30 0x7f3e1c0693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3e200091e0 tx=0x7f3e20017000 comp rx=0 tx=0).stop 2023-10-06T04:43:28.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.795+0000 7f3e34e86700 1 -- 172.21.15.17:0/2705528174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e300cced0 msgr2=0x7f3e300b49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:28.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.795+0000 7f3e34e86700 1 --2- 172.21.15.17:0/2705528174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e300cced0 0x7f3e300b49f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3e2400c7e0 tx=0x7f3e24007df0 comp rx=0 tx=0).stop 2023-10-06T04:43:28.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.796+0000 7f3e34e86700 1 -- 172.21.15.17:0/2705528174 shutdown_connections 2023-10-06T04:43:28.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.796+0000 7f3e34e86700 1 --2- 172.21.15.17:0/2705528174 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3e1c066f30 0x7f3e1c0693e0 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3e200091e0 tx=0x7f3e20017000 comp rx=0 tx=0).stop 2023-10-06T04:43:28.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.796+0000 7f3e34e86700 1 --2- 172.21.15.17:0/2705528174 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3e3015a7d0 0x7f3e300b4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:28.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.796+0000 7f3e34e86700 1 --2- 172.21.15.17:0/2705528174 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e300af540 0x7f3e300c59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:28.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.796+0000 7f3e34e86700 1 --2- 172.21.15.17:0/2705528174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e300cced0 0x7f3e300b49f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:28.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.796+0000 7f3e34e86700 1 -- 172.21.15.17:0/2705528174 >> 172.21.15.17:0/2705528174 conn(0x7f3e3006d9b0 msgr2=0x7f3e300c67e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:28.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.804+0000 7f3e34e86700 1 -- 172.21.15.17:0/2705528174 shutdown_connections 2023-10-06T04:43:28.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.805+0000 7f3e34e86700 1 -- 172.21.15.17:0/2705528174 wait complete. 2023-10-06T04:43:28.810 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2023-10-06T04:43:28.823 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T04:43:28.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.944+0000 7f70c16b0700 1 Processor -- start 2023-10-06T04:43:28.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.944+0000 7f70c16b0700 1 -- start start 2023-10-06T04:43:28.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.945+0000 7f70c16b0700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f70bc159800 0x7f70bc0af520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:28.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.945+0000 7f70c16b0700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f70bc0af0c0 0x7f70bc06b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:28.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.945+0000 7f70c16b0700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70bc0aec30 con 0x7f70bc0b1140 2023-10-06T04:43:28.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.945+0000 7f70c16b0700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70bc0ae300 con 0x7f70bc159800 2023-10-06T04:43:28.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.945+0000 7f70c16b0700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70bc0ae5e0 con 0x7f70bc0af0c0 2023-10-06T04:43:28.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.946+0000 7f70ba7fc700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f70bc0af0c0 0x7f70bc06b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:28.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.946+0000 7f70baffd700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f70bc159800 0x7f70bc0af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:28.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.946+0000 7f70ba7fc700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f70bc0af0c0 0x7f70bc06b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.17:48936/0 (socket says 172.21.15.17:48936) 2023-10-06T04:43:28.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.946+0000 7f70bb7fe700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f70bc0b1140 0x7f70bc06c560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.17:34386/0 (socket says 172.21.15.17:34386) 2023-10-06T04:43:28.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.946+0000 7f70ba7fc700 1 -- 172.21.15.17:0/1065154016 learned_addr learned my addr 172.21.15.17:0/1065154016 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:28.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.946+0000 7f70b9ffb700 1 -- 172.21.15.17:0/1065154016 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3809913094 0 0) 0x7f70bc0aec30 con 0x7f70bc0b1140 2023-10-06T04:43:28.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.946+0000 7f70b9ffb700 1 -- 172.21.15.17:0/1065154016 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70a8003570 con 0x7f70bc0b1140 2023-10-06T04:43:28.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.946+0000 7f70baffd700 1 -- 172.21.15.17:0/1065154016 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f70bc0af0c0 msgr2=0x7f70bc06b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:28.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.946+0000 7f70baffd700 1 --2- 172.21.15.17:0/1065154016 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f70bc0af0c0 0x7f70bc06b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:28.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.946+0000 7f70baffd700 1 -- 172.21.15.17:0/1065154016 >> v1:172.21.15.136:6789/0 conn(0x7f70bc0b1140 legacy=0x7f70bc06c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:28.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.946+0000 7f70baffd700 1 -- 172.21.15.17:0/1065154016 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70bc0ae8c0 con 0x7f70bc159800 2023-10-06T04:43:28.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.946+0000 7f70ba7fc700 1 --2- 172.21.15.17:0/1065154016 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f70bc0af0c0 0x7f70bc06b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:43:28.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.946+0000 7f70baffd700 1 --2- 172.21.15.17:0/1065154016 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f70bc159800 0x7f70bc0af520 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f70b40098e0 tx=0x7f70b40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4bbe81e661b7ae5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:28.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.946+0000 7f70b9ffb700 1 -- 172.21.15.17:0/1065154016 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b4011630 con 0x7f70bc159800 2023-10-06T04:43:28.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.946+0000 7f70b9ffb700 1 -- 172.21.15.17:0/1065154016 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b4011790 con 0x7f70bc159800 2023-10-06T04:43:28.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.946+0000 7f70b9ffb700 1 -- 172.21.15.17:0/1065154016 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b4011b10 con 0x7f70bc159800 2023-10-06T04:43:28.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.947+0000 7f70c16b0700 1 -- 172.21.15.17:0/1065154016 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f70bc159800 msgr2=0x7f70bc0af520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:28.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.947+0000 7f70c16b0700 1 --2- 172.21.15.17:0/1065154016 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f70bc159800 0x7f70bc0af520 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f70b40098e0 tx=0x7f70b40091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:28.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.947+0000 7f70c16b0700 1 -- 172.21.15.17:0/1065154016 shutdown_connections 2023-10-06T04:43:28.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.947+0000 7f70c16b0700 1 --2- 172.21.15.17:0/1065154016 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f70bc159800 0x7f70bc0af520 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:28.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.947+0000 7f70c16b0700 1 --2- 172.21.15.17:0/1065154016 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f70bc0af0c0 0x7f70bc06b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:28.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.947+0000 7f70c16b0700 1 -- 172.21.15.17:0/1065154016 >> 172.21.15.17:0/1065154016 conn(0x7f70bc0cde20 msgr2=0x7f70bc06ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:28.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.947+0000 7f70c16b0700 1 -- 172.21.15.17:0/1065154016 shutdown_connections 2023-10-06T04:43:28.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.947+0000 7f70c16b0700 1 -- 172.21.15.17:0/1065154016 wait complete. 2023-10-06T04:43:28.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.948+0000 7f70c16b0700 1 Processor -- start 2023-10-06T04:43:28.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.948+0000 7f70c16b0700 1 -- start start 2023-10-06T04:43:28.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.949+0000 7f70c16b0700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f70bc0af0c0 0x7f70bc16acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:28.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.949+0000 7f70c16b0700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70bc0b1140 0x7f70bc0abe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:28.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.949+0000 7f70c16b0700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f70bc159800 0x7f70bc0687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:28.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.949+0000 7f70c16b0700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70bc16b200 con 0x7f70bc0b1140 2023-10-06T04:43:28.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.949+0000 7f70c16b0700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70bc0ac850 con 0x7f70bc0af0c0 2023-10-06T04:43:28.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.949+0000 7f70c16b0700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70bc14dae0 con 0x7f70bc159800 2023-10-06T04:43:28.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.949+0000 7f70ba7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70bc0b1140 0x7f70bc0abe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:28.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.949+0000 7f70ba7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70bc0b1140 0x7f70bc0abe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33132/0 (socket says 172.21.15.17:33132) 2023-10-06T04:43:28.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.949+0000 7f70ba7fc700 1 -- 172.21.15.17:0/290672725 learned_addr learned my addr 172.21.15.17:0/290672725 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:28.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.949+0000 7f70baffd700 1 --2- 172.21.15.17:0/290672725 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f70bc0af0c0 0x7f70bc16acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:28.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.949+0000 7f70bb7fe700 1 --2- 172.21.15.17:0/290672725 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f70bc159800 0x7f70bc0687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:28.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.949+0000 7f70ba7fc700 1 -- 172.21.15.17:0/290672725 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f70bc159800 msgr2=0x7f70bc0687e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:28.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.949+0000 7f70ba7fc700 1 --2- 172.21.15.17:0/290672725 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f70bc159800 0x7f70bc0687e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:28.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.949+0000 7f70ba7fc700 1 -- 172.21.15.17:0/290672725 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f70bc0af0c0 msgr2=0x7f70bc16acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:28.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.950+0000 7f70ba7fc700 1 --2- 172.21.15.17:0/290672725 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f70bc0af0c0 0x7f70bc16acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:28.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.950+0000 7f70ba7fc700 1 -- 172.21.15.17:0/290672725 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a40094f0 con 0x7f70bc0b1140 2023-10-06T04:43:28.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.950+0000 7f70ba7fc700 1 --2- 172.21.15.17:0/290672725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70bc0b1140 0x7f70bc0abe10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f70a400ec80 tx=0x7f70a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:28.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.950+0000 7f70b2ffd700 1 -- 172.21.15.17:0/290672725 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a400c850 con 0x7f70bc0b1140 2023-10-06T04:43:28.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.950+0000 7f70b2ffd700 1 -- 172.21.15.17:0/290672725 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a400c9b0 con 0x7f70bc0b1140 2023-10-06T04:43:28.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.950+0000 7f70c16b0700 1 -- 172.21.15.17:0/290672725 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b4009420 con 0x7f70bc0b1140 2023-10-06T04:43:28.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.950+0000 7f70b2ffd700 1 -- 172.21.15.17:0/290672725 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a400cd30 con 0x7f70bc0b1140 2023-10-06T04:43:28.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.950+0000 7f70c16b0700 1 -- 172.21.15.17:0/290672725 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70bc14d700 con 0x7f70bc0b1140 2023-10-06T04:43:28.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.951+0000 7f70c16b0700 1 -- 172.21.15.17:0/290672725 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70bc14e260 con 0x7f70bc0b1140 2023-10-06T04:43:28.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.951+0000 7f70b2ffd700 1 -- 172.21.15.17:0/290672725 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f70a4013680 con 0x7f70bc0b1140 2023-10-06T04:43:28.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.952+0000 7f70b2ffd700 1 --2- 172.21.15.17:0/290672725 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f709c066f30 0x7f709c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:28.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.952+0000 7f70b2ffd700 1 -- 172.21.15.17:0/290672725 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f70a4084990 con 0x7f70bc0b1140 2023-10-06T04:43:28.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.952+0000 7f70baffd700 1 --2- 172.21.15.17:0/290672725 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f709c066f30 0x7f709c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:28.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.952+0000 7f70baffd700 1 --2- 172.21.15.17:0/290672725 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f709c066f30 0x7f709c0693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f70bc06d3a0 tx=0x7f70b4017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:28.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:28.956+0000 7f70b2ffd700 1 -- 172.21.15.17:0/290672725 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f70a4051a60 con 0x7f70bc0b1140 2023-10-06T04:43:29.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.198+0000 7f70c16b0700 1 -- 172.21.15.17:0/290672725 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f70bc14e410 con 0x7f70bc0b1140 2023-10-06T04:43:29.603 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:43:29.606 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:43:29.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.792+0000 7f70b2ffd700 1 -- 172.21.15.17:0/290672725 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f70a4055080 con 0x7f70bc0b1140 2023-10-06T04:43:29.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.796+0000 7f70c16b0700 1 -- 172.21.15.17:0/290672725 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f709c066f30 msgr2=0x7f709c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:29.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.796+0000 7f70c16b0700 1 --2- 172.21.15.17:0/290672725 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f709c066f30 0x7f709c0693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f70bc06d3a0 tx=0x7f70b4017000 comp rx=0 tx=0).stop 2023-10-06T04:43:29.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.796+0000 7f70c16b0700 1 -- 172.21.15.17:0/290672725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70bc0b1140 msgr2=0x7f70bc0abe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:29.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.796+0000 7f70c16b0700 1 --2- 172.21.15.17:0/290672725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70bc0b1140 0x7f70bc0abe10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f70a400ec80 tx=0x7f70a4009250 comp rx=0 tx=0).stop 2023-10-06T04:43:29.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.797+0000 7f70c16b0700 1 -- 172.21.15.17:0/290672725 shutdown_connections 2023-10-06T04:43:29.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.797+0000 7f70c16b0700 1 --2- 172.21.15.17:0/290672725 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f709c066f30 0x7f709c0693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:29.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.797+0000 7f70c16b0700 1 --2- 172.21.15.17:0/290672725 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f70bc159800 0x7f70bc0687e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:29.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.797+0000 7f70c16b0700 1 --2- 172.21.15.17:0/290672725 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f70bc0af0c0 0x7f70bc16acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:29.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.797+0000 7f70c16b0700 1 --2- 172.21.15.17:0/290672725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70bc0b1140 0x7f70bc0abe10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:29.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.797+0000 7f70c16b0700 1 -- 172.21.15.17:0/290672725 >> 172.21.15.17:0/290672725 conn(0x7f70bc0cde20 msgr2=0x7f70bc156dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:29.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.801+0000 7f70c16b0700 1 -- 172.21.15.17:0/290672725 shutdown_connections 2023-10-06T04:43:29.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.801+0000 7f70c16b0700 1 -- 172.21.15.17:0/290672725 wait complete. 2023-10-06T04:43:29.805 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 3 and data pool 4 2023-10-06T04:43:29.826 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:43:29.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.943+0000 7f386830c700 1 Processor -- start 2023-10-06T04:43:29.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.943+0000 7f386830c700 1 -- start start 2023-10-06T04:43:29.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.944+0000 7f386830c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3860159630 0x7f38600cd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:29.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.944+0000 7f386830c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f38600cea10 0x7f38600b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:29.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.944+0000 7f386830c700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38600cda00 con 0x7f38600cd590 2023-10-06T04:43:29.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.944+0000 7f386830c700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38600cee90 con 0x7f3860159630 2023-10-06T04:43:29.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.944+0000 7f386830c700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38600cfc80 con 0x7f38600cea10 2023-10-06T04:43:29.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.944+0000 7f38658a7700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f38600cd590 0x7f38600ce300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:32936/0 (socket says 172.21.15.17:32936) 2023-10-06T04:43:29.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.944+0000 7f38658a7700 1 -- 172.21.15.17:0/297829270 learned_addr learned my addr 172.21.15.17:0/297829270 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:29.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.944+0000 7f38668a9700 1 --2- 172.21.15.17:0/297829270 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f38600cea10 0x7f38600b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:29.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.944+0000 7f38660a8700 1 --2- 172.21.15.17:0/297829270 >> v2:172.21.15.136:3300/0 conn(0x7f3860159630 0x7f38600cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:29.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.944+0000 7f38650a6700 1 -- 172.21.15.17:0/297829270 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1954733772 0 0) 0x7f38600cda00 con 0x7f38600cd590 2023-10-06T04:43:29.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.944+0000 7f38650a6700 1 -- 172.21.15.17:0/297829270 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f384c003570 con 0x7f38600cd590 2023-10-06T04:43:29.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.944+0000 7f38668a9700 1 -- 172.21.15.17:0/297829270 >> v2:172.21.15.136:3300/0 conn(0x7f3860159630 msgr2=0x7f38600cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:29.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.944+0000 7f38668a9700 1 --2- 172.21.15.17:0/297829270 >> v2:172.21.15.136:3300/0 conn(0x7f3860159630 0x7f38600cd050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:29.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.944+0000 7f38668a9700 1 -- 172.21.15.17:0/297829270 >> v1:172.21.15.17:6789/0 conn(0x7f38600cd590 legacy=0x7f38600ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:29.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.944+0000 7f38668a9700 1 -- 172.21.15.17:0/297829270 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38600cf070 con 0x7f38600cea10 2023-10-06T04:43:29.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.945+0000 7f38668a9700 1 --2- 172.21.15.17:0/297829270 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f38600cea10 0x7f38600b02d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3858009e60 tx=0x7f3858009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a223819689962c82 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:29.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.945+0000 7f38650a6700 1 -- 172.21.15.17:0/297829270 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385800e070 con 0x7f38600cea10 2023-10-06T04:43:29.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.945+0000 7f38650a6700 1 -- 172.21.15.17:0/297829270 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385800bab0 con 0x7f38600cea10 2023-10-06T04:43:29.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.945+0000 7f38650a6700 1 -- 172.21.15.17:0/297829270 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385800be30 con 0x7f38600cea10 2023-10-06T04:43:29.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.945+0000 7f386830c700 1 -- 172.21.15.17:0/297829270 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f38600cea10 msgr2=0x7f38600b02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:29.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.945+0000 7f386830c700 1 --2- 172.21.15.17:0/297829270 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f38600cea10 0x7f38600b02d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3858009e60 tx=0x7f3858009780 comp rx=0 tx=0).stop 2023-10-06T04:43:29.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.945+0000 7f386830c700 1 -- 172.21.15.17:0/297829270 shutdown_connections 2023-10-06T04:43:29.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.945+0000 7f386830c700 1 --2- 172.21.15.17:0/297829270 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f38600cea10 0x7f38600b02d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:29.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.945+0000 7f386830c700 1 --2- 172.21.15.17:0/297829270 >> v2:172.21.15.136:3300/0 conn(0x7f3860159630 0x7f38600cd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:29.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.945+0000 7f386830c700 1 -- 172.21.15.17:0/297829270 >> 172.21.15.17:0/297829270 conn(0x7f386006cff0 msgr2=0x7f386006d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:29.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.945+0000 7f386830c700 1 -- 172.21.15.17:0/297829270 shutdown_connections 2023-10-06T04:43:29.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.945+0000 7f386830c700 1 -- 172.21.15.17:0/297829270 wait complete. 2023-10-06T04:43:29.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.946+0000 7f386830c700 1 Processor -- start 2023-10-06T04:43:29.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.946+0000 7f386830c700 1 -- start start 2023-10-06T04:43:29.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.947+0000 7f386830c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f38600cd590 0x7f386014e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:29.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.947+0000 7f386830c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38600cea10 0x7f386016d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:29.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.947+0000 7f386830c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3860159630 0x7f386015a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:29.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.947+0000 7f386830c700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3860155b40 con 0x7f38600cea10 2023-10-06T04:43:29.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.947+0000 7f386830c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3860155810 con 0x7f3860159630 2023-10-06T04:43:29.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.947+0000 7f386830c700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f386016d9c0 con 0x7f38600cd590 2023-10-06T04:43:29.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.947+0000 7f38658a7700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38600cea10 0x7f386016d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:29.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.947+0000 7f38658a7700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38600cea10 0x7f386016d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33148/0 (socket says 172.21.15.17:33148) 2023-10-06T04:43:29.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.947+0000 7f38658a7700 1 -- 172.21.15.17:0/2299333673 learned_addr learned my addr 172.21.15.17:0/2299333673 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:29.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.947+0000 7f38660a8700 1 --2- 172.21.15.17:0/2299333673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f38600cd590 0x7f386014e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:29.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.947+0000 7f38668a9700 1 --2- 172.21.15.17:0/2299333673 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3860159630 0x7f386015a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:29.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.948+0000 7f38658a7700 1 -- 172.21.15.17:0/2299333673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f38600cd590 msgr2=0x7f386014e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:29.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.948+0000 7f38658a7700 1 --2- 172.21.15.17:0/2299333673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f38600cd590 0x7f386014e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:29.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.948+0000 7f38658a7700 1 -- 172.21.15.17:0/2299333673 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3860159630 msgr2=0x7f386015a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:29.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.948+0000 7f38658a7700 1 --2- 172.21.15.17:0/2299333673 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3860159630 0x7f386015a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:29.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.948+0000 7f38658a7700 1 -- 172.21.15.17:0/2299333673 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3858009a20 con 0x7f38600cea10 2023-10-06T04:43:29.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.948+0000 7f38658a7700 1 --2- 172.21.15.17:0/2299333673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38600cea10 0x7f386016d0c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f38500011e0 tx=0x7f3850007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:29.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.948+0000 7f38567fc700 1 -- 172.21.15.17:0/2299333673 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3850005b30 con 0x7f38600cea10 2023-10-06T04:43:29.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.948+0000 7f38567fc700 1 -- 172.21.15.17:0/2299333673 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3850005c90 con 0x7f38600cea10 2023-10-06T04:43:29.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.948+0000 7f386830c700 1 -- 172.21.15.17:0/2299333673 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f386016dca0 con 0x7f38600cea10 2023-10-06T04:43:29.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.948+0000 7f38567fc700 1 -- 172.21.15.17:0/2299333673 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3850007300 con 0x7f38600cea10 2023-10-06T04:43:29.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.948+0000 7f386830c700 1 -- 172.21.15.17:0/2299333673 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f386014e620 con 0x7f38600cea10 2023-10-06T04:43:29.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.949+0000 7f386830c700 1 -- 172.21.15.17:0/2299333673 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3860155cb0 con 0x7f38600cea10 2023-10-06T04:43:29.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.949+0000 7f38567fc700 1 -- 172.21.15.17:0/2299333673 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3850007670 con 0x7f38600cea10 2023-10-06T04:43:29.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.950+0000 7f38567fc700 1 --2- 172.21.15.17:0/2299333673 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3844066f30 0x7f38440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:29.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.950+0000 7f38567fc700 1 -- 172.21.15.17:0/2299333673 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3850083aa0 con 0x7f38600cea10 2023-10-06T04:43:29.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.950+0000 7f38660a8700 1 --2- 172.21.15.17:0/2299333673 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3844066f30 0x7f38440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:29.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.950+0000 7f38660a8700 1 --2- 172.21.15.17:0/2299333673 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3844066f30 0x7f38440693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f385c009d10 tx=0x7f385c0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:29.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:29.954+0000 7f38567fc700 1 -- 172.21.15.17:0/2299333673 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3850050bb0 con 0x7f38600cea10 2023-10-06T04:43:30.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.151+0000 7f386830c700 1 -- 172.21.15.17:0/2299333673 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3860063ff0 con 0x7f38600cea10 2023-10-06T04:43:30.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.152+0000 7f38567fc700 1 -- 172.21.15.17:0/2299333673 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16879 (secure 0 0 0) 0x7f3850017020 con 0x7f38600cea10 2023-10-06T04:43:30.154 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:43:30.154 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":20,"fsid":"780777c4-2b25-4d35-9058-c9f2d62e3ad9","created":"2023-10-06T04:43:10.578520+0000","modified":"2023-10-06T04:43:29.199492+0000","last_up_change":"2023-10-06T04:43:20.682958+0000","last_in_change":"2023-10-06T04:43:12.978917+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:43:21.795733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:43:22.389592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:43:26.914728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:43:28.173678+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"84737b08-575c-46dd-9488-073ae8504494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6809","nonce":90656},{"type":"v1","addr":"172.21.15.17:6811","nonce":90656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":90656},{"type":"v1","addr":"172.21.15.17:6814","nonce":90656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":90656},{"type":"v1","addr":"172.21.15.17:6822","nonce":90656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":90656},{"type":"v1","addr":"172.21.15.17:6818","nonce":90656}]},"public_addr":"172.21.15.17:6811/90656","cluster_addr":"172.21.15.17:6814/90656","heartbeat_back_addr":"172.21.15.17:6822/90656","heartbeat_front_addr":"172.21.15.17:6818/90656","state":["exists","up"]},{"osd":1,"uuid":"dffeb740-58a2-4fd6-8ff1-a0a11a2cc709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":90655},{"type":"v1","addr":"172.21.15.17:6801","nonce":90655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":90655},{"type":"v1","addr":"172.21.15.17:6803","nonce":90655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":90655},{"type":"v1","addr":"172.21.15.17:6807","nonce":90655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":90655},{"type":"v1","addr":"172.21.15.17:6805","nonce":90655}]},"public_addr":"172.21.15.17:6801/90655","cluster_addr":"172.21.15.17:6803/90655","heartbeat_back_addr":"172.21.15.17:6807/90655","heartbeat_front_addr":"172.21.15.17:6805/90655","state":["exists","up"]},{"osd":2,"uuid":"48bd6831-763d-48c2-b515-e02c216d608b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":90657},{"type":"v1","addr":"172.21.15.17:6810","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":90657},{"type":"v1","addr":"172.21.15.17:6815","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":90657},{"type":"v1","addr":"172.21.15.17:6823","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":90657},{"type":"v1","addr":"172.21.15.17:6819","nonce":90657}]},"public_addr":"172.21.15.17:6810/90657","cluster_addr":"172.21.15.17:6815/90657","heartbeat_back_addr":"172.21.15.17:6823/90657","heartbeat_front_addr":"172.21.15.17:6819/90657","state":["exists","up"]},{"osd":3,"uuid":"ae7dbb23-abe7-4bd3-a4df-6f5963d6804c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":90688},{"type":"v1","addr":"172.21.15.17:6825","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":90688},{"type":"v1","addr":"172.21.15.17:6827","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":90688},{"type":"v1","addr":"172.21.15.17:6831","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":90688},{"type":"v1","addr":"172.21.15.17:6829","nonce":90688}]},"public_addr":"172.21.15.17:6825/90688","cluster_addr":"172.21.15.17:6827/90688","heartbeat_back_addr":"172.21.15.17:6831/90688","heartbeat_front_addr":"172.21.15.17:6829/90688","state":["exists","up"]},{"osd":4,"uuid":"29991fb4-1667-4ea3-aca0-d55db27f3bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":90902},{"type":"v1","addr":"172.21.15.136:6801","nonce":90902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":90902},{"type":"v1","addr":"172.21.15.136:6803","nonce":90902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":90902},{"type":"v1","addr":"172.21.15.136:6807","nonce":90902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":90902},{"type":"v1","addr":"172.21.15.136:6805","nonce":90902}]},"public_addr":"172.21.15.136:6801/90902","cluster_addr":"172.21.15.136:6803/90902","heartbeat_back_addr":"172.21.15.136:6807/90902","heartbeat_front_addr":"172.21.15.136:6805/90902","state":["exists","up"]},{"osd":5,"uuid":"398b4ff9-03fc-421f-882c-ba12aa088eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":90901},{"type":"v1","addr":"172.21.15.136:6809","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":90901},{"type":"v1","addr":"172.21.15.136:6811","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":90901},{"type":"v1","addr":"172.21.15.136:6815","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":90901},{"type":"v1","addr":"172.21.15.136:6813","nonce":90901}]},"public_addr":"172.21.15.136:6809/90901","cluster_addr":"172.21.15.136:6811/90901","heartbeat_back_addr":"172.21.15.136:6815/90901","heartbeat_front_addr":"172.21.15.136:6813/90901","state":["exists","up"]},{"osd":6,"uuid":"1bb91a72-4dab-4cdb-aa1d-2b8a9edf1ad0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":90927},{"type":"v1","addr":"172.21.15.136:6825","nonce":90927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":90927},{"type":"v1","addr":"172.21.15.136:6827","nonce":90927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":90927},{"type":"v1","addr":"172.21.15.136:6831","nonce":90927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":90927},{"type":"v1","addr":"172.21.15.136:6829","nonce":90927}]},"public_addr":"172.21.15.136:6825/90927","cluster_addr":"172.21.15.136:6827/90927","heartbeat_back_addr":"172.21.15.136:6831/90927","heartbeat_front_addr":"172.21.15.136:6829/90927","state":["exists","up"]},{"osd":7,"uuid":"719b654e-010d-4aa4-8c13-83fdde242b47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":90934},{"type":"v1","addr":"172.21.15.136:6817","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":90934},{"type":"v1","addr":"172.21.15.136:6819","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":90934},{"type":"v1","addr":"172.21.15.136:6824","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":90934},{"type":"v1","addr":"172.21.15.136:6821","nonce":90934}]},"public_addr":"172.21.15.136:6817/90934","cluster_addr":"172.21.15.136:6819/90934","heartbeat_back_addr":"172.21.15.136:6824/90934","heartbeat_front_addr":"172.21.15.136:6821/90934","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.157479+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.140520+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.190743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.231396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.156510+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.145822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.202888+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.139532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:43:30.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.154+0000 7f386830c700 1 -- 172.21.15.17:0/2299333673 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3844066f30 msgr2=0x7f38440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:30.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.154+0000 7f386830c700 1 --2- 172.21.15.17:0/2299333673 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3844066f30 0x7f38440693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f385c009d10 tx=0x7f385c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:30.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.154+0000 7f386830c700 1 -- 172.21.15.17:0/2299333673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38600cea10 msgr2=0x7f386016d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:30.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.154+0000 7f386830c700 1 --2- 172.21.15.17:0/2299333673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38600cea10 0x7f386016d0c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f38500011e0 tx=0x7f3850007df0 comp rx=0 tx=0).stop 2023-10-06T04:43:30.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.154+0000 7f386830c700 1 -- 172.21.15.17:0/2299333673 shutdown_connections 2023-10-06T04:43:30.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.154+0000 7f386830c700 1 --2- 172.21.15.17:0/2299333673 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3844066f30 0x7f38440693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:30.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.154+0000 7f386830c700 1 --2- 172.21.15.17:0/2299333673 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3860159630 0x7f386015a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:30.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.154+0000 7f386830c700 1 --2- 172.21.15.17:0/2299333673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f38600cd590 0x7f386014e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:30.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.154+0000 7f386830c700 1 --2- 172.21.15.17:0/2299333673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38600cea10 0x7f386016d0c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:30.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.154+0000 7f386830c700 1 -- 172.21.15.17:0/2299333673 >> 172.21.15.17:0/2299333673 conn(0x7f386006cff0 msgr2=0x7f38600b2870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:30.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.154+0000 7f386830c700 1 -- 172.21.15.17:0/2299333673 shutdown_connections 2023-10-06T04:43:30.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.154+0000 7f386830c700 1 -- 172.21.15.17:0/2299333673 wait complete. 2023-10-06T04:43:30.168 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:43:30.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.286+0000 7f4819cdb700 1 Processor -- start 2023-10-06T04:43:30.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.286+0000 7f4819cdb700 1 -- start start 2023-10-06T04:43:30.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.287+0000 7f4819cdb700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48140cd760 0x7f48140ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:30.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.287+0000 7f4819cdb700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f48140ce840 0x7f48140b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:30.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.287+0000 7f4819cdb700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48140cfc80 con 0x7f4814159630 2023-10-06T04:43:30.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.287+0000 7f4819cdb700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48140cf070 con 0x7f48140ce840 2023-10-06T04:43:30.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.287+0000 7f4819cdb700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48140cf350 con 0x7f48140cd760 2023-10-06T04:43:30.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.287+0000 7f4813fff700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f48140ce840 0x7f48140b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:30.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.287+0000 7f48137fe700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f4814159630 0x7f48140cd050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:32938/0 (socket says 172.21.15.17:32938) 2023-10-06T04:43:30.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.287+0000 7f48137fe700 1 -- 172.21.15.17:0/1032417769 learned_addr learned my addr 172.21.15.17:0/1032417769 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:30.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.287+0000 7f4812ffd700 1 --2- 172.21.15.17:0/1032417769 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48140cd760 0x7f48140ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:30.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.287+0000 7f4813fff700 1 -- 172.21.15.17:0/1032417769 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48140cd760 msgr2=0x7f48140ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:30.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.287+0000 7f4813fff700 1 --2- 172.21.15.17:0/1032417769 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48140cd760 0x7f48140ce300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:30.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.287+0000 7f4813fff700 1 -- 172.21.15.17:0/1032417769 >> v1:172.21.15.17:6789/0 conn(0x7f4814159630 legacy=0x7f48140cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:30.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.287+0000 7f4813fff700 1 -- 172.21.15.17:0/1032417769 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48140cf630 con 0x7f48140ce840 2023-10-06T04:43:30.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.287+0000 7f48127fc700 1 -- 172.21.15.17:0/1032417769 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 369566685 0 0) 0x7f48140cfc80 con 0x7f4814159630 2023-10-06T04:43:30.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.287+0000 7f4812ffd700 1 --2- 172.21.15.17:0/1032417769 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48140cd760 0x7f48140ce300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:43:30.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.287+0000 7f4813fff700 1 --2- 172.21.15.17:0/1032417769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48140ce840 0x7f48140b02d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f480c009e60 tx=0x7f480c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=417675728a58d458 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:30.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.287+0000 7f48127fc700 1 -- 172.21.15.17:0/1032417769 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480c00e070 con 0x7f48140ce840 2023-10-06T04:43:30.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.287+0000 7f48127fc700 1 -- 172.21.15.17:0/1032417769 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480c00bc30 con 0x7f48140ce840 2023-10-06T04:43:30.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.287+0000 7f48127fc700 1 -- 172.21.15.17:0/1032417769 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480c012430 con 0x7f48140ce840 2023-10-06T04:43:30.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.288+0000 7f4819cdb700 1 -- 172.21.15.17:0/1032417769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48140ce840 msgr2=0x7f48140b02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:30.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.288+0000 7f4819cdb700 1 --2- 172.21.15.17:0/1032417769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48140ce840 0x7f48140b02d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f480c009e60 tx=0x7f480c009780 comp rx=0 tx=0).stop 2023-10-06T04:43:30.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.288+0000 7f4819cdb700 1 -- 172.21.15.17:0/1032417769 shutdown_connections 2023-10-06T04:43:30.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.288+0000 7f4819cdb700 1 --2- 172.21.15.17:0/1032417769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48140ce840 0x7f48140b02d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:30.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.288+0000 7f4819cdb700 1 --2- 172.21.15.17:0/1032417769 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48140cd760 0x7f48140ce300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:30.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.288+0000 7f4819cdb700 1 -- 172.21.15.17:0/1032417769 >> 172.21.15.17:0/1032417769 conn(0x7f481406cff0 msgr2=0x7f481406d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:30.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.288+0000 7f4819cdb700 1 -- 172.21.15.17:0/1032417769 shutdown_connections 2023-10-06T04:43:30.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.288+0000 7f4819cdb700 1 -- 172.21.15.17:0/1032417769 wait complete. 2023-10-06T04:43:30.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.289+0000 7f4819cdb700 1 Processor -- start 2023-10-06T04:43:30.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.289+0000 7f4819cdb700 1 -- start start 2023-10-06T04:43:30.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.290+0000 7f4819cdb700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48140cd760 0x7f48140b5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:30.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.290+0000 7f4819cdb700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48140ce840 0x7f48140ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:30.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.290+0000 7f4819cdb700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4814159630 0x7f48140c7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:30.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.290+0000 7f4819cdb700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48140b6140 con 0x7f48140ce840 2023-10-06T04:43:30.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.290+0000 7f4819cdb700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48140ca600 con 0x7f48140cd760 2023-10-06T04:43:30.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.290+0000 7f4819cdb700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48140b5b80 con 0x7f4814159630 2023-10-06T04:43:30.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.290+0000 7f4812ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48140ce840 0x7f48140ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:30.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.290+0000 7f4812ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48140ce840 0x7f48140ca0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33162/0 (socket says 172.21.15.17:33162) 2023-10-06T04:43:30.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.290+0000 7f4812ffd700 1 -- 172.21.15.17:0/3020753315 learned_addr learned my addr 172.21.15.17:0/3020753315 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:30.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.290+0000 7f4813fff700 1 --2- 172.21.15.17:0/3020753315 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4814159630 0x7f48140c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:30.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.290+0000 7f48137fe700 1 --2- 172.21.15.17:0/3020753315 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48140cd760 0x7f48140b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:30.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.290+0000 7f4812ffd700 1 -- 172.21.15.17:0/3020753315 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4814159630 msgr2=0x7f48140c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:30.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.290+0000 7f4812ffd700 1 --2- 172.21.15.17:0/3020753315 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4814159630 0x7f48140c7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:30.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.290+0000 7f4812ffd700 1 -- 172.21.15.17:0/3020753315 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48140cd760 msgr2=0x7f48140b5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:30.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.290+0000 7f4812ffd700 1 --2- 172.21.15.17:0/3020753315 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48140cd760 0x7f48140b5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:30.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.290+0000 7f4812ffd700 1 -- 172.21.15.17:0/3020753315 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f480c009a20 con 0x7f48140ce840 2023-10-06T04:43:30.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.291+0000 7f4812ffd700 1 --2- 172.21.15.17:0/3020753315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48140ce840 0x7f48140ca0c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f480800e8d0 tx=0x7f4808008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:30.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.291+0000 7f47fb7fe700 1 -- 172.21.15.17:0/3020753315 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4808013410 con 0x7f48140ce840 2023-10-06T04:43:30.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.291+0000 7f47fb7fe700 1 -- 172.21.15.17:0/3020753315 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4808013570 con 0x7f48140ce840 2023-10-06T04:43:30.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.291+0000 7f4819cdb700 1 -- 172.21.15.17:0/3020753315 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48140b5e60 con 0x7f48140ce840 2023-10-06T04:43:30.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.291+0000 7f47fb7fe700 1 -- 172.21.15.17:0/3020753315 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4808013910 con 0x7f48140ce840 2023-10-06T04:43:30.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.291+0000 7f4819cdb700 1 -- 172.21.15.17:0/3020753315 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f481415afc0 con 0x7f48140ce840 2023-10-06T04:43:30.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.292+0000 7f4819cdb700 1 -- 172.21.15.17:0/3020753315 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f481415b1e0 con 0x7f48140ce840 2023-10-06T04:43:30.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.292+0000 7f47fb7fe700 1 -- 172.21.15.17:0/3020753315 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4808013d00 con 0x7f48140ce840 2023-10-06T04:43:30.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.292+0000 7f47fb7fe700 1 --2- 172.21.15.17:0/3020753315 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f4800066f60 0x7f4800069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:30.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.293+0000 7f47fb7fe700 1 -- 172.21.15.17:0/3020753315 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4808084420 con 0x7f48140ce840 2023-10-06T04:43:30.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.293+0000 7f48137fe700 1 --2- 172.21.15.17:0/3020753315 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f4800066f60 0x7f4800069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:30.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.293+0000 7f48137fe700 1 --2- 172.21.15.17:0/3020753315 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f4800066f60 0x7f4800069410 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4804007160 tx=0x7f4804007f50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:30.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.297+0000 7f47fb7fe700 1 -- 172.21.15.17:0/3020753315 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4808051530 con 0x7f48140ce840 2023-10-06T04:43:30.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.497+0000 7f4819cdb700 1 -- 172.21.15.17:0/3020753315 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48140c7ca0 con 0x7f48140ce840 2023-10-06T04:43:30.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.498+0000 7f47fb7fe700 1 -- 172.21.15.17:0/3020753315 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16879 (secure 0 0 0) 0x7f4808054b50 con 0x7f48140ce840 2023-10-06T04:43:30.500 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:43:30.500 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":20,"fsid":"780777c4-2b25-4d35-9058-c9f2d62e3ad9","created":"2023-10-06T04:43:10.578520+0000","modified":"2023-10-06T04:43:29.199492+0000","last_up_change":"2023-10-06T04:43:20.682958+0000","last_in_change":"2023-10-06T04:43:12.978917+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:43:21.795733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:43:22.389592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:43:26.914728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:43:28.173678+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"84737b08-575c-46dd-9488-073ae8504494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6809","nonce":90656},{"type":"v1","addr":"172.21.15.17:6811","nonce":90656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":90656},{"type":"v1","addr":"172.21.15.17:6814","nonce":90656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":90656},{"type":"v1","addr":"172.21.15.17:6822","nonce":90656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":90656},{"type":"v1","addr":"172.21.15.17:6818","nonce":90656}]},"public_addr":"172.21.15.17:6811/90656","cluster_addr":"172.21.15.17:6814/90656","heartbeat_back_addr":"172.21.15.17:6822/90656","heartbeat_front_addr":"172.21.15.17:6818/90656","state":["exists","up"]},{"osd":1,"uuid":"dffeb740-58a2-4fd6-8ff1-a0a11a2cc709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":90655},{"type":"v1","addr":"172.21.15.17:6801","nonce":90655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":90655},{"type":"v1","addr":"172.21.15.17:6803","nonce":90655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":90655},{"type":"v1","addr":"172.21.15.17:6807","nonce":90655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":90655},{"type":"v1","addr":"172.21.15.17:6805","nonce":90655}]},"public_addr":"172.21.15.17:6801/90655","cluster_addr":"172.21.15.17:6803/90655","heartbeat_back_addr":"172.21.15.17:6807/90655","heartbeat_front_addr":"172.21.15.17:6805/90655","state":["exists","up"]},{"osd":2,"uuid":"48bd6831-763d-48c2-b515-e02c216d608b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":90657},{"type":"v1","addr":"172.21.15.17:6810","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":90657},{"type":"v1","addr":"172.21.15.17:6815","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":90657},{"type":"v1","addr":"172.21.15.17:6823","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":90657},{"type":"v1","addr":"172.21.15.17:6819","nonce":90657}]},"public_addr":"172.21.15.17:6810/90657","cluster_addr":"172.21.15.17:6815/90657","heartbeat_back_addr":"172.21.15.17:6823/90657","heartbeat_front_addr":"172.21.15.17:6819/90657","state":["exists","up"]},{"osd":3,"uuid":"ae7dbb23-abe7-4bd3-a4df-6f5963d6804c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":90688},{"type":"v1","addr":"172.21.15.17:6825","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":90688},{"type":"v1","addr":"172.21.15.17:6827","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":90688},{"type":"v1","addr":"172.21.15.17:6831","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":90688},{"type":"v1","addr":"172.21.15.17:6829","nonce":90688}]},"public_addr":"172.21.15.17:6825/90688","cluster_addr":"172.21.15.17:6827/90688","heartbeat_back_addr":"172.21.15.17:6831/90688","heartbeat_front_addr":"172.21.15.17:6829/90688","state":["exists","up"]},{"osd":4,"uuid":"29991fb4-1667-4ea3-aca0-d55db27f3bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":90902},{"type":"v1","addr":"172.21.15.136:6801","nonce":90902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":90902},{"type":"v1","addr":"172.21.15.136:6803","nonce":90902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":90902},{"type":"v1","addr":"172.21.15.136:6807","nonce":90902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":90902},{"type":"v1","addr":"172.21.15.136:6805","nonce":90902}]},"public_addr":"172.21.15.136:6801/90902","cluster_addr":"172.21.15.136:6803/90902","heartbeat_back_addr":"172.21.15.136:6807/90902","heartbeat_front_addr":"172.21.15.136:6805/90902","state":["exists","up"]},{"osd":5,"uuid":"398b4ff9-03fc-421f-882c-ba12aa088eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":90901},{"type":"v1","addr":"172.21.15.136:6809","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":90901},{"type":"v1","addr":"172.21.15.136:6811","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":90901},{"type":"v1","addr":"172.21.15.136:6815","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":90901},{"type":"v1","addr":"172.21.15.136:6813","nonce":90901}]},"public_addr":"172.21.15.136:6809/90901","cluster_addr":"172.21.15.136:6811/90901","heartbeat_back_addr":"172.21.15.136:6815/90901","heartbeat_front_addr":"172.21.15.136:6813/90901","state":["exists","up"]},{"osd":6,"uuid":"1bb91a72-4dab-4cdb-aa1d-2b8a9edf1ad0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":90927},{"type":"v1","addr":"172.21.15.136:6825","nonce":90927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":90927},{"type":"v1","addr":"172.21.15.136:6827","nonce":90927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":90927},{"type":"v1","addr":"172.21.15.136:6831","nonce":90927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":90927},{"type":"v1","addr":"172.21.15.136:6829","nonce":90927}]},"public_addr":"172.21.15.136:6825/90927","cluster_addr":"172.21.15.136:6827/90927","heartbeat_back_addr":"172.21.15.136:6831/90927","heartbeat_front_addr":"172.21.15.136:6829/90927","state":["exists","up"]},{"osd":7,"uuid":"719b654e-010d-4aa4-8c13-83fdde242b47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":90934},{"type":"v1","addr":"172.21.15.136:6817","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":90934},{"type":"v1","addr":"172.21.15.136:6819","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":90934},{"type":"v1","addr":"172.21.15.136:6824","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":90934},{"type":"v1","addr":"172.21.15.136:6821","nonce":90934}]},"public_addr":"172.21.15.136:6817/90934","cluster_addr":"172.21.15.136:6819/90934","heartbeat_back_addr":"172.21.15.136:6824/90934","heartbeat_front_addr":"172.21.15.136:6821/90934","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.157479+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.140520+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.190743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.231396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.156510+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.145822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.202888+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.139532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:43:30.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.500+0000 7f4819cdb700 1 -- 172.21.15.17:0/3020753315 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f4800066f60 msgr2=0x7f4800069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:30.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.500+0000 7f4819cdb700 1 --2- 172.21.15.17:0/3020753315 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f4800066f60 0x7f4800069410 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4804007160 tx=0x7f4804007f50 comp rx=0 tx=0).stop 2023-10-06T04:43:30.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.500+0000 7f4819cdb700 1 -- 172.21.15.17:0/3020753315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48140ce840 msgr2=0x7f48140ca0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:30.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.500+0000 7f4819cdb700 1 --2- 172.21.15.17:0/3020753315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48140ce840 0x7f48140ca0c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f480800e8d0 tx=0x7f4808008040 comp rx=0 tx=0).stop 2023-10-06T04:43:30.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.500+0000 7f4819cdb700 1 -- 172.21.15.17:0/3020753315 shutdown_connections 2023-10-06T04:43:30.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.500+0000 7f4819cdb700 1 --2- 172.21.15.17:0/3020753315 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f4800066f60 0x7f4800069410 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:30.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.500+0000 7f4819cdb700 1 --2- 172.21.15.17:0/3020753315 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4814159630 0x7f48140c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:30.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.500+0000 7f4819cdb700 1 --2- 172.21.15.17:0/3020753315 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48140cd760 0x7f48140b5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:30.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.500+0000 7f4819cdb700 1 --2- 172.21.15.17:0/3020753315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48140ce840 0x7f48140ca0c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:30.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.500+0000 7f4819cdb700 1 -- 172.21.15.17:0/3020753315 >> 172.21.15.17:0/3020753315 conn(0x7f481406cff0 msgr2=0x7f481406d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:30.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.500+0000 7f4819cdb700 1 -- 172.21.15.17:0/3020753315 shutdown_connections 2023-10-06T04:43:30.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.500+0000 7f4819cdb700 1 -- 172.21.15.17:0/3020753315 wait complete. 2023-10-06T04:43:30.514 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T04:43:30.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.634+0000 7fb0ee926700 1 Processor -- start 2023-10-06T04:43:30.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.634+0000 7fb0ee926700 1 -- start start 2023-10-06T04:43:30.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.635+0000 7fb0ee926700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb0e806bb60 0x7fb0e8164590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:30.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.635+0000 7fb0ee926700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0e80aec30 con 0x7fb0e8159800 2023-10-06T04:43:30.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.635+0000 7fb0ee926700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0e80ae300 con 0x7fb0e80af0c0 2023-10-06T04:43:30.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.635+0000 7fb0ee926700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0e80afc30 con 0x7fb0e806bb60 2023-10-06T04:43:30.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.635+0000 7fb0e7fff700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fb0e8159800 0x7fb0e80af520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:32942/0 (socket says 172.21.15.17:32942) 2023-10-06T04:43:30.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.635+0000 7fb0e7fff700 1 -- 172.21.15.17:0/1711831965 learned_addr learned my addr 172.21.15.17:0/1711831965 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:30.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.635+0000 7fb0e6ffd700 1 -- 172.21.15.17:0/1711831965 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3768080210 0 0) 0x7fb0e80aec30 con 0x7fb0e8159800 2023-10-06T04:43:30.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.635+0000 7fb0e6ffd700 1 -- 172.21.15.17:0/1711831965 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0d0003570 con 0x7fb0e8159800 2023-10-06T04:43:30.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.635+0000 7fb0ecec3700 1 --2- 172.21.15.17:0/1711831965 >> v2:172.21.15.136:3300/0 conn(0x7fb0e806bb60 0x7fb0e8164590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:30.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.635+0000 7fb0e6ffd700 1 -- 172.21.15.17:0/1711831965 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 811668936 0 0) 0x7fb0d0003570 con 0x7fb0e8159800 2023-10-06T04:43:30.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.635+0000 7fb0e6ffd700 1 -- 172.21.15.17:0/1711831965 >> v2:172.21.15.136:3300/0 conn(0x7fb0e806bb60 msgr2=0x7fb0e8164590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:30.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.636+0000 7fb0e6ffd700 1 --2- 172.21.15.17:0/1711831965 >> v2:172.21.15.136:3300/0 conn(0x7fb0e806bb60 0x7fb0e8164590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:30.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.636+0000 7fb0e6ffd700 1 -- 172.21.15.17:0/1711831965 >> v1:172.21.15.136:6789/0 conn(0x7fb0e80af0c0 legacy=0x7fb0e806b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:30.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.636+0000 7fb0e6ffd700 1 -- 172.21.15.17:0/1711831965 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e80ae5e0 con 0x7fb0e8159800 2023-10-06T04:43:30.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.636+0000 7fb0e6ffd700 1 -- 172.21.15.17:0/1711831965 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4268781140 0 0) 0x7fb0d8001470 con 0x7fb0e8159800 2023-10-06T04:43:30.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.636+0000 7fb0e6ffd700 1 -- 172.21.15.17:0/1711831965 >> v1:172.21.15.17:6789/0 conn(0x7fb0e8159800 legacy=0x7fb0e80af520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:30.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.636+0000 7fb0e6ffd700 1 --2- 172.21.15.17:0/1711831965 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb0d0003a60 0x7fb0d0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:30.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.636+0000 7fb0e6ffd700 1 --2- 172.21.15.17:0/1711831965 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0d0004810 0x7fb0d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:30.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.636+0000 7fb0e6ffd700 1 --2- 172.21.15.17:0/1711831965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0d00052e0 0x7fb0d000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:30.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.636+0000 7fb0e6ffd700 1 -- 172.21.15.17:0/1711831965 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d000c270 con 0x7fb0d00052e0 2023-10-06T04:43:30.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.636+0000 7fb0e6ffd700 1 -- 172.21.15.17:0/1711831965 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d000c3e0 con 0x7fb0d0004810 2023-10-06T04:43:30.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.636+0000 7fb0e6ffd700 1 -- 172.21.15.17:0/1711831965 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d000c5a0 con 0x7fb0d0003a60 2023-10-06T04:43:30.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.636+0000 7fb0ecec3700 1 --2- 172.21.15.17:0/1711831965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0d00052e0 0x7fb0d000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:30.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.636+0000 7fb0e77fe700 1 --2- 172.21.15.17:0/1711831965 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0d0004810 0x7fb0d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:30.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.636+0000 7fb0e7fff700 1 --2- 172.21.15.17:0/1711831965 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb0d0003a60 0x7fb0d0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:30.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.636+0000 7fb0ecec3700 1 -- 172.21.15.17:0/1711831965 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb0d0003a60 msgr2=0x7fb0d0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:30.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.636+0000 7fb0ecec3700 1 --2- 172.21.15.17:0/1711831965 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb0d0003a60 0x7fb0d0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:30.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.636+0000 7fb0ecec3700 1 -- 172.21.15.17:0/1711831965 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0d0004810 msgr2=0x7fb0d0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:30.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.636+0000 7fb0ecec3700 1 --2- 172.21.15.17:0/1711831965 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0d0004810 0x7fb0d0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:30.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.636+0000 7fb0ecec3700 1 -- 172.21.15.17:0/1711831965 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d0003570 con 0x7fb0d00052e0 2023-10-06T04:43:30.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.636+0000 7fb0e7fff700 1 --2- 172.21.15.17:0/1711831965 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb0d0003a60 0x7fb0d0003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:43:30.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.636+0000 7fb0ecec3700 1 -- 172.21.15.17:0/1711831965 reap_dead start 2023-10-06T04:43:30.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.636+0000 7fb0ecec3700 1 --2- 172.21.15.17:0/1711831965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0d00052e0 0x7fb0d000ba60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb0e806bf60 tx=0x7fb0e000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=464d4386dbe4a716 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:30.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.636+0000 7fb0e6ffd700 1 -- 172.21.15.17:0/1711831965 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e000ea90 con 0x7fb0d00052e0 2023-10-06T04:43:30.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.636+0000 7fb0e6ffd700 1 -- 172.21.15.17:0/1711831965 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e000f040 con 0x7fb0d00052e0 2023-10-06T04:43:30.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.636+0000 7fb0e6ffd700 1 -- 172.21.15.17:0/1711831965 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e000ee40 con 0x7fb0d00052e0 2023-10-06T04:43:30.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.637+0000 7fb0ee926700 1 -- 172.21.15.17:0/1711831965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0d00052e0 msgr2=0x7fb0d000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:30.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.637+0000 7fb0ee926700 1 --2- 172.21.15.17:0/1711831965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0d00052e0 0x7fb0d000ba60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb0e806bf60 tx=0x7fb0e000b040 comp rx=0 tx=0).stop 2023-10-06T04:43:30.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.637+0000 7fb0ee926700 1 -- 172.21.15.17:0/1711831965 shutdown_connections 2023-10-06T04:43:30.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.637+0000 7fb0ee926700 1 --2- 172.21.15.17:0/1711831965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0d00052e0 0x7fb0d000ba60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:30.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.637+0000 7fb0ee926700 1 -- 172.21.15.17:0/1711831965 >> 172.21.15.17:0/1711831965 conn(0x7fb0e80cde20 msgr2=0x7fb0e806ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:30.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.637+0000 7fb0ee926700 1 -- 172.21.15.17:0/1711831965 shutdown_connections 2023-10-06T04:43:30.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.637+0000 7fb0ee926700 1 -- 172.21.15.17:0/1711831965 wait complete. 2023-10-06T04:43:30.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.638+0000 7fb0ee926700 1 Processor -- start 2023-10-06T04:43:30.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.638+0000 7fb0ee926700 1 -- start start 2023-10-06T04:43:30.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.639+0000 7fb0ee926700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0d00052e0 0x7fb0e81540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:30.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.639+0000 7fb0ee926700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0e814f670 0x7fb0e814c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:30.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.639+0000 7fb0ee926700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb0e814ce60 0x7fb0e814d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:30.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.639+0000 7fb0ee926700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e813ccd0 con 0x7fb0d00052e0 2023-10-06T04:43:30.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.639+0000 7fb0ee926700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e8154a60 con 0x7fb0e814f670 2023-10-06T04:43:30.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.639+0000 7fb0ee926700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e8154d40 con 0x7fb0e814ce60 2023-10-06T04:43:30.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.639+0000 7fb0e7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0d00052e0 0x7fb0e81540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:30.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.639+0000 7fb0e7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0d00052e0 0x7fb0e81540c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33182/0 (socket says 172.21.15.17:33182) 2023-10-06T04:43:30.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.639+0000 7fb0e7fff700 1 -- 172.21.15.17:0/3510518699 learned_addr learned my addr 172.21.15.17:0/3510518699 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:30.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.639+0000 7fb0e77fe700 1 --2- 172.21.15.17:0/3510518699 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0e814f670 0x7fb0e814c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:30.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.639+0000 7fb0ecec3700 1 --2- 172.21.15.17:0/3510518699 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb0e814ce60 0x7fb0e814d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:30.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.639+0000 7fb0e7fff700 1 -- 172.21.15.17:0/3510518699 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb0e814ce60 msgr2=0x7fb0e814d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:30.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.639+0000 7fb0e7fff700 1 --2- 172.21.15.17:0/3510518699 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb0e814ce60 0x7fb0e814d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:30.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.639+0000 7fb0e7fff700 1 -- 172.21.15.17:0/3510518699 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0e814f670 msgr2=0x7fb0e814c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:30.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.639+0000 7fb0e7fff700 1 --2- 172.21.15.17:0/3510518699 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0e814f670 0x7fb0e814c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:30.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.639+0000 7fb0e7fff700 1 -- 172.21.15.17:0/3510518699 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e8155020 con 0x7fb0d00052e0 2023-10-06T04:43:30.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.640+0000 7fb0e7fff700 1 --2- 172.21.15.17:0/3510518699 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0d00052e0 0x7fb0e81540c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb0d800eb00 tx=0x7fb0e80ae4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:30.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.640+0000 7fb0cffff700 1 -- 172.21.15.17:0/3510518699 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d800a550 con 0x7fb0d00052e0 2023-10-06T04:43:30.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.640+0000 7fb0cffff700 1 -- 172.21.15.17:0/3510518699 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d8010040 con 0x7fb0d00052e0 2023-10-06T04:43:30.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.640+0000 7fb0cffff700 1 -- 172.21.15.17:0/3510518699 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d800a8c0 con 0x7fb0d00052e0 2023-10-06T04:43:30.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.640+0000 7fb0ee926700 1 -- 172.21.15.17:0/3510518699 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0e813cf70 con 0x7fb0d00052e0 2023-10-06T04:43:30.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.640+0000 7fb0ee926700 1 -- 172.21.15.17:0/3510518699 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0e8154600 con 0x7fb0d00052e0 2023-10-06T04:43:30.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.641+0000 7fb0ee926700 1 -- 172.21.15.17:0/3510518699 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0e813d190 con 0x7fb0d00052e0 2023-10-06T04:43:30.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.641+0000 7fb0cffff700 1 -- 172.21.15.17:0/3510518699 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb0d800ac30 con 0x7fb0d00052e0 2023-10-06T04:43:30.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.641+0000 7fb0cffff700 1 --2- 172.21.15.17:0/3510518699 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fb0d4066f30 0x7fb0d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:30.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.642+0000 7fb0cffff700 1 -- 172.21.15.17:0/3510518699 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb0d80839c0 con 0x7fb0d00052e0 2023-10-06T04:43:30.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.642+0000 7fb0e77fe700 1 --2- 172.21.15.17:0/3510518699 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fb0d4066f30 0x7fb0d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:30.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.642+0000 7fb0e77fe700 1 --2- 172.21.15.17:0/3510518699 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fb0d4066f30 0x7fb0d40693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8153020 tx=0x7fb0dc007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:30.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.646+0000 7fb0cffff700 1 -- 172.21.15.17:0/3510518699 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb0d804d5a0 con 0x7fb0d00052e0 2023-10-06T04:43:30.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:30.885+0000 7fb0ee926700 1 -- 172.21.15.17:0/3510518699 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb0e81551b0 con 0x7fb0d00052e0 2023-10-06T04:43:31.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.817+0000 7fb0cffff700 1 -- 172.21.15.17:0/3510518699 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb0d8019070 con 0x7fb0d00052e0 2023-10-06T04:43:31.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.820+0000 7fb0ee926700 1 -- 172.21.15.17:0/3510518699 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fb0d4066f30 msgr2=0x7fb0d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:31.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.820+0000 7fb0ee926700 1 --2- 172.21.15.17:0/3510518699 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fb0d4066f30 0x7fb0d40693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8153020 tx=0x7fb0dc007d30 comp rx=0 tx=0).stop 2023-10-06T04:43:31.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.820+0000 7fb0ee926700 1 -- 172.21.15.17:0/3510518699 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0d00052e0 msgr2=0x7fb0e81540c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:31.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.820+0000 7fb0ee926700 1 --2- 172.21.15.17:0/3510518699 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0d00052e0 0x7fb0e81540c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb0d800eb00 tx=0x7fb0e80ae4d0 comp rx=0 tx=0).stop 2023-10-06T04:43:31.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.820+0000 7fb0ee926700 1 -- 172.21.15.17:0/3510518699 shutdown_connections 2023-10-06T04:43:31.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.820+0000 7fb0ee926700 1 --2- 172.21.15.17:0/3510518699 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fb0d4066f30 0x7fb0d40693e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:31.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.820+0000 7fb0ee926700 1 --2- 172.21.15.17:0/3510518699 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb0e814ce60 0x7fb0e814d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:31.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.820+0000 7fb0ee926700 1 --2- 172.21.15.17:0/3510518699 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0d00052e0 0x7fb0e81540c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:31.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.820+0000 7fb0ee926700 1 --2- 172.21.15.17:0/3510518699 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0e814f670 0x7fb0e814c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:31.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.820+0000 7fb0ee926700 1 -- 172.21.15.17:0/3510518699 >> 172.21.15.17:0/3510518699 conn(0x7fb0e80cde20 msgr2=0x7fb0e81554c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:31.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.820+0000 7fb0ee926700 1 -- 172.21.15.17:0/3510518699 shutdown_connections 2023-10-06T04:43:31.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.820+0000 7fb0ee926700 1 -- 172.21.15.17:0/3510518699 wait complete. 2023-10-06T04:43:31.838 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T04:43:31.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.968+0000 7effa223c700 1 Processor -- start 2023-10-06T04:43:31.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.968+0000 7effa223c700 1 -- start start 2023-10-06T04:43:31.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.968+0000 7effa223c700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7eff9c159b10 0x7eff9c06f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:31.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.968+0000 7effa223c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7eff9c06d140 0x7eff9c06f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:31.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.968+0000 7effa223c700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff9c0d1120 con 0x7eff9c0cabf0 2023-10-06T04:43:31.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.968+0000 7effa223c700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff9c0d1400 con 0x7eff9c159b10 2023-10-06T04:43:31.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.968+0000 7effa223c700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c06e920 con 0x7eff9c06d140 2023-10-06T04:43:31.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.968+0000 7eff9affd700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7eff9c159b10 0x7eff9c06f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:31.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.969+0000 7eff9b7fe700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7eff9c0cabf0 0x7eff9c0c7660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:35882/0 (socket says 172.21.15.17:35882) 2023-10-06T04:43:31.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.969+0000 7eff9b7fe700 1 -- 172.21.15.17:0/3804245987 learned_addr learned my addr 172.21.15.17:0/3804245987 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:31.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.969+0000 7eff9bfff700 1 --2- 172.21.15.17:0/3804245987 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7eff9c06d140 0x7eff9c06f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:31.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.969+0000 7eff9affd700 1 -- 172.21.15.17:0/3804245987 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7eff9c06d140 msgr2=0x7eff9c06f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:31.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.969+0000 7eff9affd700 1 --2- 172.21.15.17:0/3804245987 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7eff9c06d140 0x7eff9c06f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:31.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.969+0000 7eff9affd700 1 -- 172.21.15.17:0/3804245987 >> v1:172.21.15.17:6789/0 conn(0x7eff9c0cabf0 legacy=0x7eff9c0c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:31.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.969+0000 7eff9a7fc700 1 -- 172.21.15.17:0/3804245987 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1295624335 0 0) 0x7eff9c0d1120 con 0x7eff9c0cabf0 2023-10-06T04:43:31.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.969+0000 7eff9affd700 1 -- 172.21.15.17:0/3804245987 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff9c06ec00 con 0x7eff9c159b10 2023-10-06T04:43:31.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.969+0000 7eff9bfff700 1 --2- 172.21.15.17:0/3804245987 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7eff9c06d140 0x7eff9c06f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:43:31.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.969+0000 7eff9affd700 1 --2- 172.21.15.17:0/3804245987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff9c159b10 0x7eff9c06f120 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7eff840098e0 tx=0x7eff840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c23ea955b6c70af3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:31.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.969+0000 7eff9a7fc700 1 -- 172.21.15.17:0/3804245987 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff84009e80 con 0x7eff9c159b10 2023-10-06T04:43:31.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.969+0000 7eff9a7fc700 1 -- 172.21.15.17:0/3804245987 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8400b860 con 0x7eff9c159b10 2023-10-06T04:43:31.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.969+0000 7eff9a7fc700 1 -- 172.21.15.17:0/3804245987 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8400bbe0 con 0x7eff9c159b10 2023-10-06T04:43:31.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.970+0000 7effa223c700 1 -- 172.21.15.17:0/3804245987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff9c159b10 msgr2=0x7eff9c06f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:31.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.970+0000 7effa223c700 1 --2- 172.21.15.17:0/3804245987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff9c159b10 0x7eff9c06f120 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7eff840098e0 tx=0x7eff840091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:31.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.970+0000 7effa223c700 1 -- 172.21.15.17:0/3804245987 shutdown_connections 2023-10-06T04:43:31.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.970+0000 7effa223c700 1 --2- 172.21.15.17:0/3804245987 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7eff9c06d140 0x7eff9c06f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:31.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.970+0000 7effa223c700 1 --2- 172.21.15.17:0/3804245987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff9c159b10 0x7eff9c06f120 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:31.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.970+0000 7effa223c700 1 -- 172.21.15.17:0/3804245987 >> 172.21.15.17:0/3804245987 conn(0x7eff9c06cd40 msgr2=0x7eff9c0d0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:31.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.970+0000 7effa223c700 1 -- 172.21.15.17:0/3804245987 shutdown_connections 2023-10-06T04:43:31.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.970+0000 7effa223c700 1 -- 172.21.15.17:0/3804245987 wait complete. 2023-10-06T04:43:31.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.971+0000 7effa223c700 1 Processor -- start 2023-10-06T04:43:31.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.971+0000 7effa223c700 1 -- start start 2023-10-06T04:43:31.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.972+0000 7effa223c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff9c06d140 0x7eff9c09d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:31.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.972+0000 7effa223c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7eff9c0cabf0 0x7eff9c09a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:31.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.972+0000 7effa223c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff9c159b10 0x7eff9c0c67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:31.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.972+0000 7effa223c700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c0c4150 con 0x7eff9c06d140 2023-10-06T04:43:31.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.972+0000 7effa223c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c0c43f0 con 0x7eff9c159b10 2023-10-06T04:43:31.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.972+0000 7effa223c700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c0c46d0 con 0x7eff9c0cabf0 2023-10-06T04:43:31.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.972+0000 7eff9b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff9c06d140 0x7eff9c09d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:31.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.972+0000 7eff9b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff9c06d140 0x7eff9c09d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60864/0 (socket says 172.21.15.17:60864) 2023-10-06T04:43:31.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.972+0000 7eff9b7fe700 1 -- 172.21.15.17:0/3589421445 learned_addr learned my addr 172.21.15.17:0/3589421445 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:31.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.972+0000 7eff9affd700 1 --2- 172.21.15.17:0/3589421445 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7eff9c0cabf0 0x7eff9c09a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:31.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.972+0000 7eff9bfff700 1 --2- 172.21.15.17:0/3589421445 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff9c159b10 0x7eff9c0c67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:31.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.972+0000 7eff9b7fe700 1 -- 172.21.15.17:0/3589421445 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7eff9c0cabf0 msgr2=0x7eff9c09a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:31.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.972+0000 7eff9b7fe700 1 --2- 172.21.15.17:0/3589421445 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7eff9c0cabf0 0x7eff9c09a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:31.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.972+0000 7eff9b7fe700 1 -- 172.21.15.17:0/3589421445 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff9c159b10 msgr2=0x7eff9c0c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:31.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.972+0000 7eff9b7fe700 1 --2- 172.21.15.17:0/3589421445 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff9c159b10 0x7eff9c0c67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:31.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.972+0000 7eff9b7fe700 1 -- 172.21.15.17:0/3589421445 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff84009420 con 0x7eff9c06d140 2023-10-06T04:43:31.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.972+0000 7eff9bfff700 1 --2- 172.21.15.17:0/3589421445 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff9c159b10 0x7eff9c0c67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:43:31.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.972+0000 7eff9b7fe700 1 --2- 172.21.15.17:0/3589421445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff9c06d140 0x7eff9c09d8c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7eff8c00cb60 tx=0x7eff8c0017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:31.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.972+0000 7eff937fe700 1 -- 172.21.15.17:0/3589421445 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c005d80 con 0x7eff9c06d140 2023-10-06T04:43:31.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.973+0000 7eff937fe700 1 -- 172.21.15.17:0/3589421445 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8c00a5a0 con 0x7eff9c06d140 2023-10-06T04:43:31.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.973+0000 7eff937fe700 1 -- 172.21.15.17:0/3589421445 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c00a960 con 0x7eff9c06d140 2023-10-06T04:43:31.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.973+0000 7effa223c700 1 -- 172.21.15.17:0/3589421445 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff9c0c49b0 con 0x7eff9c06d140 2023-10-06T04:43:31.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.973+0000 7effa223c700 1 -- 172.21.15.17:0/3589421445 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff9c156f70 con 0x7eff9c06d140 2023-10-06T04:43:31.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.974+0000 7effa223c700 1 -- 172.21.15.17:0/3589421445 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff9c0c4e50 con 0x7eff9c06d140 2023-10-06T04:43:31.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.974+0000 7eff937fe700 1 -- 172.21.15.17:0/3589421445 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7eff8c00acd0 con 0x7eff9c06d140 2023-10-06T04:43:31.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.974+0000 7eff937fe700 1 --2- 172.21.15.17:0/3589421445 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7eff7c066f30 0x7eff7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:31.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.974+0000 7eff937fe700 1 -- 172.21.15.17:0/3589421445 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7eff8c084150 con 0x7eff9c06d140 2023-10-06T04:43:31.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.974+0000 7eff9affd700 1 --2- 172.21.15.17:0/3589421445 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7eff7c066f30 0x7eff7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:31.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.975+0000 7eff9affd700 1 --2- 172.21.15.17:0/3589421445 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7eff7c066f30 0x7eff7c0693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7eff9c0b3090 tx=0x7eff84017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:31.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:31.979+0000 7eff937fe700 1 -- 172.21.15.17:0/3589421445 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff8c0512e0 con 0x7eff9c06d140 2023-10-06T04:43:32.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.222+0000 7effa223c700 1 -- 172.21.15.17:0/3589421445 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7eff9c071310 con 0x7eff9c06d140 2023-10-06T04:43:32.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.824+0000 7eff937fe700 1 -- 172.21.15.17:0/3589421445 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7eff8c054900 con 0x7eff9c06d140 2023-10-06T04:43:32.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.826+0000 7effa223c700 1 -- 172.21.15.17:0/3589421445 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7eff7c066f30 msgr2=0x7eff7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:32.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.826+0000 7effa223c700 1 --2- 172.21.15.17:0/3589421445 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7eff7c066f30 0x7eff7c0693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7eff9c0b3090 tx=0x7eff84017000 comp rx=0 tx=0).stop 2023-10-06T04:43:32.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.826+0000 7effa223c700 1 -- 172.21.15.17:0/3589421445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff9c06d140 msgr2=0x7eff9c09d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:32.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.826+0000 7effa223c700 1 --2- 172.21.15.17:0/3589421445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff9c06d140 0x7eff9c09d8c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7eff8c00cb60 tx=0x7eff8c0017b0 comp rx=0 tx=0).stop 2023-10-06T04:43:32.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.826+0000 7effa223c700 1 -- 172.21.15.17:0/3589421445 shutdown_connections 2023-10-06T04:43:32.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.826+0000 7effa223c700 1 --2- 172.21.15.17:0/3589421445 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7eff7c066f30 0x7eff7c0693e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:32.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.826+0000 7effa223c700 1 --2- 172.21.15.17:0/3589421445 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff9c159b10 0x7eff9c0c67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:32.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.826+0000 7effa223c700 1 --2- 172.21.15.17:0/3589421445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff9c06d140 0x7eff9c09d8c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:32.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.826+0000 7effa223c700 1 --2- 172.21.15.17:0/3589421445 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7eff9c0cabf0 0x7eff9c09a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:32.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.826+0000 7effa223c700 1 -- 172.21.15.17:0/3589421445 >> 172.21.15.17:0/3589421445 conn(0x7eff9c06cd40 msgr2=0x7eff9c158d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:32.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.826+0000 7effa223c700 1 -- 172.21.15.17:0/3589421445 shutdown_connections 2023-10-06T04:43:32.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.826+0000 7effa223c700 1 -- 172.21.15.17:0/3589421445 wait complete. 2023-10-06T04:43:32.841 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:43:32.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.960+0000 7f4b3aeda700 1 Processor -- start 2023-10-06T04:43:32.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.960+0000 7f4b3aeda700 1 -- start start 2023-10-06T04:43:32.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.961+0000 7f4b3aeda700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4b34159630 0x7f4b340cd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:32.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.961+0000 7f4b3aeda700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f4b340cea10 0x7f4b340b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:32.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.961+0000 7f4b3aeda700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b340cda00 con 0x7f4b340cd590 2023-10-06T04:43:32.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.961+0000 7f4b3aeda700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b340cee90 con 0x7f4b34159630 2023-10-06T04:43:32.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.961+0000 7f4b3aeda700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b340cfc80 con 0x7f4b340cea10 2023-10-06T04:43:32.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.961+0000 7f4b38c76700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4b34159630 0x7f4b340cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:32.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.961+0000 7f4b38c76700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4b34159630 0x7f4b340cd050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60876/0 (socket says 172.21.15.17:60876) 2023-10-06T04:43:32.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.961+0000 7f4b38c76700 1 -- 172.21.15.17:0/1242747801 learned_addr learned my addr 172.21.15.17:0/1242747801 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:32.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.962+0000 7f4b39477700 1 --2- 172.21.15.17:0/1242747801 >> v2:172.21.15.136:3300/0 conn(0x7f4b340cea10 0x7f4b340b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:32.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.962+0000 7f4b38c76700 1 -- 172.21.15.17:0/1242747801 >> v2:172.21.15.136:3300/0 conn(0x7f4b340cea10 msgr2=0x7f4b340b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:32.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.962+0000 7f4b38c76700 1 --2- 172.21.15.17:0/1242747801 >> v2:172.21.15.136:3300/0 conn(0x7f4b340cea10 0x7f4b340b02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:32.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.962+0000 7f4b38c76700 1 -- 172.21.15.17:0/1242747801 >> v1:172.21.15.136:6789/0 conn(0x7f4b340cd590 legacy=0x7f4b340ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:32.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.962+0000 7f4b38c76700 1 -- 172.21.15.17:0/1242747801 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b340cf070 con 0x7f4b34159630 2023-10-06T04:43:32.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.962+0000 7f4b39477700 1 --2- 172.21.15.17:0/1242747801 >> v2:172.21.15.136:3300/0 conn(0x7f4b340cea10 0x7f4b340b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:43:32.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.962+0000 7f4b38c76700 1 --2- 172.21.15.17:0/1242747801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b34159630 0x7f4b340cd050 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4b340b00a0 tx=0x7f4b2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc0c20e6105b4ace server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:32.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.962+0000 7f4b337fe700 1 -- 172.21.15.17:0/1242747801 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c00b820 con 0x7f4b34159630 2023-10-06T04:43:32.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.962+0000 7f4b337fe700 1 -- 172.21.15.17:0/1242747801 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2c00b980 con 0x7f4b34159630 2023-10-06T04:43:32.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.962+0000 7f4b337fe700 1 -- 172.21.15.17:0/1242747801 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c00bd20 con 0x7f4b34159630 2023-10-06T04:43:32.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.962+0000 7f4b3aeda700 1 -- 172.21.15.17:0/1242747801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b34159630 msgr2=0x7f4b340cd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:32.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.962+0000 7f4b3aeda700 1 --2- 172.21.15.17:0/1242747801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b34159630 0x7f4b340cd050 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4b340b00a0 tx=0x7f4b2c009250 comp rx=0 tx=0).stop 2023-10-06T04:43:32.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.962+0000 7f4b3aeda700 1 -- 172.21.15.17:0/1242747801 shutdown_connections 2023-10-06T04:43:32.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.962+0000 7f4b3aeda700 1 --2- 172.21.15.17:0/1242747801 >> v2:172.21.15.136:3300/0 conn(0x7f4b340cea10 0x7f4b340b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:32.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.962+0000 7f4b3aeda700 1 --2- 172.21.15.17:0/1242747801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b34159630 0x7f4b340cd050 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:32.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.962+0000 7f4b3aeda700 1 -- 172.21.15.17:0/1242747801 >> 172.21.15.17:0/1242747801 conn(0x7f4b3406cff0 msgr2=0x7f4b3406d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:32.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.963+0000 7f4b3aeda700 1 -- 172.21.15.17:0/1242747801 shutdown_connections 2023-10-06T04:43:32.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.963+0000 7f4b3aeda700 1 -- 172.21.15.17:0/1242747801 wait complete. 2023-10-06T04:43:32.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.964+0000 7f4b3aeda700 1 Processor -- start 2023-10-06T04:43:32.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.964+0000 7f4b3aeda700 1 -- start start 2023-10-06T04:43:32.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.964+0000 7f4b3aeda700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b340cd590 0x7f4b340af920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:32.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.964+0000 7f4b3aeda700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b340cea10 0x7f4b3416b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:32.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.964+0000 7f4b3aeda700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4b34159630 0x7f4b341575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:32.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.964+0000 7f4b3aeda700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b340c8f70 con 0x7f4b340cd590 2023-10-06T04:43:32.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.964+0000 7f4b3aeda700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b340c9af0 con 0x7f4b340cea10 2023-10-06T04:43:32.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.964+0000 7f4b3aeda700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b340c91c0 con 0x7f4b34159630 2023-10-06T04:43:32.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.965+0000 7f4b38c76700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b340cd590 0x7f4b340af920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:32.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.965+0000 7f4b38c76700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b340cd590 0x7f4b340af920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60890/0 (socket says 172.21.15.17:60890) 2023-10-06T04:43:32.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.965+0000 7f4b38c76700 1 -- 172.21.15.17:0/161022715 learned_addr learned my addr 172.21.15.17:0/161022715 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:32.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.965+0000 7f4b38c76700 1 -- 172.21.15.17:0/161022715 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4b34159630 msgr2=0x7f4b341575f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:32.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.965+0000 7f4b38c76700 1 --2- 172.21.15.17:0/161022715 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4b34159630 0x7f4b341575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:32.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.965+0000 7f4b38c76700 1 -- 172.21.15.17:0/161022715 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b340cea10 msgr2=0x7f4b3416b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:32.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.965+0000 7f4b33fff700 1 --2- 172.21.15.17:0/161022715 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b340cea10 0x7f4b3416b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:32.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.965+0000 7f4b38c76700 1 --2- 172.21.15.17:0/161022715 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b340cea10 0x7f4b3416b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:32.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.965+0000 7f4b38c76700 1 -- 172.21.15.17:0/161022715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2c0094f0 con 0x7f4b340cd590 2023-10-06T04:43:32.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.965+0000 7f4b38c76700 1 --2- 172.21.15.17:0/161022715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b340cd590 0x7f4b340af920 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4b340d16b0 tx=0x7f4b2c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:32.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.965+0000 7f4b30ff9700 1 -- 172.21.15.17:0/161022715 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c011de0 con 0x7f4b340cd590 2023-10-06T04:43:32.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.965+0000 7f4b30ff9700 1 -- 172.21.15.17:0/161022715 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2c020070 con 0x7f4b340cd590 2023-10-06T04:43:32.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.965+0000 7f4b3aeda700 1 -- 172.21.15.17:0/161022715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b340c94a0 con 0x7f4b340cd590 2023-10-06T04:43:32.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.965+0000 7f4b30ff9700 1 -- 172.21.15.17:0/161022715 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c01b6a0 con 0x7f4b340cd590 2023-10-06T04:43:32.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.965+0000 7f4b3aeda700 1 -- 172.21.15.17:0/161022715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b340afe60 con 0x7f4b340cd590 2023-10-06T04:43:32.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.966+0000 7f4b3aeda700 1 -- 172.21.15.17:0/161022715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b34063ff0 con 0x7f4b340cd590 2023-10-06T04:43:32.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.967+0000 7f4b30ff9700 1 -- 172.21.15.17:0/161022715 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b2c022030 con 0x7f4b340cd590 2023-10-06T04:43:32.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.967+0000 7f4b30ff9700 1 --2- 172.21.15.17:0/161022715 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f4b14066f30 0x7f4b140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:32.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.967+0000 7f4b30ff9700 1 -- 172.21.15.17:0/161022715 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4b2c086620 con 0x7f4b340cd590 2023-10-06T04:43:32.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.967+0000 7f4b33fff700 1 --2- 172.21.15.17:0/161022715 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f4b14066f30 0x7f4b140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:32.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.967+0000 7f4b33fff700 1 --2- 172.21.15.17:0/161022715 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f4b14066f30 0x7f4b140693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4b24007fd0 tx=0x7f4b24009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:32.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:32.971+0000 7f4b30ff9700 1 -- 172.21.15.17:0/161022715 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b2c053730 con 0x7f4b340cd590 2023-10-06T04:43:33.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.210+0000 7f4b3aeda700 1 -- 172.21.15.17:0/161022715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4b34063ff0 con 0x7f4b340cd590 2023-10-06T04:43:33.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.211+0000 7f4b30ff9700 1 -- 172.21.15.17:0/161022715 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f4b2c056d50 con 0x7f4b340cd590 2023-10-06T04:43:33.213 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:43:33.213 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/3001699743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3001699743},{"type":"v1","addr":"172.21.15.136:6833","nonce":3001699743}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/1891609455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1891609455},{"type":"v1","addr":"172.21.15.17:6835","nonce":1891609455}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/2697752124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":2697752124},{"type":"v1","addr":"172.21.15.17:6837","nonce":2697752124}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:43:29.199801+0000","modified":"2023-10-06T04:43:32.817081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6835/1496795591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":1496795591},{"type":"v1","addr":"172.21.15.136:6835","nonce":1496795591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:43:33.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.213+0000 7f4b3aeda700 1 -- 172.21.15.17:0/161022715 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f4b14066f30 msgr2=0x7f4b140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:33.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.213+0000 7f4b3aeda700 1 --2- 172.21.15.17:0/161022715 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f4b14066f30 0x7f4b140693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4b24007fd0 tx=0x7f4b24009040 comp rx=0 tx=0).stop 2023-10-06T04:43:33.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.213+0000 7f4b3aeda700 1 -- 172.21.15.17:0/161022715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b340cd590 msgr2=0x7f4b340af920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:33.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.213+0000 7f4b3aeda700 1 --2- 172.21.15.17:0/161022715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b340cd590 0x7f4b340af920 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4b340d16b0 tx=0x7f4b2c016000 comp rx=0 tx=0).stop 2023-10-06T04:43:33.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.213+0000 7f4b3aeda700 1 -- 172.21.15.17:0/161022715 shutdown_connections 2023-10-06T04:43:33.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.213+0000 7f4b3aeda700 1 --2- 172.21.15.17:0/161022715 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f4b14066f30 0x7f4b140693e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:33.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.213+0000 7f4b3aeda700 1 --2- 172.21.15.17:0/161022715 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4b34159630 0x7f4b341575f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:33.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.213+0000 7f4b3aeda700 1 --2- 172.21.15.17:0/161022715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b340cd590 0x7f4b340af920 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:33.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.213+0000 7f4b3aeda700 1 --2- 172.21.15.17:0/161022715 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b340cea10 0x7f4b3416b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:33.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.213+0000 7f4b3aeda700 1 -- 172.21.15.17:0/161022715 >> 172.21.15.17:0/161022715 conn(0x7f4b3406cff0 msgr2=0x7f4b340b24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:33.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.213+0000 7f4b3aeda700 1 -- 172.21.15.17:0/161022715 shutdown_connections 2023-10-06T04:43:33.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.213+0000 7f4b3aeda700 1 -- 172.21.15.17:0/161022715 wait complete. 2023-10-06T04:43:33.216 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 7 2023-10-06T04:43:33.227 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:43:33.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.343+0000 7fbe63128700 1 Processor -- start 2023-10-06T04:43:33.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.343+0000 7fbe63128700 1 -- start start 2023-10-06T04:43:33.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.344+0000 7fbe63128700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbe5c0cd760 0x7fbe5c0ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:33.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.344+0000 7fbe63128700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fbe5c0ce840 0x7fbe5c0b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:33.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.344+0000 7fbe63128700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe5c0cfc80 con 0x7fbe5c159630 2023-10-06T04:43:33.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.344+0000 7fbe63128700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe5c0cf070 con 0x7fbe5c0cd760 2023-10-06T04:43:33.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.344+0000 7fbe63128700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe5c0cf350 con 0x7fbe5c0ce840 2023-10-06T04:43:33.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.344+0000 7fbe5bfff700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbe5c0cd760 0x7fbe5c0ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:33.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.344+0000 7fbe5bfff700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbe5c0cd760 0x7fbe5c0ce300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60892/0 (socket says 172.21.15.17:60892) 2023-10-06T04:43:33.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.344+0000 7fbe5bfff700 1 -- 172.21.15.17:0/3316620446 learned_addr learned my addr 172.21.15.17:0/3316620446 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:33.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.344+0000 7fbe616c5700 1 --2- 172.21.15.17:0/3316620446 >> v2:172.21.15.136:3300/0 conn(0x7fbe5c0ce840 0x7fbe5c0b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:33.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.344+0000 7fbe5bfff700 1 -- 172.21.15.17:0/3316620446 >> v2:172.21.15.136:3300/0 conn(0x7fbe5c0ce840 msgr2=0x7fbe5c0b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:33.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.344+0000 7fbe5bfff700 1 --2- 172.21.15.17:0/3316620446 >> v2:172.21.15.136:3300/0 conn(0x7fbe5c0ce840 0x7fbe5c0b02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:33.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.344+0000 7fbe5bfff700 1 -- 172.21.15.17:0/3316620446 >> v1:172.21.15.136:6789/0 conn(0x7fbe5c159630 legacy=0x7fbe5c0cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:33.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.344+0000 7fbe5bfff700 1 -- 172.21.15.17:0/3316620446 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5c0cf630 con 0x7fbe5c0cd760 2023-10-06T04:43:33.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.345+0000 7fbe5bfff700 1 --2- 172.21.15.17:0/3316620446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe5c0cd760 0x7fbe5c0ce300 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c06eee0 tx=0x7fbe44009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23e30fc790b64e47 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:33.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.345+0000 7fbe5b7fe700 1 -- 172.21.15.17:0/3316620446 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe44009e70 con 0x7fbe5c0cd760 2023-10-06T04:43:33.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.345+0000 7fbe5b7fe700 1 -- 172.21.15.17:0/3316620446 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4400b860 con 0x7fbe5c0cd760 2023-10-06T04:43:33.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.345+0000 7fbe5b7fe700 1 -- 172.21.15.17:0/3316620446 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4400bc00 con 0x7fbe5c0cd760 2023-10-06T04:43:33.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.345+0000 7fbe63128700 1 -- 172.21.15.17:0/3316620446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe5c0cd760 msgr2=0x7fbe5c0ce300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:33.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.345+0000 7fbe63128700 1 --2- 172.21.15.17:0/3316620446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe5c0cd760 0x7fbe5c0ce300 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c06eee0 tx=0x7fbe44009250 comp rx=0 tx=0).stop 2023-10-06T04:43:33.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.345+0000 7fbe63128700 1 -- 172.21.15.17:0/3316620446 shutdown_connections 2023-10-06T04:43:33.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.345+0000 7fbe63128700 1 --2- 172.21.15.17:0/3316620446 >> v2:172.21.15.136:3300/0 conn(0x7fbe5c0ce840 0x7fbe5c0b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:33.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.345+0000 7fbe63128700 1 --2- 172.21.15.17:0/3316620446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe5c0cd760 0x7fbe5c0ce300 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:33.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.345+0000 7fbe63128700 1 -- 172.21.15.17:0/3316620446 >> 172.21.15.17:0/3316620446 conn(0x7fbe5c06cff0 msgr2=0x7fbe5c06d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:33.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.345+0000 7fbe63128700 1 -- 172.21.15.17:0/3316620446 shutdown_connections 2023-10-06T04:43:33.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.345+0000 7fbe63128700 1 -- 172.21.15.17:0/3316620446 wait complete. 2023-10-06T04:43:33.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.346+0000 7fbe63128700 1 Processor -- start 2023-10-06T04:43:33.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.347+0000 7fbe63128700 1 -- start start 2023-10-06T04:43:33.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.347+0000 7fbe63128700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbe5c0cd760 0x7fbe5c150640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:33.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.347+0000 7fbe63128700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe5c0ce840 0x7fbe5c15a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:33.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.347+0000 7fbe63128700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbe5c159630 0x7fbe5c0b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:33.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.347+0000 7fbe63128700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c15b890 con 0x7fbe5c0ce840 2023-10-06T04:43:33.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.347+0000 7fbe63128700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c150c60 con 0x7fbe5c0cd760 2023-10-06T04:43:33.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.347+0000 7fbe63128700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c150f40 con 0x7fbe5c159630 2023-10-06T04:43:33.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.347+0000 7fbe5bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe5c0ce840 0x7fbe5c15a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:33.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.347+0000 7fbe5bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe5c0ce840 0x7fbe5c15a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60900/0 (socket says 172.21.15.17:60900) 2023-10-06T04:43:33.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.347+0000 7fbe5bfff700 1 -- 172.21.15.17:0/257677196 learned_addr learned my addr 172.21.15.17:0/257677196 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:33.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.348+0000 7fbe60ec4700 1 --2- 172.21.15.17:0/257677196 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbe5c0cd760 0x7fbe5c150640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:33.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.348+0000 7fbe616c5700 1 --2- 172.21.15.17:0/257677196 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbe5c159630 0x7fbe5c0b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:33.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.348+0000 7fbe5bfff700 1 -- 172.21.15.17:0/257677196 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbe5c159630 msgr2=0x7fbe5c0b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:33.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.348+0000 7fbe5bfff700 1 --2- 172.21.15.17:0/257677196 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbe5c159630 0x7fbe5c0b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:33.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.348+0000 7fbe5bfff700 1 -- 172.21.15.17:0/257677196 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbe5c0cd760 msgr2=0x7fbe5c150640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:33.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.348+0000 7fbe5bfff700 1 --2- 172.21.15.17:0/257677196 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbe5c0cd760 0x7fbe5c150640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:33.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.348+0000 7fbe5bfff700 1 -- 172.21.15.17:0/257677196 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe440094f0 con 0x7fbe5c0ce840 2023-10-06T04:43:33.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.348+0000 7fbe5bfff700 1 --2- 172.21.15.17:0/257677196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe5c0ce840 0x7fbe5c15a450 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c0d16b0 tx=0x7fbe44017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:33.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.348+0000 7fbe58ff9700 1 -- 172.21.15.17:0/257677196 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4400b9d0 con 0x7fbe5c0ce840 2023-10-06T04:43:33.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.348+0000 7fbe58ff9700 1 -- 172.21.15.17:0/257677196 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4400bb50 con 0x7fbe5c0ce840 2023-10-06T04:43:33.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.348+0000 7fbe63128700 1 -- 172.21.15.17:0/257677196 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe5c151220 con 0x7fbe5c0ce840 2023-10-06T04:43:33.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.348+0000 7fbe58ff9700 1 -- 172.21.15.17:0/257677196 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe44025670 con 0x7fbe5c0ce840 2023-10-06T04:43:33.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.348+0000 7fbe63128700 1 -- 172.21.15.17:0/257677196 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe5c1517e0 con 0x7fbe5c0ce840 2023-10-06T04:43:33.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.349+0000 7fbe63128700 1 -- 172.21.15.17:0/257677196 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe5c152f70 con 0x7fbe5c0ce840 2023-10-06T04:43:33.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.349+0000 7fbe58ff9700 1 -- 172.21.15.17:0/257677196 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbe44023070 con 0x7fbe5c0ce840 2023-10-06T04:43:33.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.350+0000 7fbe58ff9700 1 --2- 172.21.15.17:0/257677196 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fbe3c066f30 0x7fbe3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:33.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.350+0000 7fbe58ff9700 1 -- 172.21.15.17:0/257677196 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbe44085dd0 con 0x7fbe5c0ce840 2023-10-06T04:43:33.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.350+0000 7fbe60ec4700 1 --2- 172.21.15.17:0/257677196 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fbe3c066f30 0x7fbe3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:33.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.350+0000 7fbe60ec4700 1 --2- 172.21.15.17:0/257677196 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fbe3c066f30 0x7fbe3c0693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c003880 tx=0x7fbe4c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:33.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.354+0000 7fbe58ff9700 1 -- 172.21.15.17:0/257677196 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbe44052e40 con 0x7fbe5c0ce840 2023-10-06T04:43:33.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.552+0000 7fbe63128700 1 -- 172.21.15.17:0/257677196 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe5c063ff0 con 0x7fbe5c0ce840 2023-10-06T04:43:33.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.552+0000 7fbe58ff9700 1 -- 172.21.15.17:0/257677196 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16866 (secure 0 0 0) 0x7fbe44015090 con 0x7fbe5c0ce840 2023-10-06T04:43:33.554 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:43:33.555 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":21,"fsid":"780777c4-2b25-4d35-9058-c9f2d62e3ad9","created":"2023-10-06T04:43:10.578520+0000","modified":"2023-10-06T04:43:30.789916+0000","last_up_change":"2023-10-06T04:43:20.682958+0000","last_in_change":"2023-10-06T04:43:12.978917+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:43:21.795733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:43:22.389592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:43:26.914728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:43:28.173678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"84737b08-575c-46dd-9488-073ae8504494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6809","nonce":90656},{"type":"v1","addr":"172.21.15.17:6811","nonce":90656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":90656},{"type":"v1","addr":"172.21.15.17:6814","nonce":90656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":90656},{"type":"v1","addr":"172.21.15.17:6822","nonce":90656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":90656},{"type":"v1","addr":"172.21.15.17:6818","nonce":90656}]},"public_addr":"172.21.15.17:6811/90656","cluster_addr":"172.21.15.17:6814/90656","heartbeat_back_addr":"172.21.15.17:6822/90656","heartbeat_front_addr":"172.21.15.17:6818/90656","state":["exists","up"]},{"osd":1,"uuid":"dffeb740-58a2-4fd6-8ff1-a0a11a2cc709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":90655},{"type":"v1","addr":"172.21.15.17:6801","nonce":90655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":90655},{"type":"v1","addr":"172.21.15.17:6803","nonce":90655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":90655},{"type":"v1","addr":"172.21.15.17:6807","nonce":90655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":90655},{"type":"v1","addr":"172.21.15.17:6805","nonce":90655}]},"public_addr":"172.21.15.17:6801/90655","cluster_addr":"172.21.15.17:6803/90655","heartbeat_back_addr":"172.21.15.17:6807/90655","heartbeat_front_addr":"172.21.15.17:6805/90655","state":["exists","up"]},{"osd":2,"uuid":"48bd6831-763d-48c2-b515-e02c216d608b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":90657},{"type":"v1","addr":"172.21.15.17:6810","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":90657},{"type":"v1","addr":"172.21.15.17:6815","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":90657},{"type":"v1","addr":"172.21.15.17:6823","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":90657},{"type":"v1","addr":"172.21.15.17:6819","nonce":90657}]},"public_addr":"172.21.15.17:6810/90657","cluster_addr":"172.21.15.17:6815/90657","heartbeat_back_addr":"172.21.15.17:6823/90657","heartbeat_front_addr":"172.21.15.17:6819/90657","state":["exists","up"]},{"osd":3,"uuid":"ae7dbb23-abe7-4bd3-a4df-6f5963d6804c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":90688},{"type":"v1","addr":"172.21.15.17:6825","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":90688},{"type":"v1","addr":"172.21.15.17:6827","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":90688},{"type":"v1","addr":"172.21.15.17:6831","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":90688},{"type":"v1","addr":"172.21.15.17:6829","nonce":90688}]},"public_addr":"172.21.15.17:6825/90688","cluster_addr":"172.21.15.17:6827/90688","heartbeat_back_addr":"172.21.15.17:6831/90688","heartbeat_front_addr":"172.21.15.17:6829/90688","state":["exists","up"]},{"osd":4,"uuid":"29991fb4-1667-4ea3-aca0-d55db27f3bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":90902},{"type":"v1","addr":"172.21.15.136:6801","nonce":90902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":90902},{"type":"v1","addr":"172.21.15.136:6803","nonce":90902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":90902},{"type":"v1","addr":"172.21.15.136:6807","nonce":90902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":90902},{"type":"v1","addr":"172.21.15.136:6805","nonce":90902}]},"public_addr":"172.21.15.136:6801/90902","cluster_addr":"172.21.15.136:6803/90902","heartbeat_back_addr":"172.21.15.136:6807/90902","heartbeat_front_addr":"172.21.15.136:6805/90902","state":["exists","up"]},{"osd":5,"uuid":"398b4ff9-03fc-421f-882c-ba12aa088eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":90901},{"type":"v1","addr":"172.21.15.136:6809","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":90901},{"type":"v1","addr":"172.21.15.136:6811","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":90901},{"type":"v1","addr":"172.21.15.136:6815","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":90901},{"type":"v1","addr":"172.21.15.136:6813","nonce":90901}]},"public_addr":"172.21.15.136:6809/90901","cluster_addr":"172.21.15.136:6811/90901","heartbeat_back_addr":"172.21.15.136:6815/90901","heartbeat_front_addr":"172.21.15.136:6813/90901","state":["exists","up"]},{"osd":6,"uuid":"1bb91a72-4dab-4cdb-aa1d-2b8a9edf1ad0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":90927},{"type":"v1","addr":"172.21.15.136:6825","nonce":90927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":90927},{"type":"v1","addr":"172.21.15.136:6827","nonce":90927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":90927},{"type":"v1","addr":"172.21.15.136:6831","nonce":90927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":90927},{"type":"v1","addr":"172.21.15.136:6829","nonce":90927}]},"public_addr":"172.21.15.136:6825/90927","cluster_addr":"172.21.15.136:6827/90927","heartbeat_back_addr":"172.21.15.136:6831/90927","heartbeat_front_addr":"172.21.15.136:6829/90927","state":["exists","up"]},{"osd":7,"uuid":"719b654e-010d-4aa4-8c13-83fdde242b47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":90934},{"type":"v1","addr":"172.21.15.136:6817","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":90934},{"type":"v1","addr":"172.21.15.136:6819","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":90934},{"type":"v1","addr":"172.21.15.136:6824","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":90934},{"type":"v1","addr":"172.21.15.136:6821","nonce":90934}]},"public_addr":"172.21.15.136:6817/90934","cluster_addr":"172.21.15.136:6819/90934","heartbeat_back_addr":"172.21.15.136:6824/90934","heartbeat_front_addr":"172.21.15.136:6821/90934","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.157479+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.140520+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.190743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.231396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.156510+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.145822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.202888+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.139532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:43:33.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.555+0000 7fbe63128700 1 -- 172.21.15.17:0/257677196 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fbe3c066f30 msgr2=0x7fbe3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:33.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.555+0000 7fbe63128700 1 --2- 172.21.15.17:0/257677196 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fbe3c066f30 0x7fbe3c0693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c003880 tx=0x7fbe4c009040 comp rx=0 tx=0).stop 2023-10-06T04:43:33.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.555+0000 7fbe63128700 1 -- 172.21.15.17:0/257677196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe5c0ce840 msgr2=0x7fbe5c15a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:33.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.555+0000 7fbe63128700 1 --2- 172.21.15.17:0/257677196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe5c0ce840 0x7fbe5c15a450 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c0d16b0 tx=0x7fbe44017000 comp rx=0 tx=0).stop 2023-10-06T04:43:33.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.555+0000 7fbe63128700 1 -- 172.21.15.17:0/257677196 shutdown_connections 2023-10-06T04:43:33.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.555+0000 7fbe63128700 1 --2- 172.21.15.17:0/257677196 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fbe3c066f30 0x7fbe3c0693e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:33.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.555+0000 7fbe63128700 1 --2- 172.21.15.17:0/257677196 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbe5c159630 0x7fbe5c0b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:33.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.555+0000 7fbe63128700 1 --2- 172.21.15.17:0/257677196 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbe5c0cd760 0x7fbe5c150640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:33.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.555+0000 7fbe63128700 1 --2- 172.21.15.17:0/257677196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe5c0ce840 0x7fbe5c15a450 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:33.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.555+0000 7fbe63128700 1 -- 172.21.15.17:0/257677196 >> 172.21.15.17:0/257677196 conn(0x7fbe5c06cff0 msgr2=0x7fbe5c15fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:33.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.555+0000 7fbe63128700 1 -- 172.21.15.17:0/257677196 shutdown_connections 2023-10-06T04:43:33.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.555+0000 7fbe63128700 1 -- 172.21.15.17:0/257677196 wait complete. 2023-10-06T04:43:33.569 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T04:43:33.569 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:43:33.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.686+0000 7f3c60cd8700 1 Processor -- start 2023-10-06T04:43:33.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.686+0000 7f3c60cd8700 1 -- start start 2023-10-06T04:43:33.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.687+0000 7f3c60cd8700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3c5c0ccfc0 0x7f3c5c0cc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:33.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.687+0000 7f3c60cd8700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3c5c0cf3b0 0x7f3c5c1594a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:33.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.687+0000 7f3c60cd8700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c5c0cbd80 con 0x7f3c5c0cc750 2023-10-06T04:43:33.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.687+0000 7f3c60cd8700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c5c0af5f0 con 0x7f3c5c0ccfc0 2023-10-06T04:43:33.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.687+0000 7f3c60cd8700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c0af8d0 con 0x7f3c5c0cf3b0 2023-10-06T04:43:33.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.687+0000 7f3c5bfff700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f3c5c0cc750 0x7f3c5c0b0460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:35886/0 (socket says 172.21.15.17:35886) 2023-10-06T04:43:33.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.687+0000 7f3c5b7fe700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3c5c0ccfc0 0x7f3c5c0cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:33.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.687+0000 7f3c5bfff700 1 -- 172.21.15.17:0/1392855772 learned_addr learned my addr 172.21.15.17:0/1392855772 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:33.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.687+0000 7f3c5affd700 1 --2- 172.21.15.17:0/1392855772 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3c5c0cf3b0 0x7f3c5c1594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:33.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.687+0000 7f3c5a7fc700 1 -- 172.21.15.17:0/1392855772 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3921488486 0 0) 0x7f3c5c0cbd80 con 0x7f3c5c0cc750 2023-10-06T04:43:33.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.687+0000 7f3c5a7fc700 1 -- 172.21.15.17:0/1392855772 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c44003570 con 0x7f3c5c0cc750 2023-10-06T04:43:33.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.687+0000 7f3c5b7fe700 1 -- 172.21.15.17:0/1392855772 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3c5c0cf3b0 msgr2=0x7f3c5c1594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:33.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.687+0000 7f3c5b7fe700 1 --2- 172.21.15.17:0/1392855772 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3c5c0cf3b0 0x7f3c5c1594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:33.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.687+0000 7f3c5b7fe700 1 -- 172.21.15.17:0/1392855772 >> v1:172.21.15.17:6789/0 conn(0x7f3c5c0cc750 legacy=0x7f3c5c0b0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:33.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.687+0000 7f3c5b7fe700 1 -- 172.21.15.17:0/1392855772 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5c0afbb0 con 0x7f3c5c0ccfc0 2023-10-06T04:43:33.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.688+0000 7f3c5b7fe700 1 --2- 172.21.15.17:0/1392855772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c5c0ccfc0 0x7f3c5c0cc210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c0098e0 tx=0x7f3c4c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40f10b6e9e8822a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:33.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.688+0000 7f3c5a7fc700 1 -- 172.21.15.17:0/1392855772 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c011630 con 0x7f3c5c0ccfc0 2023-10-06T04:43:33.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.688+0000 7f3c5a7fc700 1 -- 172.21.15.17:0/1392855772 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4c011790 con 0x7f3c5c0ccfc0 2023-10-06T04:43:33.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.688+0000 7f3c5a7fc700 1 -- 172.21.15.17:0/1392855772 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c011b30 con 0x7f3c5c0ccfc0 2023-10-06T04:43:33.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.688+0000 7f3c60cd8700 1 -- 172.21.15.17:0/1392855772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c5c0ccfc0 msgr2=0x7f3c5c0cc210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:33.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.688+0000 7f3c60cd8700 1 --2- 172.21.15.17:0/1392855772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c5c0ccfc0 0x7f3c5c0cc210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c0098e0 tx=0x7f3c4c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:33.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.688+0000 7f3c60cd8700 1 -- 172.21.15.17:0/1392855772 shutdown_connections 2023-10-06T04:43:33.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.688+0000 7f3c60cd8700 1 --2- 172.21.15.17:0/1392855772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c5c0ccfc0 0x7f3c5c0cc210 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:33.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.688+0000 7f3c60cd8700 1 --2- 172.21.15.17:0/1392855772 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3c5c0cf3b0 0x7f3c5c1594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:33.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.688+0000 7f3c60cd8700 1 -- 172.21.15.17:0/1392855772 >> 172.21.15.17:0/1392855772 conn(0x7f3c5c06cff0 msgr2=0x7f3c5c06da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:33.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.688+0000 7f3c60cd8700 1 -- 172.21.15.17:0/1392855772 shutdown_connections 2023-10-06T04:43:33.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.688+0000 7f3c60cd8700 1 -- 172.21.15.17:0/1392855772 wait complete. 2023-10-06T04:43:33.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.689+0000 7f3c60cd8700 1 Processor -- start 2023-10-06T04:43:33.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.690+0000 7f3c60cd8700 1 -- start start 2023-10-06T04:43:33.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.690+0000 7f3c60cd8700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c5c0cc750 0x7f3c5c0c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:33.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.690+0000 7f3c60cd8700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c5c0ccfc0 0x7f3c5c155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:33.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.690+0000 7f3c60cd8700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3c5c0c9090 0x7f3c5c0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:33.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.690+0000 7f3c60cd8700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c152950 con 0x7f3c5c0ccfc0 2023-10-06T04:43:33.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.690+0000 7f3c60cd8700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c0c8500 con 0x7f3c5c0cc750 2023-10-06T04:43:33.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.690+0000 7f3c60cd8700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c0c95e0 con 0x7f3c5c0c9090 2023-10-06T04:43:33.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.690+0000 7f3c5affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c5c0ccfc0 0x7f3c5c155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:33.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.690+0000 7f3c5affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c5c0ccfc0 0x7f3c5c155160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60918/0 (socket says 172.21.15.17:60918) 2023-10-06T04:43:33.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.690+0000 7f3c5affd700 1 -- 172.21.15.17:0/3473912190 learned_addr learned my addr 172.21.15.17:0/3473912190 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:33.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.690+0000 7f3c5b7fe700 1 --2- 172.21.15.17:0/3473912190 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c5c0cc750 0x7f3c5c0c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:33.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.690+0000 7f3c5bfff700 1 --2- 172.21.15.17:0/3473912190 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3c5c0c9090 0x7f3c5c0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:33.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.691+0000 7f3c5affd700 1 -- 172.21.15.17:0/3473912190 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3c5c0c9090 msgr2=0x7f3c5c0b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:33.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.691+0000 7f3c5affd700 1 --2- 172.21.15.17:0/3473912190 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3c5c0c9090 0x7f3c5c0b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:33.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.691+0000 7f3c5affd700 1 -- 172.21.15.17:0/3473912190 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c5c0cc750 msgr2=0x7f3c5c0c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:33.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.691+0000 7f3c5affd700 1 --2- 172.21.15.17:0/3473912190 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c5c0cc750 0x7f3c5c0c7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:33.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.691+0000 7f3c5affd700 1 -- 172.21.15.17:0/3473912190 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c4c009420 con 0x7f3c5c0ccfc0 2023-10-06T04:43:33.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.691+0000 7f3c5affd700 1 --2- 172.21.15.17:0/3473912190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c5c0ccfc0 0x7f3c5c155160 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3c5000ec50 tx=0x7f3c500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:33.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.691+0000 7f3c437fe700 1 -- 172.21.15.17:0/3473912190 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5000c9d0 con 0x7f3c5c0ccfc0 2023-10-06T04:43:33.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.691+0000 7f3c437fe700 1 -- 172.21.15.17:0/3473912190 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5000cb30 con 0x7f3c5c0ccfc0 2023-10-06T04:43:33.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.691+0000 7f3c60cd8700 1 -- 172.21.15.17:0/3473912190 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c5c0c98c0 con 0x7f3c5c0ccfc0 2023-10-06T04:43:33.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.691+0000 7f3c437fe700 1 -- 172.21.15.17:0/3473912190 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c50013470 con 0x7f3c5c0ccfc0 2023-10-06T04:43:33.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.691+0000 7f3c60cd8700 1 -- 172.21.15.17:0/3473912190 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c5c0c9e80 con 0x7f3c5c0ccfc0 2023-10-06T04:43:33.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.692+0000 7f3c60cd8700 1 -- 172.21.15.17:0/3473912190 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c5c04c380 con 0x7f3c5c0ccfc0 2023-10-06T04:43:33.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.692+0000 7f3c437fe700 1 -- 172.21.15.17:0/3473912190 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3c50013820 con 0x7f3c5c0ccfc0 2023-10-06T04:43:33.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.693+0000 7f3c437fe700 1 --2- 172.21.15.17:0/3473912190 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3c48066f30 0x7f3c480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:33.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.693+0000 7f3c437fe700 1 -- 172.21.15.17:0/3473912190 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3c50084800 con 0x7f3c5c0ccfc0 2023-10-06T04:43:33.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.693+0000 7f3c5b7fe700 1 --2- 172.21.15.17:0/3473912190 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3c48066f30 0x7f3c480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:33.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.693+0000 7f3c5b7fe700 1 --2- 172.21.15.17:0/3473912190 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3c48066f30 0x7f3c480693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c0091e0 tx=0x7f3c4c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:33.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.697+0000 7f3c437fe700 1 -- 172.21.15.17:0/3473912190 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c50051910 con 0x7f3c5c0ccfc0 2023-10-06T04:43:33.827 INFO:tasks.ceph.mds.d.smithi136.stderr:2023-10-06T04:43:33.826+0000 7f94b136a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T04:43:33.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.885+0000 7f3c60cd8700 1 -- 172.21.15.17:0/3473912190 --> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3c5c0caf50 con 0x7f3c48066f30 2023-10-06T04:43:33.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.894+0000 7f3c437fe700 1 -- 172.21.15.17:0/3473912190 <== mgr.4104 v2:172.21.15.17:6832/90424 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286891 (secure 0 0 0) 0x7f3c5c0caf50 con 0x7f3c48066f30 2023-10-06T04:43:33.899 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:43:33.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.897+0000 7f3c60cd8700 1 -- 172.21.15.17:0/3473912190 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3c48066f30 msgr2=0x7f3c480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:33.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.897+0000 7f3c60cd8700 1 --2- 172.21.15.17:0/3473912190 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3c48066f30 0x7f3c480693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c0091e0 tx=0x7f3c4c017000 comp rx=0 tx=0).stop 2023-10-06T04:43:33.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.897+0000 7f3c60cd8700 1 -- 172.21.15.17:0/3473912190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c5c0ccfc0 msgr2=0x7f3c5c155160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:33.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.897+0000 7f3c60cd8700 1 --2- 172.21.15.17:0/3473912190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c5c0ccfc0 0x7f3c5c155160 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3c5000ec50 tx=0x7f3c500091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:33.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.897+0000 7f3c60cd8700 1 -- 172.21.15.17:0/3473912190 shutdown_connections 2023-10-06T04:43:33.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.897+0000 7f3c60cd8700 1 --2- 172.21.15.17:0/3473912190 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3c48066f30 0x7f3c480693e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:33.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.897+0000 7f3c60cd8700 1 --2- 172.21.15.17:0/3473912190 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3c5c0c9090 0x7f3c5c0b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:33.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.897+0000 7f3c60cd8700 1 --2- 172.21.15.17:0/3473912190 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c5c0cc750 0x7f3c5c0c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:33.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.897+0000 7f3c60cd8700 1 --2- 172.21.15.17:0/3473912190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c5c0ccfc0 0x7f3c5c155160 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:33.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.897+0000 7f3c60cd8700 1 -- 172.21.15.17:0/3473912190 >> 172.21.15.17:0/3473912190 conn(0x7f3c5c06cff0 msgr2=0x7f3c5c156ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:33.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.897+0000 7f3c60cd8700 1 -- 172.21.15.17:0/3473912190 shutdown_connections 2023-10-06T04:43:33.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:33.897+0000 7f3c60cd8700 1 -- 172.21.15.17:0/3473912190 wait complete. 2023-10-06T04:43:33.902 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-06T04:43:33.910 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-10-06T04:43:32.335968+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381176,"kb_used_data":2872,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593544,"statfs":{"total":773094113280,"available":770655789056,"internally_reserved":0,"allocated":2940928,"data_stored":1789528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.551534"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.806928+0000","last_change":"2023-10-06T04:43:29.806928+0000","last_active":"2023-10-06T04:43:29.806928+0000","last_peered":"2023-10-06T04:43:29.806928+0000","last_clean":"2023-10-06T04:43:29.806928+0000","last_became_active":"2023-10-06T04:43:29.806647+0000","last_became_peered":"2023-10-06T04:43:29.806647+0000","last_unstale":"2023-10-06T04:43:29.806928+0000","last_undegraded":"2023-10-06T04:43:29.806928+0000","last_fullsized":"2023-10-06T04:43:29.806928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:36.599513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.816979+0000","last_change":"2023-10-06T04:43:29.816979+0000","last_active":"2023-10-06T04:43:29.816979+0000","last_peered":"2023-10-06T04:43:29.816979+0000","last_clean":"2023-10-06T04:43:29.816979+0000","last_became_active":"2023-10-06T04:43:29.812045+0000","last_became_peered":"2023-10-06T04:43:29.812045+0000","last_unstale":"2023-10-06T04:43:29.816979+0000","last_undegraded":"2023-10-06T04:43:29.816979+0000","last_fullsized":"2023-10-06T04:43:29.816979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:23:24.496576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818087+0000","last_change":"2023-10-06T04:43:29.811591+0000","last_active":"2023-10-06T04:43:29.818087+0000","last_peered":"2023-10-06T04:43:29.818087+0000","last_clean":"2023-10-06T04:43:29.818087+0000","last_became_active":"2023-10-06T04:43:29.810621+0000","last_became_peered":"2023-10-06T04:43:29.810621+0000","last_unstale":"2023-10-06T04:43:29.818087+0000","last_undegraded":"2023-10-06T04:43:29.818087+0000","last_fullsized":"2023-10-06T04:43:29.818087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:58.730973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.810774+0000","last_change":"2023-10-06T04:43:29.810774+0000","last_active":"2023-10-06T04:43:29.810774+0000","last_peered":"2023-10-06T04:43:29.810774+0000","last_clean":"2023-10-06T04:43:29.810774+0000","last_became_active":"2023-10-06T04:43:29.810469+0000","last_became_peered":"2023-10-06T04:43:29.810469+0000","last_unstale":"2023-10-06T04:43:29.810774+0000","last_undegraded":"2023-10-06T04:43:29.810774+0000","last_fullsized":"2023-10-06T04:43:29.810774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:00:08.876120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.804144+0000","last_change":"2023-10-06T04:43:29.804144+0000","last_active":"2023-10-06T04:43:29.804144+0000","last_peered":"2023-10-06T04:43:29.804144+0000","last_clean":"2023-10-06T04:43:29.804144+0000","last_became_active":"2023-10-06T04:43:29.803873+0000","last_became_peered":"2023-10-06T04:43:29.803873+0000","last_unstale":"2023-10-06T04:43:29.804144+0000","last_undegraded":"2023-10-06T04:43:29.804144+0000","last_fullsized":"2023-10-06T04:43:29.804144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:01.271919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.819195+0000","last_change":"2023-10-06T04:43:29.816295+0000","last_active":"2023-10-06T04:43:29.819195+0000","last_peered":"2023-10-06T04:43:29.819195+0000","last_clean":"2023-10-06T04:43:29.819195+0000","last_became_active":"2023-10-06T04:43:29.815965+0000","last_became_peered":"2023-10-06T04:43:29.815965+0000","last_unstale":"2023-10-06T04:43:29.819195+0000","last_undegraded":"2023-10-06T04:43:29.819195+0000","last_fullsized":"2023-10-06T04:43:29.819195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:55:19.523530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.820937+0000","last_change":"2023-10-06T04:43:29.807856+0000","last_active":"2023-10-06T04:43:29.820937+0000","last_peered":"2023-10-06T04:43:29.820937+0000","last_clean":"2023-10-06T04:43:29.820937+0000","last_became_active":"2023-10-06T04:43:29.807253+0000","last_became_peered":"2023-10-06T04:43:29.807253+0000","last_unstale":"2023-10-06T04:43:29.820937+0000","last_undegraded":"2023-10-06T04:43:29.820937+0000","last_fullsized":"2023-10-06T04:43:29.820937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:15:36.021668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.817890+0000","last_change":"2023-10-06T04:43:29.817890+0000","last_active":"2023-10-06T04:43:29.817890+0000","last_peered":"2023-10-06T04:43:29.817890+0000","last_clean":"2023-10-06T04:43:29.817890+0000","last_became_active":"2023-10-06T04:43:29.817653+0000","last_became_peered":"2023-10-06T04:43:29.817653+0000","last_unstale":"2023-10-06T04:43:29.817890+0000","last_undegraded":"2023-10-06T04:43:29.817890+0000","last_fullsized":"2023-10-06T04:43:29.817890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:11.685749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.815194+0000","last_change":"2023-10-06T04:43:29.815194+0000","last_active":"2023-10-06T04:43:29.815194+0000","last_peered":"2023-10-06T04:43:29.815194+0000","last_clean":"2023-10-06T04:43:29.815194+0000","last_became_active":"2023-10-06T04:43:29.814925+0000","last_became_peered":"2023-10-06T04:43:29.814925+0000","last_unstale":"2023-10-06T04:43:29.815194+0000","last_undegraded":"2023-10-06T04:43:29.815194+0000","last_fullsized":"2023-10-06T04:43:29.815194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:52.381232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.811845+0000","last_change":"2023-10-06T04:43:29.811845+0000","last_active":"2023-10-06T04:43:29.811845+0000","last_peered":"2023-10-06T04:43:29.811845+0000","last_clean":"2023-10-06T04:43:29.811845+0000","last_became_active":"2023-10-06T04:43:29.811569+0000","last_became_peered":"2023-10-06T04:43:29.811569+0000","last_unstale":"2023-10-06T04:43:29.811845+0000","last_undegraded":"2023-10-06T04:43:29.811845+0000","last_fullsized":"2023-10-06T04:43:29.811845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:11.452212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.819391+0000","last_change":"2023-10-06T04:43:29.815826+0000","last_active":"2023-10-06T04:43:29.819391+0000","last_peered":"2023-10-06T04:43:29.819391+0000","last_clean":"2023-10-06T04:43:29.819391+0000","last_became_active":"2023-10-06T04:43:29.811044+0000","last_became_peered":"2023-10-06T04:43:29.811044+0000","last_unstale":"2023-10-06T04:43:29.819391+0000","last_undegraded":"2023-10-06T04:43:29.819391+0000","last_fullsized":"2023-10-06T04:43:29.819391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:51.734715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.816792+0000","last_change":"2023-10-06T04:43:29.816792+0000","last_active":"2023-10-06T04:43:29.816792+0000","last_peered":"2023-10-06T04:43:29.816792+0000","last_clean":"2023-10-06T04:43:29.816792+0000","last_became_active":"2023-10-06T04:43:29.816556+0000","last_became_peered":"2023-10-06T04:43:29.816556+0000","last_unstale":"2023-10-06T04:43:29.816792+0000","last_undegraded":"2023-10-06T04:43:29.816792+0000","last_fullsized":"2023-10-06T04:43:29.816792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:01:47.259709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.808514+0000","last_change":"2023-10-06T04:43:29.808514+0000","last_active":"2023-10-06T04:43:29.808514+0000","last_peered":"2023-10-06T04:43:29.808514+0000","last_clean":"2023-10-06T04:43:29.808514+0000","last_became_active":"2023-10-06T04:43:29.808290+0000","last_became_peered":"2023-10-06T04:43:29.808290+0000","last_unstale":"2023-10-06T04:43:29.808514+0000","last_undegraded":"2023-10-06T04:43:29.808514+0000","last_fullsized":"2023-10-06T04:43:29.808514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:41.895629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.810539+0000","last_change":"2023-10-06T04:43:29.810539+0000","last_active":"2023-10-06T04:43:29.810539+0000","last_peered":"2023-10-06T04:43:29.810539+0000","last_clean":"2023-10-06T04:43:29.810539+0000","last_became_active":"2023-10-06T04:43:29.809976+0000","last_became_peered":"2023-10-06T04:43:29.809976+0000","last_unstale":"2023-10-06T04:43:29.810539+0000","last_undegraded":"2023-10-06T04:43:29.810539+0000","last_fullsized":"2023-10-06T04:43:29.810539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:07.658289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.820956+0000","last_change":"2023-10-06T04:43:29.808047+0000","last_active":"2023-10-06T04:43:29.820956+0000","last_peered":"2023-10-06T04:43:29.820956+0000","last_clean":"2023-10-06T04:43:29.820956+0000","last_became_active":"2023-10-06T04:43:29.807598+0000","last_became_peered":"2023-10-06T04:43:29.807598+0000","last_unstale":"2023-10-06T04:43:29.820956+0000","last_undegraded":"2023-10-06T04:43:29.820956+0000","last_fullsized":"2023-10-06T04:43:29.820956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:11.685749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.815174+0000","last_change":"2023-10-06T04:43:29.807538+0000","last_active":"2023-10-06T04:43:29.815174+0000","last_peered":"2023-10-06T04:43:29.815174+0000","last_clean":"2023-10-06T04:43:29.815174+0000","last_became_active":"2023-10-06T04:43:29.807299+0000","last_became_peered":"2023-10-06T04:43:29.807299+0000","last_unstale":"2023-10-06T04:43:29.815174+0000","last_undegraded":"2023-10-06T04:43:29.815174+0000","last_fullsized":"2023-10-06T04:43:29.815174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:15:36.021668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.816450+0000","last_change":"2023-10-06T04:43:29.816450+0000","last_active":"2023-10-06T04:43:29.816450+0000","last_peered":"2023-10-06T04:43:29.816450+0000","last_clean":"2023-10-06T04:43:29.816450+0000","last_became_active":"2023-10-06T04:43:29.816180+0000","last_became_peered":"2023-10-06T04:43:29.816180+0000","last_unstale":"2023-10-06T04:43:29.816450+0000","last_undegraded":"2023-10-06T04:43:29.816450+0000","last_fullsized":"2023-10-06T04:43:29.816450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:45.205428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818676+0000","last_change":"2023-10-06T04:43:29.815225+0000","last_active":"2023-10-06T04:43:29.818676+0000","last_peered":"2023-10-06T04:43:29.818676+0000","last_clean":"2023-10-06T04:43:29.818676+0000","last_became_active":"2023-10-06T04:43:29.814940+0000","last_became_peered":"2023-10-06T04:43:29.814940+0000","last_unstale":"2023-10-06T04:43:29.818676+0000","last_undegraded":"2023-10-06T04:43:29.818676+0000","last_fullsized":"2023-10-06T04:43:29.818676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:01.271919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.814413+0000","last_change":"2023-10-06T04:43:29.814413+0000","last_active":"2023-10-06T04:43:29.814413+0000","last_peered":"2023-10-06T04:43:29.814413+0000","last_clean":"2023-10-06T04:43:29.814413+0000","last_became_active":"2023-10-06T04:43:29.814183+0000","last_became_peered":"2023-10-06T04:43:29.814183+0000","last_unstale":"2023-10-06T04:43:29.814413+0000","last_undegraded":"2023-10-06T04:43:29.814413+0000","last_fullsized":"2023-10-06T04:43:29.814413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:13.446695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.819145+0000","last_change":"2023-10-06T04:43:29.816764+0000","last_active":"2023-10-06T04:43:29.819145+0000","last_peered":"2023-10-06T04:43:29.819145+0000","last_clean":"2023-10-06T04:43:29.819145+0000","last_became_active":"2023-10-06T04:43:29.816331+0000","last_became_peered":"2023-10-06T04:43:29.816331+0000","last_unstale":"2023-10-06T04:43:29.819145+0000","last_undegraded":"2023-10-06T04:43:29.819145+0000","last_fullsized":"2023-10-06T04:43:29.819145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:30.317282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.820849+0000","last_change":"2023-10-06T04:43:29.808614+0000","last_active":"2023-10-06T04:43:29.820849+0000","last_peered":"2023-10-06T04:43:29.820849+0000","last_clean":"2023-10-06T04:43:29.820849+0000","last_became_active":"2023-10-06T04:43:29.808340+0000","last_became_peered":"2023-10-06T04:43:29.808340+0000","last_unstale":"2023-10-06T04:43:29.820849+0000","last_undegraded":"2023-10-06T04:43:29.820849+0000","last_fullsized":"2023-10-06T04:43:29.820849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:34.271308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.802581+0000","last_change":"2023-10-06T04:43:29.802581+0000","last_active":"2023-10-06T04:43:29.802581+0000","last_peered":"2023-10-06T04:43:29.802581+0000","last_clean":"2023-10-06T04:43:29.802581+0000","last_became_active":"2023-10-06T04:43:29.802296+0000","last_became_peered":"2023-10-06T04:43:29.802296+0000","last_unstale":"2023-10-06T04:43:29.802581+0000","last_undegraded":"2023-10-06T04:43:29.802581+0000","last_fullsized":"2023-10-06T04:43:29.802581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:34.271308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.812033+0000","last_change":"2023-10-06T04:43:29.807277+0000","last_active":"2023-10-06T04:43:29.812033+0000","last_peered":"2023-10-06T04:43:29.812033+0000","last_clean":"2023-10-06T04:43:29.812033+0000","last_became_active":"2023-10-06T04:43:29.807007+0000","last_became_peered":"2023-10-06T04:43:29.807007+0000","last_unstale":"2023-10-06T04:43:29.812033+0000","last_undegraded":"2023-10-06T04:43:29.812033+0000","last_fullsized":"2023-10-06T04:43:29.812033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:51.734715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.820779+0000","last_change":"2023-10-06T04:43:29.807216+0000","last_active":"2023-10-06T04:43:29.820779+0000","last_peered":"2023-10-06T04:43:29.820779+0000","last_clean":"2023-10-06T04:43:29.820779+0000","last_became_active":"2023-10-06T04:43:29.806926+0000","last_became_peered":"2023-10-06T04:43:29.806926+0000","last_unstale":"2023-10-06T04:43:29.820779+0000","last_undegraded":"2023-10-06T04:43:29.820779+0000","last_fullsized":"2023-10-06T04:43:29.820779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:45.205428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.811127+0000","last_change":"2023-10-06T04:43:29.809554+0000","last_active":"2023-10-06T04:43:29.811127+0000","last_peered":"2023-10-06T04:43:29.811127+0000","last_clean":"2023-10-06T04:43:29.811127+0000","last_became_active":"2023-10-06T04:43:29.809289+0000","last_became_peered":"2023-10-06T04:43:29.809289+0000","last_unstale":"2023-10-06T04:43:29.811127+0000","last_undegraded":"2023-10-06T04:43:29.811127+0000","last_fullsized":"2023-10-06T04:43:29.811127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:11.685749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.807574+0000","last_change":"2023-10-06T04:43:29.802420+0000","last_active":"2023-10-06T04:43:29.807574+0000","last_peered":"2023-10-06T04:43:29.807574+0000","last_clean":"2023-10-06T04:43:29.807574+0000","last_became_active":"2023-10-06T04:43:29.802164+0000","last_became_peered":"2023-10-06T04:43:29.802164+0000","last_unstale":"2023-10-06T04:43:29.807574+0000","last_undegraded":"2023-10-06T04:43:29.807574+0000","last_fullsized":"2023-10-06T04:43:29.807574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:40.869182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.820720+0000","last_change":"2023-10-06T04:43:29.820720+0000","last_active":"2023-10-06T04:43:29.820720+0000","last_peered":"2023-10-06T04:43:29.820720+0000","last_clean":"2023-10-06T04:43:29.820720+0000","last_became_active":"2023-10-06T04:43:29.817226+0000","last_became_peered":"2023-10-06T04:43:29.817226+0000","last_unstale":"2023-10-06T04:43:29.820720+0000","last_undegraded":"2023-10-06T04:43:29.820720+0000","last_fullsized":"2023-10-06T04:43:29.820720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:45.205428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.821084+0000","last_change":"2023-10-06T04:43:28.805712+0000","last_active":"2023-10-06T04:43:29.821084+0000","last_peered":"2023-10-06T04:43:29.821084+0000","last_clean":"2023-10-06T04:43:29.821084+0000","last_became_active":"2023-10-06T04:43:28.805368+0000","last_became_peered":"2023-10-06T04:43:28.805368+0000","last_unstale":"2023-10-06T04:43:29.821084+0000","last_undegraded":"2023-10-06T04:43:29.821084+0000","last_fullsized":"2023-10-06T04:43:29.821084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:12.441174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.808717+0000","last_change":"2023-10-06T04:43:29.806230+0000","last_active":"2023-10-06T04:43:29.808717+0000","last_peered":"2023-10-06T04:43:29.808717+0000","last_clean":"2023-10-06T04:43:29.808717+0000","last_became_active":"2023-10-06T04:43:29.805977+0000","last_became_peered":"2023-10-06T04:43:29.805977+0000","last_unstale":"2023-10-06T04:43:29.808717+0000","last_undegraded":"2023-10-06T04:43:29.808717+0000","last_fullsized":"2023-10-06T04:43:29.808717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:11.727749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.791893+0000","last_change":"2023-10-06T04:43:28.810385+0000","last_active":"2023-10-06T04:43:29.791893+0000","last_peered":"2023-10-06T04:43:29.791893+0000","last_clean":"2023-10-06T04:43:29.791893+0000","last_became_active":"2023-10-06T04:43:28.810187+0000","last_became_peered":"2023-10-06T04:43:28.810187+0000","last_unstale":"2023-10-06T04:43:29.791893+0000","last_undegraded":"2023-10-06T04:43:29.791893+0000","last_fullsized":"2023-10-06T04:43:29.791893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:40.890108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.799004+0000","last_change":"2023-10-06T04:43:29.799004+0000","last_active":"2023-10-06T04:43:29.799004+0000","last_peered":"2023-10-06T04:43:29.799004+0000","last_clean":"2023-10-06T04:43:29.799004+0000","last_became_active":"2023-10-06T04:43:29.798724+0000","last_became_peered":"2023-10-06T04:43:29.798724+0000","last_unstale":"2023-10-06T04:43:29.799004+0000","last_undegraded":"2023-10-06T04:43:29.799004+0000","last_fullsized":"2023-10-06T04:43:29.799004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:11.685749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.799049+0000","last_change":"2023-10-06T04:43:28.807299+0000","last_active":"2023-10-06T04:43:29.799049+0000","last_peered":"2023-10-06T04:43:29.799049+0000","last_clean":"2023-10-06T04:43:29.799049+0000","last_became_active":"2023-10-06T04:43:28.806721+0000","last_became_peered":"2023-10-06T04:43:28.806721+0000","last_unstale":"2023-10-06T04:43:29.799049+0000","last_undegraded":"2023-10-06T04:43:29.799049+0000","last_fullsized":"2023-10-06T04:43:29.799049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:50:16.072055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.816337+0000","last_change":"2023-10-06T04:43:29.816337+0000","last_active":"2023-10-06T04:43:29.816337+0000","last_peered":"2023-10-06T04:43:29.816337+0000","last_clean":"2023-10-06T04:43:29.816337+0000","last_became_active":"2023-10-06T04:43:29.816020+0000","last_became_peered":"2023-10-06T04:43:29.816020+0000","last_unstale":"2023-10-06T04:43:29.816337+0000","last_undegraded":"2023-10-06T04:43:29.816337+0000","last_fullsized":"2023-10-06T04:43:29.816337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:40.869182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:43:28.807364+0000","last_change":"2023-10-06T04:43:28.805467+0000","last_active":"2023-10-06T04:43:28.807364+0000","last_peered":"2023-10-06T04:43:28.807364+0000","last_clean":"2023-10-06T04:43:28.807364+0000","last_became_active":"2023-10-06T04:43:28.804827+0000","last_became_peered":"2023-10-06T04:43:28.804827+0000","last_unstale":"2023-10-06T04:43:28.807364+0000","last_undegraded":"2023-10-06T04:43:28.807364+0000","last_fullsized":"2023-10-06T04:43:28.807364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:01:46.254188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.808207+0000","last_change":"2023-10-06T04:43:29.806347+0000","last_active":"2023-10-06T04:43:29.808207+0000","last_peered":"2023-10-06T04:43:29.808207+0000","last_clean":"2023-10-06T04:43:29.808207+0000","last_became_active":"2023-10-06T04:43:29.803738+0000","last_became_peered":"2023-10-06T04:43:29.803738+0000","last_unstale":"2023-10-06T04:43:29.808207+0000","last_undegraded":"2023-10-06T04:43:29.808207+0000","last_fullsized":"2023-10-06T04:43:29.808207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:54.115093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:43:28.816228+0000","last_change":"2023-10-06T04:43:28.808150+0000","last_active":"2023-10-06T04:43:28.816228+0000","last_peered":"2023-10-06T04:43:28.816228+0000","last_clean":"2023-10-06T04:43:28.816228+0000","last_became_active":"2023-10-06T04:43:28.807880+0000","last_became_peered":"2023-10-06T04:43:28.807880+0000","last_unstale":"2023-10-06T04:43:28.816228+0000","last_undegraded":"2023-10-06T04:43:28.816228+0000","last_fullsized":"2023-10-06T04:43:28.816228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:40.890108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.815591+0000","last_change":"2023-10-06T04:43:29.813344+0000","last_active":"2023-10-06T04:43:29.815591+0000","last_peered":"2023-10-06T04:43:29.815591+0000","last_clean":"2023-10-06T04:43:29.815591+0000","last_became_active":"2023-10-06T04:43:29.813115+0000","last_became_peered":"2023-10-06T04:43:29.813115+0000","last_unstale":"2023-10-06T04:43:29.815591+0000","last_undegraded":"2023-10-06T04:43:29.815591+0000","last_fullsized":"2023-10-06T04:43:29.815591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:52.381232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.815998+0000","last_change":"2023-10-06T04:43:28.807514+0000","last_active":"2023-10-06T04:43:29.815998+0000","last_peered":"2023-10-06T04:43:29.815998+0000","last_clean":"2023-10-06T04:43:29.815998+0000","last_became_active":"2023-10-06T04:43:28.807226+0000","last_became_peered":"2023-10-06T04:43:28.807226+0000","last_unstale":"2023-10-06T04:43:29.815998+0000","last_undegraded":"2023-10-06T04:43:29.815998+0000","last_fullsized":"2023-10-06T04:43:29.815998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:54:35.372982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.812081+0000","last_change":"2023-10-06T04:43:29.810145+0000","last_active":"2023-10-06T04:43:29.812081+0000","last_peered":"2023-10-06T04:43:29.812081+0000","last_clean":"2023-10-06T04:43:29.812081+0000","last_became_active":"2023-10-06T04:43:29.809512+0000","last_became_peered":"2023-10-06T04:43:29.809512+0000","last_unstale":"2023-10-06T04:43:29.812081+0000","last_undegraded":"2023-10-06T04:43:29.812081+0000","last_fullsized":"2023-10-06T04:43:29.812081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:15:36.021668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.825075+0000","last_change":"2023-10-06T04:43:28.803587+0000","last_active":"2023-10-06T04:43:29.825075+0000","last_peered":"2023-10-06T04:43:29.825075+0000","last_clean":"2023-10-06T04:43:29.825075+0000","last_became_active":"2023-10-06T04:43:28.801777+0000","last_became_peered":"2023-10-06T04:43:28.801777+0000","last_unstale":"2023-10-06T04:43:29.825075+0000","last_undegraded":"2023-10-06T04:43:29.825075+0000","last_fullsized":"2023-10-06T04:43:29.825075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:56.458010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818645+0000","last_change":"2023-10-06T04:43:29.815592+0000","last_active":"2023-10-06T04:43:29.818645+0000","last_peered":"2023-10-06T04:43:29.818645+0000","last_clean":"2023-10-06T04:43:29.818645+0000","last_became_active":"2023-10-06T04:43:29.815322+0000","last_became_peered":"2023-10-06T04:43:29.815322+0000","last_unstale":"2023-10-06T04:43:29.818645+0000","last_undegraded":"2023-10-06T04:43:29.818645+0000","last_fullsized":"2023-10-06T04:43:29.818645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:10.192264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.817564+0000","last_change":"2023-10-06T04:43:28.802843+0000","last_active":"2023-10-06T04:43:29.817564+0000","last_peered":"2023-10-06T04:43:29.817564+0000","last_clean":"2023-10-06T04:43:29.817564+0000","last_became_active":"2023-10-06T04:43:28.802554+0000","last_became_peered":"2023-10-06T04:43:28.802554+0000","last_unstale":"2023-10-06T04:43:29.817564+0000","last_undegraded":"2023-10-06T04:43:29.817564+0000","last_fullsized":"2023-10-06T04:43:29.817564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:00:07.870599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.808168+0000","last_change":"2023-10-06T04:43:29.805945+0000","last_active":"2023-10-06T04:43:29.808168+0000","last_peered":"2023-10-06T04:43:29.808168+0000","last_clean":"2023-10-06T04:43:29.808168+0000","last_became_active":"2023-10-06T04:43:29.805658+0000","last_became_peered":"2023-10-06T04:43:29.805658+0000","last_unstale":"2023-10-06T04:43:29.808168+0000","last_undegraded":"2023-10-06T04:43:29.808168+0000","last_fullsized":"2023-10-06T04:43:29.808168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:38.867495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:43:28.804449+0000","last_change":"2023-10-06T04:43:28.797338+0000","last_active":"2023-10-06T04:43:28.804449+0000","last_peered":"2023-10-06T04:43:28.804449+0000","last_clean":"2023-10-06T04:43:28.804449+0000","last_became_active":"2023-10-06T04:43:28.797048+0000","last_became_peered":"2023-10-06T04:43:28.797048+0000","last_unstale":"2023-10-06T04:43:28.804449+0000","last_undegraded":"2023-10-06T04:43:28.804449+0000","last_fullsized":"2023-10-06T04:43:28.804449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:40.890108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.820733+0000","last_change":"2023-10-06T04:43:29.820733+0000","last_active":"2023-10-06T04:43:29.820733+0000","last_peered":"2023-10-06T04:43:29.820733+0000","last_clean":"2023-10-06T04:43:29.820733+0000","last_became_active":"2023-10-06T04:43:29.817165+0000","last_became_peered":"2023-10-06T04:43:29.817165+0000","last_unstale":"2023-10-06T04:43:29.820733+0000","last_undegraded":"2023-10-06T04:43:29.820733+0000","last_fullsized":"2023-10-06T04:43:29.820733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:34.271308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.795120+0000","last_change":"2023-10-06T04:43:28.806709+0000","last_active":"2023-10-06T04:43:29.795120+0000","last_peered":"2023-10-06T04:43:29.795120+0000","last_clean":"2023-10-06T04:43:29.795120+0000","last_became_active":"2023-10-06T04:43:28.806455+0000","last_became_peered":"2023-10-06T04:43:28.806455+0000","last_unstale":"2023-10-06T04:43:29.795120+0000","last_undegraded":"2023-10-06T04:43:29.795120+0000","last_fullsized":"2023-10-06T04:43:29.795120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:05.582666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.807303+0000","last_change":"2023-10-06T04:43:29.807303+0000","last_active":"2023-10-06T04:43:29.807303+0000","last_peered":"2023-10-06T04:43:29.807303+0000","last_clean":"2023-10-06T04:43:29.807303+0000","last_became_active":"2023-10-06T04:43:29.807034+0000","last_became_peered":"2023-10-06T04:43:29.807034+0000","last_unstale":"2023-10-06T04:43:29.807303+0000","last_undegraded":"2023-10-06T04:43:29.807303+0000","last_fullsized":"2023-10-06T04:43:29.807303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:51.734715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.819470+0000","last_change":"2023-10-06T04:43:28.807312+0000","last_active":"2023-10-06T04:43:29.819470+0000","last_peered":"2023-10-06T04:43:29.819470+0000","last_clean":"2023-10-06T04:43:29.819470+0000","last_became_active":"2023-10-06T04:43:28.807035+0000","last_became_peered":"2023-10-06T04:43:28.807035+0000","last_unstale":"2023-10-06T04:43:29.819470+0000","last_undegraded":"2023-10-06T04:43:29.819470+0000","last_fullsized":"2023-10-06T04:43:29.819470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:35.593992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818496+0000","last_change":"2023-10-06T04:43:29.816482+0000","last_active":"2023-10-06T04:43:29.818496+0000","last_peered":"2023-10-06T04:43:29.818496+0000","last_clean":"2023-10-06T04:43:29.818496+0000","last_became_active":"2023-10-06T04:43:29.816211+0000","last_became_peered":"2023-10-06T04:43:29.816211+0000","last_unstale":"2023-10-06T04:43:29.818496+0000","last_undegraded":"2023-10-06T04:43:29.818496+0000","last_fullsized":"2023-10-06T04:43:29.818496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:34.271308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.820686+0000","last_change":"2023-10-06T04:43:28.805958+0000","last_active":"2023-10-06T04:43:29.820686+0000","last_peered":"2023-10-06T04:43:29.820686+0000","last_clean":"2023-10-06T04:43:29.820686+0000","last_became_active":"2023-10-06T04:43:28.805675+0000","last_became_peered":"2023-10-06T04:43:28.805675+0000","last_unstale":"2023-10-06T04:43:29.820686+0000","last_undegraded":"2023-10-06T04:43:29.820686+0000","last_fullsized":"2023-10-06T04:43:29.820686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:54.712639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.819947+0000","last_change":"2023-10-06T04:43:29.819947+0000","last_active":"2023-10-06T04:43:29.819947+0000","last_peered":"2023-10-06T04:43:29.819947+0000","last_clean":"2023-10-06T04:43:29.819947+0000","last_became_active":"2023-10-06T04:43:29.819674+0000","last_became_peered":"2023-10-06T04:43:29.819674+0000","last_unstale":"2023-10-06T04:43:29.819947+0000","last_undegraded":"2023-10-06T04:43:29.819947+0000","last_fullsized":"2023-10-06T04:43:29.819947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:51:05.152644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.817116+0000","last_change":"2023-10-06T04:43:28.805900+0000","last_active":"2023-10-06T04:43:29.817116+0000","last_peered":"2023-10-06T04:43:29.817116+0000","last_clean":"2023-10-06T04:43:29.817116+0000","last_became_active":"2023-10-06T04:43:28.805647+0000","last_became_peered":"2023-10-06T04:43:28.805647+0000","last_unstale":"2023-10-06T04:43:29.817116+0000","last_undegraded":"2023-10-06T04:43:29.817116+0000","last_fullsized":"2023-10-06T04:43:29.817116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:37.340861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.814241+0000","last_change":"2023-10-06T04:43:29.809549+0000","last_active":"2023-10-06T04:43:29.814241+0000","last_peered":"2023-10-06T04:43:29.814241+0000","last_clean":"2023-10-06T04:43:29.814241+0000","last_became_active":"2023-10-06T04:43:29.809252+0000","last_became_peered":"2023-10-06T04:43:29.809252+0000","last_unstale":"2023-10-06T04:43:29.814241+0000","last_undegraded":"2023-10-06T04:43:29.814241+0000","last_fullsized":"2023-10-06T04:43:29.814241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:52.381232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.816103+0000","last_change":"2023-10-06T04:43:28.809092+0000","last_active":"2023-10-06T04:43:29.816103+0000","last_peered":"2023-10-06T04:43:29.816103+0000","last_clean":"2023-10-06T04:43:29.816103+0000","last_became_active":"2023-10-06T04:43:28.808653+0000","last_became_peered":"2023-10-06T04:43:28.808653+0000","last_unstale":"2023-10-06T04:43:29.816103+0000","last_undegraded":"2023-10-06T04:43:29.816103+0000","last_fullsized":"2023-10-06T04:43:29.816103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:39.863661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.812475+0000","last_change":"2023-10-06T04:43:29.812475+0000","last_active":"2023-10-06T04:43:29.812475+0000","last_peered":"2023-10-06T04:43:29.812475+0000","last_clean":"2023-10-06T04:43:29.812475+0000","last_became_active":"2023-10-06T04:43:29.812062+0000","last_became_peered":"2023-10-06T04:43:29.812062+0000","last_unstale":"2023-10-06T04:43:29.812475+0000","last_undegraded":"2023-10-06T04:43:29.812475+0000","last_fullsized":"2023-10-06T04:43:29.812475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:38.346382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:43:28.813425+0000","last_change":"2023-10-06T04:43:28.807693+0000","last_active":"2023-10-06T04:43:28.813425+0000","last_peered":"2023-10-06T04:43:28.813425+0000","last_clean":"2023-10-06T04:43:28.813425+0000","last_became_active":"2023-10-06T04:43:28.807432+0000","last_became_peered":"2023-10-06T04:43:28.807432+0000","last_unstale":"2023-10-06T04:43:28.813425+0000","last_undegraded":"2023-10-06T04:43:28.813425+0000","last_fullsized":"2023-10-06T04:43:28.813425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:50:16.072055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.805692+0000","last_change":"2023-10-06T04:43:29.805692+0000","last_active":"2023-10-06T04:43:29.805692+0000","last_peered":"2023-10-06T04:43:29.805692+0000","last_clean":"2023-10-06T04:43:29.805692+0000","last_became_active":"2023-10-06T04:43:29.805453+0000","last_became_peered":"2023-10-06T04:43:29.805453+0000","last_unstale":"2023-10-06T04:43:29.805692+0000","last_undegraded":"2023-10-06T04:43:29.805692+0000","last_fullsized":"2023-10-06T04:43:29.805692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:24:11.932858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.817215+0000","last_change":"2023-10-06T04:43:28.807062+0000","last_active":"2023-10-06T04:43:29.817215+0000","last_peered":"2023-10-06T04:43:29.817215+0000","last_clean":"2023-10-06T04:43:29.817215+0000","last_became_active":"2023-10-06T04:43:28.806751+0000","last_became_peered":"2023-10-06T04:43:28.806751+0000","last_unstale":"2023-10-06T04:43:29.817215+0000","last_undegraded":"2023-10-06T04:43:29.817215+0000","last_fullsized":"2023-10-06T04:43:29.817215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:54.712639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.819043+0000","last_change":"2023-10-06T04:43:29.815942+0000","last_active":"2023-10-06T04:43:29.819043+0000","last_peered":"2023-10-06T04:43:29.819043+0000","last_clean":"2023-10-06T04:43:29.819043+0000","last_became_active":"2023-10-06T04:43:29.815608+0000","last_became_peered":"2023-10-06T04:43:29.815608+0000","last_unstale":"2023-10-06T04:43:29.819043+0000","last_undegraded":"2023-10-06T04:43:29.819043+0000","last_fullsized":"2023-10-06T04:43:29.819043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:39:19.542778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:43:28.816232+0000","last_change":"2023-10-06T04:43:28.811867+0000","last_active":"2023-10-06T04:43:28.816232+0000","last_peered":"2023-10-06T04:43:28.816232+0000","last_clean":"2023-10-06T04:43:28.816232+0000","last_became_active":"2023-10-06T04:43:28.811616+0000","last_became_peered":"2023-10-06T04:43:28.811616+0000","last_unstale":"2023-10-06T04:43:28.816232+0000","last_undegraded":"2023-10-06T04:43:28.816232+0000","last_fullsized":"2023-10-06T04:43:28.816232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:56.458010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818108+0000","last_change":"2023-10-06T04:43:29.813764+0000","last_active":"2023-10-06T04:43:29.818108+0000","last_peered":"2023-10-06T04:43:29.818108+0000","last_clean":"2023-10-06T04:43:29.818108+0000","last_became_active":"2023-10-06T04:43:29.811411+0000","last_became_peered":"2023-10-06T04:43:29.811411+0000","last_unstale":"2023-10-06T04:43:29.818108+0000","last_undegraded":"2023-10-06T04:43:29.818108+0000","last_fullsized":"2023-10-06T04:43:29.818108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:11.727749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.797267+0000","last_change":"2023-10-06T04:43:28.804269+0000","last_active":"2023-10-06T04:43:29.797267+0000","last_peered":"2023-10-06T04:43:29.797267+0000","last_clean":"2023-10-06T04:43:29.797267+0000","last_became_active":"2023-10-06T04:43:28.802873+0000","last_became_peered":"2023-10-06T04:43:28.802873+0000","last_unstale":"2023-10-06T04:43:29.797267+0000","last_undegraded":"2023-10-06T04:43:29.797267+0000","last_fullsized":"2023-10-06T04:43:29.797267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:35.593992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.819304+0000","last_change":"2023-10-06T04:43:29.816924+0000","last_active":"2023-10-06T04:43:29.819304+0000","last_peered":"2023-10-06T04:43:29.819304+0000","last_clean":"2023-10-06T04:43:29.819304+0000","last_became_active":"2023-10-06T04:43:29.816649+0000","last_became_peered":"2023-10-06T04:43:29.816649+0000","last_unstale":"2023-10-06T04:43:29.819304+0000","last_undegraded":"2023-10-06T04:43:29.819304+0000","last_fullsized":"2023-10-06T04:43:29.819304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:38.867495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.798836+0000","last_change":"2023-10-06T04:43:28.812483+0000","last_active":"2023-10-06T04:43:29.798836+0000","last_peered":"2023-10-06T04:43:29.798836+0000","last_clean":"2023-10-06T04:43:29.798836+0000","last_became_active":"2023-10-06T04:43:28.812205+0000","last_became_peered":"2023-10-06T04:43:28.812205+0000","last_unstale":"2023-10-06T04:43:29.798836+0000","last_undegraded":"2023-10-06T04:43:29.798836+0000","last_fullsized":"2023-10-06T04:43:29.798836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:01:46.254188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.817975+0000","last_change":"2023-10-06T04:43:29.816479+0000","last_active":"2023-10-06T04:43:29.817975+0000","last_peered":"2023-10-06T04:43:29.817975+0000","last_clean":"2023-10-06T04:43:29.817975+0000","last_became_active":"2023-10-06T04:43:29.816006+0000","last_became_peered":"2023-10-06T04:43:29.816006+0000","last_unstale":"2023-10-06T04:43:29.817975+0000","last_undegraded":"2023-10-06T04:43:29.817975+0000","last_fullsized":"2023-10-06T04:43:29.817975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:24:11.932858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.821469+0000","last_change":"2023-10-06T04:43:28.807674+0000","last_active":"2023-10-06T04:43:29.821469+0000","last_peered":"2023-10-06T04:43:29.821469+0000","last_clean":"2023-10-06T04:43:29.821469+0000","last_became_active":"2023-10-06T04:43:28.807392+0000","last_became_peered":"2023-10-06T04:43:28.807392+0000","last_unstale":"2023-10-06T04:43:29.821469+0000","last_undegraded":"2023-10-06T04:43:29.821469+0000","last_fullsized":"2023-10-06T04:43:29.821469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:12.441174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.799442+0000","last_change":"2023-10-06T04:43:24.001927+0000","last_active":"2023-10-06T04:43:29.799442+0000","last_peered":"2023-10-06T04:43:29.799442+0000","last_clean":"2023-10-06T04:43:29.799442+0000","last_became_active":"2023-10-06T04:43:24.001591+0000","last_became_peered":"2023-10-06T04:43:24.001591+0000","last_unstale":"2023-10-06T04:43:29.799442+0000","last_undegraded":"2023-10-06T04:43:29.799442+0000","last_fullsized":"2023-10-06T04:43:29.799442+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:47.262845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818998+0000","last_change":"2023-10-06T04:43:29.818539+0000","last_active":"2023-10-06T04:43:29.818998+0000","last_peered":"2023-10-06T04:43:29.818998+0000","last_clean":"2023-10-06T04:43:29.818998+0000","last_became_active":"2023-10-06T04:43:29.818295+0000","last_became_peered":"2023-10-06T04:43:29.818295+0000","last_unstale":"2023-10-06T04:43:29.818998+0000","last_undegraded":"2023-10-06T04:43:29.818998+0000","last_fullsized":"2023-10-06T04:43:29.818998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:45.205428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.799574+0000","last_change":"2023-10-06T04:43:23.708597+0000","last_active":"2023-10-06T04:43:29.799574+0000","last_peered":"2023-10-06T04:43:29.799574+0000","last_clean":"2023-10-06T04:43:29.799574+0000","last_became_active":"2023-10-06T04:43:23.708317+0000","last_became_peered":"2023-10-06T04:43:23.708317+0000","last_unstale":"2023-10-06T04:43:29.799574+0000","last_undegraded":"2023-10-06T04:43:29.799574+0000","last_fullsized":"2023-10-06T04:43:29.799574+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:56.213068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:43:28.807461+0000","last_change":"2023-10-06T04:43:28.806470+0000","last_active":"2023-10-06T04:43:28.807461+0000","last_peered":"2023-10-06T04:43:28.807461+0000","last_clean":"2023-10-06T04:43:28.807461+0000","last_became_active":"2023-10-06T04:43:28.806176+0000","last_became_peered":"2023-10-06T04:43:28.806176+0000","last_unstale":"2023-10-06T04:43:28.807461+0000","last_undegraded":"2023-10-06T04:43:28.807461+0000","last_fullsized":"2023-10-06T04:43:28.807461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:56.458010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818530+0000","last_change":"2023-10-06T04:43:29.814129+0000","last_active":"2023-10-06T04:43:29.818530+0000","last_peered":"2023-10-06T04:43:29.818530+0000","last_clean":"2023-10-06T04:43:29.818530+0000","last_became_active":"2023-10-06T04:43:29.813867+0000","last_became_peered":"2023-10-06T04:43:29.813867+0000","last_unstale":"2023-10-06T04:43:29.818530+0000","last_undegraded":"2023-10-06T04:43:29.818530+0000","last_fullsized":"2023-10-06T04:43:29.818530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:23:24.496576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.791895+0000","last_change":"2023-10-06T04:43:23.708753+0000","last_active":"2023-10-06T04:43:29.791895+0000","last_peered":"2023-10-06T04:43:29.791895+0000","last_clean":"2023-10-06T04:43:29.791895+0000","last_became_active":"2023-10-06T04:43:23.708483+0000","last_became_peered":"2023-10-06T04:43:23.708483+0000","last_unstale":"2023-10-06T04:43:29.791895+0000","last_undegraded":"2023-10-06T04:43:29.791895+0000","last_fullsized":"2023-10-06T04:43:29.791895+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:47.262845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.794480+0000","last_change":"2023-10-06T04:43:23.706116+0000","last_active":"2023-10-06T04:43:29.794480+0000","last_peered":"2023-10-06T04:43:29.794480+0000","last_clean":"2023-10-06T04:43:29.794480+0000","last_became_active":"2023-10-06T04:43:23.705090+0000","last_became_peered":"2023-10-06T04:43:23.705090+0000","last_unstale":"2023-10-06T04:43:29.794480+0000","last_undegraded":"2023-10-06T04:43:29.794480+0000","last_fullsized":"2023-10-06T04:43:29.794480+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:29.869173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:43:28.806038+0000","last_change":"2023-10-06T04:43:28.802676+0000","last_active":"2023-10-06T04:43:28.806038+0000","last_peered":"2023-10-06T04:43:28.806038+0000","last_clean":"2023-10-06T04:43:28.806038+0000","last_became_active":"2023-10-06T04:43:28.802303+0000","last_became_peered":"2023-10-06T04:43:28.802303+0000","last_unstale":"2023-10-06T04:43:28.806038+0000","last_undegraded":"2023-10-06T04:43:28.806038+0000","last_fullsized":"2023-10-06T04:43:28.806038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:12.441174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.805169+0000","last_change":"2023-10-06T04:43:29.805169+0000","last_active":"2023-10-06T04:43:29.805169+0000","last_peered":"2023-10-06T04:43:29.805169+0000","last_clean":"2023-10-06T04:43:29.805169+0000","last_became_active":"2023-10-06T04:43:29.804916+0000","last_became_peered":"2023-10-06T04:43:29.804916+0000","last_unstale":"2023-10-06T04:43:29.805169+0000","last_undegraded":"2023-10-06T04:43:29.805169+0000","last_fullsized":"2023-10-06T04:43:29.805169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:23:24.496576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.795261+0000","last_change":"2023-10-06T04:43:24.002162+0000","last_active":"2023-10-06T04:43:29.795261+0000","last_peered":"2023-10-06T04:43:29.795261+0000","last_clean":"2023-10-06T04:43:29.795261+0000","last_became_active":"2023-10-06T04:43:24.001883+0000","last_became_peered":"2023-10-06T04:43:24.001883+0000","last_unstale":"2023-10-06T04:43:29.795261+0000","last_undegraded":"2023-10-06T04:43:29.795261+0000","last_fullsized":"2023-10-06T04:43:29.795261+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:51:11.168258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.791973+0000","last_change":"2023-10-06T04:43:28.805313+0000","last_active":"2023-10-06T04:43:29.791973+0000","last_peered":"2023-10-06T04:43:29.791973+0000","last_clean":"2023-10-06T04:43:29.791973+0000","last_became_active":"2023-10-06T04:43:28.805065+0000","last_became_peered":"2023-10-06T04:43:28.805065+0000","last_unstale":"2023-10-06T04:43:29.791973+0000","last_undegraded":"2023-10-06T04:43:29.791973+0000","last_fullsized":"2023-10-06T04:43:29.791973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:56.458010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.817957+0000","last_change":"2023-10-06T04:43:29.816196+0000","last_active":"2023-10-06T04:43:29.817957+0000","last_peered":"2023-10-06T04:43:29.817957+0000","last_clean":"2023-10-06T04:43:29.817957+0000","last_became_active":"2023-10-06T04:43:29.815882+0000","last_became_peered":"2023-10-06T04:43:29.815882+0000","last_unstale":"2023-10-06T04:43:29.817957+0000","last_undegraded":"2023-10-06T04:43:29.817957+0000","last_fullsized":"2023-10-06T04:43:29.817957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:51:05.152644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.794366+0000","last_change":"2023-10-06T04:43:24.002057+0000","last_active":"2023-10-06T04:43:29.794366+0000","last_peered":"2023-10-06T04:43:29.794366+0000","last_clean":"2023-10-06T04:43:29.794366+0000","last_became_active":"2023-10-06T04:43:24.001809+0000","last_became_peered":"2023-10-06T04:43:24.001809+0000","last_unstale":"2023-10-06T04:43:29.794366+0000","last_undegraded":"2023-10-06T04:43:29.794366+0000","last_fullsized":"2023-10-06T04:43:29.794366+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:49.693980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.798128+0000","last_change":"2023-10-06T04:43:28.808523+0000","last_active":"2023-10-06T04:43:29.798128+0000","last_peered":"2023-10-06T04:43:29.798128+0000","last_clean":"2023-10-06T04:43:29.798128+0000","last_became_active":"2023-10-06T04:43:28.808269+0000","last_became_peered":"2023-10-06T04:43:28.808269+0000","last_unstale":"2023-10-06T04:43:29.798128+0000","last_undegraded":"2023-10-06T04:43:29.798128+0000","last_fullsized":"2023-10-06T04:43:29.798128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:27.759735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.819416+0000","last_change":"2023-10-06T04:43:29.819416+0000","last_active":"2023-10-06T04:43:29.819416+0000","last_peered":"2023-10-06T04:43:29.819416+0000","last_clean":"2023-10-06T04:43:29.819416+0000","last_became_active":"2023-10-06T04:43:29.819099+0000","last_became_peered":"2023-10-06T04:43:29.819099+0000","last_unstale":"2023-10-06T04:43:29.819416+0000","last_undegraded":"2023-10-06T04:43:29.819416+0000","last_fullsized":"2023-10-06T04:43:29.819416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:54:36.378503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:43:28.804780+0000","last_change":"2023-10-06T04:43:24.002394+0000","last_active":"2023-10-06T04:43:28.804780+0000","last_peered":"2023-10-06T04:43:28.804780+0000","last_clean":"2023-10-06T04:43:28.804780+0000","last_became_active":"2023-10-06T04:43:24.001915+0000","last_became_peered":"2023-10-06T04:43:24.001915+0000","last_unstale":"2023-10-06T04:43:28.804780+0000","last_undegraded":"2023-10-06T04:43:28.804780+0000","last_fullsized":"2023-10-06T04:43:28.804780+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:45.031820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.797339+0000","last_change":"2023-10-06T04:43:28.806465+0000","last_active":"2023-10-06T04:43:29.797339+0000","last_peered":"2023-10-06T04:43:29.797339+0000","last_clean":"2023-10-06T04:43:29.797339+0000","last_became_active":"2023-10-06T04:43:28.806021+0000","last_became_peered":"2023-10-06T04:43:28.806021+0000","last_unstale":"2023-10-06T04:43:29.797339+0000","last_undegraded":"2023-10-06T04:43:29.797339+0000","last_fullsized":"2023-10-06T04:43:29.797339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:40.890108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.809755+0000","last_change":"2023-10-06T04:43:29.806132+0000","last_active":"2023-10-06T04:43:29.809755+0000","last_peered":"2023-10-06T04:43:29.809755+0000","last_clean":"2023-10-06T04:43:29.809755+0000","last_became_active":"2023-10-06T04:43:29.805881+0000","last_became_peered":"2023-10-06T04:43:29.805881+0000","last_unstale":"2023-10-06T04:43:29.809755+0000","last_undegraded":"2023-10-06T04:43:29.809755+0000","last_fullsized":"2023-10-06T04:43:29.809755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:07.658289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:43:28.796774+0000","last_change":"2023-10-06T04:43:24.002424+0000","last_active":"2023-10-06T04:43:28.796774+0000","last_peered":"2023-10-06T04:43:28.796774+0000","last_clean":"2023-10-06T04:43:28.796774+0000","last_became_active":"2023-10-06T04:43:24.002147+0000","last_became_peered":"2023-10-06T04:43:24.002147+0000","last_unstale":"2023-10-06T04:43:28.796774+0000","last_undegraded":"2023-10-06T04:43:28.796774+0000","last_fullsized":"2023-10-06T04:43:28.796774+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:45.031820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.792081+0000","last_change":"2023-10-06T04:43:28.808630+0000","last_active":"2023-10-06T04:43:29.792081+0000","last_peered":"2023-10-06T04:43:29.792081+0000","last_clean":"2023-10-06T04:43:29.792081+0000","last_became_active":"2023-10-06T04:43:28.808363+0000","last_became_peered":"2023-10-06T04:43:28.808363+0000","last_unstale":"2023-10-06T04:43:29.792081+0000","last_undegraded":"2023-10-06T04:43:29.792081+0000","last_fullsized":"2023-10-06T04:43:29.792081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:35.593992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.817659+0000","last_change":"2023-10-06T04:43:29.817659+0000","last_active":"2023-10-06T04:43:29.817659+0000","last_peered":"2023-10-06T04:43:29.817659+0000","last_clean":"2023-10-06T04:43:29.817659+0000","last_became_active":"2023-10-06T04:43:29.817387+0000","last_became_peered":"2023-10-06T04:43:29.817387+0000","last_unstale":"2023-10-06T04:43:29.817659+0000","last_undegraded":"2023-10-06T04:43:29.817659+0000","last_fullsized":"2023-10-06T04:43:29.817659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:15:36.021668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:43:28.797444+0000","last_change":"2023-10-06T04:43:23.707408+0000","last_active":"2023-10-06T04:43:28.797444+0000","last_peered":"2023-10-06T04:43:28.797444+0000","last_clean":"2023-10-06T04:43:28.797444+0000","last_became_active":"2023-10-06T04:43:23.707115+0000","last_became_peered":"2023-10-06T04:43:23.707115+0000","last_unstale":"2023-10-06T04:43:28.797444+0000","last_undegraded":"2023-10-06T04:43:28.797444+0000","last_fullsized":"2023-10-06T04:43:28.797444+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:56.213068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:43:28.816259+0000","last_change":"2023-10-06T04:43:28.808825+0000","last_active":"2023-10-06T04:43:28.816259+0000","last_peered":"2023-10-06T04:43:28.816259+0000","last_clean":"2023-10-06T04:43:28.816259+0000","last_became_active":"2023-10-06T04:43:28.808542+0000","last_became_peered":"2023-10-06T04:43:28.808542+0000","last_unstale":"2023-10-06T04:43:28.816259+0000","last_undegraded":"2023-10-06T04:43:28.816259+0000","last_fullsized":"2023-10-06T04:43:28.816259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:01:46.254188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.815131+0000","last_change":"2023-10-06T04:43:29.811314+0000","last_active":"2023-10-06T04:43:29.815131+0000","last_peered":"2023-10-06T04:43:29.815131+0000","last_clean":"2023-10-06T04:43:29.815131+0000","last_became_active":"2023-10-06T04:43:29.811044+0000","last_became_peered":"2023-10-06T04:43:29.811044+0000","last_unstale":"2023-10-06T04:43:29.815131+0000","last_undegraded":"2023-10-06T04:43:29.815131+0000","last_fullsized":"2023-10-06T04:43:29.815131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:11.452212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.795942+0000","last_change":"2023-10-06T04:43:28.804002+0000","last_active":"2023-10-06T04:43:29.795942+0000","last_peered":"2023-10-06T04:43:29.795942+0000","last_clean":"2023-10-06T04:43:29.795942+0000","last_became_active":"2023-10-06T04:43:28.803300+0000","last_became_peered":"2023-10-06T04:43:28.803300+0000","last_unstale":"2023-10-06T04:43:29.795942+0000","last_undegraded":"2023-10-06T04:43:29.795942+0000","last_fullsized":"2023-10-06T04:43:29.795942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:35.593992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.802812+0000","last_change":"2023-10-06T04:43:29.802812+0000","last_active":"2023-10-06T04:43:29.802812+0000","last_peered":"2023-10-06T04:43:29.802812+0000","last_clean":"2023-10-06T04:43:29.802812+0000","last_became_active":"2023-10-06T04:43:29.802567+0000","last_became_peered":"2023-10-06T04:43:29.802567+0000","last_unstale":"2023-10-06T04:43:29.802812+0000","last_undegraded":"2023-10-06T04:43:29.802812+0000","last_fullsized":"2023-10-06T04:43:29.802812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:28.765256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.821571+0000","last_change":"2023-10-06T04:43:28.811329+0000","last_active":"2023-10-06T04:43:29.821571+0000","last_peered":"2023-10-06T04:43:29.821571+0000","last_clean":"2023-10-06T04:43:29.821571+0000","last_became_active":"2023-10-06T04:43:28.811100+0000","last_became_peered":"2023-10-06T04:43:28.811100+0000","last_unstale":"2023-10-06T04:43:29.821571+0000","last_undegraded":"2023-10-06T04:43:29.821571+0000","last_fullsized":"2023-10-06T04:43:29.821571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:27.759735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.814112+0000","last_change":"2023-10-06T04:43:29.809102+0000","last_active":"2023-10-06T04:43:29.814112+0000","last_peered":"2023-10-06T04:43:29.814112+0000","last_clean":"2023-10-06T04:43:29.814112+0000","last_became_active":"2023-10-06T04:43:29.808096+0000","last_became_peered":"2023-10-06T04:43:29.808096+0000","last_unstale":"2023-10-06T04:43:29.814112+0000","last_undegraded":"2023-10-06T04:43:29.814112+0000","last_fullsized":"2023-10-06T04:43:29.814112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:11.842098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.820885+0000","last_change":"2023-10-06T04:43:28.812260+0000","last_active":"2023-10-06T04:43:29.820885+0000","last_peered":"2023-10-06T04:43:29.820885+0000","last_clean":"2023-10-06T04:43:29.820885+0000","last_became_active":"2023-10-06T04:43:28.811921+0000","last_became_peered":"2023-10-06T04:43:28.811921+0000","last_unstale":"2023-10-06T04:43:29.820885+0000","last_undegraded":"2023-10-06T04:43:29.820885+0000","last_fullsized":"2023-10-06T04:43:29.820885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:12.441174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818129+0000","last_change":"2023-10-06T04:43:29.814258+0000","last_active":"2023-10-06T04:43:29.818129+0000","last_peered":"2023-10-06T04:43:29.818129+0000","last_clean":"2023-10-06T04:43:29.818129+0000","last_became_active":"2023-10-06T04:43:29.811381+0000","last_became_peered":"2023-10-06T04:43:29.811381+0000","last_unstale":"2023-10-06T04:43:29.818129+0000","last_undegraded":"2023-10-06T04:43:29.818129+0000","last_fullsized":"2023-10-06T04:43:29.818129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:13:38.871291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.815419+0000","last_change":"2023-10-06T04:43:28.805288+0000","last_active":"2023-10-06T04:43:29.815419+0000","last_peered":"2023-10-06T04:43:29.815419+0000","last_clean":"2023-10-06T04:43:29.815419+0000","last_became_active":"2023-10-06T04:43:28.805005+0000","last_became_peered":"2023-10-06T04:43:28.805005+0000","last_unstale":"2023-10-06T04:43:29.815419+0000","last_undegraded":"2023-10-06T04:43:29.815419+0000","last_fullsized":"2023-10-06T04:43:29.815419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:05.582666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.815062+0000","last_change":"2023-10-06T04:43:29.808059+0000","last_active":"2023-10-06T04:43:29.815062+0000","last_peered":"2023-10-06T04:43:29.815062+0000","last_clean":"2023-10-06T04:43:29.815062+0000","last_became_active":"2023-10-06T04:43:29.806717+0000","last_became_peered":"2023-10-06T04:43:29.806717+0000","last_unstale":"2023-10-06T04:43:29.815062+0000","last_undegraded":"2023-10-06T04:43:29.815062+0000","last_fullsized":"2023-10-06T04:43:29.815062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:01.271919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.822237+0000","last_change":"2023-10-06T04:43:28.805496+0000","last_active":"2023-10-06T04:43:29.822237+0000","last_peered":"2023-10-06T04:43:29.822237+0000","last_clean":"2023-10-06T04:43:29.822237+0000","last_became_active":"2023-10-06T04:43:28.805197+0000","last_became_peered":"2023-10-06T04:43:28.805197+0000","last_unstale":"2023-10-06T04:43:29.822237+0000","last_undegraded":"2023-10-06T04:43:29.822237+0000","last_fullsized":"2023-10-06T04:43:29.822237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:27.759735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818411+0000","last_change":"2023-10-06T04:43:29.815066+0000","last_active":"2023-10-06T04:43:29.818411+0000","last_peered":"2023-10-06T04:43:29.818411+0000","last_clean":"2023-10-06T04:43:29.818411+0000","last_became_active":"2023-10-06T04:43:29.814792+0000","last_became_peered":"2023-10-06T04:43:29.814792+0000","last_unstale":"2023-10-06T04:43:29.818411+0000","last_undegraded":"2023-10-06T04:43:29.818411+0000","last_fullsized":"2023-10-06T04:43:29.818411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:54.115093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.809634+0000","last_change":"2023-10-06T04:43:29.809634+0000","last_active":"2023-10-06T04:43:29.809634+0000","last_peered":"2023-10-06T04:43:29.809634+0000","last_clean":"2023-10-06T04:43:29.809634+0000","last_became_active":"2023-10-06T04:43:29.809444+0000","last_became_peered":"2023-10-06T04:43:29.809444+0000","last_unstale":"2023-10-06T04:43:29.809634+0000","last_undegraded":"2023-10-06T04:43:29.809634+0000","last_fullsized":"2023-10-06T04:43:29.809634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:06.588187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.808156+0000","last_change":"2023-10-06T04:43:29.806722+0000","last_active":"2023-10-06T04:43:29.808156+0000","last_peered":"2023-10-06T04:43:29.808156+0000","last_clean":"2023-10-06T04:43:29.808156+0000","last_became_active":"2023-10-06T04:43:29.805603+0000","last_became_peered":"2023-10-06T04:43:29.805603+0000","last_unstale":"2023-10-06T04:43:29.808156+0000","last_undegraded":"2023-10-06T04:43:29.808156+0000","last_fullsized":"2023-10-06T04:43:29.808156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:10.192264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818169+0000","last_change":"2023-10-06T04:43:29.814788+0000","last_active":"2023-10-06T04:43:29.818169+0000","last_peered":"2023-10-06T04:43:29.818169+0000","last_clean":"2023-10-06T04:43:29.818169+0000","last_became_active":"2023-10-06T04:43:29.814509+0000","last_became_peered":"2023-10-06T04:43:29.814509+0000","last_unstale":"2023-10-06T04:43:29.818169+0000","last_undegraded":"2023-10-06T04:43:29.818169+0000","last_fullsized":"2023-10-06T04:43:29.818169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:21:23.533461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818470+0000","last_change":"2023-10-06T04:43:29.816479+0000","last_active":"2023-10-06T04:43:29.818470+0000","last_peered":"2023-10-06T04:43:29.818470+0000","last_clean":"2023-10-06T04:43:29.818470+0000","last_became_active":"2023-10-06T04:43:29.816181+0000","last_became_peered":"2023-10-06T04:43:29.816181+0000","last_unstale":"2023-10-06T04:43:29.818470+0000","last_undegraded":"2023-10-06T04:43:29.818470+0000","last_fullsized":"2023-10-06T04:43:29.818470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:23:24.496576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.810410+0000","last_change":"2023-10-06T04:43:29.808166+0000","last_active":"2023-10-06T04:43:29.810410+0000","last_peered":"2023-10-06T04:43:29.810410+0000","last_clean":"2023-10-06T04:43:29.810410+0000","last_became_active":"2023-10-06T04:43:29.807853+0000","last_became_peered":"2023-10-06T04:43:29.807853+0000","last_unstale":"2023-10-06T04:43:29.810410+0000","last_undegraded":"2023-10-06T04:43:29.810410+0000","last_fullsized":"2023-10-06T04:43:29.810410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:57.350546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298108,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073732,"statfs":{"total":96636764160,"available":96331501568,"internally_reserved":0,"allocated":839680,"data_stored":670963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":72202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298080,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073760,"statfs":{"total":96636764160,"available":96331530240,"internally_reserved":0,"allocated":811008,"data_stored":669211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":208896,"data_stored":72756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":72202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297504,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074336,"statfs":{"total":96636764160,"available":96332120064,"internally_reserved":0,"allocated":221184,"data_stored":78933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297520,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074320,"statfs":{"total":96636764160,"available":96332103680,"internally_reserved":0,"allocated":237568,"data_stored":80435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":72826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:43:33.918 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:43:34.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.067+0000 7f3fc5827700 1 Processor -- start 2023-10-06T04:43:34.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.067+0000 7f3fc5827700 1 -- start start 2023-10-06T04:43:34.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.068+0000 7f3fc5827700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3fc00ccfc0 0x7f3fc00cc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:34.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.068+0000 7f3fc5827700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc00cbd80 con 0x7f3fc00cf3b0 2023-10-06T04:43:34.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.068+0000 7f3fc5827700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc00af5f0 con 0x7f3fc00cc750 2023-10-06T04:43:34.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.068+0000 7f3fc5827700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc00af8d0 con 0x7f3fc00ccfc0 2023-10-06T04:43:34.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.068+0000 7f3fbffff700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f3fc00cf3b0 0x7f3fc01594a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:35898/0 (socket says 172.21.15.17:35898) 2023-10-06T04:43:34.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.068+0000 7f3fbffff700 1 -- 172.21.15.17:0/1555869146 learned_addr learned my addr 172.21.15.17:0/1555869146 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:34.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.068+0000 7f3fc4825700 1 --2- 172.21.15.17:0/1555869146 >> v2:172.21.15.136:3300/0 conn(0x7f3fc00ccfc0 0x7f3fc00cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:34.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.068+0000 7f3fbf7fe700 1 -- 172.21.15.17:0/1555869146 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 288912336 0 0) 0x7f3fc00cbd80 con 0x7f3fc00cf3b0 2023-10-06T04:43:34.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.068+0000 7f3fbf7fe700 1 -- 172.21.15.17:0/1555869146 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fb0003570 con 0x7f3fc00cf3b0 2023-10-06T04:43:34.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.069+0000 7f3fbf7fe700 1 -- 172.21.15.17:0/1555869146 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1997700175 0 0) 0x7f3fc00af5f0 con 0x7f3fc00cc750 2023-10-06T04:43:34.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.069+0000 7f3fbf7fe700 1 -- 172.21.15.17:0/1555869146 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fc00cbd80 con 0x7f3fc00cc750 2023-10-06T04:43:34.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.069+0000 7f3fbf7fe700 1 -- 172.21.15.17:0/1555869146 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 134738289 0 0) 0x7f3fb0003570 con 0x7f3fc00cf3b0 2023-10-06T04:43:34.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.069+0000 7f3fc4825700 1 -- 172.21.15.17:0/1555869146 >> v1:172.21.15.136:6789/0 conn(0x7f3fc00cc750 legacy=0x7f3fc00b0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:34.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.069+0000 7f3fc4825700 1 -- 172.21.15.17:0/1555869146 >> v1:172.21.15.17:6789/0 conn(0x7f3fc00cf3b0 legacy=0x7f3fc01594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:34.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.069+0000 7f3fc4825700 1 -- 172.21.15.17:0/1555869146 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc00afbb0 con 0x7f3fc00ccfc0 2023-10-06T04:43:34.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.069+0000 7f3fc4825700 1 --2- 172.21.15.17:0/1555869146 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fc00ccfc0 0x7f3fc00cc210 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4009910 tx=0x7f3fb40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ced12142cc91d58 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:34.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.069+0000 7f3fbf7fe700 1 -- 172.21.15.17:0/1555869146 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fac001470 con 0x7f3fc00ccfc0 2023-10-06T04:43:34.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.069+0000 7f3fbf7fe700 1 -- 172.21.15.17:0/1555869146 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb4011420 con 0x7f3fc00ccfc0 2023-10-06T04:43:34.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.069+0000 7f3fbf7fe700 1 -- 172.21.15.17:0/1555869146 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb40117c0 con 0x7f3fc00ccfc0 2023-10-06T04:43:34.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.070+0000 7f3fc5827700 1 -- 172.21.15.17:0/1555869146 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fc00ccfc0 msgr2=0x7f3fc00cc210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:34.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.070+0000 7f3fc5827700 1 --2- 172.21.15.17:0/1555869146 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fc00ccfc0 0x7f3fc00cc210 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4009910 tx=0x7f3fb40091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:34.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.070+0000 7f3fc5827700 1 -- 172.21.15.17:0/1555869146 shutdown_connections 2023-10-06T04:43:34.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.070+0000 7f3fc5827700 1 --2- 172.21.15.17:0/1555869146 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fc00ccfc0 0x7f3fc00cc210 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:34.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.070+0000 7f3fc5827700 1 -- 172.21.15.17:0/1555869146 >> 172.21.15.17:0/1555869146 conn(0x7f3fc006cff0 msgr2=0x7f3fc006da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:34.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.070+0000 7f3fc5827700 1 -- 172.21.15.17:0/1555869146 shutdown_connections 2023-10-06T04:43:34.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.070+0000 7f3fc5827700 1 -- 172.21.15.17:0/1555869146 wait complete. 2023-10-06T04:43:34.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.071+0000 7f3fc5827700 1 Processor -- start 2023-10-06T04:43:34.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.071+0000 7f3fc5827700 1 -- start start 2023-10-06T04:43:34.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.072+0000 7f3fc5827700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3fc00cc750 0x7f3fc01542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:34.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.072+0000 7f3fc5827700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fc00ccfc0 0x7f3fc016cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:34.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.072+0000 7f3fc5827700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fc00c9410 0x7f3fc01699a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:34.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.072+0000 7f3fc5827700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc00b5620 con 0x7f3fc00c9410 2023-10-06T04:43:34.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.072+0000 7f3fc5827700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc01547e0 con 0x7f3fc00ccfc0 2023-10-06T04:43:34.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.072+0000 7f3fc5827700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc00b3740 con 0x7f3fc00cc750 2023-10-06T04:43:34.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.072+0000 7f3fc5026700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fc00c9410 0x7f3fc01699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:34.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.072+0000 7f3fc5026700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fc00c9410 0x7f3fc01699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60920/0 (socket says 172.21.15.17:60920) 2023-10-06T04:43:34.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.072+0000 7f3fc5026700 1 -- 172.21.15.17:0/144748866 learned_addr learned my addr 172.21.15.17:0/144748866 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:34.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.072+0000 7f3fbffff700 1 --2- 172.21.15.17:0/144748866 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fc00ccfc0 0x7f3fc016cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:34.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.072+0000 7f3fc4825700 1 --2- 172.21.15.17:0/144748866 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3fc00cc750 0x7f3fc01542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:34.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.072+0000 7f3fc5026700 1 -- 172.21.15.17:0/144748866 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3fc00cc750 msgr2=0x7f3fc01542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:34.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.072+0000 7f3fc5026700 1 --2- 172.21.15.17:0/144748866 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3fc00cc750 0x7f3fc01542a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:34.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.072+0000 7f3fc5026700 1 -- 172.21.15.17:0/144748866 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fc00ccfc0 msgr2=0x7f3fc016cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:34.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.072+0000 7f3fc5026700 1 --2- 172.21.15.17:0/144748866 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fc00ccfc0 0x7f3fc016cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:34.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.072+0000 7f3fc5026700 1 -- 172.21.15.17:0/144748866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb4009420 con 0x7f3fc00c9410 2023-10-06T04:43:34.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.072+0000 7f3fc4825700 1 --2- 172.21.15.17:0/144748866 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3fc00cc750 0x7f3fc01542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:43:34.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.072+0000 7f3fc5026700 1 --2- 172.21.15.17:0/144748866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fc00c9410 0x7f3fc01699a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3fb800c910 tx=0x7f3fb80027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:34.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.072+0000 7f3fbcff9700 1 -- 172.21.15.17:0/144748866 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb800a7e0 con 0x7f3fc00c9410 2023-10-06T04:43:34.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.072+0000 7f3fbcff9700 1 -- 172.21.15.17:0/144748866 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb800a960 con 0x7f3fc00c9410 2023-10-06T04:43:34.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.072+0000 7f3fc5827700 1 -- 172.21.15.17:0/144748866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc016d8e0 con 0x7f3fc00c9410 2023-10-06T04:43:34.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.072+0000 7f3fbcff9700 1 -- 172.21.15.17:0/144748866 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb800ad20 con 0x7f3fc00c9410 2023-10-06T04:43:34.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.072+0000 7f3fc5827700 1 -- 172.21.15.17:0/144748866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc00b33d0 con 0x7f3fc00c9410 2023-10-06T04:43:34.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.073+0000 7f3fc5827700 1 -- 172.21.15.17:0/144748866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc004c380 con 0x7f3fc00c9410 2023-10-06T04:43:34.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.074+0000 7f3fbcff9700 1 -- 172.21.15.17:0/144748866 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3fb8012630 con 0x7f3fc00c9410 2023-10-06T04:43:34.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.074+0000 7f3fbcff9700 1 --2- 172.21.15.17:0/144748866 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3fa4066f30 0x7f3fa40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:34.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.074+0000 7f3fbcff9700 1 -- 172.21.15.17:0/144748866 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3fb8084b40 con 0x7f3fc00c9410 2023-10-06T04:43:34.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.074+0000 7f3fc4825700 1 --2- 172.21.15.17:0/144748866 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3fa4066f30 0x7f3fa40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:34.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.074+0000 7f3fc4825700 1 --2- 172.21.15.17:0/144748866 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3fa4066f30 0x7f3fa40693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3fc00aef30 tx=0x7f3fb4016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:34.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.078+0000 7f3fbcff9700 1 -- 172.21.15.17:0/144748866 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3fb8051c50 con 0x7f3fc00c9410 2023-10-06T04:43:34.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.266+0000 7f3fc5827700 1 -- 172.21.15.17:0/144748866 --> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3fc006c050 con 0x7f3fa4066f30 2023-10-06T04:43:34.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.274+0000 7f3fbcff9700 1 -- 172.21.15.17:0/144748866 <== mgr.4104 v2:172.21.15.17:6832/90424 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286891 (secure 0 0 0) 0x7f3fc006c050 con 0x7f3fa4066f30 2023-10-06T04:43:34.279 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:43:34.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.277+0000 7f3fc5827700 1 -- 172.21.15.17:0/144748866 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3fa4066f30 msgr2=0x7f3fa40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:34.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.277+0000 7f3fc5827700 1 --2- 172.21.15.17:0/144748866 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3fa4066f30 0x7f3fa40693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3fc00aef30 tx=0x7f3fb4016000 comp rx=0 tx=0).stop 2023-10-06T04:43:34.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.277+0000 7f3fc5827700 1 -- 172.21.15.17:0/144748866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fc00c9410 msgr2=0x7f3fc01699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:34.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.277+0000 7f3fc5827700 1 --2- 172.21.15.17:0/144748866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fc00c9410 0x7f3fc01699a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3fb800c910 tx=0x7f3fb80027a0 comp rx=0 tx=0).stop 2023-10-06T04:43:34.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.277+0000 7f3fc5827700 1 -- 172.21.15.17:0/144748866 shutdown_connections 2023-10-06T04:43:34.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.277+0000 7f3fc5827700 1 --2- 172.21.15.17:0/144748866 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3fa4066f30 0x7f3fa40693e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:34.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.277+0000 7f3fc5827700 1 --2- 172.21.15.17:0/144748866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fc00c9410 0x7f3fc01699a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:34.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.277+0000 7f3fc5827700 1 --2- 172.21.15.17:0/144748866 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3fc00cc750 0x7f3fc01542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:34.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.277+0000 7f3fc5827700 1 --2- 172.21.15.17:0/144748866 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fc00ccfc0 0x7f3fc016cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:34.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.277+0000 7f3fc5827700 1 -- 172.21.15.17:0/144748866 >> 172.21.15.17:0/144748866 conn(0x7f3fc006cff0 msgr2=0x7f3fc0156020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:34.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.277+0000 7f3fc5827700 1 -- 172.21.15.17:0/144748866 shutdown_connections 2023-10-06T04:43:34.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.277+0000 7f3fc5827700 1 -- 172.21.15.17:0/144748866 wait complete. 2023-10-06T04:43:34.282 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-06T04:43:34.291 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-10-06T04:43:32.335968+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381176,"kb_used_data":2872,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593544,"statfs":{"total":773094113280,"available":770655789056,"internally_reserved":0,"allocated":2940928,"data_stored":1789528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.551534"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.806928+0000","last_change":"2023-10-06T04:43:29.806928+0000","last_active":"2023-10-06T04:43:29.806928+0000","last_peered":"2023-10-06T04:43:29.806928+0000","last_clean":"2023-10-06T04:43:29.806928+0000","last_became_active":"2023-10-06T04:43:29.806647+0000","last_became_peered":"2023-10-06T04:43:29.806647+0000","last_unstale":"2023-10-06T04:43:29.806928+0000","last_undegraded":"2023-10-06T04:43:29.806928+0000","last_fullsized":"2023-10-06T04:43:29.806928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:36.599513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.816979+0000","last_change":"2023-10-06T04:43:29.816979+0000","last_active":"2023-10-06T04:43:29.816979+0000","last_peered":"2023-10-06T04:43:29.816979+0000","last_clean":"2023-10-06T04:43:29.816979+0000","last_became_active":"2023-10-06T04:43:29.812045+0000","last_became_peered":"2023-10-06T04:43:29.812045+0000","last_unstale":"2023-10-06T04:43:29.816979+0000","last_undegraded":"2023-10-06T04:43:29.816979+0000","last_fullsized":"2023-10-06T04:43:29.816979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:23:24.496576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818087+0000","last_change":"2023-10-06T04:43:29.811591+0000","last_active":"2023-10-06T04:43:29.818087+0000","last_peered":"2023-10-06T04:43:29.818087+0000","last_clean":"2023-10-06T04:43:29.818087+0000","last_became_active":"2023-10-06T04:43:29.810621+0000","last_became_peered":"2023-10-06T04:43:29.810621+0000","last_unstale":"2023-10-06T04:43:29.818087+0000","last_undegraded":"2023-10-06T04:43:29.818087+0000","last_fullsized":"2023-10-06T04:43:29.818087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:58.730973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.810774+0000","last_change":"2023-10-06T04:43:29.810774+0000","last_active":"2023-10-06T04:43:29.810774+0000","last_peered":"2023-10-06T04:43:29.810774+0000","last_clean":"2023-10-06T04:43:29.810774+0000","last_became_active":"2023-10-06T04:43:29.810469+0000","last_became_peered":"2023-10-06T04:43:29.810469+0000","last_unstale":"2023-10-06T04:43:29.810774+0000","last_undegraded":"2023-10-06T04:43:29.810774+0000","last_fullsized":"2023-10-06T04:43:29.810774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:00:08.876120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.804144+0000","last_change":"2023-10-06T04:43:29.804144+0000","last_active":"2023-10-06T04:43:29.804144+0000","last_peered":"2023-10-06T04:43:29.804144+0000","last_clean":"2023-10-06T04:43:29.804144+0000","last_became_active":"2023-10-06T04:43:29.803873+0000","last_became_peered":"2023-10-06T04:43:29.803873+0000","last_unstale":"2023-10-06T04:43:29.804144+0000","last_undegraded":"2023-10-06T04:43:29.804144+0000","last_fullsized":"2023-10-06T04:43:29.804144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:01.271919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.819195+0000","last_change":"2023-10-06T04:43:29.816295+0000","last_active":"2023-10-06T04:43:29.819195+0000","last_peered":"2023-10-06T04:43:29.819195+0000","last_clean":"2023-10-06T04:43:29.819195+0000","last_became_active":"2023-10-06T04:43:29.815965+0000","last_became_peered":"2023-10-06T04:43:29.815965+0000","last_unstale":"2023-10-06T04:43:29.819195+0000","last_undegraded":"2023-10-06T04:43:29.819195+0000","last_fullsized":"2023-10-06T04:43:29.819195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:55:19.523530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.820937+0000","last_change":"2023-10-06T04:43:29.807856+0000","last_active":"2023-10-06T04:43:29.820937+0000","last_peered":"2023-10-06T04:43:29.820937+0000","last_clean":"2023-10-06T04:43:29.820937+0000","last_became_active":"2023-10-06T04:43:29.807253+0000","last_became_peered":"2023-10-06T04:43:29.807253+0000","last_unstale":"2023-10-06T04:43:29.820937+0000","last_undegraded":"2023-10-06T04:43:29.820937+0000","last_fullsized":"2023-10-06T04:43:29.820937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:15:36.021668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.817890+0000","last_change":"2023-10-06T04:43:29.817890+0000","last_active":"2023-10-06T04:43:29.817890+0000","last_peered":"2023-10-06T04:43:29.817890+0000","last_clean":"2023-10-06T04:43:29.817890+0000","last_became_active":"2023-10-06T04:43:29.817653+0000","last_became_peered":"2023-10-06T04:43:29.817653+0000","last_unstale":"2023-10-06T04:43:29.817890+0000","last_undegraded":"2023-10-06T04:43:29.817890+0000","last_fullsized":"2023-10-06T04:43:29.817890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:11.685749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.815194+0000","last_change":"2023-10-06T04:43:29.815194+0000","last_active":"2023-10-06T04:43:29.815194+0000","last_peered":"2023-10-06T04:43:29.815194+0000","last_clean":"2023-10-06T04:43:29.815194+0000","last_became_active":"2023-10-06T04:43:29.814925+0000","last_became_peered":"2023-10-06T04:43:29.814925+0000","last_unstale":"2023-10-06T04:43:29.815194+0000","last_undegraded":"2023-10-06T04:43:29.815194+0000","last_fullsized":"2023-10-06T04:43:29.815194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:52.381232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.811845+0000","last_change":"2023-10-06T04:43:29.811845+0000","last_active":"2023-10-06T04:43:29.811845+0000","last_peered":"2023-10-06T04:43:29.811845+0000","last_clean":"2023-10-06T04:43:29.811845+0000","last_became_active":"2023-10-06T04:43:29.811569+0000","last_became_peered":"2023-10-06T04:43:29.811569+0000","last_unstale":"2023-10-06T04:43:29.811845+0000","last_undegraded":"2023-10-06T04:43:29.811845+0000","last_fullsized":"2023-10-06T04:43:29.811845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:11.452212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.819391+0000","last_change":"2023-10-06T04:43:29.815826+0000","last_active":"2023-10-06T04:43:29.819391+0000","last_peered":"2023-10-06T04:43:29.819391+0000","last_clean":"2023-10-06T04:43:29.819391+0000","last_became_active":"2023-10-06T04:43:29.811044+0000","last_became_peered":"2023-10-06T04:43:29.811044+0000","last_unstale":"2023-10-06T04:43:29.819391+0000","last_undegraded":"2023-10-06T04:43:29.819391+0000","last_fullsized":"2023-10-06T04:43:29.819391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:51.734715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.816792+0000","last_change":"2023-10-06T04:43:29.816792+0000","last_active":"2023-10-06T04:43:29.816792+0000","last_peered":"2023-10-06T04:43:29.816792+0000","last_clean":"2023-10-06T04:43:29.816792+0000","last_became_active":"2023-10-06T04:43:29.816556+0000","last_became_peered":"2023-10-06T04:43:29.816556+0000","last_unstale":"2023-10-06T04:43:29.816792+0000","last_undegraded":"2023-10-06T04:43:29.816792+0000","last_fullsized":"2023-10-06T04:43:29.816792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:01:47.259709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.808514+0000","last_change":"2023-10-06T04:43:29.808514+0000","last_active":"2023-10-06T04:43:29.808514+0000","last_peered":"2023-10-06T04:43:29.808514+0000","last_clean":"2023-10-06T04:43:29.808514+0000","last_became_active":"2023-10-06T04:43:29.808290+0000","last_became_peered":"2023-10-06T04:43:29.808290+0000","last_unstale":"2023-10-06T04:43:29.808514+0000","last_undegraded":"2023-10-06T04:43:29.808514+0000","last_fullsized":"2023-10-06T04:43:29.808514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:41.895629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.810539+0000","last_change":"2023-10-06T04:43:29.810539+0000","last_active":"2023-10-06T04:43:29.810539+0000","last_peered":"2023-10-06T04:43:29.810539+0000","last_clean":"2023-10-06T04:43:29.810539+0000","last_became_active":"2023-10-06T04:43:29.809976+0000","last_became_peered":"2023-10-06T04:43:29.809976+0000","last_unstale":"2023-10-06T04:43:29.810539+0000","last_undegraded":"2023-10-06T04:43:29.810539+0000","last_fullsized":"2023-10-06T04:43:29.810539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:07.658289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.820956+0000","last_change":"2023-10-06T04:43:29.808047+0000","last_active":"2023-10-06T04:43:29.820956+0000","last_peered":"2023-10-06T04:43:29.820956+0000","last_clean":"2023-10-06T04:43:29.820956+0000","last_became_active":"2023-10-06T04:43:29.807598+0000","last_became_peered":"2023-10-06T04:43:29.807598+0000","last_unstale":"2023-10-06T04:43:29.820956+0000","last_undegraded":"2023-10-06T04:43:29.820956+0000","last_fullsized":"2023-10-06T04:43:29.820956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:11.685749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.815174+0000","last_change":"2023-10-06T04:43:29.807538+0000","last_active":"2023-10-06T04:43:29.815174+0000","last_peered":"2023-10-06T04:43:29.815174+0000","last_clean":"2023-10-06T04:43:29.815174+0000","last_became_active":"2023-10-06T04:43:29.807299+0000","last_became_peered":"2023-10-06T04:43:29.807299+0000","last_unstale":"2023-10-06T04:43:29.815174+0000","last_undegraded":"2023-10-06T04:43:29.815174+0000","last_fullsized":"2023-10-06T04:43:29.815174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:15:36.021668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.816450+0000","last_change":"2023-10-06T04:43:29.816450+0000","last_active":"2023-10-06T04:43:29.816450+0000","last_peered":"2023-10-06T04:43:29.816450+0000","last_clean":"2023-10-06T04:43:29.816450+0000","last_became_active":"2023-10-06T04:43:29.816180+0000","last_became_peered":"2023-10-06T04:43:29.816180+0000","last_unstale":"2023-10-06T04:43:29.816450+0000","last_undegraded":"2023-10-06T04:43:29.816450+0000","last_fullsized":"2023-10-06T04:43:29.816450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:45.205428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818676+0000","last_change":"2023-10-06T04:43:29.815225+0000","last_active":"2023-10-06T04:43:29.818676+0000","last_peered":"2023-10-06T04:43:29.818676+0000","last_clean":"2023-10-06T04:43:29.818676+0000","last_became_active":"2023-10-06T04:43:29.814940+0000","last_became_peered":"2023-10-06T04:43:29.814940+0000","last_unstale":"2023-10-06T04:43:29.818676+0000","last_undegraded":"2023-10-06T04:43:29.818676+0000","last_fullsized":"2023-10-06T04:43:29.818676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:01.271919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.814413+0000","last_change":"2023-10-06T04:43:29.814413+0000","last_active":"2023-10-06T04:43:29.814413+0000","last_peered":"2023-10-06T04:43:29.814413+0000","last_clean":"2023-10-06T04:43:29.814413+0000","last_became_active":"2023-10-06T04:43:29.814183+0000","last_became_peered":"2023-10-06T04:43:29.814183+0000","last_unstale":"2023-10-06T04:43:29.814413+0000","last_undegraded":"2023-10-06T04:43:29.814413+0000","last_fullsized":"2023-10-06T04:43:29.814413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:13.446695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.819145+0000","last_change":"2023-10-06T04:43:29.816764+0000","last_active":"2023-10-06T04:43:29.819145+0000","last_peered":"2023-10-06T04:43:29.819145+0000","last_clean":"2023-10-06T04:43:29.819145+0000","last_became_active":"2023-10-06T04:43:29.816331+0000","last_became_peered":"2023-10-06T04:43:29.816331+0000","last_unstale":"2023-10-06T04:43:29.819145+0000","last_undegraded":"2023-10-06T04:43:29.819145+0000","last_fullsized":"2023-10-06T04:43:29.819145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:30.317282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.820849+0000","last_change":"2023-10-06T04:43:29.808614+0000","last_active":"2023-10-06T04:43:29.820849+0000","last_peered":"2023-10-06T04:43:29.820849+0000","last_clean":"2023-10-06T04:43:29.820849+0000","last_became_active":"2023-10-06T04:43:29.808340+0000","last_became_peered":"2023-10-06T04:43:29.808340+0000","last_unstale":"2023-10-06T04:43:29.820849+0000","last_undegraded":"2023-10-06T04:43:29.820849+0000","last_fullsized":"2023-10-06T04:43:29.820849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:34.271308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.802581+0000","last_change":"2023-10-06T04:43:29.802581+0000","last_active":"2023-10-06T04:43:29.802581+0000","last_peered":"2023-10-06T04:43:29.802581+0000","last_clean":"2023-10-06T04:43:29.802581+0000","last_became_active":"2023-10-06T04:43:29.802296+0000","last_became_peered":"2023-10-06T04:43:29.802296+0000","last_unstale":"2023-10-06T04:43:29.802581+0000","last_undegraded":"2023-10-06T04:43:29.802581+0000","last_fullsized":"2023-10-06T04:43:29.802581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:34.271308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.812033+0000","last_change":"2023-10-06T04:43:29.807277+0000","last_active":"2023-10-06T04:43:29.812033+0000","last_peered":"2023-10-06T04:43:29.812033+0000","last_clean":"2023-10-06T04:43:29.812033+0000","last_became_active":"2023-10-06T04:43:29.807007+0000","last_became_peered":"2023-10-06T04:43:29.807007+0000","last_unstale":"2023-10-06T04:43:29.812033+0000","last_undegraded":"2023-10-06T04:43:29.812033+0000","last_fullsized":"2023-10-06T04:43:29.812033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:51.734715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.820779+0000","last_change":"2023-10-06T04:43:29.807216+0000","last_active":"2023-10-06T04:43:29.820779+0000","last_peered":"2023-10-06T04:43:29.820779+0000","last_clean":"2023-10-06T04:43:29.820779+0000","last_became_active":"2023-10-06T04:43:29.806926+0000","last_became_peered":"2023-10-06T04:43:29.806926+0000","last_unstale":"2023-10-06T04:43:29.820779+0000","last_undegraded":"2023-10-06T04:43:29.820779+0000","last_fullsized":"2023-10-06T04:43:29.820779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:45.205428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.811127+0000","last_change":"2023-10-06T04:43:29.809554+0000","last_active":"2023-10-06T04:43:29.811127+0000","last_peered":"2023-10-06T04:43:29.811127+0000","last_clean":"2023-10-06T04:43:29.811127+0000","last_became_active":"2023-10-06T04:43:29.809289+0000","last_became_peered":"2023-10-06T04:43:29.809289+0000","last_unstale":"2023-10-06T04:43:29.811127+0000","last_undegraded":"2023-10-06T04:43:29.811127+0000","last_fullsized":"2023-10-06T04:43:29.811127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:11.685749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.807574+0000","last_change":"2023-10-06T04:43:29.802420+0000","last_active":"2023-10-06T04:43:29.807574+0000","last_peered":"2023-10-06T04:43:29.807574+0000","last_clean":"2023-10-06T04:43:29.807574+0000","last_became_active":"2023-10-06T04:43:29.802164+0000","last_became_peered":"2023-10-06T04:43:29.802164+0000","last_unstale":"2023-10-06T04:43:29.807574+0000","last_undegraded":"2023-10-06T04:43:29.807574+0000","last_fullsized":"2023-10-06T04:43:29.807574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:40.869182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.820720+0000","last_change":"2023-10-06T04:43:29.820720+0000","last_active":"2023-10-06T04:43:29.820720+0000","last_peered":"2023-10-06T04:43:29.820720+0000","last_clean":"2023-10-06T04:43:29.820720+0000","last_became_active":"2023-10-06T04:43:29.817226+0000","last_became_peered":"2023-10-06T04:43:29.817226+0000","last_unstale":"2023-10-06T04:43:29.820720+0000","last_undegraded":"2023-10-06T04:43:29.820720+0000","last_fullsized":"2023-10-06T04:43:29.820720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:45.205428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.821084+0000","last_change":"2023-10-06T04:43:28.805712+0000","last_active":"2023-10-06T04:43:29.821084+0000","last_peered":"2023-10-06T04:43:29.821084+0000","last_clean":"2023-10-06T04:43:29.821084+0000","last_became_active":"2023-10-06T04:43:28.805368+0000","last_became_peered":"2023-10-06T04:43:28.805368+0000","last_unstale":"2023-10-06T04:43:29.821084+0000","last_undegraded":"2023-10-06T04:43:29.821084+0000","last_fullsized":"2023-10-06T04:43:29.821084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:12.441174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.808717+0000","last_change":"2023-10-06T04:43:29.806230+0000","last_active":"2023-10-06T04:43:29.808717+0000","last_peered":"2023-10-06T04:43:29.808717+0000","last_clean":"2023-10-06T04:43:29.808717+0000","last_became_active":"2023-10-06T04:43:29.805977+0000","last_became_peered":"2023-10-06T04:43:29.805977+0000","last_unstale":"2023-10-06T04:43:29.808717+0000","last_undegraded":"2023-10-06T04:43:29.808717+0000","last_fullsized":"2023-10-06T04:43:29.808717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:11.727749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.791893+0000","last_change":"2023-10-06T04:43:28.810385+0000","last_active":"2023-10-06T04:43:29.791893+0000","last_peered":"2023-10-06T04:43:29.791893+0000","last_clean":"2023-10-06T04:43:29.791893+0000","last_became_active":"2023-10-06T04:43:28.810187+0000","last_became_peered":"2023-10-06T04:43:28.810187+0000","last_unstale":"2023-10-06T04:43:29.791893+0000","last_undegraded":"2023-10-06T04:43:29.791893+0000","last_fullsized":"2023-10-06T04:43:29.791893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:40.890108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.799004+0000","last_change":"2023-10-06T04:43:29.799004+0000","last_active":"2023-10-06T04:43:29.799004+0000","last_peered":"2023-10-06T04:43:29.799004+0000","last_clean":"2023-10-06T04:43:29.799004+0000","last_became_active":"2023-10-06T04:43:29.798724+0000","last_became_peered":"2023-10-06T04:43:29.798724+0000","last_unstale":"2023-10-06T04:43:29.799004+0000","last_undegraded":"2023-10-06T04:43:29.799004+0000","last_fullsized":"2023-10-06T04:43:29.799004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:11.685749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.799049+0000","last_change":"2023-10-06T04:43:28.807299+0000","last_active":"2023-10-06T04:43:29.799049+0000","last_peered":"2023-10-06T04:43:29.799049+0000","last_clean":"2023-10-06T04:43:29.799049+0000","last_became_active":"2023-10-06T04:43:28.806721+0000","last_became_peered":"2023-10-06T04:43:28.806721+0000","last_unstale":"2023-10-06T04:43:29.799049+0000","last_undegraded":"2023-10-06T04:43:29.799049+0000","last_fullsized":"2023-10-06T04:43:29.799049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:50:16.072055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.816337+0000","last_change":"2023-10-06T04:43:29.816337+0000","last_active":"2023-10-06T04:43:29.816337+0000","last_peered":"2023-10-06T04:43:29.816337+0000","last_clean":"2023-10-06T04:43:29.816337+0000","last_became_active":"2023-10-06T04:43:29.816020+0000","last_became_peered":"2023-10-06T04:43:29.816020+0000","last_unstale":"2023-10-06T04:43:29.816337+0000","last_undegraded":"2023-10-06T04:43:29.816337+0000","last_fullsized":"2023-10-06T04:43:29.816337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:40.869182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:43:28.807364+0000","last_change":"2023-10-06T04:43:28.805467+0000","last_active":"2023-10-06T04:43:28.807364+0000","last_peered":"2023-10-06T04:43:28.807364+0000","last_clean":"2023-10-06T04:43:28.807364+0000","last_became_active":"2023-10-06T04:43:28.804827+0000","last_became_peered":"2023-10-06T04:43:28.804827+0000","last_unstale":"2023-10-06T04:43:28.807364+0000","last_undegraded":"2023-10-06T04:43:28.807364+0000","last_fullsized":"2023-10-06T04:43:28.807364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:01:46.254188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.808207+0000","last_change":"2023-10-06T04:43:29.806347+0000","last_active":"2023-10-06T04:43:29.808207+0000","last_peered":"2023-10-06T04:43:29.808207+0000","last_clean":"2023-10-06T04:43:29.808207+0000","last_became_active":"2023-10-06T04:43:29.803738+0000","last_became_peered":"2023-10-06T04:43:29.803738+0000","last_unstale":"2023-10-06T04:43:29.808207+0000","last_undegraded":"2023-10-06T04:43:29.808207+0000","last_fullsized":"2023-10-06T04:43:29.808207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:54.115093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:43:28.816228+0000","last_change":"2023-10-06T04:43:28.808150+0000","last_active":"2023-10-06T04:43:28.816228+0000","last_peered":"2023-10-06T04:43:28.816228+0000","last_clean":"2023-10-06T04:43:28.816228+0000","last_became_active":"2023-10-06T04:43:28.807880+0000","last_became_peered":"2023-10-06T04:43:28.807880+0000","last_unstale":"2023-10-06T04:43:28.816228+0000","last_undegraded":"2023-10-06T04:43:28.816228+0000","last_fullsized":"2023-10-06T04:43:28.816228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:40.890108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.815591+0000","last_change":"2023-10-06T04:43:29.813344+0000","last_active":"2023-10-06T04:43:29.815591+0000","last_peered":"2023-10-06T04:43:29.815591+0000","last_clean":"2023-10-06T04:43:29.815591+0000","last_became_active":"2023-10-06T04:43:29.813115+0000","last_became_peered":"2023-10-06T04:43:29.813115+0000","last_unstale":"2023-10-06T04:43:29.815591+0000","last_undegraded":"2023-10-06T04:43:29.815591+0000","last_fullsized":"2023-10-06T04:43:29.815591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:52.381232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.815998+0000","last_change":"2023-10-06T04:43:28.807514+0000","last_active":"2023-10-06T04:43:29.815998+0000","last_peered":"2023-10-06T04:43:29.815998+0000","last_clean":"2023-10-06T04:43:29.815998+0000","last_became_active":"2023-10-06T04:43:28.807226+0000","last_became_peered":"2023-10-06T04:43:28.807226+0000","last_unstale":"2023-10-06T04:43:29.815998+0000","last_undegraded":"2023-10-06T04:43:29.815998+0000","last_fullsized":"2023-10-06T04:43:29.815998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:54:35.372982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.812081+0000","last_change":"2023-10-06T04:43:29.810145+0000","last_active":"2023-10-06T04:43:29.812081+0000","last_peered":"2023-10-06T04:43:29.812081+0000","last_clean":"2023-10-06T04:43:29.812081+0000","last_became_active":"2023-10-06T04:43:29.809512+0000","last_became_peered":"2023-10-06T04:43:29.809512+0000","last_unstale":"2023-10-06T04:43:29.812081+0000","last_undegraded":"2023-10-06T04:43:29.812081+0000","last_fullsized":"2023-10-06T04:43:29.812081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:15:36.021668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.825075+0000","last_change":"2023-10-06T04:43:28.803587+0000","last_active":"2023-10-06T04:43:29.825075+0000","last_peered":"2023-10-06T04:43:29.825075+0000","last_clean":"2023-10-06T04:43:29.825075+0000","last_became_active":"2023-10-06T04:43:28.801777+0000","last_became_peered":"2023-10-06T04:43:28.801777+0000","last_unstale":"2023-10-06T04:43:29.825075+0000","last_undegraded":"2023-10-06T04:43:29.825075+0000","last_fullsized":"2023-10-06T04:43:29.825075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:56.458010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818645+0000","last_change":"2023-10-06T04:43:29.815592+0000","last_active":"2023-10-06T04:43:29.818645+0000","last_peered":"2023-10-06T04:43:29.818645+0000","last_clean":"2023-10-06T04:43:29.818645+0000","last_became_active":"2023-10-06T04:43:29.815322+0000","last_became_peered":"2023-10-06T04:43:29.815322+0000","last_unstale":"2023-10-06T04:43:29.818645+0000","last_undegraded":"2023-10-06T04:43:29.818645+0000","last_fullsized":"2023-10-06T04:43:29.818645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:10.192264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.817564+0000","last_change":"2023-10-06T04:43:28.802843+0000","last_active":"2023-10-06T04:43:29.817564+0000","last_peered":"2023-10-06T04:43:29.817564+0000","last_clean":"2023-10-06T04:43:29.817564+0000","last_became_active":"2023-10-06T04:43:28.802554+0000","last_became_peered":"2023-10-06T04:43:28.802554+0000","last_unstale":"2023-10-06T04:43:29.817564+0000","last_undegraded":"2023-10-06T04:43:29.817564+0000","last_fullsized":"2023-10-06T04:43:29.817564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:00:07.870599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.808168+0000","last_change":"2023-10-06T04:43:29.805945+0000","last_active":"2023-10-06T04:43:29.808168+0000","last_peered":"2023-10-06T04:43:29.808168+0000","last_clean":"2023-10-06T04:43:29.808168+0000","last_became_active":"2023-10-06T04:43:29.805658+0000","last_became_peered":"2023-10-06T04:43:29.805658+0000","last_unstale":"2023-10-06T04:43:29.808168+0000","last_undegraded":"2023-10-06T04:43:29.808168+0000","last_fullsized":"2023-10-06T04:43:29.808168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:38.867495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:43:28.804449+0000","last_change":"2023-10-06T04:43:28.797338+0000","last_active":"2023-10-06T04:43:28.804449+0000","last_peered":"2023-10-06T04:43:28.804449+0000","last_clean":"2023-10-06T04:43:28.804449+0000","last_became_active":"2023-10-06T04:43:28.797048+0000","last_became_peered":"2023-10-06T04:43:28.797048+0000","last_unstale":"2023-10-06T04:43:28.804449+0000","last_undegraded":"2023-10-06T04:43:28.804449+0000","last_fullsized":"2023-10-06T04:43:28.804449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:40.890108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.820733+0000","last_change":"2023-10-06T04:43:29.820733+0000","last_active":"2023-10-06T04:43:29.820733+0000","last_peered":"2023-10-06T04:43:29.820733+0000","last_clean":"2023-10-06T04:43:29.820733+0000","last_became_active":"2023-10-06T04:43:29.817165+0000","last_became_peered":"2023-10-06T04:43:29.817165+0000","last_unstale":"2023-10-06T04:43:29.820733+0000","last_undegraded":"2023-10-06T04:43:29.820733+0000","last_fullsized":"2023-10-06T04:43:29.820733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:34.271308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.795120+0000","last_change":"2023-10-06T04:43:28.806709+0000","last_active":"2023-10-06T04:43:29.795120+0000","last_peered":"2023-10-06T04:43:29.795120+0000","last_clean":"2023-10-06T04:43:29.795120+0000","last_became_active":"2023-10-06T04:43:28.806455+0000","last_became_peered":"2023-10-06T04:43:28.806455+0000","last_unstale":"2023-10-06T04:43:29.795120+0000","last_undegraded":"2023-10-06T04:43:29.795120+0000","last_fullsized":"2023-10-06T04:43:29.795120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:05.582666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.807303+0000","last_change":"2023-10-06T04:43:29.807303+0000","last_active":"2023-10-06T04:43:29.807303+0000","last_peered":"2023-10-06T04:43:29.807303+0000","last_clean":"2023-10-06T04:43:29.807303+0000","last_became_active":"2023-10-06T04:43:29.807034+0000","last_became_peered":"2023-10-06T04:43:29.807034+0000","last_unstale":"2023-10-06T04:43:29.807303+0000","last_undegraded":"2023-10-06T04:43:29.807303+0000","last_fullsized":"2023-10-06T04:43:29.807303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:51.734715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.819470+0000","last_change":"2023-10-06T04:43:28.807312+0000","last_active":"2023-10-06T04:43:29.819470+0000","last_peered":"2023-10-06T04:43:29.819470+0000","last_clean":"2023-10-06T04:43:29.819470+0000","last_became_active":"2023-10-06T04:43:28.807035+0000","last_became_peered":"2023-10-06T04:43:28.807035+0000","last_unstale":"2023-10-06T04:43:29.819470+0000","last_undegraded":"2023-10-06T04:43:29.819470+0000","last_fullsized":"2023-10-06T04:43:29.819470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:35.593992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818496+0000","last_change":"2023-10-06T04:43:29.816482+0000","last_active":"2023-10-06T04:43:29.818496+0000","last_peered":"2023-10-06T04:43:29.818496+0000","last_clean":"2023-10-06T04:43:29.818496+0000","last_became_active":"2023-10-06T04:43:29.816211+0000","last_became_peered":"2023-10-06T04:43:29.816211+0000","last_unstale":"2023-10-06T04:43:29.818496+0000","last_undegraded":"2023-10-06T04:43:29.818496+0000","last_fullsized":"2023-10-06T04:43:29.818496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:34.271308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.820686+0000","last_change":"2023-10-06T04:43:28.805958+0000","last_active":"2023-10-06T04:43:29.820686+0000","last_peered":"2023-10-06T04:43:29.820686+0000","last_clean":"2023-10-06T04:43:29.820686+0000","last_became_active":"2023-10-06T04:43:28.805675+0000","last_became_peered":"2023-10-06T04:43:28.805675+0000","last_unstale":"2023-10-06T04:43:29.820686+0000","last_undegraded":"2023-10-06T04:43:29.820686+0000","last_fullsized":"2023-10-06T04:43:29.820686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:54.712639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.819947+0000","last_change":"2023-10-06T04:43:29.819947+0000","last_active":"2023-10-06T04:43:29.819947+0000","last_peered":"2023-10-06T04:43:29.819947+0000","last_clean":"2023-10-06T04:43:29.819947+0000","last_became_active":"2023-10-06T04:43:29.819674+0000","last_became_peered":"2023-10-06T04:43:29.819674+0000","last_unstale":"2023-10-06T04:43:29.819947+0000","last_undegraded":"2023-10-06T04:43:29.819947+0000","last_fullsized":"2023-10-06T04:43:29.819947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:51:05.152644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.817116+0000","last_change":"2023-10-06T04:43:28.805900+0000","last_active":"2023-10-06T04:43:29.817116+0000","last_peered":"2023-10-06T04:43:29.817116+0000","last_clean":"2023-10-06T04:43:29.817116+0000","last_became_active":"2023-10-06T04:43:28.805647+0000","last_became_peered":"2023-10-06T04:43:28.805647+0000","last_unstale":"2023-10-06T04:43:29.817116+0000","last_undegraded":"2023-10-06T04:43:29.817116+0000","last_fullsized":"2023-10-06T04:43:29.817116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:37.340861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.814241+0000","last_change":"2023-10-06T04:43:29.809549+0000","last_active":"2023-10-06T04:43:29.814241+0000","last_peered":"2023-10-06T04:43:29.814241+0000","last_clean":"2023-10-06T04:43:29.814241+0000","last_became_active":"2023-10-06T04:43:29.809252+0000","last_became_peered":"2023-10-06T04:43:29.809252+0000","last_unstale":"2023-10-06T04:43:29.814241+0000","last_undegraded":"2023-10-06T04:43:29.814241+0000","last_fullsized":"2023-10-06T04:43:29.814241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:52.381232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.816103+0000","last_change":"2023-10-06T04:43:28.809092+0000","last_active":"2023-10-06T04:43:29.816103+0000","last_peered":"2023-10-06T04:43:29.816103+0000","last_clean":"2023-10-06T04:43:29.816103+0000","last_became_active":"2023-10-06T04:43:28.808653+0000","last_became_peered":"2023-10-06T04:43:28.808653+0000","last_unstale":"2023-10-06T04:43:29.816103+0000","last_undegraded":"2023-10-06T04:43:29.816103+0000","last_fullsized":"2023-10-06T04:43:29.816103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:39.863661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.812475+0000","last_change":"2023-10-06T04:43:29.812475+0000","last_active":"2023-10-06T04:43:29.812475+0000","last_peered":"2023-10-06T04:43:29.812475+0000","last_clean":"2023-10-06T04:43:29.812475+0000","last_became_active":"2023-10-06T04:43:29.812062+0000","last_became_peered":"2023-10-06T04:43:29.812062+0000","last_unstale":"2023-10-06T04:43:29.812475+0000","last_undegraded":"2023-10-06T04:43:29.812475+0000","last_fullsized":"2023-10-06T04:43:29.812475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:38.346382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:43:28.813425+0000","last_change":"2023-10-06T04:43:28.807693+0000","last_active":"2023-10-06T04:43:28.813425+0000","last_peered":"2023-10-06T04:43:28.813425+0000","last_clean":"2023-10-06T04:43:28.813425+0000","last_became_active":"2023-10-06T04:43:28.807432+0000","last_became_peered":"2023-10-06T04:43:28.807432+0000","last_unstale":"2023-10-06T04:43:28.813425+0000","last_undegraded":"2023-10-06T04:43:28.813425+0000","last_fullsized":"2023-10-06T04:43:28.813425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:50:16.072055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.805692+0000","last_change":"2023-10-06T04:43:29.805692+0000","last_active":"2023-10-06T04:43:29.805692+0000","last_peered":"2023-10-06T04:43:29.805692+0000","last_clean":"2023-10-06T04:43:29.805692+0000","last_became_active":"2023-10-06T04:43:29.805453+0000","last_became_peered":"2023-10-06T04:43:29.805453+0000","last_unstale":"2023-10-06T04:43:29.805692+0000","last_undegraded":"2023-10-06T04:43:29.805692+0000","last_fullsized":"2023-10-06T04:43:29.805692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:24:11.932858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.817215+0000","last_change":"2023-10-06T04:43:28.807062+0000","last_active":"2023-10-06T04:43:29.817215+0000","last_peered":"2023-10-06T04:43:29.817215+0000","last_clean":"2023-10-06T04:43:29.817215+0000","last_became_active":"2023-10-06T04:43:28.806751+0000","last_became_peered":"2023-10-06T04:43:28.806751+0000","last_unstale":"2023-10-06T04:43:29.817215+0000","last_undegraded":"2023-10-06T04:43:29.817215+0000","last_fullsized":"2023-10-06T04:43:29.817215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:54.712639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.819043+0000","last_change":"2023-10-06T04:43:29.815942+0000","last_active":"2023-10-06T04:43:29.819043+0000","last_peered":"2023-10-06T04:43:29.819043+0000","last_clean":"2023-10-06T04:43:29.819043+0000","last_became_active":"2023-10-06T04:43:29.815608+0000","last_became_peered":"2023-10-06T04:43:29.815608+0000","last_unstale":"2023-10-06T04:43:29.819043+0000","last_undegraded":"2023-10-06T04:43:29.819043+0000","last_fullsized":"2023-10-06T04:43:29.819043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:39:19.542778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:43:28.816232+0000","last_change":"2023-10-06T04:43:28.811867+0000","last_active":"2023-10-06T04:43:28.816232+0000","last_peered":"2023-10-06T04:43:28.816232+0000","last_clean":"2023-10-06T04:43:28.816232+0000","last_became_active":"2023-10-06T04:43:28.811616+0000","last_became_peered":"2023-10-06T04:43:28.811616+0000","last_unstale":"2023-10-06T04:43:28.816232+0000","last_undegraded":"2023-10-06T04:43:28.816232+0000","last_fullsized":"2023-10-06T04:43:28.816232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:56.458010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818108+0000","last_change":"2023-10-06T04:43:29.813764+0000","last_active":"2023-10-06T04:43:29.818108+0000","last_peered":"2023-10-06T04:43:29.818108+0000","last_clean":"2023-10-06T04:43:29.818108+0000","last_became_active":"2023-10-06T04:43:29.811411+0000","last_became_peered":"2023-10-06T04:43:29.811411+0000","last_unstale":"2023-10-06T04:43:29.818108+0000","last_undegraded":"2023-10-06T04:43:29.818108+0000","last_fullsized":"2023-10-06T04:43:29.818108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:11.727749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.797267+0000","last_change":"2023-10-06T04:43:28.804269+0000","last_active":"2023-10-06T04:43:29.797267+0000","last_peered":"2023-10-06T04:43:29.797267+0000","last_clean":"2023-10-06T04:43:29.797267+0000","last_became_active":"2023-10-06T04:43:28.802873+0000","last_became_peered":"2023-10-06T04:43:28.802873+0000","last_unstale":"2023-10-06T04:43:29.797267+0000","last_undegraded":"2023-10-06T04:43:29.797267+0000","last_fullsized":"2023-10-06T04:43:29.797267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:35.593992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.819304+0000","last_change":"2023-10-06T04:43:29.816924+0000","last_active":"2023-10-06T04:43:29.819304+0000","last_peered":"2023-10-06T04:43:29.819304+0000","last_clean":"2023-10-06T04:43:29.819304+0000","last_became_active":"2023-10-06T04:43:29.816649+0000","last_became_peered":"2023-10-06T04:43:29.816649+0000","last_unstale":"2023-10-06T04:43:29.819304+0000","last_undegraded":"2023-10-06T04:43:29.819304+0000","last_fullsized":"2023-10-06T04:43:29.819304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:38.867495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.798836+0000","last_change":"2023-10-06T04:43:28.812483+0000","last_active":"2023-10-06T04:43:29.798836+0000","last_peered":"2023-10-06T04:43:29.798836+0000","last_clean":"2023-10-06T04:43:29.798836+0000","last_became_active":"2023-10-06T04:43:28.812205+0000","last_became_peered":"2023-10-06T04:43:28.812205+0000","last_unstale":"2023-10-06T04:43:29.798836+0000","last_undegraded":"2023-10-06T04:43:29.798836+0000","last_fullsized":"2023-10-06T04:43:29.798836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:01:46.254188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.817975+0000","last_change":"2023-10-06T04:43:29.816479+0000","last_active":"2023-10-06T04:43:29.817975+0000","last_peered":"2023-10-06T04:43:29.817975+0000","last_clean":"2023-10-06T04:43:29.817975+0000","last_became_active":"2023-10-06T04:43:29.816006+0000","last_became_peered":"2023-10-06T04:43:29.816006+0000","last_unstale":"2023-10-06T04:43:29.817975+0000","last_undegraded":"2023-10-06T04:43:29.817975+0000","last_fullsized":"2023-10-06T04:43:29.817975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:24:11.932858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.821469+0000","last_change":"2023-10-06T04:43:28.807674+0000","last_active":"2023-10-06T04:43:29.821469+0000","last_peered":"2023-10-06T04:43:29.821469+0000","last_clean":"2023-10-06T04:43:29.821469+0000","last_became_active":"2023-10-06T04:43:28.807392+0000","last_became_peered":"2023-10-06T04:43:28.807392+0000","last_unstale":"2023-10-06T04:43:29.821469+0000","last_undegraded":"2023-10-06T04:43:29.821469+0000","last_fullsized":"2023-10-06T04:43:29.821469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:12.441174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.799442+0000","last_change":"2023-10-06T04:43:24.001927+0000","last_active":"2023-10-06T04:43:29.799442+0000","last_peered":"2023-10-06T04:43:29.799442+0000","last_clean":"2023-10-06T04:43:29.799442+0000","last_became_active":"2023-10-06T04:43:24.001591+0000","last_became_peered":"2023-10-06T04:43:24.001591+0000","last_unstale":"2023-10-06T04:43:29.799442+0000","last_undegraded":"2023-10-06T04:43:29.799442+0000","last_fullsized":"2023-10-06T04:43:29.799442+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:47.262845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818998+0000","last_change":"2023-10-06T04:43:29.818539+0000","last_active":"2023-10-06T04:43:29.818998+0000","last_peered":"2023-10-06T04:43:29.818998+0000","last_clean":"2023-10-06T04:43:29.818998+0000","last_became_active":"2023-10-06T04:43:29.818295+0000","last_became_peered":"2023-10-06T04:43:29.818295+0000","last_unstale":"2023-10-06T04:43:29.818998+0000","last_undegraded":"2023-10-06T04:43:29.818998+0000","last_fullsized":"2023-10-06T04:43:29.818998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:45.205428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.799574+0000","last_change":"2023-10-06T04:43:23.708597+0000","last_active":"2023-10-06T04:43:29.799574+0000","last_peered":"2023-10-06T04:43:29.799574+0000","last_clean":"2023-10-06T04:43:29.799574+0000","last_became_active":"2023-10-06T04:43:23.708317+0000","last_became_peered":"2023-10-06T04:43:23.708317+0000","last_unstale":"2023-10-06T04:43:29.799574+0000","last_undegraded":"2023-10-06T04:43:29.799574+0000","last_fullsized":"2023-10-06T04:43:29.799574+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:56.213068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:43:28.807461+0000","last_change":"2023-10-06T04:43:28.806470+0000","last_active":"2023-10-06T04:43:28.807461+0000","last_peered":"2023-10-06T04:43:28.807461+0000","last_clean":"2023-10-06T04:43:28.807461+0000","last_became_active":"2023-10-06T04:43:28.806176+0000","last_became_peered":"2023-10-06T04:43:28.806176+0000","last_unstale":"2023-10-06T04:43:28.807461+0000","last_undegraded":"2023-10-06T04:43:28.807461+0000","last_fullsized":"2023-10-06T04:43:28.807461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:56.458010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818530+0000","last_change":"2023-10-06T04:43:29.814129+0000","last_active":"2023-10-06T04:43:29.818530+0000","last_peered":"2023-10-06T04:43:29.818530+0000","last_clean":"2023-10-06T04:43:29.818530+0000","last_became_active":"2023-10-06T04:43:29.813867+0000","last_became_peered":"2023-10-06T04:43:29.813867+0000","last_unstale":"2023-10-06T04:43:29.818530+0000","last_undegraded":"2023-10-06T04:43:29.818530+0000","last_fullsized":"2023-10-06T04:43:29.818530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:23:24.496576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.791895+0000","last_change":"2023-10-06T04:43:23.708753+0000","last_active":"2023-10-06T04:43:29.791895+0000","last_peered":"2023-10-06T04:43:29.791895+0000","last_clean":"2023-10-06T04:43:29.791895+0000","last_became_active":"2023-10-06T04:43:23.708483+0000","last_became_peered":"2023-10-06T04:43:23.708483+0000","last_unstale":"2023-10-06T04:43:29.791895+0000","last_undegraded":"2023-10-06T04:43:29.791895+0000","last_fullsized":"2023-10-06T04:43:29.791895+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:47.262845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.794480+0000","last_change":"2023-10-06T04:43:23.706116+0000","last_active":"2023-10-06T04:43:29.794480+0000","last_peered":"2023-10-06T04:43:29.794480+0000","last_clean":"2023-10-06T04:43:29.794480+0000","last_became_active":"2023-10-06T04:43:23.705090+0000","last_became_peered":"2023-10-06T04:43:23.705090+0000","last_unstale":"2023-10-06T04:43:29.794480+0000","last_undegraded":"2023-10-06T04:43:29.794480+0000","last_fullsized":"2023-10-06T04:43:29.794480+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:29.869173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:43:28.806038+0000","last_change":"2023-10-06T04:43:28.802676+0000","last_active":"2023-10-06T04:43:28.806038+0000","last_peered":"2023-10-06T04:43:28.806038+0000","last_clean":"2023-10-06T04:43:28.806038+0000","last_became_active":"2023-10-06T04:43:28.802303+0000","last_became_peered":"2023-10-06T04:43:28.802303+0000","last_unstale":"2023-10-06T04:43:28.806038+0000","last_undegraded":"2023-10-06T04:43:28.806038+0000","last_fullsized":"2023-10-06T04:43:28.806038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:12.441174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.805169+0000","last_change":"2023-10-06T04:43:29.805169+0000","last_active":"2023-10-06T04:43:29.805169+0000","last_peered":"2023-10-06T04:43:29.805169+0000","last_clean":"2023-10-06T04:43:29.805169+0000","last_became_active":"2023-10-06T04:43:29.804916+0000","last_became_peered":"2023-10-06T04:43:29.804916+0000","last_unstale":"2023-10-06T04:43:29.805169+0000","last_undegraded":"2023-10-06T04:43:29.805169+0000","last_fullsized":"2023-10-06T04:43:29.805169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:23:24.496576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.795261+0000","last_change":"2023-10-06T04:43:24.002162+0000","last_active":"2023-10-06T04:43:29.795261+0000","last_peered":"2023-10-06T04:43:29.795261+0000","last_clean":"2023-10-06T04:43:29.795261+0000","last_became_active":"2023-10-06T04:43:24.001883+0000","last_became_peered":"2023-10-06T04:43:24.001883+0000","last_unstale":"2023-10-06T04:43:29.795261+0000","last_undegraded":"2023-10-06T04:43:29.795261+0000","last_fullsized":"2023-10-06T04:43:29.795261+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:51:11.168258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.791973+0000","last_change":"2023-10-06T04:43:28.805313+0000","last_active":"2023-10-06T04:43:29.791973+0000","last_peered":"2023-10-06T04:43:29.791973+0000","last_clean":"2023-10-06T04:43:29.791973+0000","last_became_active":"2023-10-06T04:43:28.805065+0000","last_became_peered":"2023-10-06T04:43:28.805065+0000","last_unstale":"2023-10-06T04:43:29.791973+0000","last_undegraded":"2023-10-06T04:43:29.791973+0000","last_fullsized":"2023-10-06T04:43:29.791973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:56.458010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.817957+0000","last_change":"2023-10-06T04:43:29.816196+0000","last_active":"2023-10-06T04:43:29.817957+0000","last_peered":"2023-10-06T04:43:29.817957+0000","last_clean":"2023-10-06T04:43:29.817957+0000","last_became_active":"2023-10-06T04:43:29.815882+0000","last_became_peered":"2023-10-06T04:43:29.815882+0000","last_unstale":"2023-10-06T04:43:29.817957+0000","last_undegraded":"2023-10-06T04:43:29.817957+0000","last_fullsized":"2023-10-06T04:43:29.817957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:51:05.152644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.794366+0000","last_change":"2023-10-06T04:43:24.002057+0000","last_active":"2023-10-06T04:43:29.794366+0000","last_peered":"2023-10-06T04:43:29.794366+0000","last_clean":"2023-10-06T04:43:29.794366+0000","last_became_active":"2023-10-06T04:43:24.001809+0000","last_became_peered":"2023-10-06T04:43:24.001809+0000","last_unstale":"2023-10-06T04:43:29.794366+0000","last_undegraded":"2023-10-06T04:43:29.794366+0000","last_fullsized":"2023-10-06T04:43:29.794366+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:49.693980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.798128+0000","last_change":"2023-10-06T04:43:28.808523+0000","last_active":"2023-10-06T04:43:29.798128+0000","last_peered":"2023-10-06T04:43:29.798128+0000","last_clean":"2023-10-06T04:43:29.798128+0000","last_became_active":"2023-10-06T04:43:28.808269+0000","last_became_peered":"2023-10-06T04:43:28.808269+0000","last_unstale":"2023-10-06T04:43:29.798128+0000","last_undegraded":"2023-10-06T04:43:29.798128+0000","last_fullsized":"2023-10-06T04:43:29.798128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:27.759735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.819416+0000","last_change":"2023-10-06T04:43:29.819416+0000","last_active":"2023-10-06T04:43:29.819416+0000","last_peered":"2023-10-06T04:43:29.819416+0000","last_clean":"2023-10-06T04:43:29.819416+0000","last_became_active":"2023-10-06T04:43:29.819099+0000","last_became_peered":"2023-10-06T04:43:29.819099+0000","last_unstale":"2023-10-06T04:43:29.819416+0000","last_undegraded":"2023-10-06T04:43:29.819416+0000","last_fullsized":"2023-10-06T04:43:29.819416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:54:36.378503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:43:28.804780+0000","last_change":"2023-10-06T04:43:24.002394+0000","last_active":"2023-10-06T04:43:28.804780+0000","last_peered":"2023-10-06T04:43:28.804780+0000","last_clean":"2023-10-06T04:43:28.804780+0000","last_became_active":"2023-10-06T04:43:24.001915+0000","last_became_peered":"2023-10-06T04:43:24.001915+0000","last_unstale":"2023-10-06T04:43:28.804780+0000","last_undegraded":"2023-10-06T04:43:28.804780+0000","last_fullsized":"2023-10-06T04:43:28.804780+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:45.031820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.797339+0000","last_change":"2023-10-06T04:43:28.806465+0000","last_active":"2023-10-06T04:43:29.797339+0000","last_peered":"2023-10-06T04:43:29.797339+0000","last_clean":"2023-10-06T04:43:29.797339+0000","last_became_active":"2023-10-06T04:43:28.806021+0000","last_became_peered":"2023-10-06T04:43:28.806021+0000","last_unstale":"2023-10-06T04:43:29.797339+0000","last_undegraded":"2023-10-06T04:43:29.797339+0000","last_fullsized":"2023-10-06T04:43:29.797339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:40.890108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.809755+0000","last_change":"2023-10-06T04:43:29.806132+0000","last_active":"2023-10-06T04:43:29.809755+0000","last_peered":"2023-10-06T04:43:29.809755+0000","last_clean":"2023-10-06T04:43:29.809755+0000","last_became_active":"2023-10-06T04:43:29.805881+0000","last_became_peered":"2023-10-06T04:43:29.805881+0000","last_unstale":"2023-10-06T04:43:29.809755+0000","last_undegraded":"2023-10-06T04:43:29.809755+0000","last_fullsized":"2023-10-06T04:43:29.809755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:07.658289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:43:28.796774+0000","last_change":"2023-10-06T04:43:24.002424+0000","last_active":"2023-10-06T04:43:28.796774+0000","last_peered":"2023-10-06T04:43:28.796774+0000","last_clean":"2023-10-06T04:43:28.796774+0000","last_became_active":"2023-10-06T04:43:24.002147+0000","last_became_peered":"2023-10-06T04:43:24.002147+0000","last_unstale":"2023-10-06T04:43:28.796774+0000","last_undegraded":"2023-10-06T04:43:28.796774+0000","last_fullsized":"2023-10-06T04:43:28.796774+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:45.031820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.792081+0000","last_change":"2023-10-06T04:43:28.808630+0000","last_active":"2023-10-06T04:43:29.792081+0000","last_peered":"2023-10-06T04:43:29.792081+0000","last_clean":"2023-10-06T04:43:29.792081+0000","last_became_active":"2023-10-06T04:43:28.808363+0000","last_became_peered":"2023-10-06T04:43:28.808363+0000","last_unstale":"2023-10-06T04:43:29.792081+0000","last_undegraded":"2023-10-06T04:43:29.792081+0000","last_fullsized":"2023-10-06T04:43:29.792081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:35.593992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.817659+0000","last_change":"2023-10-06T04:43:29.817659+0000","last_active":"2023-10-06T04:43:29.817659+0000","last_peered":"2023-10-06T04:43:29.817659+0000","last_clean":"2023-10-06T04:43:29.817659+0000","last_became_active":"2023-10-06T04:43:29.817387+0000","last_became_peered":"2023-10-06T04:43:29.817387+0000","last_unstale":"2023-10-06T04:43:29.817659+0000","last_undegraded":"2023-10-06T04:43:29.817659+0000","last_fullsized":"2023-10-06T04:43:29.817659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:15:36.021668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:43:28.797444+0000","last_change":"2023-10-06T04:43:23.707408+0000","last_active":"2023-10-06T04:43:28.797444+0000","last_peered":"2023-10-06T04:43:28.797444+0000","last_clean":"2023-10-06T04:43:28.797444+0000","last_became_active":"2023-10-06T04:43:23.707115+0000","last_became_peered":"2023-10-06T04:43:23.707115+0000","last_unstale":"2023-10-06T04:43:28.797444+0000","last_undegraded":"2023-10-06T04:43:28.797444+0000","last_fullsized":"2023-10-06T04:43:28.797444+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:56.213068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T04:43:28.816259+0000","last_change":"2023-10-06T04:43:28.808825+0000","last_active":"2023-10-06T04:43:28.816259+0000","last_peered":"2023-10-06T04:43:28.816259+0000","last_clean":"2023-10-06T04:43:28.816259+0000","last_became_active":"2023-10-06T04:43:28.808542+0000","last_became_peered":"2023-10-06T04:43:28.808542+0000","last_unstale":"2023-10-06T04:43:28.816259+0000","last_undegraded":"2023-10-06T04:43:28.816259+0000","last_fullsized":"2023-10-06T04:43:28.816259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:01:46.254188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.815131+0000","last_change":"2023-10-06T04:43:29.811314+0000","last_active":"2023-10-06T04:43:29.815131+0000","last_peered":"2023-10-06T04:43:29.815131+0000","last_clean":"2023-10-06T04:43:29.815131+0000","last_became_active":"2023-10-06T04:43:29.811044+0000","last_became_peered":"2023-10-06T04:43:29.811044+0000","last_unstale":"2023-10-06T04:43:29.815131+0000","last_undegraded":"2023-10-06T04:43:29.815131+0000","last_fullsized":"2023-10-06T04:43:29.815131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:11.452212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.795942+0000","last_change":"2023-10-06T04:43:28.804002+0000","last_active":"2023-10-06T04:43:29.795942+0000","last_peered":"2023-10-06T04:43:29.795942+0000","last_clean":"2023-10-06T04:43:29.795942+0000","last_became_active":"2023-10-06T04:43:28.803300+0000","last_became_peered":"2023-10-06T04:43:28.803300+0000","last_unstale":"2023-10-06T04:43:29.795942+0000","last_undegraded":"2023-10-06T04:43:29.795942+0000","last_fullsized":"2023-10-06T04:43:29.795942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:35.593992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.802812+0000","last_change":"2023-10-06T04:43:29.802812+0000","last_active":"2023-10-06T04:43:29.802812+0000","last_peered":"2023-10-06T04:43:29.802812+0000","last_clean":"2023-10-06T04:43:29.802812+0000","last_became_active":"2023-10-06T04:43:29.802567+0000","last_became_peered":"2023-10-06T04:43:29.802567+0000","last_unstale":"2023-10-06T04:43:29.802812+0000","last_undegraded":"2023-10-06T04:43:29.802812+0000","last_fullsized":"2023-10-06T04:43:29.802812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:28.765256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.821571+0000","last_change":"2023-10-06T04:43:28.811329+0000","last_active":"2023-10-06T04:43:29.821571+0000","last_peered":"2023-10-06T04:43:29.821571+0000","last_clean":"2023-10-06T04:43:29.821571+0000","last_became_active":"2023-10-06T04:43:28.811100+0000","last_became_peered":"2023-10-06T04:43:28.811100+0000","last_unstale":"2023-10-06T04:43:29.821571+0000","last_undegraded":"2023-10-06T04:43:29.821571+0000","last_fullsized":"2023-10-06T04:43:29.821571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:27.759735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.814112+0000","last_change":"2023-10-06T04:43:29.809102+0000","last_active":"2023-10-06T04:43:29.814112+0000","last_peered":"2023-10-06T04:43:29.814112+0000","last_clean":"2023-10-06T04:43:29.814112+0000","last_became_active":"2023-10-06T04:43:29.808096+0000","last_became_peered":"2023-10-06T04:43:29.808096+0000","last_unstale":"2023-10-06T04:43:29.814112+0000","last_undegraded":"2023-10-06T04:43:29.814112+0000","last_fullsized":"2023-10-06T04:43:29.814112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:11.842098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.820885+0000","last_change":"2023-10-06T04:43:28.812260+0000","last_active":"2023-10-06T04:43:29.820885+0000","last_peered":"2023-10-06T04:43:29.820885+0000","last_clean":"2023-10-06T04:43:29.820885+0000","last_became_active":"2023-10-06T04:43:28.811921+0000","last_became_peered":"2023-10-06T04:43:28.811921+0000","last_unstale":"2023-10-06T04:43:29.820885+0000","last_undegraded":"2023-10-06T04:43:29.820885+0000","last_fullsized":"2023-10-06T04:43:29.820885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:12.441174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818129+0000","last_change":"2023-10-06T04:43:29.814258+0000","last_active":"2023-10-06T04:43:29.818129+0000","last_peered":"2023-10-06T04:43:29.818129+0000","last_clean":"2023-10-06T04:43:29.818129+0000","last_became_active":"2023-10-06T04:43:29.811381+0000","last_became_peered":"2023-10-06T04:43:29.811381+0000","last_unstale":"2023-10-06T04:43:29.818129+0000","last_undegraded":"2023-10-06T04:43:29.818129+0000","last_fullsized":"2023-10-06T04:43:29.818129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:13:38.871291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.815419+0000","last_change":"2023-10-06T04:43:28.805288+0000","last_active":"2023-10-06T04:43:29.815419+0000","last_peered":"2023-10-06T04:43:29.815419+0000","last_clean":"2023-10-06T04:43:29.815419+0000","last_became_active":"2023-10-06T04:43:28.805005+0000","last_became_peered":"2023-10-06T04:43:28.805005+0000","last_unstale":"2023-10-06T04:43:29.815419+0000","last_undegraded":"2023-10-06T04:43:29.815419+0000","last_fullsized":"2023-10-06T04:43:29.815419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:05.582666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.815062+0000","last_change":"2023-10-06T04:43:29.808059+0000","last_active":"2023-10-06T04:43:29.815062+0000","last_peered":"2023-10-06T04:43:29.815062+0000","last_clean":"2023-10-06T04:43:29.815062+0000","last_became_active":"2023-10-06T04:43:29.806717+0000","last_became_peered":"2023-10-06T04:43:29.806717+0000","last_unstale":"2023-10-06T04:43:29.815062+0000","last_undegraded":"2023-10-06T04:43:29.815062+0000","last_fullsized":"2023-10-06T04:43:29.815062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:01.271919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.822237+0000","last_change":"2023-10-06T04:43:28.805496+0000","last_active":"2023-10-06T04:43:29.822237+0000","last_peered":"2023-10-06T04:43:29.822237+0000","last_clean":"2023-10-06T04:43:29.822237+0000","last_became_active":"2023-10-06T04:43:28.805197+0000","last_became_peered":"2023-10-06T04:43:28.805197+0000","last_unstale":"2023-10-06T04:43:29.822237+0000","last_undegraded":"2023-10-06T04:43:29.822237+0000","last_fullsized":"2023-10-06T04:43:29.822237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:27.759735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818411+0000","last_change":"2023-10-06T04:43:29.815066+0000","last_active":"2023-10-06T04:43:29.818411+0000","last_peered":"2023-10-06T04:43:29.818411+0000","last_clean":"2023-10-06T04:43:29.818411+0000","last_became_active":"2023-10-06T04:43:29.814792+0000","last_became_peered":"2023-10-06T04:43:29.814792+0000","last_unstale":"2023-10-06T04:43:29.818411+0000","last_undegraded":"2023-10-06T04:43:29.818411+0000","last_fullsized":"2023-10-06T04:43:29.818411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:54.115093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":8,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.809634+0000","last_change":"2023-10-06T04:43:29.809634+0000","last_active":"2023-10-06T04:43:29.809634+0000","last_peered":"2023-10-06T04:43:29.809634+0000","last_clean":"2023-10-06T04:43:29.809634+0000","last_became_active":"2023-10-06T04:43:29.809444+0000","last_became_peered":"2023-10-06T04:43:29.809444+0000","last_unstale":"2023-10-06T04:43:29.809634+0000","last_undegraded":"2023-10-06T04:43:29.809634+0000","last_fullsized":"2023-10-06T04:43:29.809634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:06.588187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.808156+0000","last_change":"2023-10-06T04:43:29.806722+0000","last_active":"2023-10-06T04:43:29.808156+0000","last_peered":"2023-10-06T04:43:29.808156+0000","last_clean":"2023-10-06T04:43:29.808156+0000","last_became_active":"2023-10-06T04:43:29.805603+0000","last_became_peered":"2023-10-06T04:43:29.805603+0000","last_unstale":"2023-10-06T04:43:29.808156+0000","last_undegraded":"2023-10-06T04:43:29.808156+0000","last_fullsized":"2023-10-06T04:43:29.808156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:10.192264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818169+0000","last_change":"2023-10-06T04:43:29.814788+0000","last_active":"2023-10-06T04:43:29.818169+0000","last_peered":"2023-10-06T04:43:29.818169+0000","last_clean":"2023-10-06T04:43:29.818169+0000","last_became_active":"2023-10-06T04:43:29.814509+0000","last_became_peered":"2023-10-06T04:43:29.814509+0000","last_unstale":"2023-10-06T04:43:29.818169+0000","last_undegraded":"2023-10-06T04:43:29.818169+0000","last_fullsized":"2023-10-06T04:43:29.818169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:21:23.533461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818470+0000","last_change":"2023-10-06T04:43:29.816479+0000","last_active":"2023-10-06T04:43:29.818470+0000","last_peered":"2023-10-06T04:43:29.818470+0000","last_clean":"2023-10-06T04:43:29.818470+0000","last_became_active":"2023-10-06T04:43:29.816181+0000","last_became_peered":"2023-10-06T04:43:29.816181+0000","last_unstale":"2023-10-06T04:43:29.818470+0000","last_undegraded":"2023-10-06T04:43:29.818470+0000","last_fullsized":"2023-10-06T04:43:29.818470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:23:24.496576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.810410+0000","last_change":"2023-10-06T04:43:29.808166+0000","last_active":"2023-10-06T04:43:29.810410+0000","last_peered":"2023-10-06T04:43:29.810410+0000","last_clean":"2023-10-06T04:43:29.810410+0000","last_became_active":"2023-10-06T04:43:29.807853+0000","last_became_peered":"2023-10-06T04:43:29.807853+0000","last_unstale":"2023-10-06T04:43:29.810410+0000","last_undegraded":"2023-10-06T04:43:29.810410+0000","last_fullsized":"2023-10-06T04:43:29.810410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:57.350546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298108,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073732,"statfs":{"total":96636764160,"available":96331501568,"internally_reserved":0,"allocated":839680,"data_stored":670963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":72202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298080,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073760,"statfs":{"total":96636764160,"available":96331530240,"internally_reserved":0,"allocated":811008,"data_stored":669211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":208896,"data_stored":72756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":72202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297504,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074336,"statfs":{"total":96636764160,"available":96332120064,"internally_reserved":0,"allocated":221184,"data_stored":78933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297520,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074320,"statfs":{"total":96636764160,"available":96332103680,"internally_reserved":0,"allocated":237568,"data_stored":80435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":72826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:43:34.297 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T04:43:34.298 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-06T04:43:34.298 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-06T04:43:34.298 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-06T04:43:34.298 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-06T04:43:34.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.448+0000 7fdbed158700 1 Processor -- start 2023-10-06T04:43:34.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.448+0000 7fdbed158700 1 -- start start 2023-10-06T04:43:34.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.449+0000 7fdbed158700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fdbe8159630 0x7fdbe80cd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:34.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.449+0000 7fdbed158700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdbe80cd590 0x7fdbe80ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:34.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.449+0000 7fdbed158700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbe80cda00 con 0x7fdbe80ce840 2023-10-06T04:43:34.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.449+0000 7fdbed158700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbe80cfc80 con 0x7fdbe8159630 2023-10-06T04:43:34.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.449+0000 7fdbed158700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe80cf070 con 0x7fdbe80cd590 2023-10-06T04:43:34.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.449+0000 7fdbe759e700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fdbe80ce840 0x7fdbe815d2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:35902/0 (socket says 172.21.15.17:35902) 2023-10-06T04:43:34.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.449+0000 7fdbe759e700 1 -- 172.21.15.17:0/1777465088 learned_addr learned my addr 172.21.15.17:0/1777465088 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:34.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.450+0000 7fdbe6d9d700 1 --2- 172.21.15.17:0/1777465088 >> v2:172.21.15.136:3300/0 conn(0x7fdbe8159630 0x7fdbe80cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:34.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.450+0000 7fdbe5d9b700 1 -- 172.21.15.17:0/1777465088 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1363904209 0 0) 0x7fdbe80cda00 con 0x7fdbe80ce840 2023-10-06T04:43:34.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.450+0000 7fdbe5d9b700 1 -- 172.21.15.17:0/1777465088 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbd4003570 con 0x7fdbe80ce840 2023-10-06T04:43:34.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.450+0000 7fdbe659c700 1 --2- 172.21.15.17:0/1777465088 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdbe80cd590 0x7fdbe80ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:34.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.450+0000 7fdbe5d9b700 1 -- 172.21.15.17:0/1777465088 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1637327860 0 0) 0x7fdbd4003570 con 0x7fdbe80ce840 2023-10-06T04:43:34.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.450+0000 7fdbe5d9b700 1 -- 172.21.15.17:0/1777465088 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdbe80cd590 msgr2=0x7fdbe80ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:34.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.450+0000 7fdbe5d9b700 1 --2- 172.21.15.17:0/1777465088 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdbe80cd590 0x7fdbe80ce300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:34.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.450+0000 7fdbe5d9b700 1 -- 172.21.15.17:0/1777465088 >> v2:172.21.15.136:3300/0 conn(0x7fdbe8159630 msgr2=0x7fdbe80cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:34.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.450+0000 7fdbe5d9b700 1 --2- 172.21.15.17:0/1777465088 >> v2:172.21.15.136:3300/0 conn(0x7fdbe8159630 0x7fdbe80cd050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:34.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.450+0000 7fdbe5d9b700 1 -- 172.21.15.17:0/1777465088 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe80cf350 con 0x7fdbe80ce840 2023-10-06T04:43:34.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.450+0000 7fdbe5d9b700 1 -- 172.21.15.17:0/1777465088 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4268781140 0 0) 0x7fdbe00017f0 con 0x7fdbe80ce840 2023-10-06T04:43:34.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.450+0000 7fdbe5d9b700 1 -- 172.21.15.17:0/1777465088 >> v1:172.21.15.17:6789/0 conn(0x7fdbe80ce840 legacy=0x7fdbe815d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:34.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.450+0000 7fdbe5d9b700 1 --2- 172.21.15.17:0/1777465088 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdbd4003a60 0x7fdbd4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:34.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.450+0000 7fdbe5d9b700 1 --2- 172.21.15.17:0/1777465088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbd4004810 0x7fdbd4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:34.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.450+0000 7fdbe5d9b700 1 --2- 172.21.15.17:0/1777465088 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdbe80cd590 0x7fdbd40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:34.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.450+0000 7fdbe5d9b700 1 -- 172.21.15.17:0/1777465088 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe80cfc80 con 0x7fdbd4004810 2023-10-06T04:43:34.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.450+0000 7fdbe5d9b700 1 -- 172.21.15.17:0/1777465088 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe80cf070 con 0x7fdbd4003a60 2023-10-06T04:43:34.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.450+0000 7fdbe5d9b700 1 -- 172.21.15.17:0/1777465088 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd400ba60 con 0x7fdbe80cd590 2023-10-06T04:43:34.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.450+0000 7fdbe659c700 1 --2- 172.21.15.17:0/1777465088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbd4004810 0x7fdbd4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:34.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.450+0000 7fdbe6d9d700 1 --2- 172.21.15.17:0/1777465088 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdbd4003a60 0x7fdbd4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:34.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.450+0000 7fdbe759e700 1 --2- 172.21.15.17:0/1777465088 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdbe80cd590 0x7fdbd40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:34.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.450+0000 7fdbe659c700 1 -- 172.21.15.17:0/1777465088 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdbe80cd590 msgr2=0x7fdbd40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:34.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.450+0000 7fdbe659c700 1 --2- 172.21.15.17:0/1777465088 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdbe80cd590 0x7fdbd40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:34.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.450+0000 7fdbe659c700 1 -- 172.21.15.17:0/1777465088 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdbd4003a60 msgr2=0x7fdbd4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:34.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.450+0000 7fdbe659c700 1 --2- 172.21.15.17:0/1777465088 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdbd4003a60 0x7fdbd4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:34.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.450+0000 7fdbe659c700 1 -- 172.21.15.17:0/1777465088 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd4003570 con 0x7fdbd4004810 2023-10-06T04:43:34.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.451+0000 7fdbe659c700 1 --2- 172.21.15.17:0/1777465088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbd4004810 0x7fdbd4004c80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0009c30 tx=0x7fdbd00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb91cd08542c09d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:34.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.451+0000 7fdbe5d9b700 1 -- 172.21.15.17:0/1777465088 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd000e710 con 0x7fdbd4004810 2023-10-06T04:43:34.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.451+0000 7fdbe5d9b700 1 -- 172.21.15.17:0/1777465088 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd000e870 con 0x7fdbd4004810 2023-10-06T04:43:34.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.451+0000 7fdbe5d9b700 1 -- 172.21.15.17:0/1777465088 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd000ec30 con 0x7fdbd4004810 2023-10-06T04:43:34.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.451+0000 7fdbed158700 1 -- 172.21.15.17:0/1777465088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbd4004810 msgr2=0x7fdbd4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:34.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.451+0000 7fdbed158700 1 --2- 172.21.15.17:0/1777465088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbd4004810 0x7fdbd4004c80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0009c30 tx=0x7fdbd00091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:34.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.451+0000 7fdbe759e700 1 -- 172.21.15.17:0/1777465088 reap_dead start 2023-10-06T04:43:34.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.451+0000 7fdbed158700 1 -- 172.21.15.17:0/1777465088 shutdown_connections 2023-10-06T04:43:34.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.451+0000 7fdbed158700 1 -- 172.21.15.17:0/1777465088 >> 172.21.15.17:0/1777465088 conn(0x7fdbe806cff0 msgr2=0x7fdbe806d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:34.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.451+0000 7fdbed158700 1 -- 172.21.15.17:0/1777465088 shutdown_connections 2023-10-06T04:43:34.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.451+0000 7fdbed158700 1 -- 172.21.15.17:0/1777465088 wait complete. 2023-10-06T04:43:34.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.453+0000 7fdbed158700 1 Processor -- start 2023-10-06T04:43:34.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.453+0000 7fdbed158700 1 -- start start 2023-10-06T04:43:34.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.453+0000 7fdbed158700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdbd4004810 0x7fdbe8159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:34.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.453+0000 7fdbed158700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdbe80b0550 0x7fdbe816cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:34.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.453+0000 7fdbed158700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbe816d4f0 0x7fdbe8149f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:34.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.453+0000 7fdbed158700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe80c9980 con 0x7fdbe816d4f0 2023-10-06T04:43:34.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.453+0000 7fdbed158700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe815a1a0 con 0x7fdbd4004810 2023-10-06T04:43:34.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.453+0000 7fdbed158700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe816da00 con 0x7fdbe80b0550 2023-10-06T04:43:34.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.453+0000 7fdbe759e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbe816d4f0 0x7fdbe8149f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:34.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.453+0000 7fdbe759e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbe816d4f0 0x7fdbe8149f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60940/0 (socket says 172.21.15.17:60940) 2023-10-06T04:43:34.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.453+0000 7fdbe759e700 1 -- 172.21.15.17:0/2666846390 learned_addr learned my addr 172.21.15.17:0/2666846390 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:34.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.454+0000 7fdbe6d9d700 1 --2- 172.21.15.17:0/2666846390 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdbd4004810 0x7fdbe8159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:34.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.454+0000 7fdbe659c700 1 --2- 172.21.15.17:0/2666846390 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdbe80b0550 0x7fdbe816cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:34.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.454+0000 7fdbe759e700 1 -- 172.21.15.17:0/2666846390 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdbe80b0550 msgr2=0x7fdbe816cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:34.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.454+0000 7fdbe759e700 1 --2- 172.21.15.17:0/2666846390 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdbe80b0550 0x7fdbe816cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:34.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.454+0000 7fdbe759e700 1 -- 172.21.15.17:0/2666846390 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdbd4004810 msgr2=0x7fdbe8159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:34.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.454+0000 7fdbe759e700 1 --2- 172.21.15.17:0/2666846390 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdbd4004810 0x7fdbe8159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:34.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.454+0000 7fdbe759e700 1 -- 172.21.15.17:0/2666846390 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe816dce0 con 0x7fdbe816d4f0 2023-10-06T04:43:34.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.454+0000 7fdbe6d9d700 1 --2- 172.21.15.17:0/2666846390 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdbd4004810 0x7fdbe8159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:43:34.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.454+0000 7fdbe759e700 1 --2- 172.21.15.17:0/2666846390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbe816d4f0 0x7fdbe8149f30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdbe80d1760 tx=0x7fdbe0002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:34.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.454+0000 7fdbdeffd700 1 -- 172.21.15.17:0/2666846390 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe000adf0 con 0x7fdbe816d4f0 2023-10-06T04:43:34.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.454+0000 7fdbdeffd700 1 -- 172.21.15.17:0/2666846390 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe00133f0 con 0x7fdbe816d4f0 2023-10-06T04:43:34.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.454+0000 7fdbed158700 1 -- 172.21.15.17:0/2666846390 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbe80c9610 con 0x7fdbe816d4f0 2023-10-06T04:43:34.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.454+0000 7fdbdeffd700 1 -- 172.21.15.17:0/2666846390 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe00137b0 con 0x7fdbe816d4f0 2023-10-06T04:43:34.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.454+0000 7fdbed158700 1 -- 172.21.15.17:0/2666846390 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe80c78e0 con 0x7fdbe816d4f0 2023-10-06T04:43:34.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.455+0000 7fdbed158700 1 -- 172.21.15.17:0/2666846390 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbe80c97d0 con 0x7fdbe816d4f0 2023-10-06T04:43:34.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.455+0000 7fdbdeffd700 1 -- 172.21.15.17:0/2666846390 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdbe0013ba0 con 0x7fdbe816d4f0 2023-10-06T04:43:34.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.456+0000 7fdbdeffd700 1 --2- 172.21.15.17:0/2666846390 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fdbc8066f30 0x7fdbc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:34.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.456+0000 7fdbe6d9d700 1 --2- 172.21.15.17:0/2666846390 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fdbc8066f30 0x7fdbc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:34.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.456+0000 7fdbdeffd700 1 -- 172.21.15.17:0/2666846390 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdbe00851c0 con 0x7fdbe816d4f0 2023-10-06T04:43:34.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.456+0000 7fdbe6d9d700 1 --2- 172.21.15.17:0/2666846390 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fdbc8066f30 0x7fdbc80693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdbd80093f0 tx=0x7fdbd8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:34.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.460+0000 7fdbdeffd700 1 -- 172.21.15.17:0/2666846390 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdbe0052230 con 0x7fdbe816d4f0 2023-10-06T04:43:34.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.709+0000 7fdbed158700 1 -- 172.21.15.17:0/2666846390 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fdbe8063ff0 con 0x7fdbe816d4f0 2023-10-06T04:43:34.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.712+0000 7fdbdeffd700 1 -- 172.21.15.17:0/2666846390 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163699 (secure 0 0 0) 0x7fdbe0055850 con 0x7fdbe816d4f0 2023-10-06T04:43:34.716 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:43:34.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.715+0000 7fdbed158700 1 -- 172.21.15.17:0/2666846390 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fdbc8066f30 msgr2=0x7fdbc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:34.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.715+0000 7fdbed158700 1 --2- 172.21.15.17:0/2666846390 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fdbc8066f30 0x7fdbc80693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdbd80093f0 tx=0x7fdbd8008040 comp rx=0 tx=0).stop 2023-10-06T04:43:34.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.715+0000 7fdbed158700 1 -- 172.21.15.17:0/2666846390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbe816d4f0 msgr2=0x7fdbe8149f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:34.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.715+0000 7fdbed158700 1 --2- 172.21.15.17:0/2666846390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbe816d4f0 0x7fdbe8149f30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdbe80d1760 tx=0x7fdbe0002210 comp rx=0 tx=0).stop 2023-10-06T04:43:34.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.715+0000 7fdbed158700 1 -- 172.21.15.17:0/2666846390 shutdown_connections 2023-10-06T04:43:34.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.715+0000 7fdbed158700 1 --2- 172.21.15.17:0/2666846390 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fdbc8066f30 0x7fdbc80693e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:34.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.715+0000 7fdbed158700 1 --2- 172.21.15.17:0/2666846390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbe816d4f0 0x7fdbe8149f30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:34.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.715+0000 7fdbed158700 1 --2- 172.21.15.17:0/2666846390 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdbd4004810 0x7fdbe8159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:34.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.715+0000 7fdbed158700 1 --2- 172.21.15.17:0/2666846390 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdbe80b0550 0x7fdbe816cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:34.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.715+0000 7fdbed158700 1 -- 172.21.15.17:0/2666846390 >> 172.21.15.17:0/2666846390 conn(0x7fdbe806cff0 msgr2=0x7fdbe8154c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:34.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.715+0000 7fdbed158700 1 -- 172.21.15.17:0/2666846390 shutdown_connections 2023-10-06T04:43:34.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.715+0000 7fdbed158700 1 -- 172.21.15.17:0/2666846390 wait complete. 2023-10-06T04:43:34.729 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":5,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":90424},{"type":"v1","addr":"172.21.15.17:6833","nonce":90424}]},"active_addr":"172.21.15.17:6833/90424","active_change":"2023-10-06T04:43:16.327817+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4120,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":4144773854}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":4272130761}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":1681589463}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":3468304654}]}]} 2023-10-06T04:43:34.733 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-06T04:43:34.733 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-06T04:43:34.734 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:43:34.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.851+0000 7f362a97e700 1 Processor -- start 2023-10-06T04:43:34.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.851+0000 7f362a97e700 1 -- start start 2023-10-06T04:43:34.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.852+0000 7f362a97e700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3624159520 0x7f36240c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:34.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.852+0000 7f362a97e700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f36240c82a0 0x7f362406a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:34.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.852+0000 7f362a97e700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f362406c820 con 0x7f36240c6170 2023-10-06T04:43:34.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.852+0000 7f362a97e700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36240c6610 con 0x7f3624159520 2023-10-06T04:43:34.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.852+0000 7f362a97e700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f362406a160 con 0x7f36240c82a0 2023-10-06T04:43:34.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.852+0000 7f362997c700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3624159520 0x7f36240c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:34.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.852+0000 7f362997c700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3624159520 0x7f36240c5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60956/0 (socket says 172.21.15.17:60956) 2023-10-06T04:43:34.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.852+0000 7f362997c700 1 -- 172.21.15.17:0/697478632 learned_addr learned my addr 172.21.15.17:0/697478632 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:34.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.853+0000 7f362a17d700 1 --2- 172.21.15.17:0/697478632 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f36240c82a0 0x7f362406a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:34.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.853+0000 7f362997c700 1 -- 172.21.15.17:0/697478632 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f36240c82a0 msgr2=0x7f362406a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:34.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.853+0000 7f362997c700 1 --2- 172.21.15.17:0/697478632 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f36240c82a0 0x7f362406a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:34.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.853+0000 7f362997c700 1 -- 172.21.15.17:0/697478632 >> v1:172.21.15.136:6789/0 conn(0x7f36240c6170 legacy=0x7f36240c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:34.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.853+0000 7f362997c700 1 -- 172.21.15.17:0/697478632 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36240c8800 con 0x7f3624159520 2023-10-06T04:43:34.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.853+0000 7f362a17d700 1 --2- 172.21.15.17:0/697478632 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f36240c82a0 0x7f362406a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:43:34.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.853+0000 7f362997c700 1 --2- 172.21.15.17:0/697478632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3624159520 0x7f36240c5c30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3614009f20 tx=0x7f3614009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61bc74dbb047c672 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:34.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.853+0000 7f362897a700 1 -- 172.21.15.17:0/697478632 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361400e070 con 0x7f3624159520 2023-10-06T04:43:34.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.853+0000 7f362897a700 1 -- 172.21.15.17:0/697478632 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f361400ba80 con 0x7f3624159520 2023-10-06T04:43:34.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.853+0000 7f362897a700 1 -- 172.21.15.17:0/697478632 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36140092e0 con 0x7f3624159520 2023-10-06T04:43:34.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.854+0000 7f362a97e700 1 -- 172.21.15.17:0/697478632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3624159520 msgr2=0x7f36240c5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:34.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.854+0000 7f362a97e700 1 --2- 172.21.15.17:0/697478632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3624159520 0x7f36240c5c30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3614009f20 tx=0x7f3614009840 comp rx=0 tx=0).stop 2023-10-06T04:43:34.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.854+0000 7f362a97e700 1 -- 172.21.15.17:0/697478632 shutdown_connections 2023-10-06T04:43:34.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.854+0000 7f362a97e700 1 --2- 172.21.15.17:0/697478632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3624159520 0x7f36240c5c30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:34.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.854+0000 7f362a97e700 1 --2- 172.21.15.17:0/697478632 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f36240c82a0 0x7f362406a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:34.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.854+0000 7f362a97e700 1 -- 172.21.15.17:0/697478632 >> 172.21.15.17:0/697478632 conn(0x7f36240cc930 msgr2=0x7f36240ccd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:34.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.854+0000 7f362a97e700 1 -- 172.21.15.17:0/697478632 shutdown_connections 2023-10-06T04:43:34.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.854+0000 7f362a97e700 1 -- 172.21.15.17:0/697478632 wait complete. 2023-10-06T04:43:34.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.855+0000 7f362a97e700 1 Processor -- start 2023-10-06T04:43:34.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.855+0000 7f362a97e700 1 -- start start 2023-10-06T04:43:34.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.856+0000 7f362a97e700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f36240c6170 0x7f36240abc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:34.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.856+0000 7f362a97e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36240c82a0 0x7f3624147470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:34.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.856+0000 7f362a97e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3624159520 0x7f3624158210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:34.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.856+0000 7f362a97e700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36241479b0 con 0x7f36240c82a0 2023-10-06T04:43:34.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.856+0000 7f362a97e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362416a980 con 0x7f3624159520 2023-10-06T04:43:34.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.856+0000 7f362a97e700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3624169d70 con 0x7f36240c6170 2023-10-06T04:43:34.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.856+0000 7f362917b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36240c82a0 0x7f3624147470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:34.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.856+0000 7f362917b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36240c82a0 0x7f3624147470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60970/0 (socket says 172.21.15.17:60970) 2023-10-06T04:43:34.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.856+0000 7f362917b700 1 -- 172.21.15.17:0/3508219104 learned_addr learned my addr 172.21.15.17:0/3508219104 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:34.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.856+0000 7f362997c700 1 --2- 172.21.15.17:0/3508219104 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f36240c6170 0x7f36240abc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:34.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.856+0000 7f362a17d700 1 --2- 172.21.15.17:0/3508219104 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3624159520 0x7f3624158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:34.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.856+0000 7f362917b700 1 -- 172.21.15.17:0/3508219104 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f36240c6170 msgr2=0x7f36240abc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:34.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.856+0000 7f362917b700 1 --2- 172.21.15.17:0/3508219104 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f36240c6170 0x7f36240abc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:34.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.856+0000 7f362917b700 1 -- 172.21.15.17:0/3508219104 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3624159520 msgr2=0x7f3624158210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:34.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.856+0000 7f362917b700 1 --2- 172.21.15.17:0/3508219104 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3624159520 0x7f3624158210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:34.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.856+0000 7f362917b700 1 -- 172.21.15.17:0/3508219104 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3614009ae0 con 0x7f36240c82a0 2023-10-06T04:43:34.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.856+0000 7f362917b700 1 --2- 172.21.15.17:0/3508219104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36240c82a0 0x7f3624147470 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f361800c790 tx=0x7f3618007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:34.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.856+0000 7f3621ffb700 1 -- 172.21.15.17:0/3508219104 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3618011590 con 0x7f36240c82a0 2023-10-06T04:43:34.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.856+0000 7f3621ffb700 1 -- 172.21.15.17:0/3508219104 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3618011710 con 0x7f36240c82a0 2023-10-06T04:43:34.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.856+0000 7f362a97e700 1 -- 172.21.15.17:0/3508219104 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f362416a050 con 0x7f36240c82a0 2023-10-06T04:43:34.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.856+0000 7f3621ffb700 1 -- 172.21.15.17:0/3508219104 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3618011ad0 con 0x7f36240c82a0 2023-10-06T04:43:34.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.857+0000 7f362a97e700 1 -- 172.21.15.17:0/3508219104 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f362416a610 con 0x7f36240c82a0 2023-10-06T04:43:34.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.858+0000 7f362a97e700 1 -- 172.21.15.17:0/3508219104 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f362415b1d0 con 0x7f36240c82a0 2023-10-06T04:43:34.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.858+0000 7f3621ffb700 1 -- 172.21.15.17:0/3508219104 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f361801c440 con 0x7f36240c82a0 2023-10-06T04:43:34.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.858+0000 7f3621ffb700 1 --2- 172.21.15.17:0/3508219104 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3610066f30 0x7f36100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:34.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.858+0000 7f3621ffb700 1 -- 172.21.15.17:0/3508219104 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f36180839e0 con 0x7f36240c82a0 2023-10-06T04:43:34.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.858+0000 7f362997c700 1 --2- 172.21.15.17:0/3508219104 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3610066f30 0x7f36100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:34.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.859+0000 7f362997c700 1 --2- 172.21.15.17:0/3508219104 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3610066f30 0x7f36100693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3614009880 tx=0x7f3614018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:34.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:34.863+0000 7f3621ffb700 1 -- 172.21.15.17:0/3508219104 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f362415b1d0 con 0x7f36240c82a0 2023-10-06T04:43:35.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.056+0000 7f362a97e700 1 -- 172.21.15.17:0/3508219104 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f362415b1d0 con 0x7f36240c82a0 2023-10-06T04:43:35.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.057+0000 7f3621ffb700 1 -- 172.21.15.17:0/3508219104 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f362415b1d0 con 0x7f36240c82a0 2023-10-06T04:43:35.059 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:43:35.059 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":21,"fsid":"780777c4-2b25-4d35-9058-c9f2d62e3ad9","created":"2023-10-06T04:43:10.578520+0000","modified":"2023-10-06T04:43:30.789916+0000","last_up_change":"2023-10-06T04:43:20.682958+0000","last_in_change":"2023-10-06T04:43:12.978917+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:43:21.795733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:43:22.389592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:43:26.914728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:43:28.173678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"84737b08-575c-46dd-9488-073ae8504494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6809","nonce":90656},{"type":"v1","addr":"172.21.15.17:6811","nonce":90656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":90656},{"type":"v1","addr":"172.21.15.17:6814","nonce":90656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":90656},{"type":"v1","addr":"172.21.15.17:6822","nonce":90656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":90656},{"type":"v1","addr":"172.21.15.17:6818","nonce":90656}]},"public_addr":"172.21.15.17:6811/90656","cluster_addr":"172.21.15.17:6814/90656","heartbeat_back_addr":"172.21.15.17:6822/90656","heartbeat_front_addr":"172.21.15.17:6818/90656","state":["exists","up"]},{"osd":1,"uuid":"dffeb740-58a2-4fd6-8ff1-a0a11a2cc709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":90655},{"type":"v1","addr":"172.21.15.17:6801","nonce":90655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":90655},{"type":"v1","addr":"172.21.15.17:6803","nonce":90655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":90655},{"type":"v1","addr":"172.21.15.17:6807","nonce":90655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":90655},{"type":"v1","addr":"172.21.15.17:6805","nonce":90655}]},"public_addr":"172.21.15.17:6801/90655","cluster_addr":"172.21.15.17:6803/90655","heartbeat_back_addr":"172.21.15.17:6807/90655","heartbeat_front_addr":"172.21.15.17:6805/90655","state":["exists","up"]},{"osd":2,"uuid":"48bd6831-763d-48c2-b515-e02c216d608b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":90657},{"type":"v1","addr":"172.21.15.17:6810","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":90657},{"type":"v1","addr":"172.21.15.17:6815","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":90657},{"type":"v1","addr":"172.21.15.17:6823","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":90657},{"type":"v1","addr":"172.21.15.17:6819","nonce":90657}]},"public_addr":"172.21.15.17:6810/90657","cluster_addr":"172.21.15.17:6815/90657","heartbeat_back_addr":"172.21.15.17:6823/90657","heartbeat_front_addr":"172.21.15.17:6819/90657","state":["exists","up"]},{"osd":3,"uuid":"ae7dbb23-abe7-4bd3-a4df-6f5963d6804c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":90688},{"type":"v1","addr":"172.21.15.17:6825","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":90688},{"type":"v1","addr":"172.21.15.17:6827","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":90688},{"type":"v1","addr":"172.21.15.17:6831","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":90688},{"type":"v1","addr":"172.21.15.17:6829","nonce":90688}]},"public_addr":"172.21.15.17:6825/90688","cluster_addr":"172.21.15.17:6827/90688","heartbeat_back_addr":"172.21.15.17:6831/90688","heartbeat_front_addr":"172.21.15.17:6829/90688","state":["exists","up"]},{"osd":4,"uuid":"29991fb4-1667-4ea3-aca0-d55db27f3bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":90902},{"type":"v1","addr":"172.21.15.136:6801","nonce":90902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":90902},{"type":"v1","addr":"172.21.15.136:6803","nonce":90902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":90902},{"type":"v1","addr":"172.21.15.136:6807","nonce":90902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":90902},{"type":"v1","addr":"172.21.15.136:6805","nonce":90902}]},"public_addr":"172.21.15.136:6801/90902","cluster_addr":"172.21.15.136:6803/90902","heartbeat_back_addr":"172.21.15.136:6807/90902","heartbeat_front_addr":"172.21.15.136:6805/90902","state":["exists","up"]},{"osd":5,"uuid":"398b4ff9-03fc-421f-882c-ba12aa088eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":90901},{"type":"v1","addr":"172.21.15.136:6809","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":90901},{"type":"v1","addr":"172.21.15.136:6811","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":90901},{"type":"v1","addr":"172.21.15.136:6815","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":90901},{"type":"v1","addr":"172.21.15.136:6813","nonce":90901}]},"public_addr":"172.21.15.136:6809/90901","cluster_addr":"172.21.15.136:6811/90901","heartbeat_back_addr":"172.21.15.136:6815/90901","heartbeat_front_addr":"172.21.15.136:6813/90901","state":["exists","up"]},{"osd":6,"uuid":"1bb91a72-4dab-4cdb-aa1d-2b8a9edf1ad0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":90927},{"type":"v1","addr":"172.21.15.136:6825","nonce":90927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":90927},{"type":"v1","addr":"172.21.15.136:6827","nonce":90927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":90927},{"type":"v1","addr":"172.21.15.136:6831","nonce":90927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":90927},{"type":"v1","addr":"172.21.15.136:6829","nonce":90927}]},"public_addr":"172.21.15.136:6825/90927","cluster_addr":"172.21.15.136:6827/90927","heartbeat_back_addr":"172.21.15.136:6831/90927","heartbeat_front_addr":"172.21.15.136:6829/90927","state":["exists","up"]},{"osd":7,"uuid":"719b654e-010d-4aa4-8c13-83fdde242b47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":90934},{"type":"v1","addr":"172.21.15.136:6817","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":90934},{"type":"v1","addr":"172.21.15.136:6819","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":90934},{"type":"v1","addr":"172.21.15.136:6824","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":90934},{"type":"v1","addr":"172.21.15.136:6821","nonce":90934}]},"public_addr":"172.21.15.136:6817/90934","cluster_addr":"172.21.15.136:6819/90934","heartbeat_back_addr":"172.21.15.136:6824/90934","heartbeat_front_addr":"172.21.15.136:6821/90934","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.157479+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.140520+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.190743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.231396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.156510+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.145822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.202888+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.139532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:43:35.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.059+0000 7f362a97e700 1 -- 172.21.15.17:0/3508219104 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3610066f30 msgr2=0x7f36100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.059+0000 7f362a97e700 1 --2- 172.21.15.17:0/3508219104 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3610066f30 0x7f36100693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3614009880 tx=0x7f3614018000 comp rx=0 tx=0).stop 2023-10-06T04:43:35.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.059+0000 7f362a97e700 1 -- 172.21.15.17:0/3508219104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36240c82a0 msgr2=0x7f3624147470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.059+0000 7f362a97e700 1 --2- 172.21.15.17:0/3508219104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36240c82a0 0x7f3624147470 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f361800c790 tx=0x7f3618007f40 comp rx=0 tx=0).stop 2023-10-06T04:43:35.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.059+0000 7f362a97e700 1 -- 172.21.15.17:0/3508219104 shutdown_connections 2023-10-06T04:43:35.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.059+0000 7f362a97e700 1 --2- 172.21.15.17:0/3508219104 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3610066f30 0x7f36100693e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.059+0000 7f362a97e700 1 --2- 172.21.15.17:0/3508219104 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3624159520 0x7f3624158210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.059+0000 7f362a97e700 1 --2- 172.21.15.17:0/3508219104 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f36240c6170 0x7f36240abc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.059+0000 7f362a97e700 1 --2- 172.21.15.17:0/3508219104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36240c82a0 0x7f3624147470 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.059+0000 7f362a97e700 1 -- 172.21.15.17:0/3508219104 >> 172.21.15.17:0/3508219104 conn(0x7f36240cc930 msgr2=0x7f36240c7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:35.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.059+0000 7f362a97e700 1 -- 172.21.15.17:0/3508219104 shutdown_connections 2023-10-06T04:43:35.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.059+0000 7f362a97e700 1 -- 172.21.15.17:0/3508219104 wait complete. 2023-10-06T04:43:35.073 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-06T04:43:35.073 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:43:35.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.190+0000 7fb68261a700 1 Processor -- start 2023-10-06T04:43:35.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.190+0000 7fb68261a700 1 -- start start 2023-10-06T04:43:35.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.191+0000 7fb68261a700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb67c0cf3b0 0x7fb67c1594a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.191+0000 7fb68261a700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb67c0cbd80 con 0x7fb67c0ccfc0 2023-10-06T04:43:35.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.191+0000 7fb68261a700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb67c0af5f0 con 0x7fb67c0af0a0 2023-10-06T04:43:35.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.191+0000 7fb68261a700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb67c0af8d0 con 0x7fb67c0cf3b0 2023-10-06T04:43:35.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.191+0000 7fb681618700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fb67c0ccfc0 0x7fb67c0cc210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:35910/0 (socket says 172.21.15.17:35910) 2023-10-06T04:43:35.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.191+0000 7fb681618700 1 -- 172.21.15.17:0/179590556 learned_addr learned my addr 172.21.15.17:0/179590556 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:35.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.191+0000 7fb680e17700 1 --2- 172.21.15.17:0/179590556 >> v2:172.21.15.17:3300/0 conn(0x7fb67c0cf3b0 0x7fb67c1594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.191+0000 7fb67bfff700 1 -- 172.21.15.17:0/179590556 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3774534449 0 0) 0x7fb67c0cbd80 con 0x7fb67c0ccfc0 2023-10-06T04:43:35.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.191+0000 7fb67bfff700 1 -- 172.21.15.17:0/179590556 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb664003570 con 0x7fb67c0ccfc0 2023-10-06T04:43:35.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.192+0000 7fb680e17700 1 -- 172.21.15.17:0/179590556 >> v1:172.21.15.136:6789/0 conn(0x7fb67c0af0a0 legacy=0x7fb67c0b0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.192+0000 7fb680e17700 1 -- 172.21.15.17:0/179590556 >> v1:172.21.15.17:6789/0 conn(0x7fb67c0ccfc0 legacy=0x7fb67c0cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.192+0000 7fb680e17700 1 -- 172.21.15.17:0/179590556 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb67c0afbb0 con 0x7fb67c0cf3b0 2023-10-06T04:43:35.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.192+0000 7fb680e17700 1 --2- 172.21.15.17:0/179590556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb67c0cf3b0 0x7fb67c1594a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb670009910 tx=0x7fb6700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edc0fad77a288ece server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:35.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.192+0000 7fb67bfff700 1 -- 172.21.15.17:0/179590556 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67000b640 con 0x7fb67c0cf3b0 2023-10-06T04:43:35.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.192+0000 7fb67bfff700 1 -- 172.21.15.17:0/179590556 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67000b7a0 con 0x7fb67c0cf3b0 2023-10-06T04:43:35.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.192+0000 7fb67bfff700 1 -- 172.21.15.17:0/179590556 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67000bb60 con 0x7fb67c0cf3b0 2023-10-06T04:43:35.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.192+0000 7fb68261a700 1 -- 172.21.15.17:0/179590556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb67c0cf3b0 msgr2=0x7fb67c1594a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.192+0000 7fb68261a700 1 --2- 172.21.15.17:0/179590556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb67c0cf3b0 0x7fb67c1594a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb670009910 tx=0x7fb6700091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.192+0000 7fb68261a700 1 -- 172.21.15.17:0/179590556 shutdown_connections 2023-10-06T04:43:35.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.192+0000 7fb68261a700 1 --2- 172.21.15.17:0/179590556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb67c0cf3b0 0x7fb67c1594a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.192+0000 7fb68261a700 1 -- 172.21.15.17:0/179590556 >> 172.21.15.17:0/179590556 conn(0x7fb67c06cff0 msgr2=0x7fb67c06da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:35.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.192+0000 7fb68261a700 1 -- 172.21.15.17:0/179590556 shutdown_connections 2023-10-06T04:43:35.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.193+0000 7fb68261a700 1 -- 172.21.15.17:0/179590556 wait complete. 2023-10-06T04:43:35.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.194+0000 7fb68261a700 1 Processor -- start 2023-10-06T04:43:35.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.194+0000 7fb68261a700 1 -- start start 2023-10-06T04:43:35.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.194+0000 7fb68261a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb67c0af0a0 0x7fb67c0b32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.194+0000 7fb68261a700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb67c0ccfc0 0x7fb67c0b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.194+0000 7fb68261a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb67c0ca030 0x7fb67c0b5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.194+0000 7fb68261a700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c0b0ed0 con 0x7fb67c0af0a0 2023-10-06T04:43:35.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.194+0000 7fb68261a700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c0b1140 con 0x7fb67c0ca030 2023-10-06T04:43:35.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.194+0000 7fb68261a700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c0b1420 con 0x7fb67c0ccfc0 2023-10-06T04:43:35.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.194+0000 7fb681618700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb67c0af0a0 0x7fb67c0b32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.195+0000 7fb681618700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb67c0af0a0 0x7fb67c0b32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32768/0 (socket says 172.21.15.17:32768) 2023-10-06T04:43:35.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.195+0000 7fb681618700 1 -- 172.21.15.17:0/2376611502 learned_addr learned my addr 172.21.15.17:0/2376611502 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:35.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.195+0000 7fb681618700 1 -- 172.21.15.17:0/2376611502 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb67c0ccfc0 msgr2=0x7fb67c0b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.195+0000 7fb680e17700 1 --2- 172.21.15.17:0/2376611502 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb67c0ccfc0 0x7fb67c0b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.195+0000 7fb681618700 1 --2- 172.21.15.17:0/2376611502 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb67c0ccfc0 0x7fb67c0b4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.195+0000 7fb681e19700 1 --2- 172.21.15.17:0/2376611502 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb67c0ca030 0x7fb67c0b5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.195+0000 7fb681618700 1 -- 172.21.15.17:0/2376611502 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb67c0ca030 msgr2=0x7fb67c0b5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.195+0000 7fb681618700 1 --2- 172.21.15.17:0/2376611502 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb67c0ca030 0x7fb67c0b5340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.195+0000 7fb681618700 1 -- 172.21.15.17:0/2376611502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb670009420 con 0x7fb67c0af0a0 2023-10-06T04:43:35.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.195+0000 7fb681618700 1 --2- 172.21.15.17:0/2376611502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb67c0af0a0 0x7fb67c0b32a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb67400c7c0 tx=0x7fb674007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:35.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.195+0000 7fb6797fa700 1 -- 172.21.15.17:0/2376611502 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb674005b30 con 0x7fb67c0af0a0 2023-10-06T04:43:35.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.195+0000 7fb6797fa700 1 -- 172.21.15.17:0/2376611502 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb674005c90 con 0x7fb67c0af0a0 2023-10-06T04:43:35.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.195+0000 7fb68261a700 1 -- 172.21.15.17:0/2376611502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb67c0b1700 con 0x7fb67c0af0a0 2023-10-06T04:43:35.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.195+0000 7fb6797fa700 1 -- 172.21.15.17:0/2376611502 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb674007340 con 0x7fb67c0af0a0 2023-10-06T04:43:35.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.195+0000 7fb68261a700 1 -- 172.21.15.17:0/2376611502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb67c0b37e0 con 0x7fb67c0af0a0 2023-10-06T04:43:35.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.196+0000 7fb68261a700 1 -- 172.21.15.17:0/2376611502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb67c04c380 con 0x7fb67c0af0a0 2023-10-06T04:43:35.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.196+0000 7fb6797fa700 1 -- 172.21.15.17:0/2376611502 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb67401b400 con 0x7fb67c0af0a0 2023-10-06T04:43:35.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.197+0000 7fb6797fa700 1 --2- 172.21.15.17:0/2376611502 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fb668066f30 0x7fb6680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.197+0000 7fb6797fa700 1 -- 172.21.15.17:0/2376611502 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb6740841a0 con 0x7fb67c0af0a0 2023-10-06T04:43:35.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.197+0000 7fb680e17700 1 --2- 172.21.15.17:0/2376611502 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fb668066f30 0x7fb6680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.197+0000 7fb680e17700 1 --2- 172.21.15.17:0/2376611502 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fb668066f30 0x7fb6680693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb67c0b0250 tx=0x7fb670017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:35.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.201+0000 7fb6797fa700 1 -- 172.21.15.17:0/2376611502 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb674051330 con 0x7fb67c0af0a0 2023-10-06T04:43:35.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.394+0000 7fb68261a700 1 -- 172.21.15.17:0/2376611502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb67c0b62d0 con 0x7fb67c0af0a0 2023-10-06T04:43:35.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.395+0000 7fb6797fa700 1 -- 172.21.15.17:0/2376611502 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16866 (secure 0 0 0) 0x7fb674054950 con 0x7fb67c0af0a0 2023-10-06T04:43:35.397 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:43:35.397 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":21,"fsid":"780777c4-2b25-4d35-9058-c9f2d62e3ad9","created":"2023-10-06T04:43:10.578520+0000","modified":"2023-10-06T04:43:30.789916+0000","last_up_change":"2023-10-06T04:43:20.682958+0000","last_in_change":"2023-10-06T04:43:12.978917+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:43:21.795733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:43:22.389592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:43:26.914728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:43:28.173678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"84737b08-575c-46dd-9488-073ae8504494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6809","nonce":90656},{"type":"v1","addr":"172.21.15.17:6811","nonce":90656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":90656},{"type":"v1","addr":"172.21.15.17:6814","nonce":90656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":90656},{"type":"v1","addr":"172.21.15.17:6822","nonce":90656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":90656},{"type":"v1","addr":"172.21.15.17:6818","nonce":90656}]},"public_addr":"172.21.15.17:6811/90656","cluster_addr":"172.21.15.17:6814/90656","heartbeat_back_addr":"172.21.15.17:6822/90656","heartbeat_front_addr":"172.21.15.17:6818/90656","state":["exists","up"]},{"osd":1,"uuid":"dffeb740-58a2-4fd6-8ff1-a0a11a2cc709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":90655},{"type":"v1","addr":"172.21.15.17:6801","nonce":90655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":90655},{"type":"v1","addr":"172.21.15.17:6803","nonce":90655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":90655},{"type":"v1","addr":"172.21.15.17:6807","nonce":90655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":90655},{"type":"v1","addr":"172.21.15.17:6805","nonce":90655}]},"public_addr":"172.21.15.17:6801/90655","cluster_addr":"172.21.15.17:6803/90655","heartbeat_back_addr":"172.21.15.17:6807/90655","heartbeat_front_addr":"172.21.15.17:6805/90655","state":["exists","up"]},{"osd":2,"uuid":"48bd6831-763d-48c2-b515-e02c216d608b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":90657},{"type":"v1","addr":"172.21.15.17:6810","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":90657},{"type":"v1","addr":"172.21.15.17:6815","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":90657},{"type":"v1","addr":"172.21.15.17:6823","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":90657},{"type":"v1","addr":"172.21.15.17:6819","nonce":90657}]},"public_addr":"172.21.15.17:6810/90657","cluster_addr":"172.21.15.17:6815/90657","heartbeat_back_addr":"172.21.15.17:6823/90657","heartbeat_front_addr":"172.21.15.17:6819/90657","state":["exists","up"]},{"osd":3,"uuid":"ae7dbb23-abe7-4bd3-a4df-6f5963d6804c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":90688},{"type":"v1","addr":"172.21.15.17:6825","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":90688},{"type":"v1","addr":"172.21.15.17:6827","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":90688},{"type":"v1","addr":"172.21.15.17:6831","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":90688},{"type":"v1","addr":"172.21.15.17:6829","nonce":90688}]},"public_addr":"172.21.15.17:6825/90688","cluster_addr":"172.21.15.17:6827/90688","heartbeat_back_addr":"172.21.15.17:6831/90688","heartbeat_front_addr":"172.21.15.17:6829/90688","state":["exists","up"]},{"osd":4,"uuid":"29991fb4-1667-4ea3-aca0-d55db27f3bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":90902},{"type":"v1","addr":"172.21.15.136:6801","nonce":90902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":90902},{"type":"v1","addr":"172.21.15.136:6803","nonce":90902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":90902},{"type":"v1","addr":"172.21.15.136:6807","nonce":90902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":90902},{"type":"v1","addr":"172.21.15.136:6805","nonce":90902}]},"public_addr":"172.21.15.136:6801/90902","cluster_addr":"172.21.15.136:6803/90902","heartbeat_back_addr":"172.21.15.136:6807/90902","heartbeat_front_addr":"172.21.15.136:6805/90902","state":["exists","up"]},{"osd":5,"uuid":"398b4ff9-03fc-421f-882c-ba12aa088eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":90901},{"type":"v1","addr":"172.21.15.136:6809","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":90901},{"type":"v1","addr":"172.21.15.136:6811","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":90901},{"type":"v1","addr":"172.21.15.136:6815","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":90901},{"type":"v1","addr":"172.21.15.136:6813","nonce":90901}]},"public_addr":"172.21.15.136:6809/90901","cluster_addr":"172.21.15.136:6811/90901","heartbeat_back_addr":"172.21.15.136:6815/90901","heartbeat_front_addr":"172.21.15.136:6813/90901","state":["exists","up"]},{"osd":6,"uuid":"1bb91a72-4dab-4cdb-aa1d-2b8a9edf1ad0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":90927},{"type":"v1","addr":"172.21.15.136:6825","nonce":90927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":90927},{"type":"v1","addr":"172.21.15.136:6827","nonce":90927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":90927},{"type":"v1","addr":"172.21.15.136:6831","nonce":90927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":90927},{"type":"v1","addr":"172.21.15.136:6829","nonce":90927}]},"public_addr":"172.21.15.136:6825/90927","cluster_addr":"172.21.15.136:6827/90927","heartbeat_back_addr":"172.21.15.136:6831/90927","heartbeat_front_addr":"172.21.15.136:6829/90927","state":["exists","up"]},{"osd":7,"uuid":"719b654e-010d-4aa4-8c13-83fdde242b47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":90934},{"type":"v1","addr":"172.21.15.136:6817","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":90934},{"type":"v1","addr":"172.21.15.136:6819","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":90934},{"type":"v1","addr":"172.21.15.136:6824","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":90934},{"type":"v1","addr":"172.21.15.136:6821","nonce":90934}]},"public_addr":"172.21.15.136:6817/90934","cluster_addr":"172.21.15.136:6819/90934","heartbeat_back_addr":"172.21.15.136:6824/90934","heartbeat_front_addr":"172.21.15.136:6821/90934","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.157479+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.140520+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.190743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.231396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.156510+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.145822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.202888+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.139532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:43:35.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.397+0000 7fb68261a700 1 -- 172.21.15.17:0/2376611502 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fb668066f30 msgr2=0x7fb6680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.397+0000 7fb68261a700 1 --2- 172.21.15.17:0/2376611502 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fb668066f30 0x7fb6680693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb67c0b0250 tx=0x7fb670017000 comp rx=0 tx=0).stop 2023-10-06T04:43:35.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.397+0000 7fb68261a700 1 -- 172.21.15.17:0/2376611502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb67c0af0a0 msgr2=0x7fb67c0b32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.397+0000 7fb68261a700 1 --2- 172.21.15.17:0/2376611502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb67c0af0a0 0x7fb67c0b32a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb67400c7c0 tx=0x7fb674007e00 comp rx=0 tx=0).stop 2023-10-06T04:43:35.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.397+0000 7fb68261a700 1 -- 172.21.15.17:0/2376611502 shutdown_connections 2023-10-06T04:43:35.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.397+0000 7fb68261a700 1 --2- 172.21.15.17:0/2376611502 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fb668066f30 0x7fb6680693e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.397+0000 7fb68261a700 1 --2- 172.21.15.17:0/2376611502 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb67c0ca030 0x7fb67c0b5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.397+0000 7fb68261a700 1 --2- 172.21.15.17:0/2376611502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb67c0af0a0 0x7fb67c0b32a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.397+0000 7fb68261a700 1 --2- 172.21.15.17:0/2376611502 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb67c0ccfc0 0x7fb67c0b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.397+0000 7fb68261a700 1 -- 172.21.15.17:0/2376611502 >> 172.21.15.17:0/2376611502 conn(0x7fb67c06cff0 msgr2=0x7fb67c15fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:35.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.397+0000 7fb68261a700 1 -- 172.21.15.17:0/2376611502 shutdown_connections 2023-10-06T04:43:35.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.397+0000 7fb68261a700 1 -- 172.21.15.17:0/2376611502 wait complete. 2023-10-06T04:43:35.411 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-06T04:43:35.412 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-06T04:43:35.412 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-06T04:43:35.412 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-06T04:43:35.413 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-06T04:43:35.413 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-06T04:43:35.413 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-06T04:43:35.414 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-06T04:43:35.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.616+0000 7f53c0c5e700 1 Processor -- start 2023-10-06T04:43:35.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.617+0000 7f53c0c5e700 1 -- start start 2023-10-06T04:43:35.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.618+0000 7f53c0c5e700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f53bc155860 0x7f53bc06d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.618+0000 7f53c0c5e700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f53bc0cb670 0x7f53bc0c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.618+0000 7f53c0c5e700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53bc0c7af0 con 0x7f53bc155c30 2023-10-06T04:43:35.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.618+0000 7f53c0c5e700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53bc0c7dd0 con 0x7f53bc0cb670 2023-10-06T04:43:35.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.618+0000 7f53c0c5e700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53bc0c80b0 con 0x7f53bc155860 2023-10-06T04:43:35.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.618+0000 7f53bbfff700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f53bc0cb670 0x7f53bc0c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.618+0000 7f53bbfff700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f53bc0cb670 0x7f53bc0c8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32784/0 (socket says 172.21.15.17:32784) 2023-10-06T04:43:35.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.618+0000 7f53bbfff700 1 -- 172.21.15.17:0/752785521 learned_addr learned my addr 172.21.15.17:0/752785521 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:35.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.618+0000 7f53bb7fe700 1 --2- 172.21.15.17:0/752785521 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f53bc155860 0x7f53bc06d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.619+0000 7f53bbfff700 1 -- 172.21.15.17:0/752785521 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f53bc155860 msgr2=0x7f53bc06d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:35.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.619+0000 7f53bbfff700 1 --2- 172.21.15.17:0/752785521 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f53bc155860 0x7f53bc06d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.619+0000 7f53bbfff700 1 -- 172.21.15.17:0/752785521 >> v1:172.21.15.136:6789/0 conn(0x7f53bc155c30 legacy=0x7f53bc0caf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:35.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.619+0000 7f53bbfff700 1 -- 172.21.15.17:0/752785521 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53bc0c8390 con 0x7f53bc0cb670 2023-10-06T04:43:35.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.619+0000 7fc2ece5f700 1 Processor -- start 2023-10-06T04:43:35.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.619+0000 7f53bbfff700 1 --2- 172.21.15.17:0/752785521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53bc0cb670 0x7f53bc0c8b90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f53b400d1a0 tx=0x7f53b400ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=659f2355cf16a7c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:35.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.619+0000 7f53ba7fc700 1 -- 172.21.15.17:0/752785521 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b4010070 con 0x7f53bc0cb670 2023-10-06T04:43:35.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.619+0000 7f53ba7fc700 1 -- 172.21.15.17:0/752785521 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b400dbc0 con 0x7f53bc0cb670 2023-10-06T04:43:35.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.619+0000 7f53ba7fc700 1 -- 172.21.15.17:0/752785521 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b4016440 con 0x7f53bc0cb670 2023-10-06T04:43:35.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.619+0000 7fc2ece5f700 1 -- start start 2023-10-06T04:43:35.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.620+0000 7f53c0c5e700 1 -- 172.21.15.17:0/752785521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53bc0cb670 msgr2=0x7f53bc0c8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.620+0000 7f9d41abb700 1 Processor -- start 2023-10-06T04:43:35.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.620+0000 7f53c0c5e700 1 --2- 172.21.15.17:0/752785521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53bc0cb670 0x7f53bc0c8b90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f53b400d1a0 tx=0x7f53b400ba50 comp rx=0 tx=0).stop 2023-10-06T04:43:35.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.620+0000 7f9d41abb700 1 -- start start 2023-10-06T04:43:35.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.620+0000 7f53c0c5e700 1 -- 172.21.15.17:0/752785521 shutdown_connections 2023-10-06T04:43:35.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.620+0000 7f53c0c5e700 1 --2- 172.21.15.17:0/752785521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53bc0cb670 0x7f53bc0c8b90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.620+0000 7f53c0c5e700 1 --2- 172.21.15.17:0/752785521 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f53bc155860 0x7f53bc06d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.620+0000 7f53c0c5e700 1 -- 172.21.15.17:0/752785521 >> 172.21.15.17:0/752785521 conn(0x7f53bc06e650 msgr2=0x7f53bc06ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:35.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.620+0000 7f53c0c5e700 1 -- 172.21.15.17:0/752785521 shutdown_connections 2023-10-06T04:43:35.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.620+0000 7f53c0c5e700 1 -- 172.21.15.17:0/752785521 wait complete. 2023-10-06T04:43:35.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.620+0000 7fc2ece5f700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc2e80c7140 0x7fc2e80b0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.620+0000 7fc2ece5f700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc2e806a940 0x7fc2e80b0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.620+0000 7fc2ece5f700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2e806c600 con 0x7fc2e806a570 2023-10-06T04:43:35.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.620+0000 7fc2ece5f700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2e806c8e0 con 0x7fc2e806a940 2023-10-06T04:43:35.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.620+0000 7fc2ece5f700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e806cbc0 con 0x7fc2e80c7140 2023-10-06T04:43:35.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.621+0000 7fc2e6d9d700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc2e806a940 0x7fc2e80b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.621+0000 7fc2e6d9d700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc2e806a940 0x7fc2e80b0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32786/0 (socket says 172.21.15.17:32786) 2023-10-06T04:43:35.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.621+0000 7fc2e6d9d700 1 -- 172.21.15.17:0/1292728548 learned_addr learned my addr 172.21.15.17:0/1292728548 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:35.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.621+0000 7fc2e5d9b700 1 --2- 172.21.15.17:0/1292728548 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc2e80c7140 0x7fc2e80b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.621+0000 7fc2e6d9d700 1 -- 172.21.15.17:0/1292728548 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc2e80c7140 msgr2=0x7fc2e80b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:35.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.621+0000 7fc2e6d9d700 1 --2- 172.21.15.17:0/1292728548 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc2e80c7140 0x7fc2e80b0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.621+0000 7fc2e6d9d700 1 -- 172.21.15.17:0/1292728548 >> v1:172.21.15.136:6789/0 conn(0x7fc2e806a570 legacy=0x7fc2e80c7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:35.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.621+0000 7fc2e6d9d700 1 -- 172.21.15.17:0/1292728548 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e806cea0 con 0x7fc2e806a940 2023-10-06T04:43:35.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.621+0000 7fc2e5d9b700 1 --2- 172.21.15.17:0/1292728548 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc2e80c7140 0x7fc2e80b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:43:35.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.621+0000 7fc2e6d9d700 1 --2- 172.21.15.17:0/1292728548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2e806a940 0x7fc2e80b0560 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0009f20 tx=0x7fc2e0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d9e5fa8fabc7811 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:35.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.621+0000 7f9d41abb700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9d3c06e920 0x7f9d3c0c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.621+0000 7f9d41abb700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9d3c155990 0x7f9d3c0ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.621+0000 7f9d41abb700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d3c0ca930 con 0x7f9d3c1555c0 2023-10-06T04:43:35.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.621+0000 7f9d41abb700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d3c0cb780 con 0x7f9d3c155990 2023-10-06T04:43:35.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.621+0000 7fc2e559a700 1 -- 172.21.15.17:0/1292728548 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e000e070 con 0x7fc2e806a940 2023-10-06T04:43:35.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.621+0000 7f9d41abb700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d3c0cab70 con 0x7f9d3c06e920 2023-10-06T04:43:35.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.622+0000 7fc2e559a700 1 -- 172.21.15.17:0/1292728548 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e000ba20 con 0x7fc2e806a940 2023-10-06T04:43:35.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.622+0000 7fc2e559a700 1 -- 172.21.15.17:0/1292728548 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e00092e0 con 0x7fc2e806a940 2023-10-06T04:43:35.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.622+0000 7f9d3bfff700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9d3c155990 0x7f9d3c0ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.622+0000 7f9d3bfff700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9d3c155990 0x7f9d3c0ca3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32802/0 (socket says 172.21.15.17:32802) 2023-10-06T04:43:35.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.622+0000 7f9d3bfff700 1 -- 172.21.15.17:0/1170676944 learned_addr learned my addr 172.21.15.17:0/1170676944 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:35.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.622+0000 7f9d3affd700 1 --2- 172.21.15.17:0/1170676944 >> v2:172.21.15.136:3300/0 conn(0x7f9d3c06e920 0x7f9d3c0c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.622+0000 7f9d3bfff700 1 -- 172.21.15.17:0/1170676944 >> v2:172.21.15.136:3300/0 conn(0x7f9d3c06e920 msgr2=0x7f9d3c0c9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:35.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.622+0000 7f9d3bfff700 1 --2- 172.21.15.17:0/1170676944 >> v2:172.21.15.136:3300/0 conn(0x7f9d3c06e920 0x7f9d3c0c9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.622+0000 7f9d3bfff700 1 -- 172.21.15.17:0/1170676944 >> v1:172.21.15.136:6789/0 conn(0x7f9d3c1555c0 legacy=0x7f9d3c06e210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T04:43:35.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.622+0000 7f9d3bfff700 1 -- 172.21.15.17:0/1170676944 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d3c0cae50 con 0x7f9d3c155990 2023-10-06T04:43:35.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.622+0000 7f53c0c5e700 1 Processor -- start 2023-10-06T04:43:35.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.622+0000 7f9d3bfff700 1 --2- 172.21.15.17:0/1170676944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d3c155990 0x7f9d3c0ca3f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9d3400cac0 tx=0x7f9d3400c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d5e60a9c8f4643 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:35.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.622+0000 7f53c0c5e700 1 -- start start 2023-10-06T04:43:35.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.622+0000 7f9d3a7fc700 1 -- 172.21.15.17:0/1170676944 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d34007920 con 0x7f9d3c155990 2023-10-06T04:43:35.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.622+0000 7f9d3a7fc700 1 -- 172.21.15.17:0/1170676944 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d34013480 con 0x7f9d3c155990 2023-10-06T04:43:35.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.622+0000 7f9d3a7fc700 1 -- 172.21.15.17:0/1170676944 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d34013820 con 0x7f9d3c155990 2023-10-06T04:43:35.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.623+0000 7fc2ece5f700 1 -- 172.21.15.17:0/1292728548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2e806a940 msgr2=0x7fc2e80b0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.623+0000 7fc2ece5f700 1 --2- 172.21.15.17:0/1292728548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2e806a940 0x7fc2e80b0560 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0009f20 tx=0x7fc2e0009840 comp rx=0 tx=0).stop 2023-10-06T04:43:35.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.623+0000 7fc2ece5f700 1 -- 172.21.15.17:0/1292728548 shutdown_connections 2023-10-06T04:43:35.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.623+0000 7fc2ece5f700 1 --2- 172.21.15.17:0/1292728548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2e806a940 0x7fc2e80b0560 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.623+0000 7fc2ece5f700 1 --2- 172.21.15.17:0/1292728548 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc2e80c7140 0x7fc2e80b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.623+0000 7fc2ece5f700 1 -- 172.21.15.17:0/1292728548 >> 172.21.15.17:0/1292728548 conn(0x7fc2e80cd600 msgr2=0x7fc2e80c95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:35.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.623+0000 7f53c0c5e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f53bc0cb670 0x7f53bc16d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.623+0000 7f53c0c5e700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f53bc155860 0x7f53bc157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.623+0000 7f53c0c5e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53bc155c30 0x7f53bc1560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.623+0000 7f53c0c5e700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53bc16d9f0 con 0x7f53bc155c30 2023-10-06T04:43:35.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.623+0000 7f53c0c5e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53bc158bb0 con 0x7f53bc0cb670 2023-10-06T04:43:35.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.623+0000 7f53c0c5e700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53bc158e90 con 0x7f53bc155860 2023-10-06T04:43:35.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.623+0000 7f53bbfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53bc155c30 0x7f53bc1560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.623+0000 7f53bb7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f53bc0cb670 0x7f53bc16d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.623+0000 7f53bb7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f53bc0cb670 0x7f53bc16d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.17:32834/0 (socket says 172.21.15.17:32834) 2023-10-06T04:43:35.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.623+0000 7f53bbfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53bc155c30 0x7f53bc1560a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32806/0 (socket says 172.21.15.17:32806) 2023-10-06T04:43:35.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.623+0000 7f53bb7fe700 1 -- 172.21.15.17:0/1251784823 learned_addr learned my addr 172.21.15.17:0/1251784823 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:35.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.623+0000 7f9d41abb700 1 -- 172.21.15.17:0/1170676944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d3c155990 msgr2=0x7f9d3c0ca3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.623+0000 7f9d41abb700 1 --2- 172.21.15.17:0/1170676944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d3c155990 0x7f9d3c0ca3f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9d3400cac0 tx=0x7f9d3400c3c0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.623+0000 7f9d41abb700 1 -- 172.21.15.17:0/1170676944 shutdown_connections 2023-10-06T04:43:35.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.623+0000 7f9d41abb700 1 --2- 172.21.15.17:0/1170676944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d3c155990 0x7f9d3c0ca3f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.623+0000 7f9d41abb700 1 --2- 172.21.15.17:0/1170676944 >> v2:172.21.15.136:3300/0 conn(0x7f9d3c06e920 0x7f9d3c0c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.623+0000 7f9d41abb700 1 -- 172.21.15.17:0/1170676944 >> 172.21.15.17:0/1170676944 conn(0x7f9d3c0ccd10 msgr2=0x7f9d3c0c8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:35.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.623+0000 7f53baffd700 1 --2- 172.21.15.17:0/1251784823 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f53bc155860 0x7f53bc157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.624+0000 7f53bbfff700 1 -- 172.21.15.17:0/1251784823 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f53bc155860 msgr2=0x7f53bc157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.624+0000 7f53bbfff700 1 --2- 172.21.15.17:0/1251784823 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f53bc155860 0x7f53bc157f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.624+0000 7f53bbfff700 1 -- 172.21.15.17:0/1251784823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f53bc0cb670 msgr2=0x7f53bc16d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.624+0000 7f53bbfff700 1 --2- 172.21.15.17:0/1251784823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f53bc0cb670 0x7f53bc16d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.624+0000 7f53bbfff700 1 -- 172.21.15.17:0/1251784823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b400bcf0 con 0x7f53bc155c30 2023-10-06T04:43:35.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.624+0000 7f53bb7fe700 1 --2- 172.21.15.17:0/1251784823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f53bc0cb670 0x7f53bc16d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:43:35.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.624+0000 7f53bbfff700 1 --2- 172.21.15.17:0/1251784823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53bc155c30 0x7f53bc1560a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f53b4018000 tx=0x7f53b401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:35.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.624+0000 7f53a37fe700 1 -- 172.21.15.17:0/1251784823 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b4016b80 con 0x7f53bc155c30 2023-10-06T04:43:35.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.624+0000 7f53a37fe700 1 -- 172.21.15.17:0/1251784823 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b4016d00 con 0x7f53bc155c30 2023-10-06T04:43:35.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.624+0000 7f53c0c5e700 1 -- 172.21.15.17:0/1251784823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53bc0b11b0 con 0x7f53bc155c30 2023-10-06T04:43:35.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.624+0000 7f53a37fe700 1 -- 172.21.15.17:0/1251784823 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b401f660 con 0x7f53bc155c30 2023-10-06T04:43:35.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.624+0000 7f53c0c5e700 1 -- 172.21.15.17:0/1251784823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53bc0ae270 con 0x7f53bc155c30 2023-10-06T04:43:35.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.624+0000 7f8306958700 1 Processor -- start 2023-10-06T04:43:35.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.625+0000 7fc2ece5f700 1 -- 172.21.15.17:0/1292728548 shutdown_connections 2023-10-06T04:43:35.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.625+0000 7f9d41abb700 1 -- 172.21.15.17:0/1170676944 shutdown_connections 2023-10-06T04:43:35.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.625+0000 7f8306958700 1 -- start start 2023-10-06T04:43:35.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.625+0000 7f9d41abb700 1 -- 172.21.15.17:0/1170676944 wait complete. 2023-10-06T04:43:35.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.626+0000 7fc2ece5f700 1 -- 172.21.15.17:0/1292728548 wait complete. 2023-10-06T04:43:35.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.626+0000 7f8306958700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f830006b2f0 0x7f830015ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.626+0000 7f8306958700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f83000ae380 0x7f8300156140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.626+0000 7f8306958700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8300067ca0 con 0x7f830006af20 2023-10-06T04:43:35.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.626+0000 7f8306958700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8300068840 con 0x7f83000ae380 2023-10-06T04:43:35.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.626+0000 7f8306958700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8300067690 con 0x7f830006b2f0 2023-10-06T04:43:35.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.626+0000 7f53c0c5e700 1 -- 172.21.15.17:0/1251784823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f53bc04c380 con 0x7f53bc155c30 2023-10-06T04:43:35.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.626+0000 7f9d41abb700 1 Processor -- start 2023-10-06T04:43:35.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.627+0000 7f9d41abb700 1 -- start start 2023-10-06T04:43:35.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.627+0000 7f82fffff700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f830006af20 0x7f8300068130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:35922/0 (socket says 172.21.15.17:35922) 2023-10-06T04:43:35.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.627+0000 7f82fffff700 1 -- 172.21.15.17:0/86022205 learned_addr learned my addr 172.21.15.17:0/86022205 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:35.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.627+0000 7f82ff7fe700 1 --2- 172.21.15.17:0/86022205 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f830006b2f0 0x7f830015ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.627+0000 7f53a37fe700 1 -- 172.21.15.17:0/1251784823 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f53b401d040 con 0x7f53bc155c30 2023-10-06T04:43:35.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.627+0000 7f53a37fe700 1 --2- 172.21.15.17:0/1251784823 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f53a8066f30 0x7f53a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.627+0000 7f82ff7fe700 1 -- 172.21.15.17:0/86022205 >> v2:172.21.15.17:3300/0 conn(0x7f83000ae380 msgr2=0x7f8300156140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:35.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.627+0000 7f82ff7fe700 1 --2- 172.21.15.17:0/86022205 >> v2:172.21.15.17:3300/0 conn(0x7f83000ae380 0x7f8300156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.627+0000 7f82feffd700 1 -- 172.21.15.17:0/86022205 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2005399956 0 0) 0x7f8300067ca0 con 0x7f830006af20 2023-10-06T04:43:35.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.627+0000 7f82ff7fe700 1 -- 172.21.15.17:0/86022205 >> v1:172.21.15.17:6789/0 conn(0x7f830006af20 legacy=0x7f8300068130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.627+0000 7f82ff7fe700 1 -- 172.21.15.17:0/86022205 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83000aeaf0 con 0x7f830006b2f0 2023-10-06T04:43:35.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.627+0000 7fc1a0f75700 1 Processor -- start 2023-10-06T04:43:35.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.627+0000 7f53a37fe700 1 -- 172.21.15.17:0/1251784823 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f53b4085270 con 0x7f53bc155c30 2023-10-06T04:43:35.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.627+0000 7f4f2ebb1700 1 Processor -- start 2023-10-06T04:43:35.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.627+0000 7f82ff7fe700 1 --2- 172.21.15.17:0/86022205 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f830006b2f0 0x7f830015ad60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f82f0010c90 tx=0x7f82f00090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e419326cd467cb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:35.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.627+0000 7f53a37fe700 1 --2- 172.21.15.17:0/1251784823 >> [v2:172.21.15.17:6800/90655,v1:172.21.15.17:6801/90655] conn(0x7f53a806f7e0 0x7f53a8071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.628+0000 7f53a37fe700 1 -- 172.21.15.17:0/1251784823 --> [v2:172.21.15.17:6800/90655,v1:172.21.15.17:6801/90655] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f53a80722a0 con 0x7f53a806f7e0 2023-10-06T04:43:35.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.628+0000 7f53a37fe700 1 -- 172.21.15.17:0/1251784823 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f53b40878b0 con 0x7f53bc155c30 2023-10-06T04:43:35.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.628+0000 7fc2ece5f700 1 Processor -- start 2023-10-06T04:43:35.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.628+0000 7fc2ece5f700 1 -- start start 2023-10-06T04:43:35.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.628+0000 7f53bb7fe700 1 --2- 172.21.15.17:0/1251784823 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f53a8066f30 0x7f53a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.628+0000 7f9d41abb700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d3c06e920 0x7f9d3c1584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.628+0000 7f9d41abb700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9d3c155990 0x7f9d3c0c3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.628+0000 7f9d41abb700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d3c156d00 0x7f9d3c154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.628+0000 7f9d41abb700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3c0c4b80 con 0x7f9d3c06e920 2023-10-06T04:43:35.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.628+0000 7f9d41abb700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3c0c4e60 con 0x7f9d3c156d00 2023-10-06T04:43:35.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.628+0000 7f9d41abb700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3c0c5140 con 0x7f9d3c155990 2023-10-06T04:43:35.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.628+0000 7fe2bb1e5700 1 Processor -- start 2023-10-06T04:43:35.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.628+0000 7f9d3bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d3c156d00 0x7f9d3c154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.628+0000 7f9d3bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d3c156d00 0x7f9d3c154ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.17:32840/0 (socket says 172.21.15.17:32840) 2023-10-06T04:43:35.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.628+0000 7f9d3bfff700 1 -- 172.21.15.17:0/3606463127 learned_addr learned my addr 172.21.15.17:0/3606463127 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:35.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.628+0000 7f9d3b7fe700 1 --2- 172.21.15.17:0/3606463127 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d3c06e920 0x7f9d3c1584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.628+0000 7f82feffd700 1 -- 172.21.15.17:0/86022205 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f0010ea0 con 0x7f830006b2f0 2023-10-06T04:43:35.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.628+0000 7f82feffd700 1 -- 172.21.15.17:0/86022205 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f0018430 con 0x7f830006b2f0 2023-10-06T04:43:35.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.628+0000 7f82feffd700 1 -- 172.21.15.17:0/86022205 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f00187f0 con 0x7f830006b2f0 2023-10-06T04:43:35.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7f9d3bfff700 1 -- 172.21.15.17:0/3606463127 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9d3c155990 msgr2=0x7f9d3c0c3d50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T04:43:35.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7f9d3bfff700 1 --2- 172.21.15.17:0/3606463127 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9d3c155990 0x7f9d3c0c3d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7f9d3bfff700 1 -- 172.21.15.17:0/3606463127 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d3c06e920 msgr2=0x7f9d3c1584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7f9d3bfff700 1 --2- 172.21.15.17:0/3606463127 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d3c06e920 0x7f9d3c1584b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7f9d3bfff700 1 -- 172.21.15.17:0/3606463127 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d3400c600 con 0x7f9d3c156d00 2023-10-06T04:43:35.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7f9d3b7fe700 1 --2- 172.21.15.17:0/3606463127 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d3c06e920 0x7f9d3c1584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:43:35.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7fc2ece5f700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc2e806a570 0x7fc2e80aba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7fc2ece5f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2e806a940 0x7fc2e814e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7fc2ece5f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2e80c7140 0x7fc2e80c1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7f9d3bfff700 1 --2- 172.21.15.17:0/3606463127 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d3c156d00 0x7f9d3c154ce0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9d3400c400 tx=0x7f9d3401a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:35.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.627+0000 7f4f2ebb1700 1 -- start start 2023-10-06T04:43:35.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7fc2ece5f700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e814e950 con 0x7fc2e806a940 2023-10-06T04:43:35.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7fc2ece5f700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e80c04e0 con 0x7fc2e80c7140 2023-10-06T04:43:35.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7f4f2ebb1700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4f2806af20 0x7f4f2815ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7f4f2ebb1700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4f2806b2f0 0x7f4f280ae380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7f4f2ebb1700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f280ae8c0 con 0x7f4f28068130 2023-10-06T04:43:35.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7f4f2ebb1700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f28067ca0 con 0x7f4f2806af20 2023-10-06T04:43:35.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7f4f2ebb1700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f28067690 con 0x7f4f2806b2f0 2023-10-06T04:43:35.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7fc2ece5f700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e80c0aa0 con 0x7fc2e806a570 2023-10-06T04:43:35.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7f4f27fff700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4f2806b2f0 0x7f4f280ae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7f4f27fff700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4f2806b2f0 0x7f4f280ae380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.17:36176/0 (socket says 172.21.15.17:36176) 2023-10-06T04:43:35.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7f4f27fff700 1 -- 172.21.15.17:0/547649073 learned_addr learned my addr 172.21.15.17:0/547649073 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:35.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7fc1a0f75700 1 -- start start 2023-10-06T04:43:35.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7fc2e659c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc2e806a570 0x7fc2e80aba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7fc2e659c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc2e806a570 0x7fc2e80aba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.17:36162/0 (socket says 172.21.15.17:36162) 2023-10-06T04:43:35.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7fc2e659c700 1 -- 172.21.15.17:0/1522646573 learned_addr learned my addr 172.21.15.17:0/1522646573 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:35.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.627+0000 7fa5e2ba7700 1 Processor -- start 2023-10-06T04:43:35.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.627+0000 7fa5e2ba7700 1 -- start start 2023-10-06T04:43:35.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.628+0000 7fa5e2ba7700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5dc0caae0 0x7fa5dc06e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7fa5e2ba7700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5dc0c7330 con 0x7fa5dc06e750 2023-10-06T04:43:35.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7fa5e2ba7700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5dc0c8190 con 0x7fa5dc15dad0 2023-10-06T04:43:35.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7fa5e2ba7700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc06eb90 con 0x7fa5dc0caae0 2023-10-06T04:43:35.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7fa5e0943700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fa5dc15dad0 0x7fa5dc0ca3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.17:37416/0 (socket says 172.21.15.17:37416) 2023-10-06T04:43:35.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7fa5e0943700 1 -- 172.21.15.17:0/2281210296 learned_addr learned my addr 172.21.15.17:0/2281210296 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:35.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7fa5dbfff700 1 --2- 172.21.15.17:0/2281210296 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5dc0caae0 0x7fa5dc06e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7fa5dbfff700 1 -- 172.21.15.17:0/2281210296 >> v1:172.21.15.136:6789/0 conn(0x7fa5dc15dad0 legacy=0x7fa5dc0ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7fa5dbfff700 1 -- 172.21.15.17:0/2281210296 >> v1:172.21.15.17:6789/0 conn(0x7fa5dc06e750 legacy=0x7fa5dc069bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:35.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7fa5dbfff700 1 -- 172.21.15.17:0/2281210296 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5dc0c7580 con 0x7fa5dc0caae0 2023-10-06T04:43:35.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7f9d237fe700 1 -- 172.21.15.17:0/3606463127 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d340079f0 con 0x7f9d3c156d00 2023-10-06T04:43:35.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7f8306958700 1 -- 172.21.15.17:0/86022205 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f830006b2f0 msgr2=0x7f830015ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7f8306958700 1 --2- 172.21.15.17:0/86022205 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f830006b2f0 0x7f830015ad60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f82f0010c90 tx=0x7f82f00090f0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7f8306958700 1 -- 172.21.15.17:0/86022205 shutdown_connections 2023-10-06T04:43:35.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7f8306958700 1 --2- 172.21.15.17:0/86022205 >> v2:172.21.15.17:3300/0 conn(0x7f83000ae380 0x7f8300156140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7f9d237fe700 1 -- 172.21.15.17:0/3606463127 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d34012c80 con 0x7f9d3c156d00 2023-10-06T04:43:35.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7f9d237fe700 1 -- 172.21.15.17:0/3606463127 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3401d440 con 0x7f9d3c156d00 2023-10-06T04:43:35.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7f8306958700 1 --2- 172.21.15.17:0/86022205 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f830006b2f0 0x7f830015ad60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7f8306958700 1 -- 172.21.15.17:0/86022205 >> 172.21.15.17:0/86022205 conn(0x7f83000cd420 msgr2=0x7f83000cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:35.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.630+0000 7fc2e659c700 1 -- 172.21.15.17:0/1522646573 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2e80c7140 msgr2=0x7fc2e80c1e00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T04:43:35.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.630+0000 7fc2e659c700 1 --2- 172.21.15.17:0/1522646573 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2e80c7140 0x7fc2e80c1e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.630+0000 7fc2e659c700 1 -- 172.21.15.17:0/1522646573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2e806a940 msgr2=0x7fc2e814e410 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T04:43:35.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.630+0000 7fc2e659c700 1 --2- 172.21.15.17:0/1522646573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2e806a940 0x7fc2e814e410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.630+0000 7fc2e659c700 1 -- 172.21.15.17:0/1522646573 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d8009420 con 0x7fc2e806a570 2023-10-06T04:43:35.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.630+0000 7f8306958700 1 -- 172.21.15.17:0/86022205 shutdown_connections 2023-10-06T04:43:35.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.630+0000 7f8306958700 1 -- 172.21.15.17:0/86022205 wait complete. 2023-10-06T04:43:35.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.630+0000 7f4f27fff700 1 -- 172.21.15.17:0/547649073 >> v2:172.21.15.17:3300/0 conn(0x7f4f2806af20 msgr2=0x7f4f2815ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:35.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.630+0000 7f4f27fff700 1 --2- 172.21.15.17:0/547649073 >> v2:172.21.15.17:3300/0 conn(0x7f4f2806af20 0x7f4f2815ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.630+0000 7f4f27fff700 1 -- 172.21.15.17:0/547649073 >> v1:172.21.15.136:6789/0 conn(0x7f4f28068130 legacy=0x7f4f28156140 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T04:43:35.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.630+0000 7f4f27fff700 1 -- 172.21.15.17:0/547649073 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f280aeaf0 con 0x7f4f2806b2f0 2023-10-06T04:43:35.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.630+0000 7fa5dbfff700 1 --2- 172.21.15.17:0/2281210296 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5dc0caae0 0x7fa5dc06e210 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc009910 tx=0x7fa5cc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d2c877f18367d78 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:35.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.630+0000 7f9d41abb700 1 -- 172.21.15.17:0/3606463127 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d3c0c5420 con 0x7f9d3c156d00 2023-10-06T04:43:35.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.630+0000 7f9d41abb700 1 -- 172.21.15.17:0/3606463127 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d3c0c4290 con 0x7f9d3c156d00 2023-10-06T04:43:35.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.630+0000 7fa5db7fe700 1 -- 172.21.15.17:0/2281210296 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5cc00b820 con 0x7fa5dc0caae0 2023-10-06T04:43:35.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.630+0000 7fa5db7fe700 1 -- 172.21.15.17:0/2281210296 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5cc00b980 con 0x7fa5dc0caae0 2023-10-06T04:43:35.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.630+0000 7fa5db7fe700 1 -- 172.21.15.17:0/2281210296 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5cc00bd20 con 0x7fa5dc0caae0 2023-10-06T04:43:35.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.629+0000 7f53baffd700 1 --2- 172.21.15.17:0/1251784823 >> [v2:172.21.15.17:6800/90655,v1:172.21.15.17:6801/90655] conn(0x7f53a806f7e0 0x7f53a8071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.630+0000 7f53baffd700 1 --2- 172.21.15.17:0/1251784823 >> [v2:172.21.15.17:6800/90655,v1:172.21.15.17:6801/90655] conn(0x7f53a806f7e0 0x7f53a8071bf0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:35.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.630+0000 7f53bb7fe700 1 --2- 172.21.15.17:0/1251784823 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f53a8066f30 0x7f53a80693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f53ac009fd0 tx=0x7f53ac0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:35.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.628+0000 7fe2bb1e5700 1 -- start start 2023-10-06T04:43:35.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.630+0000 7fe2bb1e5700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe2b41555c0 0x7fe2b406e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.630+0000 7fe2bb1e5700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe2b4155990 0x7fe2b406e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.630+0000 7fe2bb1e5700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2b40cb780 con 0x7fe2b40c9eb0 2023-10-06T04:43:35.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.630+0000 7fe2bb1e5700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b40cab70 con 0x7fe2b41555c0 2023-10-06T04:43:35.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.630+0000 7fe2bb1e5700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b40cae50 con 0x7fe2b4155990 2023-10-06T04:43:35.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.630+0000 7fe2b9782700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fe2b40c9eb0 0x7fe2b40ca2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:35940/0 (socket says 172.21.15.17:35940) 2023-10-06T04:43:35.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.630+0000 7fe2b8f81700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe2b41555c0 0x7fe2b406e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.630+0000 7fe2b9782700 1 -- 172.21.15.17:0/1816316084 learned_addr learned my addr 172.21.15.17:0/1816316084 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:35.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.630+0000 7fe2abfff700 1 --2- 172.21.15.17:0/1816316084 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe2b4155990 0x7fe2b406e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.630+0000 7fe2b8f81700 1 -- 172.21.15.17:0/1816316084 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe2b4155990 msgr2=0x7fe2b406e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:35.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.630+0000 7fe2b8f81700 1 --2- 172.21.15.17:0/1816316084 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe2b4155990 0x7fe2b406e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.630+0000 7fe2b8f81700 1 -- 172.21.15.17:0/1816316084 >> v1:172.21.15.17:6789/0 conn(0x7fe2b40c9eb0 legacy=0x7fe2b40ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.630+0000 7fe2b8f81700 1 -- 172.21.15.17:0/1816316084 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b40cb130 con 0x7fe2b41555c0 2023-10-06T04:43:35.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.631+0000 7fc1a0f75700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc19c06dd30 0x7fc19c0caf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.631+0000 7fc1a0f75700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc19c155ee0 con 0x7fc19c0c7560 2023-10-06T04:43:35.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.631+0000 7fc1a0f75700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc19c0c7af0 con 0x7fc19c06d8c0 2023-10-06T04:43:35.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.631+0000 7fc1a0f75700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc19c070b50 con 0x7fc19c06dd30 2023-10-06T04:43:35.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.631+0000 7f4f27fff700 1 --2- 172.21.15.17:0/547649073 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4f2806b2f0 0x7f4f280ae380 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4f2000d1a0 tx=0x7f4f2000ba50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6f5768e5ea2ae16 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:35.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.631+0000 7fe2b8f81700 1 --2- 172.21.15.17:0/1816316084 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2b41555c0 0x7fe2b406e210 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4009e60 tx=0x7fe2a4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6efe4e3c378dd07 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:35.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.631+0000 7fc2e659c700 1 --2- 172.21.15.17:0/1522646573 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc2e806a570 0x7fc2e80aba40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc00c5d0 tx=0x7fc2dc007f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:35.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.631+0000 7fe2b3fff700 1 -- 172.21.15.17:0/1816316084 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a400e070 con 0x7fe2b41555c0 2023-10-06T04:43:35.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.631+0000 7f4f277fe700 1 -- 172.21.15.17:0/547649073 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f20010070 con 0x7f4f2806b2f0 2023-10-06T04:43:35.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.631+0000 7fe2b3fff700 1 -- 172.21.15.17:0/1816316084 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a400bb60 con 0x7fe2b41555c0 2023-10-06T04:43:35.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.631+0000 7fe2b3fff700 1 -- 172.21.15.17:0/1816316084 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a4012430 con 0x7fe2b41555c0 2023-10-06T04:43:35.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.631+0000 7f53a37fe700 1 -- 172.21.15.17:0/1251784823 <== osd.1 v2:172.21.15.17:6800/90655 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f53a80722a0 con 0x7f53a806f7e0 2023-10-06T04:43:35.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.631+0000 7fc19affd700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fc19c06d8c0 0x7fc19c1557d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.17:37432/0 (socket says 172.21.15.17:37432) 2023-10-06T04:43:35.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.631+0000 7fc19affd700 1 -- 172.21.15.17:0/1504136592 learned_addr learned my addr 172.21.15.17:0/1504136592 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:35.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.631+0000 7f4f277fe700 1 -- 172.21.15.17:0/547649073 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2000de80 con 0x7f4f2806b2f0 2023-10-06T04:43:35.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.631+0000 7f4f277fe700 1 -- 172.21.15.17:0/547649073 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2000b300 con 0x7f4f2806b2f0 2023-10-06T04:43:35.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.631+0000 7fc19bfff700 1 --2- 172.21.15.17:0/1504136592 >> v2:172.21.15.136:3300/0 conn(0x7fc19c06dd30 0x7fc19c0caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.631+0000 7fc19a7fc700 1 -- 172.21.15.17:0/1504136592 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 79482799 0 0) 0x7fc19c0c7af0 con 0x7fc19c06d8c0 2023-10-06T04:43:35.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.631+0000 7fa5e2ba7700 1 -- 172.21.15.17:0/2281210296 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5dc0caae0 msgr2=0x7fa5dc06e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.631+0000 7fa5e2ba7700 1 --2- 172.21.15.17:0/2281210296 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5dc0caae0 0x7fa5dc06e210 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc009910 tx=0x7fa5cc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.631+0000 7fc19a7fc700 1 -- 172.21.15.17:0/1504136592 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc184003570 con 0x7fc19c06d8c0 2023-10-06T04:43:35.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.632+0000 7fc19bfff700 1 -- 172.21.15.17:0/1504136592 >> v1:172.21.15.136:6789/0 conn(0x7fc19c06d8c0 legacy=0x7fc19c1557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.632+0000 7fc19bfff700 1 -- 172.21.15.17:0/1504136592 >> v1:172.21.15.17:6789/0 conn(0x7fc19c0c7560 legacy=0x7fc19c070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:35.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.632+0000 7fc19bfff700 1 -- 172.21.15.17:0/1504136592 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc19c15c680 con 0x7fc19c06dd30 2023-10-06T04:43:35.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.632+0000 7fe2bb1e5700 1 -- 172.21.15.17:0/1816316084 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2b41555c0 msgr2=0x7fe2b406e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.632+0000 7fe2bb1e5700 1 --2- 172.21.15.17:0/1816316084 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2b41555c0 0x7fe2b406e210 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4009e60 tx=0x7fe2a4009780 comp rx=0 tx=0).stop 2023-10-06T04:43:35.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.632+0000 7f9d41abb700 1 -- 172.21.15.17:0/3606463127 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9d1c000fd0 con 0x7f9d3c156d00 2023-10-06T04:43:35.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.632+0000 7fc19bfff700 1 --2- 172.21.15.17:0/1504136592 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc19c06dd30 0x7fc19c0caf60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc194009e60 tx=0x7fc194009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0a9d418d8a28a92 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:35.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.631+0000 7fc2d67fc700 1 -- 172.21.15.17:0/1522646573 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc011590 con 0x7fc2e806a570 2023-10-06T04:43:35.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.631+0000 7fc2d67fc700 1 -- 172.21.15.17:0/1522646573 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2dc011710 con 0x7fc2e806a570 2023-10-06T04:43:35.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.631+0000 7fc2d67fc700 1 -- 172.21.15.17:0/1522646573 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc011ad0 con 0x7fc2e806a570 2023-10-06T04:43:35.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.632+0000 7f4f2ebb1700 1 -- 172.21.15.17:0/547649073 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4f2806b2f0 msgr2=0x7f4f280ae380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.632+0000 7f4f2ebb1700 1 --2- 172.21.15.17:0/547649073 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4f2806b2f0 0x7f4f280ae380 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4f2000d1a0 tx=0x7f4f2000ba50 comp rx=0 tx=0).stop 2023-10-06T04:43:35.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.632+0000 7fc19a7fc700 1 -- 172.21.15.17:0/1504136592 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19400e070 con 0x7fc19c06dd30 2023-10-06T04:43:35.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.632+0000 7fc19a7fc700 1 -- 172.21.15.17:0/1504136592 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19400bbb0 con 0x7fc19c06dd30 2023-10-06T04:43:35.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.632+0000 7fc19a7fc700 1 -- 172.21.15.17:0/1504136592 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc194012430 con 0x7fc19c06dd30 2023-10-06T04:43:35.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.632+0000 7f4f2ebb1700 1 -- 172.21.15.17:0/547649073 shutdown_connections 2023-10-06T04:43:35.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.632+0000 7f4f2ebb1700 1 --2- 172.21.15.17:0/547649073 >> v2:172.21.15.17:3300/0 conn(0x7f4f2806af20 0x7f4f2815ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.632+0000 7f4f2ebb1700 1 --2- 172.21.15.17:0/547649073 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4f2806b2f0 0x7f4f280ae380 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.632+0000 7f4f2ebb1700 1 -- 172.21.15.17:0/547649073 >> 172.21.15.17:0/547649073 conn(0x7f4f280cd420 msgr2=0x7f4f280cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:35.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.632+0000 7f8306958700 1 Processor -- start 2023-10-06T04:43:35.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.632+0000 7f4f2ebb1700 1 -- 172.21.15.17:0/547649073 shutdown_connections 2023-10-06T04:43:35.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.632+0000 7f4f2ebb1700 1 -- 172.21.15.17:0/547649073 wait complete. 2023-10-06T04:43:35.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.632+0000 7fe2bb1e5700 1 -- 172.21.15.17:0/1816316084 shutdown_connections 2023-10-06T04:43:35.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.632+0000 7fe2bb1e5700 1 --2- 172.21.15.17:0/1816316084 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2b41555c0 0x7fe2b406e210 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.632+0000 7fe2bb1e5700 1 --2- 172.21.15.17:0/1816316084 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe2b4155990 0x7fe2b406e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.632+0000 7fe2bb1e5700 1 -- 172.21.15.17:0/1816316084 >> 172.21.15.17:0/1816316084 conn(0x7fe2b40ccd10 msgr2=0x7fe2b40c8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:35.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.633+0000 7fa5e2ba7700 1 -- 172.21.15.17:0/2281210296 shutdown_connections 2023-10-06T04:43:35.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.633+0000 7fa5e2ba7700 1 --2- 172.21.15.17:0/2281210296 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5dc0caae0 0x7fa5dc06e210 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.633+0000 7fa5e2ba7700 1 -- 172.21.15.17:0/2281210296 >> 172.21.15.17:0/2281210296 conn(0x7fa5dc0ccd10 msgr2=0x7fa5dc0c8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:35.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.633+0000 7f9d237fe700 1 -- 172.21.15.17:0/3606463127 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9d3401d7b0 con 0x7f9d3c156d00 2023-10-06T04:43:35.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.633+0000 7fc1a0f75700 1 -- 172.21.15.17:0/1504136592 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc19c06dd30 msgr2=0x7fc19c0caf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.633+0000 7fc1a0f75700 1 --2- 172.21.15.17:0/1504136592 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc19c06dd30 0x7fc19c0caf60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc194009e60 tx=0x7fc194009780 comp rx=0 tx=0).stop 2023-10-06T04:43:35.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.633+0000 7f9d237fe700 1 --2- 172.21.15.17:0/3606463127 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9d28067000 0x7f9d280694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.634+0000 7f9d237fe700 1 -- 172.21.15.17:0/3606463127 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9d340869d0 con 0x7f9d3c156d00 2023-10-06T04:43:35.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.634+0000 7f9d3b7fe700 1 --2- 172.21.15.17:0/3606463127 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9d28067000 0x7f9d280694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.634+0000 7f9d237fe700 1 --2- 172.21.15.17:0/3606463127 >> [v2:172.21.15.17:6808/90657,v1:172.21.15.17:6810/90657] conn(0x7f9d2806f8b0 0x7f9d28071cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.634+0000 7f9d237fe700 1 -- 172.21.15.17:0/3606463127 --> [v2:172.21.15.17:6808/90657,v1:172.21.15.17:6810/90657] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9d28072370 con 0x7f9d2806f8b0 2023-10-06T04:43:35.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.634+0000 7f9d237fe700 1 -- 172.21.15.17:0/3606463127 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d3408b240 con 0x7f9d3c156d00 2023-10-06T04:43:35.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.633+0000 7f8306958700 1 -- start start 2023-10-06T04:43:35.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.634+0000 7f8306958700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f830006af20 0x7f8300150110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.634+0000 7f8306958700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f830006b2f0 0x7f83001597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.634+0000 7f8306958700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83000ae380 0x7f83000b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.634+0000 7f8306958700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8300150650 con 0x7f830006af20 2023-10-06T04:43:35.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.634+0000 7f8306958700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830016fad0 con 0x7f83000ae380 2023-10-06T04:43:35.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.634+0000 7f8306958700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f830016eec0 con 0x7f830006b2f0 2023-10-06T04:43:35.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.634+0000 7f4f2ebb1700 1 Processor -- start 2023-10-06T04:43:35.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.633+0000 7fc2ece5f700 1 -- 172.21.15.17:0/1522646573 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e0009ae0 con 0x7fc2e806a570 2023-10-06T04:43:35.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.633+0000 7fc2ece5f700 1 -- 172.21.15.17:0/1522646573 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e80c2660 con 0x7fc2e806a570 2023-10-06T04:43:35.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.634+0000 7f4f2ebb1700 1 -- start start 2023-10-06T04:43:35.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.633+0000 7fe2bb1e5700 1 -- 172.21.15.17:0/1816316084 shutdown_connections 2023-10-06T04:43:35.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.633+0000 7fe2bb1e5700 1 -- 172.21.15.17:0/1816316084 wait complete. 2023-10-06T04:43:35.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.634+0000 7fe2bb1e5700 1 Processor -- start 2023-10-06T04:43:35.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.634+0000 7fe2bb1e5700 1 -- start start 2023-10-06T04:43:35.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.634+0000 7f82ff7fe700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f830006b2f0 0x7f83001597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.634+0000 7f82ff7fe700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f830006b2f0 0x7f83001597b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.17:36196/0 (socket says 172.21.15.17:36196) 2023-10-06T04:43:35.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.635+0000 7f9d3affd700 1 --2- 172.21.15.17:0/3606463127 >> [v2:172.21.15.17:6808/90657,v1:172.21.15.17:6810/90657] conn(0x7f9d2806f8b0 0x7f9d28071cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.634+0000 7f82ff7fe700 1 -- 172.21.15.17:0/2939688174 learned_addr learned my addr 172.21.15.17:0/2939688174 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:35.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.634+0000 7f82ff7fe700 1 -- 172.21.15.17:0/2939688174 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83000ae380 msgr2=0x7f83000b16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.634+0000 7f82ff7fe700 1 --2- 172.21.15.17:0/2939688174 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83000ae380 0x7f83000b16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.634+0000 7f82ff7fe700 1 -- 172.21.15.17:0/2939688174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f830006af20 msgr2=0x7f8300150110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.634+0000 7f82ff7fe700 1 --2- 172.21.15.17:0/2939688174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f830006af20 0x7f8300150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.634+0000 7f82ff7fe700 1 -- 172.21.15.17:0/2939688174 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f00107d0 con 0x7f830006b2f0 2023-10-06T04:43:35.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.635+0000 7f82ff7fe700 1 --2- 172.21.15.17:0/2939688174 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f830006b2f0 0x7f83001597b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f82f000b2c0 tx=0x7f82f0018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:35.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.635+0000 7f9d3affd700 1 --2- 172.21.15.17:0/3606463127 >> [v2:172.21.15.17:6808/90657,v1:172.21.15.17:6810/90657] conn(0x7f9d2806f8b0 0x7f9d28071cc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:35.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.635+0000 7fc2ece5f700 1 -- 172.21.15.17:0/1522646573 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc2cc000fd0 con 0x7fc2e806a570 2023-10-06T04:43:35.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.635+0000 7fc2d67fc700 1 -- 172.21.15.17:0/1522646573 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc2dc01c460 con 0x7fc2e806a570 2023-10-06T04:43:35.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7fc2d67fc700 1 --2- 172.21.15.17:0/1522646573 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc2c8066f30 0x7fc2c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7fc2d67fc700 1 -- 172.21.15.17:0/1522646573 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc2dc084540 con 0x7fc2e806a570 2023-10-06T04:43:35.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7fc2e5d9b700 1 --2- 172.21.15.17:0/1522646573 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc2c8066f30 0x7fc2c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7fc2d67fc700 1 --2- 172.21.15.17:0/1522646573 >> [v2:172.21.15.17:6809/90656,v1:172.21.15.17:6811/90656] conn(0x7fc2c806f7e0 0x7fc2c8071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7fc2d67fc700 1 -- 172.21.15.17:0/1522646573 --> [v2:172.21.15.17:6809/90656,v1:172.21.15.17:6811/90656] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc2c80722a0 con 0x7fc2c806f7e0 2023-10-06T04:43:35.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7fc2d67fc700 1 -- 172.21.15.17:0/1522646573 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2dc086ae0 con 0x7fc2e806a570 2023-10-06T04:43:35.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.635+0000 7f4f2ebb1700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f28068130 0x7f4f28157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.635+0000 7f4f2ebb1700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4f2806af20 0x7f4f280ac100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.635+0000 7f4f2ebb1700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f2806b2f0 0x7f4f281667a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.635+0000 7f4f2ebb1700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f28166ce0 con 0x7f4f2806b2f0 2023-10-06T04:43:35.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.635+0000 7f4f2ebb1700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f28167ea0 con 0x7f4f28068130 2023-10-06T04:43:35.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.635+0000 7f4f2ebb1700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f28167290 con 0x7f4f2806af20 2023-10-06T04:43:35.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7f4f2c94d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f28068130 0x7f4f28157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7f4f2c94d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f28068130 0x7f4f28157980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.17:32870/0 (socket says 172.21.15.17:32870) 2023-10-06T04:43:35.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7f4f2c94d700 1 -- 172.21.15.17:0/1067174751 learned_addr learned my addr 172.21.15.17:0/1067174751 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:35.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7f4f2d14e700 1 --2- 172.21.15.17:0/1067174751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f2806b2f0 0x7f4f281667a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7f9d3b7fe700 1 --2- 172.21.15.17:0/3606463127 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9d28067000 0x7f9d280694b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c064d10 tx=0x7f9d2c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:35.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7f4f27fff700 1 --2- 172.21.15.17:0/1067174751 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4f2806af20 0x7f4f280ac100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7fc1a0f75700 1 -- 172.21.15.17:0/1504136592 shutdown_connections 2023-10-06T04:43:35.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7fc1a0f75700 1 --2- 172.21.15.17:0/1504136592 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc19c06dd30 0x7fc19c0caf60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7fc1a0f75700 1 -- 172.21.15.17:0/1504136592 >> 172.21.15.17:0/1504136592 conn(0x7fc19c06e650 msgr2=0x7fc19c06ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:35.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7fe2bb1e5700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe2b40c9eb0 0x7fe2b40c7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7fe2bb1e5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2b41555c0 0x7fe2b415d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7fe2bb1e5700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2b4155990 0x7fe2b40b0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7fe2bb1e5700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b4177590 con 0x7fe2b4155990 2023-10-06T04:43:35.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7fe2bb1e5700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b41769f0 con 0x7fe2b41555c0 2023-10-06T04:43:35.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7fe2bb1e5700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b415d990 con 0x7fe2b40c9eb0 2023-10-06T04:43:35.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7fe2b9782700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2b4155990 0x7fe2b40b0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7fe2b9782700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2b4155990 0x7fe2b40b0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32858/0 (socket says 172.21.15.17:32858) 2023-10-06T04:43:35.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7fe2b9782700 1 -- 172.21.15.17:0/1271364165 learned_addr learned my addr 172.21.15.17:0/1271364165 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:35.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7fe2b8f81700 1 --2- 172.21.15.17:0/1271364165 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe2b40c9eb0 0x7fe2b40c7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7fe2abfff700 1 --2- 172.21.15.17:0/1271364165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2b41555c0 0x7fe2b415d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7fe2b9782700 1 -- 172.21.15.17:0/1271364165 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe2b40c9eb0 msgr2=0x7fe2b40c7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7fe2b9782700 1 --2- 172.21.15.17:0/1271364165 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe2b40c9eb0 0x7fe2b40c7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7fe2b9782700 1 -- 172.21.15.17:0/1271364165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2b41555c0 msgr2=0x7fe2b415d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7fe2b9782700 1 --2- 172.21.15.17:0/1271364165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2b41555c0 0x7fe2b415d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7fe2b9782700 1 -- 172.21.15.17:0/1271364165 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a4009a20 con 0x7fe2b4155990 2023-10-06T04:43:35.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7fe2abfff700 1 --2- 172.21.15.17:0/1271364165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2b41555c0 0x7fe2b415d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:43:35.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7fe2b8f81700 1 --2- 172.21.15.17:0/1271364165 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe2b40c9eb0 0x7fe2b40c7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:43:35.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7fc2e5d9b700 1 --2- 172.21.15.17:0/1522646573 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc2c8066f30 0x7fc2c80693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8158930 tx=0x7fc2d80091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:35.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7f4f27fff700 1 -- 172.21.15.17:0/1067174751 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f28068130 msgr2=0x7f4f28157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7f4f27fff700 1 --2- 172.21.15.17:0/1067174751 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f28068130 0x7f4f28157980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7f4f27fff700 1 -- 172.21.15.17:0/1067174751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f2806b2f0 msgr2=0x7f4f281667a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7f4f27fff700 1 --2- 172.21.15.17:0/1067174751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f2806b2f0 0x7f4f281667a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7f4f27fff700 1 -- 172.21.15.17:0/1067174751 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f2000bcf0 con 0x7f4f2806af20 2023-10-06T04:43:35.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7f4f2d14e700 1 --2- 172.21.15.17:0/1067174751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f2806b2f0 0x7f4f281667a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:43:35.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.636+0000 7fe2b9782700 1 --2- 172.21.15.17:0/1271364165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2b4155990 0x7fe2b40b0a20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00c5f0 tx=0x7fe2ac007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:35.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.637+0000 7fc2e6d9d700 1 --2- 172.21.15.17:0/1522646573 >> [v2:172.21.15.17:6809/90656,v1:172.21.15.17:6811/90656] conn(0x7fc2c806f7e0 0x7fc2c8071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.637+0000 7f9d237fe700 1 -- 172.21.15.17:0/3606463127 <== osd.2 v2:172.21.15.17:6808/90657 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f9d28072370 con 0x7f9d2806f8b0 2023-10-06T04:43:35.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.637+0000 7fe2b17fa700 1 -- 172.21.15.17:0/1271364165 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac005b30 con 0x7fe2b4155990 2023-10-06T04:43:35.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.637+0000 7f4f27fff700 1 --2- 172.21.15.17:0/1067174751 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4f2806af20 0x7f4f280ac100 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4f20016000 tx=0x7f4f20019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:35.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.637+0000 7fe2bb1e5700 1 -- 172.21.15.17:0/1271364165 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b4176c60 con 0x7fe2b4155990 2023-10-06T04:43:35.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.637+0000 7fe2b17fa700 1 -- 172.21.15.17:0/1271364165 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ac005cb0 con 0x7fe2b4155990 2023-10-06T04:43:35.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.637+0000 7fe2b17fa700 1 -- 172.21.15.17:0/1271364165 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac007320 con 0x7fe2b4155990 2023-10-06T04:43:35.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.637+0000 7fc1a0f75700 1 -- 172.21.15.17:0/1504136592 shutdown_connections 2023-10-06T04:43:35.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.637+0000 7fc2e6d9d700 1 --2- 172.21.15.17:0/1522646573 >> [v2:172.21.15.17:6809/90656,v1:172.21.15.17:6811/90656] conn(0x7fc2c806f7e0 0x7fc2c8071bf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:35.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.638+0000 7fc2d67fc700 1 -- 172.21.15.17:0/1522646573 <== osd.0 v2:172.21.15.17:6809/90656 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fc2c80722a0 con 0x7fc2c806f7e0 2023-10-06T04:43:35.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.638+0000 7fc1a0f75700 1 -- 172.21.15.17:0/1504136592 wait complete. 2023-10-06T04:43:35.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.637+0000 7f4f24ff9700 1 -- 172.21.15.17:0/1067174751 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f20009bb0 con 0x7f4f2806af20 2023-10-06T04:43:35.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.637+0000 7f4f24ff9700 1 -- 172.21.15.17:0/1067174751 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f20009d10 con 0x7f4f2806af20 2023-10-06T04:43:35.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.637+0000 7f4f24ff9700 1 -- 172.21.15.17:0/1067174751 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f20022980 con 0x7f4f2806af20 2023-10-06T04:43:35.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.638+0000 7f4f2ebb1700 1 -- 172.21.15.17:0/1067174751 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f28167570 con 0x7f4f2806af20 2023-10-06T04:43:35.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.638+0000 7f4f2ebb1700 1 -- 172.21.15.17:0/1067174751 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f28167b30 con 0x7f4f2806af20 2023-10-06T04:43:35.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.638+0000 7f4f2ebb1700 1 -- 172.21.15.17:0/1067174751 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4f280cb320 con 0x7f4f2806af20 2023-10-06T04:43:35.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.638+0000 7fe2bb1e5700 1 -- 172.21.15.17:0/1271364165 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b4177220 con 0x7fe2b4155990 2023-10-06T04:43:35.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.639+0000 7fe2b17fa700 1 -- 172.21.15.17:0/1271364165 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe2ac01b3b0 con 0x7fe2b4155990 2023-10-06T04:43:35.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.639+0000 7fe2bb1e5700 1 -- 172.21.15.17:0/1271364165 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe2b4063ff0 con 0x7fe2b4155990 2023-10-06T04:43:35.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.639+0000 7fe2b17fa700 1 --2- 172.21.15.17:0/1271364165 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe294066f00 0x7fe2940693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.639+0000 7fe2b17fa700 1 -- 172.21.15.17:0/1271364165 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe2ac083950 con 0x7fe2b4155990 2023-10-06T04:43:35.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.639+0000 7fe2b17fa700 1 --2- 172.21.15.17:0/1271364165 >> [v2:172.21.15.136:6823/90927,v1:172.21.15.136:6825/90927] conn(0x7fe29406f6b0 0x7fe294071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.639+0000 7fe2b17fa700 1 -- 172.21.15.17:0/1271364165 --> [v2:172.21.15.136:6823/90927,v1:172.21.15.136:6825/90927] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe294072170 con 0x7fe29406f6b0 2023-10-06T04:43:35.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.639+0000 7fe2b17fa700 1 -- 172.21.15.17:0/1271364165 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2ac050a60 con 0x7fe2b4155990 2023-10-06T04:43:35.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.640+0000 7fc1a0f75700 1 Processor -- start 2023-10-06T04:43:35.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.640+0000 7fa5e2ba7700 1 -- 172.21.15.17:0/2281210296 shutdown_connections 2023-10-06T04:43:35.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.640+0000 7fe2b8f81700 1 --2- 172.21.15.17:0/1271364165 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe294066f00 0x7fe2940693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.640+0000 7fc1a0f75700 1 -- start start 2023-10-06T04:43:35.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.641+0000 7fc1a0f75700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc19c06d8c0 0x7fc19c14a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.641+0000 7fc1a0f75700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc19c06dd30 0x7fc19c0b0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.641+0000 7fc1a0f75700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc19c0c7560 0x7fc19c0b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.641+0000 7fc1a0f75700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19c0b1c90 con 0x7fc19c06dd30 2023-10-06T04:43:35.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.641+0000 7fc1a0f75700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19c166aa0 con 0x7fc19c06d8c0 2023-10-06T04:43:35.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.641+0000 7fc1a0f75700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc19c0b24c0 con 0x7fc19c0c7560 2023-10-06T04:43:35.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.641+0000 7fc19affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc19c06dd30 0x7fc19c0b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.641+0000 7fc19affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc19c06dd30 0x7fc19c0b0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32860/0 (socket says 172.21.15.17:32860) 2023-10-06T04:43:35.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.641+0000 7fc19affd700 1 -- 172.21.15.17:0/1529628115 learned_addr learned my addr 172.21.15.17:0/1529628115 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:35.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.641+0000 7fc19b7fe700 1 --2- 172.21.15.17:0/1529628115 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc19c06d8c0 0x7fc19c14a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.640+0000 7f82e7fff700 1 -- 172.21.15.17:0/2939688174 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f0010ea0 con 0x7f830006b2f0 2023-10-06T04:43:35.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.640+0000 7f82e7fff700 1 -- 172.21.15.17:0/2939688174 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f0010540 con 0x7f830006b2f0 2023-10-06T04:43:35.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.640+0000 7f82e7fff700 1 -- 172.21.15.17:0/2939688174 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f000f830 con 0x7f830006b2f0 2023-10-06T04:43:35.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.640+0000 7f8306958700 1 -- 172.21.15.17:0/2939688174 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f830016f1a0 con 0x7f830006b2f0 2023-10-06T04:43:35.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.640+0000 7f8306958700 1 -- 172.21.15.17:0/2939688174 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f830016f760 con 0x7f830006b2f0 2023-10-06T04:43:35.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.641+0000 7f82e5ffb700 1 -- 172.21.15.17:0/2939688174 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f82d8000fd0 con 0x7f830006b2f0 2023-10-06T04:43:35.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.640+0000 7f4f24ff9700 1 -- 172.21.15.17:0/1067174751 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4f20022d30 con 0x7f4f2806af20 2023-10-06T04:43:35.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.640+0000 7f4f24ff9700 1 --2- 172.21.15.17:0/1067174751 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f4f08066f30 0x7f4f080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.640+0000 7f4f24ff9700 1 -- 172.21.15.17:0/1067174751 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4f20086420 con 0x7f4f2806af20 2023-10-06T04:43:35.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.641+0000 7f4f2c94d700 1 --2- 172.21.15.17:0/1067174751 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f4f08066f30 0x7f4f080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.641+0000 7f4f24ff9700 1 --2- 172.21.15.17:0/1067174751 >> [v2:172.21.15.136:6808/90901,v1:172.21.15.136:6809/90901] conn(0x7f4f0806f7e0 0x7f4f08071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.641+0000 7f4f24ff9700 1 -- 172.21.15.17:0/1067174751 --> [v2:172.21.15.136:6808/90901,v1:172.21.15.136:6809/90901] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4f080722a0 con 0x7f4f0806f7e0 2023-10-06T04:43:35.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.641+0000 7f4f24ff9700 1 -- 172.21.15.17:0/1067174751 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f200867f0 con 0x7f4f2806af20 2023-10-06T04:43:35.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.640+0000 7fe2b8f81700 1 --2- 172.21.15.17:0/1271364165 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe294066f00 0x7fe2940693b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe2a40097c0 tx=0x7fe2a4019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:35.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.640+0000 7fa5e2ba7700 1 -- 172.21.15.17:0/2281210296 wait complete. 2023-10-06T04:43:35.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.641+0000 7fa5e2ba7700 1 Processor -- start 2023-10-06T04:43:35.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.641+0000 7fc19affd700 1 -- 172.21.15.17:0/1529628115 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc19c0c7560 msgr2=0x7fc19c0b05c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T04:43:35.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.641+0000 7fc19affd700 1 --2- 172.21.15.17:0/1529628115 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc19c0c7560 0x7fc19c0b05c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.641+0000 7fc19affd700 1 -- 172.21.15.17:0/1529628115 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc19c06d8c0 msgr2=0x7fc19c14a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.641+0000 7fc19affd700 1 --2- 172.21.15.17:0/1529628115 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc19c06d8c0 0x7fc19c14a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.641+0000 7fc19affd700 1 -- 172.21.15.17:0/1529628115 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc194009a20 con 0x7fc19c06dd30 2023-10-06T04:43:35.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.641+0000 7f4f2c94d700 1 --2- 172.21.15.17:0/1067174751 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f4f08066f30 0x7f4f080693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4f28155c70 tx=0x7f4f18008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:35.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.642+0000 7fe2abfff700 1 --2- 172.21.15.17:0/1271364165 >> [v2:172.21.15.136:6823/90927,v1:172.21.15.136:6825/90927] conn(0x7fe29406f6b0 0x7fe294071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.642+0000 7fc19affd700 1 --2- 172.21.15.17:0/1529628115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc19c06dd30 0x7fc19c0b0080 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc19000c7f0 tx=0x7fc190007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:35.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.642+0000 7fa5e2ba7700 1 -- start start 2023-10-06T04:43:35.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.642+0000 7fc1837fe700 1 -- 172.21.15.17:0/1529628115 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc190005b30 con 0x7fc19c06dd30 2023-10-06T04:43:35.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.642+0000 7fc1a0f75700 1 -- 172.21.15.17:0/1529628115 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc19c0afb60 con 0x7fc19c06dd30 2023-10-06T04:43:35.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.642+0000 7fc1837fe700 1 -- 172.21.15.17:0/1529628115 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc190005cb0 con 0x7fc19c06dd30 2023-10-06T04:43:35.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.642+0000 7fc1837fe700 1 -- 172.21.15.17:0/1529628115 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc190007320 con 0x7fc19c06dd30 2023-10-06T04:43:35.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.642+0000 7fc1a0f75700 1 -- 172.21.15.17:0/1529628115 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc19c0b2150 con 0x7fc19c06dd30 2023-10-06T04:43:35.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.643+0000 7f4f2d14e700 1 --2- 172.21.15.17:0/1067174751 >> [v2:172.21.15.136:6808/90901,v1:172.21.15.136:6809/90901] conn(0x7f4f0806f7e0 0x7f4f08071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.643+0000 7fa5e2ba7700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5dc06e750 0x7fa5dc13ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.643+0000 7fa5e2ba7700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5dc15dad0 0x7fa5dc13b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.643+0000 7fa5e2ba7700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5dc148eb0 0x7fa5dc139b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.643+0000 7fa5e2ba7700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc1348a0 con 0x7fa5dc148eb0 2023-10-06T04:43:35.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.643+0000 7fa5e2ba7700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc134b80 con 0x7fa5dc06e750 2023-10-06T04:43:35.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.643+0000 7fa5e2ba7700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc134e60 con 0x7fa5dc15dad0 2023-10-06T04:43:35.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.643+0000 7fc1a0f75700 1 -- 172.21.15.17:0/1529628115 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc19c04c380 con 0x7fc19c06dd30 2023-10-06T04:43:35.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.643+0000 7fa5e0943700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5dc06e750 0x7fa5dc13ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.643+0000 7fa5dbfff700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5dc15dad0 0x7fa5dc13b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.643+0000 7fa5e1144700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5dc148eb0 0x7fa5dc139b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.643+0000 7fa5dbfff700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5dc15dad0 0x7fa5dc13b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.17:36220/0 (socket says 172.21.15.17:36220) 2023-10-06T04:43:35.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.643+0000 7fa5dbfff700 1 -- 172.21.15.17:0/365233684 learned_addr learned my addr 172.21.15.17:0/365233684 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:35.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.643+0000 7fa5e0943700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5dc06e750 0x7fa5dc13ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.17:32890/0 (socket says 172.21.15.17:32890) 2023-10-06T04:43:35.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.643+0000 7fa5dbfff700 1 -- 172.21.15.17:0/365233684 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5dc06e750 msgr2=0x7fa5dc13ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.643+0000 7fa5dbfff700 1 --2- 172.21.15.17:0/365233684 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5dc06e750 0x7fa5dc13ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.643+0000 7fa5dbfff700 1 -- 172.21.15.17:0/365233684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5dc148eb0 msgr2=0x7fa5dc139b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.643+0000 7fa5dbfff700 1 --2- 172.21.15.17:0/365233684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5dc148eb0 0x7fa5dc139b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.643+0000 7fa5dbfff700 1 -- 172.21.15.17:0/365233684 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5cc009420 con 0x7fa5dc15dad0 2023-10-06T04:43:35.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.643+0000 7fa5e0943700 1 --2- 172.21.15.17:0/365233684 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5dc06e750 0x7fa5dc13ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:43:35.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.643+0000 7f82e7fff700 1 -- 172.21.15.17:0/2939688174 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f82f000fbe0 con 0x7f830006b2f0 2023-10-06T04:43:35.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.644+0000 7fa5dbfff700 1 --2- 172.21.15.17:0/365233684 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5dc15dad0 0x7fa5dc13b140 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc0030c0 tx=0x7fa5cc016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:35.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.644+0000 7f4f2d14e700 1 --2- 172.21.15.17:0/1067174751 >> [v2:172.21.15.136:6808/90901,v1:172.21.15.136:6809/90901] conn(0x7f4f0806f7e0 0x7f4f08071bf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:35.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.644+0000 7fa5d8ff9700 1 -- 172.21.15.17:0/365233684 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5cc01b470 con 0x7fa5dc15dad0 2023-10-06T04:43:35.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.644+0000 7fa5d8ff9700 1 -- 172.21.15.17:0/365233684 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5cc01b5d0 con 0x7fa5dc15dad0 2023-10-06T04:43:35.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.644+0000 7f82e7fff700 1 --2- 172.21.15.17:0/2939688174 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f82ec067000 0x7f82ec0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.644+0000 7fa5e2ba7700 1 -- 172.21.15.17:0/365233684 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5dc135140 con 0x7fa5dc15dad0 2023-10-06T04:43:35.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.644+0000 7fa5e2ba7700 1 -- 172.21.15.17:0/365233684 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5dc13a0b0 con 0x7fa5dc15dad0 2023-10-06T04:43:35.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.644+0000 7f82e7fff700 1 -- 172.21.15.17:0/2939688174 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f82f0086960 con 0x7f830006b2f0 2023-10-06T04:43:35.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.644+0000 7f82e7fff700 1 --2- 172.21.15.17:0/2939688174 >> [v2:172.21.15.136:6800/90902,v1:172.21.15.136:6801/90902] conn(0x7f82ec06f8b0 0x7f82ec071cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.644+0000 7f82e7fff700 1 -- 172.21.15.17:0/2939688174 --> [v2:172.21.15.136:6800/90902,v1:172.21.15.136:6801/90902] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f82ec072370 con 0x7f82ec06f8b0 2023-10-06T04:43:35.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.644+0000 7f82e7fff700 1 -- 172.21.15.17:0/2939688174 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82f0086d30 con 0x7f830006b2f0 2023-10-06T04:43:35.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.645+0000 7f8304ef5700 1 --2- 172.21.15.17:0/2939688174 >> [v2:172.21.15.136:6800/90902,v1:172.21.15.136:6801/90902] conn(0x7f82ec06f8b0 0x7f82ec071cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.645+0000 7fc1837fe700 1 -- 172.21.15.17:0/1529628115 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc19001b3b0 con 0x7fc19c06dd30 2023-10-06T04:43:35.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.645+0000 7f82fffff700 1 --2- 172.21.15.17:0/2939688174 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f82ec067000 0x7f82ec0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.645+0000 7fa5d8ff9700 1 -- 172.21.15.17:0/365233684 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5cc01b950 con 0x7fa5dc15dad0 2023-10-06T04:43:35.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.645+0000 7fc1837fe700 1 --2- 172.21.15.17:0/1529628115 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc188066f30 0x7fc1880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.645+0000 7fc1837fe700 1 -- 172.21.15.17:0/1529628115 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc1900843b0 con 0x7fc19c06dd30 2023-10-06T04:43:35.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.646+0000 7fc1837fe700 1 --2- 172.21.15.17:0/1529628115 >> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] conn(0x7fc18806f760 0x7fc188071b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.646+0000 7fc1837fe700 1 -- 172.21.15.17:0/1529628115 --> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc188072220 con 0x7fc18806f760 2023-10-06T04:43:35.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.646+0000 7fc1837fe700 1 -- 172.21.15.17:0/1529628115 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc190084780 con 0x7fc19c06dd30 2023-10-06T04:43:35.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.646+0000 7fc19b7fe700 1 --2- 172.21.15.17:0/1529628115 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc188066f30 0x7fc1880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.646+0000 7fc19bfff700 1 --2- 172.21.15.17:0/1529628115 >> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] conn(0x7fc18806f760 0x7fc188071b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.646+0000 7f82fffff700 1 --2- 172.21.15.17:0/2939688174 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f82ec067000 0x7f82ec0694b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f82f8001560 tx=0x7f82f80016c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:35.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.646+0000 7f8304ef5700 1 --2- 172.21.15.17:0/2939688174 >> [v2:172.21.15.136:6800/90902,v1:172.21.15.136:6801/90902] conn(0x7f82ec06f8b0 0x7f82ec071cc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:35.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.646+0000 7fe2abfff700 1 --2- 172.21.15.17:0/1271364165 >> [v2:172.21.15.136:6823/90927,v1:172.21.15.136:6825/90927] conn(0x7fe29406f6b0 0x7fe294071ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:35.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.646+0000 7fc19b7fe700 1 --2- 172.21.15.17:0/1529628115 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc188066f30 0x7fc1880693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc19c161f50 tx=0x7fc18c009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:35.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.646+0000 7fc19bfff700 1 --2- 172.21.15.17:0/1529628115 >> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] conn(0x7fc18806f760 0x7fc188071b70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:35.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.647+0000 7fe2b17fa700 1 -- 172.21.15.17:0/1271364165 <== osd.6 v2:172.21.15.136:6823/90927 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fe294072170 con 0x7fe29406f6b0 2023-10-06T04:43:35.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.647+0000 7f4f24ff9700 1 -- 172.21.15.17:0/1067174751 <== osd.5 v2:172.21.15.136:6808/90901 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f4f080722a0 con 0x7f4f0806f7e0 2023-10-06T04:43:35.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.647+0000 7fa5d8ff9700 1 -- 172.21.15.17:0/365233684 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa5cc01bd00 con 0x7fa5dc15dad0 2023-10-06T04:43:35.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.647+0000 7f82e7fff700 1 -- 172.21.15.17:0/2939688174 <== osd.4 v2:172.21.15.136:6800/90902 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f82ec072370 con 0x7f82ec06f8b0 2023-10-06T04:43:35.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.647+0000 7fc1837fe700 1 -- 172.21.15.17:0/1529628115 <== osd.3 v2:172.21.15.17:6824/90688 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fc188072220 con 0x7fc18806f760 2023-10-06T04:43:35.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.647+0000 7fa5d8ff9700 1 --2- 172.21.15.17:0/365233684 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa5bc066f80 0x7fa5bc069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.648+0000 7fa5d8ff9700 1 -- 172.21.15.17:0/365233684 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa5cc086380 con 0x7fa5dc15dad0 2023-10-06T04:43:35.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.648+0000 7fa5e0943700 1 --2- 172.21.15.17:0/365233684 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa5bc066f80 0x7fa5bc069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.648+0000 7fa5e0943700 1 --2- 172.21.15.17:0/365233684 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa5bc066f80 0x7fa5bc069430 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4007110 tx=0x7fa5c4007f10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:35.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.648+0000 7fa5e2ba7700 1 --2- 172.21.15.17:0/365233684 >> [v2:172.21.15.136:6816/90934,v1:172.21.15.136:6817/90934] conn(0x7fa5dc0caae0 0x7fa5dc0c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.648+0000 7fa5e2ba7700 1 -- 172.21.15.17:0/365233684 --> [v2:172.21.15.136:6816/90934,v1:172.21.15.136:6817/90934] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa5dc1349e0 con 0x7fa5dc0caae0 2023-10-06T04:43:35.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.654+0000 7fa5e1144700 1 --2- 172.21.15.17:0/365233684 >> [v2:172.21.15.136:6816/90934,v1:172.21.15.136:6817/90934] conn(0x7fa5dc0caae0 0x7fa5dc0c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.654+0000 7fa5e1144700 1 --2- 172.21.15.17:0/365233684 >> [v2:172.21.15.136:6816/90934,v1:172.21.15.136:6817/90934] conn(0x7fa5dc0caae0 0x7fa5dc0c56b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:35.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.655+0000 7fa5d8ff9700 1 -- 172.21.15.17:0/365233684 <== osd.7 v2:172.21.15.136:6816/90934 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fa5dc1349e0 con 0x7fa5dc0caae0 2023-10-06T04:43:35.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.655+0000 7f53c0c5e700 1 -- 172.21.15.17:0/1251784823 --> [v2:172.21.15.17:6800/90655,v1:172.21.15.17:6801/90655] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f53bc0c8670 con 0x7f53a806f7e0 2023-10-06T04:43:35.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.656+0000 7f53a37fe700 1 -- 172.21.15.17:0/1251784823 <== osd.1 v2:172.21.15.17:6800/90655 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f53bc0c8670 con 0x7f53a806f7e0 2023-10-06T04:43:35.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.656+0000 7f53c0c5e700 1 -- 172.21.15.17:0/1251784823 >> [v2:172.21.15.17:6800/90655,v1:172.21.15.17:6801/90655] conn(0x7f53a806f7e0 msgr2=0x7f53a8071bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.656+0000 7f53c0c5e700 1 --2- 172.21.15.17:0/1251784823 >> [v2:172.21.15.17:6800/90655,v1:172.21.15.17:6801/90655] conn(0x7f53a806f7e0 0x7f53a8071bf0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.657+0000 7f53c0c5e700 1 -- 172.21.15.17:0/1251784823 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f53a8066f30 msgr2=0x7f53a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.657+0000 7f53c0c5e700 1 --2- 172.21.15.17:0/1251784823 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f53a8066f30 0x7f53a80693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f53ac009fd0 tx=0x7f53ac0091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.657+0000 7f53c0c5e700 1 -- 172.21.15.17:0/1251784823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53bc155c30 msgr2=0x7f53bc1560a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.657+0000 7f53c0c5e700 1 --2- 172.21.15.17:0/1251784823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53bc155c30 0x7f53bc1560a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f53b4018000 tx=0x7f53b401b000 comp rx=0 tx=0).stop 2023-10-06T04:43:35.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.660+0000 7f53bbfff700 1 -- 172.21.15.17:0/1251784823 reap_dead start 2023-10-06T04:43:35.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.660+0000 7f53c0c5e700 1 -- 172.21.15.17:0/1251784823 shutdown_connections 2023-10-06T04:43:35.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.660+0000 7f53c0c5e700 1 -- 172.21.15.17:0/1251784823 >> 172.21.15.17:0/1251784823 conn(0x7f53bc06e650 msgr2=0x7f53bc06d300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:35.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.661+0000 7f53c0c5e700 1 -- 172.21.15.17:0/1251784823 shutdown_connections 2023-10-06T04:43:35.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.661+0000 7f53c0c5e700 1 -- 172.21.15.17:0/1251784823 wait complete. 2023-10-06T04:43:35.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.664+0000 7f4f2ebb1700 1 -- 172.21.15.17:0/1067174751 --> [v2:172.21.15.136:6808/90901,v1:172.21.15.136:6809/90901] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4f28063ff0 con 0x7f4f0806f7e0 2023-10-06T04:43:35.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.669+0000 7f9d41abb700 1 -- 172.21.15.17:0/3606463127 --> [v2:172.21.15.17:6808/90657,v1:172.21.15.17:6810/90657] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9d1c002d30 con 0x7f9d2806f8b0 2023-10-06T04:43:35.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.670+0000 7f9d237fe700 1 -- 172.21.15.17:0/3606463127 <== osd.2 v2:172.21.15.17:6808/90657 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9d1c002d30 con 0x7f9d2806f8b0 2023-10-06T04:43:35.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.672+0000 7f9d41abb700 1 -- 172.21.15.17:0/3606463127 >> [v2:172.21.15.17:6808/90657,v1:172.21.15.17:6810/90657] conn(0x7f9d2806f8b0 msgr2=0x7f9d28071cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.672+0000 7f9d41abb700 1 --2- 172.21.15.17:0/3606463127 >> [v2:172.21.15.17:6808/90657,v1:172.21.15.17:6810/90657] conn(0x7f9d2806f8b0 0x7f9d28071cc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.673+0000 7f4f24ff9700 1 -- 172.21.15.17:0/1067174751 <== osd.5 v2:172.21.15.136:6808/90901 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4f28063ff0 con 0x7f4f0806f7e0 2023-10-06T04:43:35.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.674+0000 7fc2ece5f700 1 -- 172.21.15.17:0/1522646573 --> [v2:172.21.15.17:6809/90656,v1:172.21.15.17:6811/90656] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc2cc002d30 con 0x7fc2c806f7e0 2023-10-06T04:43:35.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.675+0000 7f4f2ebb1700 1 -- 172.21.15.17:0/1067174751 >> [v2:172.21.15.136:6808/90901,v1:172.21.15.136:6809/90901] conn(0x7f4f0806f7e0 msgr2=0x7f4f08071bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.675+0000 7f4f2ebb1700 1 --2- 172.21.15.17:0/1067174751 >> [v2:172.21.15.136:6808/90901,v1:172.21.15.136:6809/90901] conn(0x7f4f0806f7e0 0x7f4f08071bf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.675+0000 7f4f2ebb1700 1 -- 172.21.15.17:0/1067174751 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f4f08066f30 msgr2=0x7f4f080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.675+0000 7f4f2ebb1700 1 --2- 172.21.15.17:0/1067174751 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f4f08066f30 0x7f4f080693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4f28155c70 tx=0x7f4f18008040 comp rx=0 tx=0).stop 2023-10-06T04:43:35.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.675+0000 7f4f2ebb1700 1 -- 172.21.15.17:0/1067174751 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4f2806af20 msgr2=0x7f4f280ac100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.675+0000 7f4f2ebb1700 1 --2- 172.21.15.17:0/1067174751 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4f2806af20 0x7f4f280ac100 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4f20016000 tx=0x7f4f20019000 comp rx=0 tx=0).stop 2023-10-06T04:43:35.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.675+0000 7f4f2d14e700 1 -- 172.21.15.17:0/1067174751 reap_dead start 2023-10-06T04:43:35.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.675+0000 7f4f2ebb1700 1 -- 172.21.15.17:0/1067174751 shutdown_connections 2023-10-06T04:43:35.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.675+0000 7f4f2ebb1700 1 -- 172.21.15.17:0/1067174751 >> 172.21.15.17:0/1067174751 conn(0x7f4f280cd420 msgr2=0x7f4f28152000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:35.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.676+0000 7fc2d67fc700 1 -- 172.21.15.17:0/1522646573 <== osd.0 v2:172.21.15.17:6809/90656 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc2cc002d30 con 0x7fc2c806f7e0 2023-10-06T04:43:35.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.676+0000 7fc1a0f75700 1 -- 172.21.15.17:0/1529628115 --> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc19c070ed0 con 0x7fc18806f760 2023-10-06T04:43:35.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.676+0000 7fc1837fe700 1 -- 172.21.15.17:0/1529628115 <== osd.3 v2:172.21.15.17:6824/90688 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc19c070ed0 con 0x7fc18806f760 2023-10-06T04:43:35.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.676+0000 7fc2ece5f700 1 -- 172.21.15.17:0/1522646573 >> [v2:172.21.15.17:6809/90656,v1:172.21.15.17:6811/90656] conn(0x7fc2c806f7e0 msgr2=0x7fc2c8071bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.676+0000 7fc2ece5f700 1 --2- 172.21.15.17:0/1522646573 >> [v2:172.21.15.17:6809/90656,v1:172.21.15.17:6811/90656] conn(0x7fc2c806f7e0 0x7fc2c8071bf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.677+0000 7fc1a0f75700 1 -- 172.21.15.17:0/1529628115 >> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] conn(0x7fc18806f760 msgr2=0x7fc188071b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.677+0000 7fc1a0f75700 1 --2- 172.21.15.17:0/1529628115 >> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] conn(0x7fc18806f760 0x7fc188071b70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.677+0000 7f9d41abb700 1 -- 172.21.15.17:0/3606463127 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9d28067000 msgr2=0x7f9d280694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.677+0000 7f9d41abb700 1 --2- 172.21.15.17:0/3606463127 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9d28067000 0x7f9d280694b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c064d10 tx=0x7f9d2c008040 comp rx=0 tx=0).stop 2023-10-06T04:43:35.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.677+0000 7f9d41abb700 1 -- 172.21.15.17:0/3606463127 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d3c156d00 msgr2=0x7f9d3c154ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.677+0000 7f9d41abb700 1 --2- 172.21.15.17:0/3606463127 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d3c156d00 0x7f9d3c154ce0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9d3400c400 tx=0x7f9d3401a000 comp rx=0 tx=0).stop 2023-10-06T04:43:35.725 INFO:teuthology.orchestra.run.smithi017.stdout:55834574853 2023-10-06T04:43:35.725 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T04:43:35.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.678+0000 7fe2bb1e5700 1 -- 172.21.15.17:0/1271364165 --> [v2:172.21.15.136:6823/90927,v1:172.21.15.136:6825/90927] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe2b40cb410 con 0x7fe29406f6b0 2023-10-06T04:43:35.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.678+0000 7fe2b17fa700 1 -- 172.21.15.17:0/1271364165 <== osd.6 v2:172.21.15.136:6823/90927 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe2b40cb410 con 0x7fe29406f6b0 2023-10-06T04:43:35.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.679+0000 7fc2ece5f700 1 -- 172.21.15.17:0/1522646573 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc2c8066f30 msgr2=0x7fc2c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.679+0000 7fc2ece5f700 1 --2- 172.21.15.17:0/1522646573 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc2c8066f30 0x7fc2c80693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8158930 tx=0x7fc2d80091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.679+0000 7fc2ece5f700 1 -- 172.21.15.17:0/1522646573 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc2e806a570 msgr2=0x7fc2e80aba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.679+0000 7fc2ece5f700 1 --2- 172.21.15.17:0/1522646573 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc2e806a570 0x7fc2e80aba40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc00c5d0 tx=0x7fc2dc007f60 comp rx=0 tx=0).stop 2023-10-06T04:43:35.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.679+0000 7fc1a0f75700 1 -- 172.21.15.17:0/1529628115 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc188066f30 msgr2=0x7fc1880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.679+0000 7fc1a0f75700 1 --2- 172.21.15.17:0/1529628115 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc188066f30 0x7fc1880693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc19c161f50 tx=0x7fc18c009060 comp rx=0 tx=0).stop 2023-10-06T04:43:35.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.679+0000 7fc1a0f75700 1 -- 172.21.15.17:0/1529628115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc19c06dd30 msgr2=0x7fc19c0b0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.679+0000 7fc1a0f75700 1 --2- 172.21.15.17:0/1529628115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc19c06dd30 0x7fc19c0b0080 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc19000c7f0 tx=0x7fc190007e00 comp rx=0 tx=0).stop 2023-10-06T04:43:35.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.679+0000 7fe2bb1e5700 1 -- 172.21.15.17:0/1271364165 >> [v2:172.21.15.136:6823/90927,v1:172.21.15.136:6825/90927] conn(0x7fe29406f6b0 msgr2=0x7fe294071ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.679+0000 7fe2bb1e5700 1 --2- 172.21.15.17:0/1271364165 >> [v2:172.21.15.136:6823/90927,v1:172.21.15.136:6825/90927] conn(0x7fe29406f6b0 0x7fe294071ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.679+0000 7fc2e6d9d700 1 -- 172.21.15.17:0/1522646573 reap_dead start 2023-10-06T04:43:35.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.679+0000 7fc2ece5f700 1 -- 172.21.15.17:0/1522646573 shutdown_connections 2023-10-06T04:43:35.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.679+0000 7fc2ece5f700 1 -- 172.21.15.17:0/1522646573 >> 172.21.15.17:0/1522646573 conn(0x7fc2e80cd600 msgr2=0x7fc2e8159dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:35.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.679+0000 7f9d3bfff700 1 -- 172.21.15.17:0/3606463127 reap_dead start 2023-10-06T04:43:35.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.679+0000 7f9d41abb700 1 -- 172.21.15.17:0/3606463127 shutdown_connections 2023-10-06T04:43:35.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.679+0000 7f9d41abb700 1 -- 172.21.15.17:0/3606463127 >> 172.21.15.17:0/3606463127 conn(0x7f9d3c0ccd10 msgr2=0x7f9d3c069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:35.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.679+0000 7f9d41abb700 1 -- 172.21.15.17:0/3606463127 shutdown_connections 2023-10-06T04:43:35.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.679+0000 7fc19bfff700 1 -- 172.21.15.17:0/1529628115 reap_dead start 2023-10-06T04:43:35.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.679+0000 7fc1a0f75700 1 -- 172.21.15.17:0/1529628115 shutdown_connections 2023-10-06T04:43:35.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.679+0000 7fc1a0f75700 1 -- 172.21.15.17:0/1529628115 >> 172.21.15.17:0/1529628115 conn(0x7fc19c06e650 msgr2=0x7fc19c070440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:35.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.679+0000 7f4f2ebb1700 1 -- 172.21.15.17:0/1067174751 shutdown_connections 2023-10-06T04:43:35.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.679+0000 7f4f2ebb1700 1 -- 172.21.15.17:0/1067174751 wait complete. 2023-10-06T04:43:35.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.679+0000 7fe2bb1e5700 1 -- 172.21.15.17:0/1271364165 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe294066f00 msgr2=0x7fe2940693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.679+0000 7fe2bb1e5700 1 --2- 172.21.15.17:0/1271364165 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe294066f00 0x7fe2940693b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe2a40097c0 tx=0x7fe2a4019000 comp rx=0 tx=0).stop 2023-10-06T04:43:35.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.679+0000 7fe2bb1e5700 1 -- 172.21.15.17:0/1271364165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2b4155990 msgr2=0x7fe2b40b0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.679+0000 7fe2bb1e5700 1 --2- 172.21.15.17:0/1271364165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2b4155990 0x7fe2b40b0a20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00c5f0 tx=0x7fe2ac007ef0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.679+0000 7fe2b9782700 1 -- 172.21.15.17:0/1271364165 reap_dead start 2023-10-06T04:43:35.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.679+0000 7fe2bb1e5700 1 -- 172.21.15.17:0/1271364165 shutdown_connections 2023-10-06T04:43:35.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.679+0000 7fe2bb1e5700 1 -- 172.21.15.17:0/1271364165 >> 172.21.15.17:0/1271364165 conn(0x7fe2b40ccd10 msgr2=0x7fe2b40c2030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:35.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.679+0000 7fc2ece5f700 1 -- 172.21.15.17:0/1522646573 shutdown_connections 2023-10-06T04:43:35.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.679+0000 7f9d41abb700 1 -- 172.21.15.17:0/3606463127 wait complete. 2023-10-06T04:43:35.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.679+0000 7fc2ece5f700 1 -- 172.21.15.17:0/1522646573 wait complete. 2023-10-06T04:43:35.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.679+0000 7fe2bb1e5700 1 -- 172.21.15.17:0/1271364165 shutdown_connections 2023-10-06T04:43:35.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.679+0000 7fe2bb1e5700 1 -- 172.21.15.17:0/1271364165 wait complete. 2023-10-06T04:43:35.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.681+0000 7fc1a0f75700 1 -- 172.21.15.17:0/1529628115 shutdown_connections 2023-10-06T04:43:35.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.681+0000 7fa5e2ba7700 1 -- 172.21.15.17:0/365233684 --> [v2:172.21.15.136:6816/90934,v1:172.21.15.136:6817/90934] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa5dc063ff0 con 0x7fa5dc0caae0 2023-10-06T04:43:35.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.682+0000 7fa5d8ff9700 1 -- 172.21.15.17:0/365233684 <== osd.7 v2:172.21.15.136:6816/90934 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa5dc063ff0 con 0x7fa5dc0caae0 2023-10-06T04:43:35.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.682+0000 7fa5e2ba7700 1 -- 172.21.15.17:0/365233684 >> [v2:172.21.15.136:6816/90934,v1:172.21.15.136:6817/90934] conn(0x7fa5dc0caae0 msgr2=0x7fa5dc0c56b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.682+0000 7fa5e2ba7700 1 --2- 172.21.15.17:0/365233684 >> [v2:172.21.15.136:6816/90934,v1:172.21.15.136:6817/90934] conn(0x7fa5dc0caae0 0x7fa5dc0c56b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.683+0000 7fa5e2ba7700 1 -- 172.21.15.17:0/365233684 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa5bc066f80 msgr2=0x7fa5bc069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.683+0000 7fa5e2ba7700 1 --2- 172.21.15.17:0/365233684 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa5bc066f80 0x7fa5bc069430 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4007110 tx=0x7fa5c4007f10 comp rx=0 tx=0).stop 2023-10-06T04:43:35.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.683+0000 7fa5e2ba7700 1 -- 172.21.15.17:0/365233684 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5dc15dad0 msgr2=0x7fa5dc13b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.683+0000 7fa5e2ba7700 1 --2- 172.21.15.17:0/365233684 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5dc15dad0 0x7fa5dc13b140 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc0030c0 tx=0x7fa5cc016000 comp rx=0 tx=0).stop 2023-10-06T04:43:35.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.683+0000 7fa5e1144700 1 -- 172.21.15.17:0/365233684 reap_dead start 2023-10-06T04:43:35.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.683+0000 7f82e5ffb700 1 -- 172.21.15.17:0/2939688174 --> [v2:172.21.15.136:6800/90902,v1:172.21.15.136:6801/90902] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f82d8002d30 con 0x7f82ec06f8b0 2023-10-06T04:43:35.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.684+0000 7fa5e2ba7700 1 -- 172.21.15.17:0/365233684 shutdown_connections 2023-10-06T04:43:35.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.684+0000 7fa5e2ba7700 1 -- 172.21.15.17:0/365233684 >> 172.21.15.17:0/365233684 conn(0x7fa5dc0ccd10 msgr2=0x7fa5dc15cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:35.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.684+0000 7fc1a0f75700 1 -- 172.21.15.17:0/1529628115 wait complete. 2023-10-06T04:43:35.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.684+0000 7f82e7fff700 1 -- 172.21.15.17:0/2939688174 <== osd.4 v2:172.21.15.136:6800/90902 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f82d8002d30 con 0x7f82ec06f8b0 2023-10-06T04:43:35.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.685+0000 7f82e5ffb700 1 -- 172.21.15.17:0/2939688174 >> [v2:172.21.15.136:6800/90902,v1:172.21.15.136:6801/90902] conn(0x7f82ec06f8b0 msgr2=0x7f82ec071cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.685+0000 7f82e5ffb700 1 --2- 172.21.15.17:0/2939688174 >> [v2:172.21.15.136:6800/90902,v1:172.21.15.136:6801/90902] conn(0x7f82ec06f8b0 0x7f82ec071cc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.685+0000 7fa5e2ba7700 1 -- 172.21.15.17:0/365233684 shutdown_connections 2023-10-06T04:43:35.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.685+0000 7fa5e2ba7700 1 -- 172.21.15.17:0/365233684 wait complete. 2023-10-06T04:43:35.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.685+0000 7f82e5ffb700 1 -- 172.21.15.17:0/2939688174 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f82ec067000 msgr2=0x7f82ec0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.685+0000 7f82e5ffb700 1 --2- 172.21.15.17:0/2939688174 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f82ec067000 0x7f82ec0694b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f82f8001560 tx=0x7f82f80016c0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.685+0000 7f82e5ffb700 1 -- 172.21.15.17:0/2939688174 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f830006b2f0 msgr2=0x7f83001597b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.685+0000 7f82e5ffb700 1 --2- 172.21.15.17:0/2939688174 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f830006b2f0 0x7f83001597b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f82f000b2c0 tx=0x7f82f0018000 comp rx=0 tx=0).stop 2023-10-06T04:43:35.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.685+0000 7f8304ef5700 1 -- 172.21.15.17:0/2939688174 reap_dead start 2023-10-06T04:43:35.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.686+0000 7f82e5ffb700 1 -- 172.21.15.17:0/2939688174 shutdown_connections 2023-10-06T04:43:35.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.686+0000 7f82e5ffb700 1 -- 172.21.15.17:0/2939688174 >> 172.21.15.17:0/2939688174 conn(0x7f83000cd420 msgr2=0x7f8300151e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:35.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.686+0000 7f82e5ffb700 1 -- 172.21.15.17:0/2939688174 shutdown_connections 2023-10-06T04:43:35.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.686+0000 7f82e5ffb700 1 -- 172.21.15.17:0/2939688174 wait complete. 2023-10-06T04:43:35.740 INFO:teuthology.orchestra.run.smithi017.stdout:55834574853 2023-10-06T04:43:35.741 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T04:43:35.741 INFO:teuthology.orchestra.run.smithi017.stdout:55834574853 2023-10-06T04:43:35.742 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T04:43:35.742 INFO:teuthology.orchestra.run.smithi017.stdout:55834574853 2023-10-06T04:43:35.743 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T04:43:35.743 INFO:teuthology.orchestra.run.smithi017.stdout:55834574854 2023-10-06T04:43:35.744 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T04:43:35.744 INFO:teuthology.orchestra.run.smithi017.stdout:55834574854 2023-10-06T04:43:35.745 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T04:43:35.745 INFO:teuthology.orchestra.run.smithi017.stdout:55834574853 2023-10-06T04:43:35.746 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T04:43:35.746 INFO:teuthology.orchestra.run.smithi017.stdout:55834574854 2023-10-06T04:43:35.747 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T04:43:35.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.985+0000 7f333e0b9700 1 Processor -- start 2023-10-06T04:43:35.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.985+0000 7f333e0b9700 1 -- start start 2023-10-06T04:43:35.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.986+0000 7f333e0b9700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f333806a570 0x7f333815b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.986+0000 7f333e0b9700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f33380bfff0 0x7f333815ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.986+0000 7f333e0b9700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f333806b1f0 con 0x7f33380abbe0 2023-10-06T04:43:35.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.986+0000 7f333e0b9700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f333806b7b0 con 0x7f333806a570 2023-10-06T04:43:35.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.986+0000 7f333e0b9700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f333806b4d0 con 0x7f33380bfff0 2023-10-06T04:43:35.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.986+0000 7f33377fe700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f333806a570 0x7f333815b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.986+0000 7f33377fe700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f333806a570 0x7f333815b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32870/0 (socket says 172.21.15.17:32870) 2023-10-06T04:43:35.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.986+0000 7f33377fe700 1 -- 172.21.15.17:0/254078801 learned_addr learned my addr 172.21.15.17:0/254078801 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:35.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.986+0000 7f3336ffd700 1 --2- 172.21.15.17:0/254078801 >> v2:172.21.15.136:3300/0 conn(0x7f33380bfff0 0x7f333815ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.987+0000 7f3336ffd700 1 -- 172.21.15.17:0/254078801 >> v2:172.21.15.17:3300/0 conn(0x7f333806a570 msgr2=0x7f333815b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:35.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.987+0000 7f3336ffd700 1 --2- 172.21.15.17:0/254078801 >> v2:172.21.15.17:3300/0 conn(0x7f333806a570 0x7f333815b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.987+0000 7f3336ffd700 1 -- 172.21.15.17:0/254078801 >> v1:172.21.15.136:6789/0 conn(0x7f33380abbe0 legacy=0x7f33380b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.987+0000 7f3336ffd700 1 -- 172.21.15.17:0/254078801 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33380705e0 con 0x7f33380bfff0 2023-10-06T04:43:35.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.987+0000 7f3336ffd700 1 --2- 172.21.15.17:0/254078801 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33380bfff0 0x7f333815ba30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3338069b50 tx=0x7f332c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98dd316be03cf590 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:35.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.987+0000 7f33367fc700 1 -- 172.21.15.17:0/254078801 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332c011630 con 0x7f33380bfff0 2023-10-06T04:43:35.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.987+0000 7f33367fc700 1 -- 172.21.15.17:0/254078801 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332c011790 con 0x7f33380bfff0 2023-10-06T04:43:35.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.987+0000 7f33367fc700 1 -- 172.21.15.17:0/254078801 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332c011b30 con 0x7f33380bfff0 2023-10-06T04:43:35.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.988+0000 7f333e0b9700 1 -- 172.21.15.17:0/254078801 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33380bfff0 msgr2=0x7f333815ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:35.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.988+0000 7f333e0b9700 1 --2- 172.21.15.17:0/254078801 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33380bfff0 0x7f333815ba30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3338069b50 tx=0x7f332c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.988+0000 7f333e0b9700 1 -- 172.21.15.17:0/254078801 shutdown_connections 2023-10-06T04:43:35.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.988+0000 7f333e0b9700 1 --2- 172.21.15.17:0/254078801 >> v2:172.21.15.17:3300/0 conn(0x7f333806a570 0x7f333815b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.988+0000 7f333e0b9700 1 --2- 172.21.15.17:0/254078801 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33380bfff0 0x7f333815ba30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.988+0000 7f333e0b9700 1 -- 172.21.15.17:0/254078801 >> 172.21.15.17:0/254078801 conn(0x7f33380cd600 msgr2=0x7f33380c95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:35.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.988+0000 7f333e0b9700 1 -- 172.21.15.17:0/254078801 shutdown_connections 2023-10-06T04:43:35.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.988+0000 7f333e0b9700 1 -- 172.21.15.17:0/254078801 wait complete. 2023-10-06T04:43:35.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.988+0000 7f1cf8ff6700 1 Processor -- start 2023-10-06T04:43:35.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.988+0000 7f1cf8ff6700 1 -- start start 2023-10-06T04:43:35.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.990+0000 7fa7adeb3700 1 Processor -- start 2023-10-06T04:43:35.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.990+0000 7f1cf8ff6700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1cf406bd30 0x7f1cf40ca8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.990+0000 7f1cf8ff6700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1cf40c70f0 0x7f1cf406e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.990+0000 7f1cf8ff6700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1cf406e750 0x7f1cf40870a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.990+0000 7f1cf8ff6700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf40cae00 con 0x7f1cf406e750 2023-10-06T04:43:35.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.990+0000 7f1cf8ff6700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf406eb90 con 0x7f1cf406bd30 2023-10-06T04:43:35.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.990+0000 7f1cf8ff6700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf4166900 con 0x7f1cf40c70f0 2023-10-06T04:43:35.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.990+0000 7fa08a906700 1 Processor -- start 2023-10-06T04:43:35.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.990+0000 7f333e0b9700 1 Processor -- start 2023-10-06T04:43:35.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.990+0000 7f333e0b9700 1 -- start start 2023-10-06T04:43:35.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.990+0000 7f1cf2d9d700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1cf406e750 0x7f1cf40870a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:35.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.990+0000 7f1cf2d9d700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1cf406e750 0x7f1cf40870a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32872/0 (socket says 172.21.15.17:32872) 2023-10-06T04:43:35.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.990+0000 7f1cf2d9d700 1 -- 172.21.15.17:0/1148342399 learned_addr learned my addr 172.21.15.17:0/1148342399 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:35.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.991+0000 7f1cf2d9d700 1 -- 172.21.15.17:0/1148342399 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1cf40c70f0 msgr2=0x7f1cf406e210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T04:43:35.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.991+0000 7f1cf2d9d700 1 --2- 172.21.15.17:0/1148342399 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1cf40c70f0 0x7f1cf406e210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.991+0000 7f1cf2d9d700 1 -- 172.21.15.17:0/1148342399 >> v2:172.21.15.136:3300/0 conn(0x7f1cf406bd30 msgr2=0x7f1cf40ca8c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T04:43:35.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.991+0000 7f1cf2d9d700 1 --2- 172.21.15.17:0/1148342399 >> v2:172.21.15.136:3300/0 conn(0x7f1cf406bd30 0x7f1cf40ca8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:35.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.991+0000 7f1cf2d9d700 1 -- 172.21.15.17:0/1148342399 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf40cb030 con 0x7f1cf406e750 2023-10-06T04:43:35.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.991+0000 7f1cf2d9d700 1 --2- 172.21.15.17:0/1148342399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cf406e750 0x7f1cf40870a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4069670 tx=0x7f1cec009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=962dbb4cd012f0d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:35.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.991+0000 7f1cf159a700 1 -- 172.21.15.17:0/1148342399 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cec0090f0 con 0x7f1cf406e750 2023-10-06T04:43:35.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.991+0000 7f1cf159a700 1 -- 172.21.15.17:0/1148342399 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cec009250 con 0x7f1cf406e750 2023-10-06T04:43:35.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.991+0000 7f1cf159a700 1 -- 172.21.15.17:0/1148342399 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cec00f690 con 0x7f1cf406e750 2023-10-06T04:43:35.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.990+0000 7f2527ece700 1 Processor -- start 2023-10-06T04:43:35.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.990+0000 7f2527ece700 1 -- start start 2023-10-06T04:43:35.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.990+0000 7fa7adeb3700 1 -- start start 2023-10-06T04:43:35.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.991+0000 7fa7adeb3700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa7a80af140 0x7fa7a80707d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.991+0000 7fa7adeb3700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa7a80c70d0 0x7fa7a806a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.991+0000 7fa7adeb3700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a80afcf0 con 0x7fa7a806a860 2023-10-06T04:43:35.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.991+0000 7fa7adeb3700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7a806ace0 con 0x7fa7a80c70d0 2023-10-06T04:43:35.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.991+0000 7fa7adeb3700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a80c7690 con 0x7fa7a80af140 2023-10-06T04:43:35.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.991+0000 7f333e0b9700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f333806a570 0x7f3338151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.991+0000 7f333e0b9700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33380abbe0 0x7f333816e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.991+0000 7f333e0b9700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33380bfff0 0x7f3338150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:35.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7f333e0b9700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3338153660 con 0x7f33380abbe0 2023-10-06T04:43:35.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7f333e0b9700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33381531d0 con 0x7f33380bfff0 2023-10-06T04:43:35.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7f333e0b9700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f333816ee40 con 0x7f333806a570 2023-10-06T04:43:35.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.990+0000 7fa08a906700 1 -- start start 2023-10-06T04:43:35.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.990+0000 7fa7572ac700 1 Processor -- start 2023-10-06T04:43:35.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.990+0000 7fa7572ac700 1 -- start start 2023-10-06T04:43:36.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7fa7572ac700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa750068000 0x7fa7500cbb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:36.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7fa08a906700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa084161e40 0x7fa0840ce730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:36.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7fa08a906700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0840cf990 con 0x7fa0840cbc70 2023-10-06T04:43:36.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7fa08a906700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0840ced80 con 0x7fa0840cb190 2023-10-06T04:43:36.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7fa08a906700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0840cf060 con 0x7fa084161e40 2023-10-06T04:43:36.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7fa7572ac700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa750156690 0x7fa75006b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:36.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7fa7572ac700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa750156cb0 con 0x7fa7500c9eb0 2023-10-06T04:43:36.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7fa7572ac700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa75006a080 con 0x7fa750068000 2023-10-06T04:43:36.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7fa7572ac700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa750156aa0 con 0x7fa750156690 2023-10-06T04:43:36.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7fa7a77fe700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa7a80af140 0x7fa7a80707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:36.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7fa7a77fe700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa7a80af140 0x7fa7a80707d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.17:36252/0 (socket says 172.21.15.17:36252) 2023-10-06T04:43:36.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7fa7a77fe700 1 -- 172.21.15.17:0/1140806150 learned_addr learned my addr 172.21.15.17:0/1140806150 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:36.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7f3337fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33380bfff0 0x7f3338150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:36.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7f33377fe700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f333806a570 0x7f3338151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:36.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7f3337fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33380bfff0 0x7f3338150000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.17:32926/0 (socket says 172.21.15.17:32926) 2023-10-06T04:43:36.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7f33377fe700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f333806a570 0x7f3338151f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.17:36272/0 (socket says 172.21.15.17:36272) 2023-10-06T04:43:36.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7f3337fff700 1 -- 172.21.15.17:0/1056744136 learned_addr learned my addr 172.21.15.17:0/1056744136 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:36.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7f3336ffd700 1 --2- 172.21.15.17:0/1056744136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33380abbe0 0x7f333816e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:36.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7f2527ece700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f252015dad0 0x7f25200ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:36.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7f2527ece700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f25200ca910 0x7f252006e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:36.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7f2527ece700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f252006ebb0 con 0x7f252006e750 2023-10-06T04:43:36.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7f2527ece700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25200cad80 con 0x7f25200ca910 2023-10-06T04:43:36.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7f2527ece700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25200c7330 con 0x7f252015dad0 2023-10-06T04:43:36.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7f252646b700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f252006e750 0x7f2520161730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.17:37464/0 (socket says 172.21.15.17:37464) 2023-10-06T04:43:36.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7f252646b700 1 -- 172.21.15.17:0/3807420227 learned_addr learned my addr 172.21.15.17:0/3807420227 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:36.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7f2525c6a700 1 --2- 172.21.15.17:0/3807420227 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f252015dad0 0x7f25200ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:36.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7fa088ea3700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa084161e40 0x7fa0840ce730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:36.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7fa088ea3700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa084161e40 0x7fa0840ce730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.17:36260/0 (socket says 172.21.15.17:36260) 2023-10-06T04:43:36.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7fa088ea3700 1 -- 172.21.15.17:0/342145778 learned_addr learned my addr 172.21.15.17:0/342145778 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:36.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7fa755849700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa750156690 0x7fa75006b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:36.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7fa755849700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa750156690 0x7fa75006b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.17:36274/0 (socket says 172.21.15.17:36274) 2023-10-06T04:43:36.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7fa754847700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fa7500c9eb0 0x7fa750155f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:35968/0 (socket says 172.21.15.17:35968) 2023-10-06T04:43:36.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7fa755849700 1 -- 172.21.15.17:0/3410160897 learned_addr learned my addr 172.21.15.17:0/3410160897 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:36.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7f2525469700 1 --2- 172.21.15.17:0/3807420227 >> v2:172.21.15.136:3300/0 conn(0x7f25200ca910 0x7f252006e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:36.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7f1cf8ff6700 1 -- 172.21.15.17:0/1148342399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cf406e750 msgr2=0x7f1cf40870a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7f1cf8ff6700 1 --2- 172.21.15.17:0/1148342399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cf406e750 0x7f1cf40870a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4069670 tx=0x7f1cec009f90 comp rx=0 tx=0).stop 2023-10-06T04:43:36.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7fa7a77fe700 1 -- 172.21.15.17:0/1140806150 >> v2:172.21.15.17:3300/0 conn(0x7fa7a80c70d0 msgr2=0x7fa7a806a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:36.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7fa7a77fe700 1 --2- 172.21.15.17:0/1140806150 >> v2:172.21.15.17:3300/0 conn(0x7fa7a80c70d0 0x7fa7a806a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7fa7a77fe700 1 -- 172.21.15.17:0/1140806150 >> v1:172.21.15.136:6789/0 conn(0x7fa7a806a860 legacy=0x7fa7a806c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7fa7a77fe700 1 -- 172.21.15.17:0/1140806150 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a80c7970 con 0x7fa7a80af140 2023-10-06T04:43:36.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.993+0000 7f2525c6a700 1 -- 172.21.15.17:0/3807420227 >> v2:172.21.15.136:3300/0 conn(0x7f25200ca910 msgr2=0x7f252006e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:36.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.993+0000 7f2525c6a700 1 --2- 172.21.15.17:0/3807420227 >> v2:172.21.15.136:3300/0 conn(0x7f25200ca910 0x7f252006e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.993+0000 7f2525c6a700 1 -- 172.21.15.17:0/3807420227 >> v1:172.21.15.136:6789/0 conn(0x7f252006e750 legacy=0x7f2520161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.993+0000 7f2524c68700 1 -- 172.21.15.17:0/3807420227 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4205787668 0 0) 0x7f2518001490 con 0x7f252006e750 2023-10-06T04:43:36.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.993+0000 7f2525c6a700 1 -- 172.21.15.17:0/3807420227 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25200c8190 con 0x7f252015dad0 2023-10-06T04:43:36.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7fa088ea3700 1 -- 172.21.15.17:0/342145778 >> v1:172.21.15.136:6789/0 conn(0x7fa0840cb190 legacy=0x7fa0840cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7fa088ea3700 1 -- 172.21.15.17:0/342145778 >> v1:172.21.15.17:6789/0 conn(0x7fa0840cbc70 legacy=0x7fa084161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.992+0000 7fa088ea3700 1 -- 172.21.15.17:0/342145778 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0840cf340 con 0x7fa084161e40 2023-10-06T04:43:36.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.993+0000 7f3336ffd700 1 -- 172.21.15.17:0/1056744136 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f333806a570 msgr2=0x7f3338151f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.993+0000 7f3336ffd700 1 --2- 172.21.15.17:0/1056744136 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f333806a570 0x7f3338151f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.993+0000 7f3336ffd700 1 -- 172.21.15.17:0/1056744136 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33380bfff0 msgr2=0x7f3338150000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.993+0000 7f3336ffd700 1 --2- 172.21.15.17:0/1056744136 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33380bfff0 0x7f3338150000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.993+0000 7f3336ffd700 1 -- 172.21.15.17:0/1056744136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f332c009420 con 0x7f33380abbe0 2023-10-06T04:43:36.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.993+0000 7f2525469700 1 --2- 172.21.15.17:0/3807420227 >> v2:172.21.15.136:3300/0 conn(0x7f25200ca910 0x7f252006e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:43:36.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.993+0000 7faa780e3700 1 Processor -- start 2023-10-06T04:43:36.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.993+0000 7f1cf8ff6700 1 -- 172.21.15.17:0/1148342399 shutdown_connections 2023-10-06T04:43:36.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.993+0000 7f1cf8ff6700 1 --2- 172.21.15.17:0/1148342399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cf406e750 0x7f1cf40870a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.993+0000 7f1cf8ff6700 1 --2- 172.21.15.17:0/1148342399 >> v2:172.21.15.136:3300/0 conn(0x7f1cf406bd30 0x7f1cf40ca8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.993+0000 7f1cf8ff6700 1 --2- 172.21.15.17:0/1148342399 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1cf40c70f0 0x7f1cf406e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.993+0000 7f1cf8ff6700 1 -- 172.21.15.17:0/1148342399 >> 172.21.15.17:0/1148342399 conn(0x7f1cf40ccd10 msgr2=0x7f1cf40c8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:36.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.993+0000 7f1cf8ff6700 1 -- 172.21.15.17:0/1148342399 shutdown_connections 2023-10-06T04:43:36.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.993+0000 7fa7a77fe700 1 --2- 172.21.15.17:0/1140806150 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa7a80af140 0x7fa7a80707d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0009f20 tx=0x7fa7a0009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=244aece0d4e002eb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:36.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.993+0000 7f3336ffd700 1 --2- 172.21.15.17:0/1056744136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33380abbe0 0x7f333816e900 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f332c015000 tx=0x7f332c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:36.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.993+0000 7f2525c6a700 1 --2- 172.21.15.17:0/3807420227 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f252015dad0 0x7f25200ca3d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f251c0098e0 tx=0x7f251c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e5a24faa6fceb68 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:36.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.993+0000 7fa088ea3700 1 --2- 172.21.15.17:0/342145778 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa084161e40 0x7fa0840ce730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa07c009f50 tx=0x7fa07c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=798de94ec16df84 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:36.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.993+0000 7fa755849700 1 -- 172.21.15.17:0/3410160897 >> v2:172.21.15.17:3300/0 conn(0x7fa750068000 msgr2=0x7fa7500cbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:36.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.993+0000 7fa755849700 1 --2- 172.21.15.17:0/3410160897 >> v2:172.21.15.17:3300/0 conn(0x7fa750068000 0x7fa7500cbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.993+0000 7fa755849700 1 -- 172.21.15.17:0/3410160897 >> v1:172.21.15.17:6789/0 conn(0x7fa7500c9eb0 legacy=0x7fa750155f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.993+0000 7fa755849700 1 -- 172.21.15.17:0/3410160897 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa750155be0 con 0x7fa750156690 2023-10-06T04:43:36.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.993+0000 7fa7a67fc700 1 -- 172.21.15.17:0/1140806150 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a000e070 con 0x7fa7a80af140 2023-10-06T04:43:36.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.993+0000 7fa7a67fc700 1 -- 172.21.15.17:0/1140806150 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a000ba80 con 0x7fa7a80af140 2023-10-06T04:43:36.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.993+0000 7fa7a67fc700 1 -- 172.21.15.17:0/1140806150 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a00092e0 con 0x7fa7a80af140 2023-10-06T04:43:36.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.993+0000 7f1cf8ff6700 1 -- 172.21.15.17:0/1148342399 wait complete. 2023-10-06T04:43:36.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.993+0000 7fa755849700 1 --2- 172.21.15.17:0/3410160897 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa750156690 0x7fa75006b050 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa748009f20 tx=0x7fa748009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb0ed27127fd405 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:36.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.993+0000 7f331f7fe700 1 -- 172.21.15.17:0/1056744136 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332c011900 con 0x7f33380abbe0 2023-10-06T04:43:36.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.993+0000 7f331f7fe700 1 -- 172.21.15.17:0/1056744136 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332c011a60 con 0x7f33380abbe0 2023-10-06T04:43:36.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.993+0000 7f333e0b9700 1 -- 172.21.15.17:0/1056744136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33381525c0 con 0x7f33380abbe0 2023-10-06T04:43:36.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.993+0000 7fa082ffd700 1 -- 172.21.15.17:0/342145778 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c00e070 con 0x7fa084161e40 2023-10-06T04:43:36.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.993+0000 7fa082ffd700 1 -- 172.21.15.17:0/342145778 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07c00bab0 con 0x7fa084161e40 2023-10-06T04:43:36.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.993+0000 7fa082ffd700 1 -- 172.21.15.17:0/342145778 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c0092e0 con 0x7fa084161e40 2023-10-06T04:43:36.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.994+0000 7fa7adeb3700 1 -- 172.21.15.17:0/1140806150 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa7a80af140 msgr2=0x7fa7a80707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.994+0000 7fa7adeb3700 1 --2- 172.21.15.17:0/1140806150 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa7a80af140 0x7fa7a80707d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0009f20 tx=0x7fa7a0009840 comp rx=0 tx=0).stop 2023-10-06T04:43:36.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.994+0000 7fa7adeb3700 1 -- 172.21.15.17:0/1140806150 shutdown_connections 2023-10-06T04:43:36.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.994+0000 7fa7adeb3700 1 --2- 172.21.15.17:0/1140806150 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa7a80af140 0x7fa7a80707d0 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0009f20 tx=0x7fa7a0009840 comp rx=0 tx=0).stop 2023-10-06T04:43:36.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.994+0000 7fa7adeb3700 1 --2- 172.21.15.17:0/1140806150 >> v2:172.21.15.17:3300/0 conn(0x7fa7a80c70d0 0x7fa7a806a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.994+0000 7fa7adeb3700 1 -- 172.21.15.17:0/1140806150 >> 172.21.15.17:0/1140806150 conn(0x7fa7a80cd600 msgr2=0x7fa7a80c95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:36.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.993+0000 7f331f7fe700 1 -- 172.21.15.17:0/1056744136 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332c01a6a0 con 0x7f33380abbe0 2023-10-06T04:43:36.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.993+0000 7f333e0b9700 1 -- 172.21.15.17:0/1056744136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3338152b80 con 0x7f33380abbe0 2023-10-06T04:43:36.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.994+0000 7f2524c68700 1 -- 172.21.15.17:0/3807420227 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251c009e80 con 0x7f252015dad0 2023-10-06T04:43:36.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.995+0000 7f2524c68700 1 -- 172.21.15.17:0/3807420227 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251c00b860 con 0x7f252015dad0 2023-10-06T04:43:36.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.995+0000 7f2524c68700 1 -- 172.21.15.17:0/3807420227 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251c00bbe0 con 0x7f252015dad0 2023-10-06T04:43:36.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.994+0000 7fa08a906700 1 -- 172.21.15.17:0/342145778 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa084161e40 msgr2=0x7fa0840ce730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.994+0000 7fa08a906700 1 --2- 172.21.15.17:0/342145778 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa084161e40 0x7fa0840ce730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa07c009f50 tx=0x7fa07c009840 comp rx=0 tx=0).stop 2023-10-06T04:43:36.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.995+0000 7fa08a906700 1 -- 172.21.15.17:0/342145778 shutdown_connections 2023-10-06T04:43:36.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.995+0000 7fa08a906700 1 --2- 172.21.15.17:0/342145778 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa084161e40 0x7fa0840ce730 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.995+0000 7fa08a906700 1 -- 172.21.15.17:0/342145778 >> 172.21.15.17:0/342145778 conn(0x7fa0840cd140 msgr2=0x7fa0840cd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:36.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.995+0000 7f1cf8ff6700 1 Processor -- start 2023-10-06T04:43:36.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.995+0000 7fa08a906700 1 -- 172.21.15.17:0/342145778 shutdown_connections 2023-10-06T04:43:36.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.995+0000 7fa08a906700 1 -- 172.21.15.17:0/342145778 wait complete. 2023-10-06T04:43:36.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.995+0000 7fa7adeb3700 1 -- 172.21.15.17:0/1140806150 shutdown_connections 2023-10-06T04:43:36.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.995+0000 7f333e0b9700 1 -- 172.21.15.17:0/1056744136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3338063ff0 con 0x7f33380abbe0 2023-10-06T04:43:36.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.995+0000 7fa747fff700 1 -- 172.21.15.17:0/3410160897 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74800e070 con 0x7fa750156690 2023-10-06T04:43:36.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.995+0000 7fa747fff700 1 -- 172.21.15.17:0/3410160897 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74800b980 con 0x7fa750156690 2023-10-06T04:43:36.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.995+0000 7fa747fff700 1 -- 172.21.15.17:0/3410160897 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7480092e0 con 0x7fa750156690 2023-10-06T04:43:36.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.996+0000 7f331f7fe700 1 -- 172.21.15.17:0/1056744136 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f332c01aad0 con 0x7f33380abbe0 2023-10-06T04:43:36.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.993+0000 7faa780e3700 1 -- start start 2023-10-06T04:43:36.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.994+0000 7faa780e3700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7faa700cb190 0x7faa700ce730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:36.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.994+0000 7faa780e3700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faa70161e40 0x7faa700cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:36.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.994+0000 7faa780e3700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa700cf990 con 0x7faa700cb560 2023-10-06T04:43:36.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.994+0000 7faa780e3700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa700cbf10 con 0x7faa700cb190 2023-10-06T04:43:36.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.994+0000 7faa780e3700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa700ced80 con 0x7faa70161e40 2023-10-06T04:43:36.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.994+0000 7faa75e7f700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7faa700cb190 0x7faa700ce730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:36.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.995+0000 7faa75e7f700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7faa700cb190 0x7faa700ce730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32898/0 (socket says 172.21.15.17:32898) 2023-10-06T04:43:36.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.995+0000 7faa75e7f700 1 -- 172.21.15.17:0/2169230822 learned_addr learned my addr 172.21.15.17:0/2169230822 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:36.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.995+0000 7faa76680700 1 --2- 172.21.15.17:0/2169230822 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faa70161e40 0x7faa700cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:36.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.995+0000 7faa75e7f700 1 -- 172.21.15.17:0/2169230822 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faa70161e40 msgr2=0x7faa700cb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:36.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.995+0000 7faa75e7f700 1 --2- 172.21.15.17:0/2169230822 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faa70161e40 0x7faa700cb9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.995+0000 7faa75e7f700 1 -- 172.21.15.17:0/2169230822 >> v1:172.21.15.136:6789/0 conn(0x7faa700cb560 legacy=0x7faa70161730 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T04:43:36.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.995+0000 7faa75e7f700 1 -- 172.21.15.17:0/2169230822 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa700cf060 con 0x7faa700cb190 2023-10-06T04:43:36.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.995+0000 7faa75e7f700 1 --2- 172.21.15.17:0/2169230822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa700cb190 0x7faa700ce730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7faa60009990 tx=0x7faa60009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3be98ac7d3b2ced server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:36.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.995+0000 7faa74e7d700 1 -- 172.21.15.17:0/2169230822 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa60009e80 con 0x7faa700cb190 2023-10-06T04:43:36.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.995+0000 7faa74e7d700 1 -- 172.21.15.17:0/2169230822 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa60005c10 con 0x7faa700cb190 2023-10-06T04:43:36.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.995+0000 7faa74e7d700 1 -- 172.21.15.17:0/2169230822 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6000b610 con 0x7faa700cb190 2023-10-06T04:43:36.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.996+0000 7fa7572ac700 1 -- 172.21.15.17:0/3410160897 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa750156690 msgr2=0x7fa75006b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.996+0000 7fa7572ac700 1 --2- 172.21.15.17:0/3410160897 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa750156690 0x7fa75006b050 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa748009f20 tx=0x7fa748009840 comp rx=0 tx=0).stop 2023-10-06T04:43:36.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.996+0000 7fa7572ac700 1 -- 172.21.15.17:0/3410160897 shutdown_connections 2023-10-06T04:43:36.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.996+0000 7fa7572ac700 1 --2- 172.21.15.17:0/3410160897 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa750156690 0x7fa75006b050 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.996+0000 7fa7572ac700 1 --2- 172.21.15.17:0/3410160897 >> v2:172.21.15.17:3300/0 conn(0x7fa750068000 0x7fa7500cbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.996+0000 7fa7572ac700 1 -- 172.21.15.17:0/3410160897 >> 172.21.15.17:0/3410160897 conn(0x7fa75006d030 msgr2=0x7fa7500cc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:36.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.996+0000 7f331f7fe700 1 --2- 172.21.15.17:0/1056744136 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3324067000 0x7f33240694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:36.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.996+0000 7f2527ece700 1 -- 172.21.15.17:0/3807420227 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f252015dad0 msgr2=0x7f25200ca3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.996+0000 7f2527ece700 1 --2- 172.21.15.17:0/3807420227 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f252015dad0 0x7f25200ca3d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f251c0098e0 tx=0x7f251c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.996+0000 7f331f7fe700 1 -- 172.21.15.17:0/1056744136 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f332c0861f0 con 0x7f33380abbe0 2023-10-06T04:43:36.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.996+0000 7fa08a906700 1 Processor -- start 2023-10-06T04:43:36.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.997+0000 7faa780e3700 1 -- 172.21.15.17:0/2169230822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa700cb190 msgr2=0x7faa700ce730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.997+0000 7faa780e3700 1 --2- 172.21.15.17:0/2169230822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa700cb190 0x7faa700ce730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7faa60009990 tx=0x7faa60009220 comp rx=0 tx=0).stop 2023-10-06T04:43:36.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.997+0000 7faa780e3700 1 -- 172.21.15.17:0/2169230822 shutdown_connections 2023-10-06T04:43:36.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.997+0000 7faa780e3700 1 --2- 172.21.15.17:0/2169230822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa700cb190 0x7faa700ce730 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.997+0000 7faa780e3700 1 --2- 172.21.15.17:0/2169230822 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faa70161e40 0x7faa700cb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.997+0000 7faa780e3700 1 -- 172.21.15.17:0/2169230822 >> 172.21.15.17:0/2169230822 conn(0x7faa700cd140 msgr2=0x7faa700cd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:36.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.997+0000 7f1cf8ff6700 1 -- start start 2023-10-06T04:43:36.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.995+0000 7fa7adeb3700 1 -- 172.21.15.17:0/1140806150 wait complete. 2023-10-06T04:43:36.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.997+0000 7fa7adeb3700 1 Processor -- start 2023-10-06T04:43:36.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.997+0000 7fa7adeb3700 1 -- start start 2023-10-06T04:43:36.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.996+0000 7f33377fe700 1 --2- 172.21.15.17:0/1056744136 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3324067000 0x7f33240694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:36.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.997+0000 7f33377fe700 1 --2- 172.21.15.17:0/1056744136 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3324067000 0x7f33240694b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3328006fd0 tx=0x7f3328008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:36.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.997+0000 7f2527ece700 1 -- 172.21.15.17:0/3807420227 shutdown_connections 2023-10-06T04:43:36.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.997+0000 7f2527ece700 1 --2- 172.21.15.17:0/3807420227 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f252015dad0 0x7f25200ca3d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.997+0000 7f2527ece700 1 --2- 172.21.15.17:0/3807420227 >> v2:172.21.15.136:3300/0 conn(0x7f25200ca910 0x7f252006e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.997+0000 7f2527ece700 1 -- 172.21.15.17:0/3807420227 >> 172.21.15.17:0/3807420227 conn(0x7f25200ccd10 msgr2=0x7f25200c8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:36.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.997+0000 7f2527ece700 1 -- 172.21.15.17:0/3807420227 shutdown_connections 2023-10-06T04:43:36.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.997+0000 7f2527ece700 1 -- 172.21.15.17:0/3807420227 wait complete. 2023-10-06T04:43:36.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.997+0000 7fa08a906700 1 -- start start 2023-10-06T04:43:36.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.998+0000 7faa780e3700 1 -- 172.21.15.17:0/2169230822 shutdown_connections 2023-10-06T04:43:36.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.998+0000 7f1cf8ff6700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cf406bd30 0x7f1cf40c38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:36.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.998+0000 7f1cf8ff6700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1cf406e750 0x7f1cf4182540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:36.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.998+0000 7f1cf8ff6700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1cf40c70f0 0x7f1cf4182a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:36.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.998+0000 7f1cf8ff6700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf40c6640 con 0x7f1cf406bd30 2023-10-06T04:43:36.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.998+0000 7f1cf8ff6700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf41693b0 con 0x7f1cf40c70f0 2023-10-06T04:43:36.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.998+0000 7f1cf8ff6700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf4168830 con 0x7f1cf406e750 2023-10-06T04:43:36.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.998+0000 7fa7adeb3700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7a806a860 0x7fa7a80c2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:36.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.998+0000 7fa7adeb3700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7a80c70d0 0x7fa7a8158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:36.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.998+0000 7fa7adeb3700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa7a80ac950 0x7fa7a81486b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:36.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.998+0000 7fa7adeb3700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a80c2950 con 0x7fa7a80c70d0 2023-10-06T04:43:36.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.998+0000 7fa7adeb3700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a80c2c10 con 0x7fa7a806a860 2023-10-06T04:43:36.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.998+0000 7fa7adeb3700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a80c2ef0 con 0x7fa7a80ac950 2023-10-06T04:43:36.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.998+0000 7f1cf259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cf406bd30 0x7f1cf40c38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:36.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.998+0000 7f1cf259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cf406bd30 0x7f1cf40c38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32902/0 (socket says 172.21.15.17:32902) 2023-10-06T04:43:36.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.998+0000 7f1cf259c700 1 -- 172.21.15.17:0/3931095914 learned_addr learned my addr 172.21.15.17:0/3931095914 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:36.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.998+0000 7fdf06683700 1 Processor -- start 2023-10-06T04:43:36.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.998+0000 7f1cf1d9b700 1 --2- 172.21.15.17:0/3931095914 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1cf406e750 0x7f1cf4182540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:36.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.998+0000 7fa7a77fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7a806a860 0x7fa7a80c2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:36.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.998+0000 7fa7a77fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7a806a860 0x7fa7a80c2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.17:32942/0 (socket says 172.21.15.17:32942) 2023-10-06T04:43:36.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.998+0000 7fa7a77fe700 1 -- 172.21.15.17:0/46417346 learned_addr learned my addr 172.21.15.17:0/46417346 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:36.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.998+0000 7fa7a6ffd700 1 --2- 172.21.15.17:0/46417346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7a80c70d0 0x7fa7a8158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:36.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.998+0000 7fa7a7fff700 1 --2- 172.21.15.17:0/46417346 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa7a80ac950 0x7fa7a81486b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:36.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.998+0000 7fa08a906700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0840cb190 0x7fa084157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:36.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.998+0000 7fa08a906700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa084161e40 0x7fa08406c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:36.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.998+0000 7fa08a906700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa08406caa0 0x7fa084160170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:36.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.998+0000 7fa08a906700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08406cf40 con 0x7fa0840cb190 2023-10-06T04:43:36.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.998+0000 7fa08a906700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa084159950 con 0x7fa08406caa0 2023-10-06T04:43:36.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.998+0000 7fa08a906700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa084157b40 con 0x7fa084161e40 2023-10-06T04:43:36.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.999+0000 7fa083fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0840cb190 0x7fa084157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:36.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.999+0000 7fa083fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0840cb190 0x7fa084157600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32920/0 (socket says 172.21.15.17:32920) 2023-10-06T04:43:36.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.999+0000 7fa083fff700 1 -- 172.21.15.17:0/3738111744 learned_addr learned my addr 172.21.15.17:0/3738111744 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:36.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.999+0000 7fa088ea3700 1 --2- 172.21.15.17:0/3738111744 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa08406caa0 0x7fa084160170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:36.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.999+0000 7f1cf259c700 1 -- 172.21.15.17:0/3931095914 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1cf406e750 msgr2=0x7f1cf4182540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.999+0000 7f1cf259c700 1 --2- 172.21.15.17:0/3931095914 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1cf406e750 0x7f1cf4182540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.999+0000 7f1cf259c700 1 -- 172.21.15.17:0/3931095914 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1cf40c70f0 msgr2=0x7f1cf4182a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.999+0000 7f1cf259c700 1 --2- 172.21.15.17:0/3931095914 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1cf40c70f0 0x7f1cf4182a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.999+0000 7f1cf259c700 1 -- 172.21.15.17:0/3931095914 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cec009850 con 0x7f1cf406bd30 2023-10-06T04:43:36.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.999+0000 7fa0837fe700 1 --2- 172.21.15.17:0/3738111744 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa084161e40 0x7fa08406c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:36.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.999+0000 7fdf06683700 1 -- start start 2023-10-06T04:43:36.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.999+0000 7f1cf259c700 1 --2- 172.21.15.17:0/3931095914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cf406bd30 0x7f1cf40c38f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1ce400b5e0 tx=0x7f1ce40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:36.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.999+0000 7fa7a77fe700 1 -- 172.21.15.17:0/46417346 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa7a80ac950 msgr2=0x7fa7a81486b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.999+0000 7fa7a77fe700 1 --2- 172.21.15.17:0/46417346 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa7a80ac950 0x7fa7a81486b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.999+0000 7fa7a77fe700 1 -- 172.21.15.17:0/46417346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7a80c70d0 msgr2=0x7fa7a8158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.999+0000 7fa7a77fe700 1 --2- 172.21.15.17:0/46417346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7a80c70d0 0x7fa7a8158fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.999+0000 7fa7a77fe700 1 -- 172.21.15.17:0/46417346 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a0009ae0 con 0x7fa7a806a860 2023-10-06T04:43:36.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.999+0000 7f2527ece700 1 Processor -- start 2023-10-06T04:43:36.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.999+0000 7faa780e3700 1 -- 172.21.15.17:0/2169230822 wait complete. 2023-10-06T04:43:36.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.999+0000 7fa083fff700 1 -- 172.21.15.17:0/3738111744 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa084161e40 msgr2=0x7fa08406c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.999+0000 7fa083fff700 1 --2- 172.21.15.17:0/3738111744 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa084161e40 0x7fa08406c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.999+0000 7fa083fff700 1 -- 172.21.15.17:0/3738111744 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa08406caa0 msgr2=0x7fa084160170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.999+0000 7fa083fff700 1 --2- 172.21.15.17:0/3738111744 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa08406caa0 0x7fa084160170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.999+0000 7fa083fff700 1 -- 172.21.15.17:0/3738111744 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa07c009ae0 con 0x7fa0840cb190 2023-10-06T04:43:36.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.999+0000 7fa7572ac700 1 -- 172.21.15.17:0/3410160897 shutdown_connections 2023-10-06T04:43:36.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.999+0000 7fa7a77fe700 1 --2- 172.21.15.17:0/46417346 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7a806a860 0x7fa7a80c2410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0012000 tx=0x7fa7a0018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:36.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.999+0000 7fa083fff700 1 --2- 172.21.15.17:0/3738111744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0840cb190 0x7fa084157600 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa07400c5c0 tx=0x7fa074007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:36.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.999+0000 7fa78f7fe700 1 -- 172.21.15.17:0/46417346 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a0008ae0 con 0x7fa7a806a860 2023-10-06T04:43:36.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:35.999+0000 7fa78f7fe700 1 -- 172.21.15.17:0/46417346 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a0008c60 con 0x7fa7a806a860 2023-10-06T04:43:36.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.000+0000 7fa7adeb3700 1 -- 172.21.15.17:0/46417346 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7a80ad100 con 0x7fa7a806a860 2023-10-06T04:43:36.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.000+0000 7fa7adeb3700 1 -- 172.21.15.17:0/46417346 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a80ad6c0 con 0x7fa7a806a860 2023-10-06T04:43:36.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.000+0000 7fa78f7fe700 1 -- 172.21.15.17:0/46417346 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a001d420 con 0x7fa7a806a860 2023-10-06T04:43:36.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.000+0000 7fdf06683700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf0006af20 0x7fdf0015ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:36.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.000+0000 7fdf06683700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fdf000ae380 0x7fdf00156140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:36.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.000+0000 7fdf06683700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf00067ca0 con 0x7fdf0006b2f0 2023-10-06T04:43:36.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.000+0000 7fdf06683700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf00068840 con 0x7fdf000ae380 2023-10-06T04:43:36.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.000+0000 7fdf06683700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf00067690 con 0x7fdf0006af20 2023-10-06T04:43:36.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.000+0000 7fa7572ac700 1 -- 172.21.15.17:0/3410160897 wait complete. 2023-10-06T04:43:36.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.000+0000 7fdefffff700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf0006af20 0x7fdf0015ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:36.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.000+0000 7fdeff7fe700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fdf0006b2f0 0x7fdf00068130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.17:37474/0 (socket says 172.21.15.17:37474) 2023-10-06T04:43:36.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.000+0000 7fdeff7fe700 1 -- 172.21.15.17:0/3387937314 learned_addr learned my addr 172.21.15.17:0/3387937314 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:36.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.000+0000 7fdf04c20700 1 --2- 172.21.15.17:0/3387937314 >> v2:172.21.15.136:3300/0 conn(0x7fdf000ae380 0x7fdf00156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:36.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.000+0000 7fdefffff700 1 -- 172.21.15.17:0/3387937314 >> v2:172.21.15.136:3300/0 conn(0x7fdf000ae380 msgr2=0x7fdf00156140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:36.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.000+0000 7fdefffff700 1 --2- 172.21.15.17:0/3387937314 >> v2:172.21.15.136:3300/0 conn(0x7fdf000ae380 0x7fdf00156140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.000+0000 7fdefffff700 1 -- 172.21.15.17:0/3387937314 >> v1:172.21.15.136:6789/0 conn(0x7fdf0006b2f0 legacy=0x7fdf00068130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.000+0000 7fdefffff700 1 -- 172.21.15.17:0/3387937314 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf000aeaf0 con 0x7fdf0006af20 2023-10-06T04:43:36.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.000+0000 7fdefeffd700 1 -- 172.21.15.17:0/3387937314 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2171011552 0 0) 0x7fdf00067ca0 con 0x7fdf0006b2f0 2023-10-06T04:43:36.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.001+0000 7faa780e3700 1 Processor -- start 2023-10-06T04:43:36.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.001+0000 7faa780e3700 1 -- start start 2023-10-06T04:43:36.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.001+0000 7fdefffff700 1 --2- 172.21.15.17:0/3387937314 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf0006af20 0x7fdf0015ad60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdef80098e0 tx=0x7fdef80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=952133f79933108e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:36.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.001+0000 7f2527ece700 1 -- start start 2023-10-06T04:43:36.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.001+0000 7fdefeffd700 1 -- 172.21.15.17:0/3387937314 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef800b640 con 0x7fdf0006af20 2023-10-06T04:43:36.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.001+0000 7fdefeffd700 1 -- 172.21.15.17:0/3387937314 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef800b7a0 con 0x7fdf0006af20 2023-10-06T04:43:36.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.001+0000 7fdefeffd700 1 -- 172.21.15.17:0/3387937314 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef800bb40 con 0x7fdf0006af20 2023-10-06T04:43:36.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.001+0000 7f2527ece700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f252006e750 0x7f25200b09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:36.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.001+0000 7fdf06683700 1 -- 172.21.15.17:0/3387937314 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf0006af20 msgr2=0x7fdf0015ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.002+0000 7fdf06683700 1 --2- 172.21.15.17:0/3387937314 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf0006af20 0x7fdf0015ad60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdef80098e0 tx=0x7fdef80091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.001+0000 7f2527ece700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25200ca910 0x7f25200af740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:36.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.001+0000 7f2527ece700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f252015dad0 0x7f25200afc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:36.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.001+0000 7f2527ece700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25200c4440 con 0x7f25200ca910 2023-10-06T04:43:36.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.001+0000 7f2527ece700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25200c4180 con 0x7f252006e750 2023-10-06T04:43:36.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.001+0000 7f2527ece700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25200b1340 con 0x7f252015dad0 2023-10-06T04:43:36.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.002+0000 7fa7572ac700 1 Processor -- start 2023-10-06T04:43:36.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.002+0000 7fa7adeb3700 1 -- 172.21.15.17:0/46417346 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7880052b0 con 0x7fa7a806a860 2023-10-06T04:43:36.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.002+0000 7f2525c6a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f252006e750 0x7f25200b09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:36.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.002+0000 7f2525c6a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f252006e750 0x7f25200b09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.17:32972/0 (socket says 172.21.15.17:32972) 2023-10-06T04:43:36.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.002+0000 7f2525c6a700 1 -- 172.21.15.17:0/2715571240 learned_addr learned my addr 172.21.15.17:0/2715571240 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:36.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.002+0000 7fdf06683700 1 -- 172.21.15.17:0/3387937314 shutdown_connections 2023-10-06T04:43:36.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.002+0000 7fdf06683700 1 --2- 172.21.15.17:0/3387937314 >> v2:172.21.15.136:3300/0 conn(0x7fdf000ae380 0x7fdf00156140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.002+0000 7fdf06683700 1 --2- 172.21.15.17:0/3387937314 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf0006af20 0x7fdf0015ad60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.002+0000 7fdf06683700 1 -- 172.21.15.17:0/3387937314 >> 172.21.15.17:0/3387937314 conn(0x7fdf000cd420 msgr2=0x7fdf000cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:36.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.002+0000 7faa780e3700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa700cb190 0x7faa700b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:36.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.002+0000 7faa780e3700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faa700cb560 0x7faa700b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:36.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.002+0000 7faa780e3700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa70161e40 0x7faa7015b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:36.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.002+0000 7faa780e3700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa700b5340 con 0x7faa700cb190 2023-10-06T04:43:36.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.002+0000 7faa780e3700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa700b4970 con 0x7faa70161e40 2023-10-06T04:43:36.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.002+0000 7faa780e3700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa700b3d60 con 0x7faa700cb560 2023-10-06T04:43:36.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.002+0000 7f2525469700 1 --2- 172.21.15.17:0/2715571240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25200ca910 0x7f25200af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:36.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.002+0000 7fa7572ac700 1 -- start start 2023-10-06T04:43:36.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.002+0000 7f252646b700 1 --2- 172.21.15.17:0/2715571240 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f252015dad0 0x7f25200afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:36.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.002+0000 7faa7567e700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faa700cb560 0x7faa700b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:36.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.002+0000 7faa7567e700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faa700cb560 0x7faa700b3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.17:36354/0 (socket says 172.21.15.17:36354) 2023-10-06T04:43:36.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.002+0000 7faa7567e700 1 -- 172.21.15.17:0/1905951167 learned_addr learned my addr 172.21.15.17:0/1905951167 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:36.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.002+0000 7faa75e7f700 1 --2- 172.21.15.17:0/1905951167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa700cb190 0x7faa700b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:36.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.002+0000 7fdf06683700 1 -- 172.21.15.17:0/3387937314 shutdown_connections 2023-10-06T04:43:36.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.002+0000 7faa76680700 1 --2- 172.21.15.17:0/1905951167 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa70161e40 0x7faa7015b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:36.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.002+0000 7f2525469700 1 -- 172.21.15.17:0/2715571240 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f252015dad0 msgr2=0x7f25200afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.002+0000 7f2525469700 1 --2- 172.21.15.17:0/2715571240 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f252015dad0 0x7f25200afc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.002+0000 7f2525469700 1 -- 172.21.15.17:0/2715571240 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f252006e750 msgr2=0x7f25200b09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.002+0000 7f2525469700 1 --2- 172.21.15.17:0/2715571240 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f252006e750 0x7f25200b09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.002+0000 7f2525469700 1 -- 172.21.15.17:0/2715571240 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f251c009420 con 0x7f25200ca910 2023-10-06T04:43:36.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.002+0000 7f2525c6a700 1 --2- 172.21.15.17:0/2715571240 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f252006e750 0x7f25200b09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:43:36.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.002+0000 7faa75e7f700 1 -- 172.21.15.17:0/1905951167 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faa700cb560 msgr2=0x7faa700b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.002+0000 7faa75e7f700 1 --2- 172.21.15.17:0/1905951167 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faa700cb560 0x7faa700b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.002+0000 7faa75e7f700 1 -- 172.21.15.17:0/1905951167 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa70161e40 msgr2=0x7faa7015b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.002+0000 7faa75e7f700 1 --2- 172.21.15.17:0/1905951167 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa70161e40 0x7faa7015b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.002+0000 7faa75e7f700 1 -- 172.21.15.17:0/1905951167 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa60009480 con 0x7faa700cb190 2023-10-06T04:43:36.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.002+0000 7fdf06683700 1 -- 172.21.15.17:0/3387937314 wait complete. 2023-10-06T04:43:36.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.003+0000 7f2525469700 1 --2- 172.21.15.17:0/2715571240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25200ca910 0x7f25200af740 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f251000c880 tx=0x7f2510008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:36.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.003+0000 7faa75e7f700 1 --2- 172.21.15.17:0/1905951167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa700cb190 0x7faa700b4e00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7faa60014000 tx=0x7faa60015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:36.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.003+0000 7fa7572ac700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa750068000 0x7fa7501639c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:36.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.003+0000 7fa7572ac700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7500c9eb0 0x7fa7500c23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:36.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.003+0000 7fa7572ac700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa750156690 0x7fa7500c2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:36.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.003+0000 7fa7572ac700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75016a7c0 con 0x7fa7500c9eb0 2023-10-06T04:43:36.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.003+0000 7fa7572ac700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa750163f00 con 0x7fa750068000 2023-10-06T04:43:36.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.003+0000 7fa7572ac700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa750169bb0 con 0x7fa750156690 2023-10-06T04:43:36.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.003+0000 7fa755048700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa750068000 0x7fa7501639c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:36.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.003+0000 7fa754847700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7500c9eb0 0x7fa7500c23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:36.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.003+0000 7fa755048700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa750068000 0x7fa7501639c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.17:32990/0 (socket says 172.21.15.17:32990) 2023-10-06T04:43:36.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.003+0000 7fa755048700 1 -- 172.21.15.17:0/542574256 learned_addr learned my addr 172.21.15.17:0/542574256 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:36.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.003+0000 7fa755849700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa750156690 0x7fa7500c2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:36.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.004+0000 7fa755048700 1 -- 172.21.15.17:0/542574256 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa750156690 msgr2=0x7fa7500c2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.004+0000 7fa755048700 1 --2- 172.21.15.17:0/542574256 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa750156690 0x7fa7500c2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.004+0000 7fa755048700 1 -- 172.21.15.17:0/542574256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7500c9eb0 msgr2=0x7fa7500c23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.004+0000 7fa755048700 1 --2- 172.21.15.17:0/542574256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7500c9eb0 0x7fa7500c23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.004+0000 7fa755048700 1 -- 172.21.15.17:0/542574256 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa748009ae0 con 0x7fa750068000 2023-10-06T04:43:36.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.004+0000 7fa754847700 1 --2- 172.21.15.17:0/542574256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7500c9eb0 0x7fa7500c23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:43:36.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.004+0000 7fa78f7fe700 1 -- 172.21.15.17:0/46417346 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa7a0003040 con 0x7fa7a806a860 2023-10-06T04:43:36.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.004+0000 7fdf06683700 1 Processor -- start 2023-10-06T04:43:36.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.004+0000 7fa755048700 1 --2- 172.21.15.17:0/542574256 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa750068000 0x7fa7501639c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa74000b810 tx=0x7fa7400091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:36.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.004+0000 7fdf06683700 1 -- start start 2023-10-06T04:43:36.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.004+0000 7fa78f7fe700 1 --2- 172.21.15.17:0/46417346 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa794066f60 0x7fa794069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:36.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.004+0000 7f2515ffb700 1 -- 172.21.15.17:0/2715571240 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2510011600 con 0x7f25200ca910 2023-10-06T04:43:36.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.004+0000 7f1ce27fc700 1 -- 172.21.15.17:0/3931095914 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce400f510 con 0x7f1cf406bd30 2023-10-06T04:43:36.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.004+0000 7faa65ffb700 1 -- 172.21.15.17:0/1905951167 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa60011ae0 con 0x7faa700cb190 2023-10-06T04:43:36.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.004+0000 7faa65ffb700 1 -- 172.21.15.17:0/1905951167 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa60011c60 con 0x7faa700cb190 2023-10-06T04:43:36.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.004+0000 7faa65ffb700 1 -- 172.21.15.17:0/1905951167 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6001d430 con 0x7faa700cb190 2023-10-06T04:43:36.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.004+0000 7fa78f7fe700 1 -- 172.21.15.17:0/46417346 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa7a0086440 con 0x7fa7a806a860 2023-10-06T04:43:36.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.004+0000 7f331f7fe700 1 -- 172.21.15.17:0/1056744136 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f332c053380 con 0x7f33380abbe0 2023-10-06T04:43:36.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.005+0000 7f2527ece700 1 -- 172.21.15.17:0/2715571240 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25200b1620 con 0x7f25200ca910 2023-10-06T04:43:36.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.005+0000 7fa06bfff700 1 -- 172.21.15.17:0/3738111744 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa074011590 con 0x7fa0840cb190 2023-10-06T04:43:36.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.005+0000 7fa06bfff700 1 -- 172.21.15.17:0/3738111744 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0740116f0 con 0x7fa0840cb190 2023-10-06T04:43:36.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.005+0000 7fa06bfff700 1 -- 172.21.15.17:0/3738111744 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa074011ab0 con 0x7fa0840cb190 2023-10-06T04:43:36.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.005+0000 7fa08a906700 1 -- 172.21.15.17:0/3738111744 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa084160ea0 con 0x7fa0840cb190 2023-10-06T04:43:36.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.005+0000 7f2527ece700 1 -- 172.21.15.17:0/2715571240 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25200b1be0 con 0x7f25200ca910 2023-10-06T04:43:36.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.005+0000 7fa08a906700 1 -- 172.21.15.17:0/3738111744 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa084159300 con 0x7fa0840cb190 2023-10-06T04:43:36.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.005+0000 7fa7a6ffd700 1 --2- 172.21.15.17:0/46417346 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa794066f60 0x7fa794069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:36.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.005+0000 7fdf06683700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf0006af20 0x7fdf00151e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:36.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.005+0000 7faa780e3700 1 -- 172.21.15.17:0/1905951167 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa700b4040 con 0x7faa700cb190 2023-10-06T04:43:36.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.006+0000 7fa7a6ffd700 1 --2- 172.21.15.17:0/46417346 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa794066f60 0x7fa794069410 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa7a80cc3c0 tx=0x7fa798008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:36.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.005+0000 7fdf06683700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf0006b2f0 0x7fdf001713f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:36.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.006+0000 7fdf06683700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf000ae380 0x7fdf00157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:36.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.006+0000 7fdf06683700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf00172390 con 0x7fdf0006af20 2023-10-06T04:43:36.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.006+0000 7fdf06683700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf001523a0 con 0x7fdf0006b2f0 2023-10-06T04:43:36.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.006+0000 7fdf06683700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf00157ab0 con 0x7fdf000ae380 2023-10-06T04:43:36.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.006+0000 7fdeff7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf0006b2f0 0x7fdf001713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:36.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.006+0000 7faa780e3700 1 -- 172.21.15.17:0/1905951167 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa700b4600 con 0x7faa700cb190 2023-10-06T04:43:36.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.006+0000 7fdeff7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf0006b2f0 0x7fdf001713f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.17:33004/0 (socket says 172.21.15.17:33004) 2023-10-06T04:43:36.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.006+0000 7fdeff7fe700 1 -- 172.21.15.17:0/3124007792 learned_addr learned my addr 172.21.15.17:0/3124007792 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:36.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.006+0000 7fdf04c20700 1 --2- 172.21.15.17:0/3124007792 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf000ae380 0x7fdf00157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:36.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.006+0000 7f2527ece700 1 -- 172.21.15.17:0/2715571240 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25200c45b0 con 0x7f25200ca910 2023-10-06T04:43:36.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.006+0000 7fdf04c20700 1 -- 172.21.15.17:0/3124007792 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf0006b2f0 msgr2=0x7fdf001713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.006+0000 7fdf04c20700 1 --2- 172.21.15.17:0/3124007792 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf0006b2f0 0x7fdf001713f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.006+0000 7fdf04c20700 1 -- 172.21.15.17:0/3124007792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf0006af20 msgr2=0x7fdf00151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.006+0000 7fdf04c20700 1 --2- 172.21.15.17:0/3124007792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf0006af20 0x7fdf00151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.006+0000 7fdf04c20700 1 -- 172.21.15.17:0/3124007792 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef8009420 con 0x7fdf000ae380 2023-10-06T04:43:36.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.006+0000 7fdf04c20700 1 --2- 172.21.15.17:0/3124007792 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf000ae380 0x7fdf00157f40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdef000ecf0 tx=0x7fdef000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:36.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.007+0000 7fdef7fff700 1 -- 172.21.15.17:0/3124007792 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef000cb50 con 0x7fdf000ae380 2023-10-06T04:43:36.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.007+0000 7faa780e3700 1 -- 172.21.15.17:0/1905951167 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa70063ff0 con 0x7faa700cb190 2023-10-06T04:43:36.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.007+0000 7fdef7fff700 1 -- 172.21.15.17:0/3124007792 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef000f040 con 0x7fdf000ae380 2023-10-06T04:43:36.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.007+0000 7fdef7fff700 1 -- 172.21.15.17:0/3124007792 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef0014480 con 0x7fdf000ae380 2023-10-06T04:43:36.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.007+0000 7fdf06683700 1 -- 172.21.15.17:0/3124007792 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf00171dd0 con 0x7fdf000ae380 2023-10-06T04:43:36.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.007+0000 7fdf06683700 1 -- 172.21.15.17:0/3124007792 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf00157740 con 0x7fdf000ae380 2023-10-06T04:43:36.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.004+0000 7f1cf8ff6700 1 -- 172.21.15.17:0/3931095914 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf4168b10 con 0x7f1cf406bd30 2023-10-06T04:43:36.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.004+0000 7f1cf8ff6700 1 -- 172.21.15.17:0/3931095914 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf41690d0 con 0x7f1cf406bd30 2023-10-06T04:43:36.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.006+0000 7f1cf8ff6700 1 -- 172.21.15.17:0/3931095914 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf40c4310 con 0x7f1cf406bd30 2023-10-06T04:43:36.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.007+0000 7fa08a906700 1 -- 172.21.15.17:0/3738111744 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0640052b0 con 0x7fa0840cb190 2023-10-06T04:43:36.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.007+0000 7f2515ffb700 1 -- 172.21.15.17:0/2715571240 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2510011760 con 0x7f25200ca910 2023-10-06T04:43:36.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.007+0000 7f2515ffb700 1 -- 172.21.15.17:0/2715571240 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2510011ae0 con 0x7f25200ca910 2023-10-06T04:43:36.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.007+0000 7fa7457fa700 1 -- 172.21.15.17:0/542574256 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74000f510 con 0x7fa750068000 2023-10-06T04:43:36.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.008+0000 7fa78f7fe700 1 -- 172.21.15.17:0/46417346 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa7a00535d0 con 0x7fa7a806a860 2023-10-06T04:43:36.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.007+0000 7fa7457fa700 1 -- 172.21.15.17:0/542574256 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74000f670 con 0x7fa750068000 2023-10-06T04:43:36.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.007+0000 7fa7457fa700 1 -- 172.21.15.17:0/542574256 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74000fa30 con 0x7fa750068000 2023-10-06T04:43:36.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.007+0000 7fa7572ac700 1 -- 172.21.15.17:0/542574256 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa750169e90 con 0x7fa750068000 2023-10-06T04:43:36.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.008+0000 7faa65ffb700 1 -- 172.21.15.17:0/1905951167 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faa6001d860 con 0x7faa700cb190 2023-10-06T04:43:36.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.008+0000 7faa65ffb700 1 --2- 172.21.15.17:0/1905951167 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7faa54066f30 0x7faa540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:36.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.008+0000 7faa65ffb700 1 -- 172.21.15.17:0/1905951167 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7faa60086130 con 0x7faa700cb190 2023-10-06T04:43:36.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.008+0000 7faa7567e700 1 --2- 172.21.15.17:0/1905951167 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7faa54066f30 0x7faa540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:36.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.009+0000 7faa7567e700 1 --2- 172.21.15.17:0/1905951167 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7faa54066f30 0x7faa540693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7faa68009fd0 tx=0x7faa68009820 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:36.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.008+0000 7f1ce27fc700 1 -- 172.21.15.17:0/3931095914 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce400f670 con 0x7f1cf406bd30 2023-10-06T04:43:36.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.008+0000 7f1ce27fc700 1 -- 172.21.15.17:0/3931095914 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce400f9f0 con 0x7f1cf406bd30 2023-10-06T04:43:36.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.007+0000 7fa7572ac700 1 -- 172.21.15.17:0/542574256 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa75016a450 con 0x7fa750068000 2023-10-06T04:43:36.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.009+0000 7f2515ffb700 1 -- 172.21.15.17:0/2715571240 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f251001a450 con 0x7f25200ca910 2023-10-06T04:43:36.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.010+0000 7f2515ffb700 1 --2- 172.21.15.17:0/2715571240 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2504066f30 0x7f25040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:36.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.008+0000 7fdf06683700 1 -- 172.21.15.17:0/3124007792 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf001575a0 con 0x7fdf000ae380 2023-10-06T04:43:36.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.009+0000 7fdef7fff700 1 -- 172.21.15.17:0/3124007792 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdef0014870 con 0x7fdf000ae380 2023-10-06T04:43:36.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.009+0000 7fdef7fff700 1 --2- 172.21.15.17:0/3124007792 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fdee0066f30 0x7fdee00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:36.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.009+0000 7fdef7fff700 1 -- 172.21.15.17:0/3124007792 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdef0084f80 con 0x7fdf000ae380 2023-10-06T04:43:36.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.010+0000 7fdefffff700 1 --2- 172.21.15.17:0/3124007792 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fdee0066f30 0x7fdee00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:36.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.010+0000 7f2525c6a700 1 --2- 172.21.15.17:0/2715571240 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2504066f30 0x7f25040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:36.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.009+0000 7fa7457fa700 1 -- 172.21.15.17:0/542574256 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa74001a400 con 0x7fa750068000 2023-10-06T04:43:36.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.010+0000 7fa7457fa700 1 --2- 172.21.15.17:0/542574256 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa73c0670a0 0x7fa73c069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:36.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.010+0000 7fa7457fa700 1 -- 172.21.15.17:0/542574256 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa7400840a0 con 0x7fa750068000 2023-10-06T04:43:36.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.010+0000 7fa754847700 1 --2- 172.21.15.17:0/542574256 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa73c0670a0 0x7fa73c069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:36.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.010+0000 7fa7572ac700 1 -- 172.21.15.17:0/542574256 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa750063ff0 con 0x7fa750068000 2023-10-06T04:43:36.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.010+0000 7f2525c6a700 1 --2- 172.21.15.17:0/2715571240 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2504066f30 0x7f25040693e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f251c003080 tx=0x7f251c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:36.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.011+0000 7fdefffff700 1 --2- 172.21.15.17:0/3124007792 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fdee0066f30 0x7fdee00693e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdef800a010 tx=0x7fdef8017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:36.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.011+0000 7fa754847700 1 --2- 172.21.15.17:0/542574256 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa73c0670a0 0x7fa73c069550 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa75006c280 tx=0x7fa74c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:36.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.014+0000 7fa06bfff700 1 -- 172.21.15.17:0/3738111744 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa07401b3b0 con 0x7fa0840cb190 2023-10-06T04:43:36.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.014+0000 7fdef7fff700 1 -- 172.21.15.17:0/3124007792 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf001575a0 con 0x7fdf000ae380 2023-10-06T04:43:36.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.014+0000 7fa06bfff700 1 --2- 172.21.15.17:0/3738111744 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa070066f30 0x7fa0700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:36.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.014+0000 7fa06bfff700 1 -- 172.21.15.17:0/3738111744 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa074083e40 con 0x7fa0840cb190 2023-10-06T04:43:36.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.014+0000 7fa0837fe700 1 --2- 172.21.15.17:0/3738111744 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa070066f30 0x7fa0700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:36.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.015+0000 7fa0837fe700 1 --2- 172.21.15.17:0/3738111744 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa070066f30 0x7fa0700693e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa08415d690 tx=0x7fa078009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:36.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.015+0000 7fa7457fa700 1 -- 172.21.15.17:0/542574256 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa740058e60 con 0x7fa750068000 2023-10-06T04:43:36.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.016+0000 7f1ce27fc700 1 -- 172.21.15.17:0/3931095914 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1ce4024430 con 0x7f1cf406bd30 2023-10-06T04:43:36.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.016+0000 7f1ce27fc700 1 --2- 172.21.15.17:0/3931095914 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1cd4066f30 0x7f1cd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:36.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.017+0000 7f1cf1d9b700 1 --2- 172.21.15.17:0/3931095914 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1cd4066f30 0x7f1cd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:36.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.017+0000 7f1cf1d9b700 1 --2- 172.21.15.17:0/3931095914 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1cd4066f30 0x7f1cd40693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1cf40c2c80 tx=0x7f1ce80090f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:36.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.018+0000 7f2515ffb700 1 -- 172.21.15.17:0/2715571240 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2510054eb0 con 0x7f25200ca910 2023-10-06T04:43:36.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.018+0000 7faa65ffb700 1 -- 172.21.15.17:0/1905951167 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faa600531a0 con 0x7faa700cb190 2023-10-06T04:43:36.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.020+0000 7fa06bfff700 1 -- 172.21.15.17:0/3738111744 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa074051080 con 0x7fa0840cb190 2023-10-06T04:43:36.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.028+0000 7f2515ffb700 1 -- 172.21.15.17:0/2715571240 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f25100495a0 con 0x7f25200ca910 2023-10-06T04:43:36.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.028+0000 7f1ce27fc700 1 -- 172.21.15.17:0/3931095914 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1ce4019360 con 0x7f1cf406bd30 2023-10-06T04:43:36.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.037+0000 7f1ce27fc700 1 -- 172.21.15.17:0/3931095914 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ce4051ba0 con 0x7f1cf406bd30 2023-10-06T04:43:36.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.418+0000 7faa780e3700 1 -- 172.21.15.17:0/1905951167 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7faa700cf340 con 0x7faa700cb190 2023-10-06T04:43:36.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.418+0000 7faa65ffb700 1 -- 172.21.15.17:0/1905951167 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faa600567c0 con 0x7faa700cb190 2023-10-06T04:43:36.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.417+0000 7f333e0b9700 1 -- 172.21.15.17:0/1056744136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f333806ccc0 con 0x7f33380abbe0 2023-10-06T04:43:36.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.419+0000 7f331f7fe700 1 -- 172.21.15.17:0/1056744136 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f332c0569a0 con 0x7f33380abbe0 2023-10-06T04:43:36.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.412+0000 7f2527ece700 1 -- 172.21.15.17:0/2715571240 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f25200c7580 con 0x7f25200ca910 2023-10-06T04:43:36.421 INFO:teuthology.orchestra.run.smithi017.stdout:55834574853 2023-10-06T04:43:36.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.416+0000 7fa7572ac700 1 -- 172.21.15.17:0/542574256 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa75006a290 con 0x7fa750068000 2023-10-06T04:43:36.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.417+0000 7fa7457fa700 1 -- 172.21.15.17:0/542574256 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa740051210 con 0x7fa750068000 2023-10-06T04:43:36.422 INFO:teuthology.orchestra.run.smithi017.stdout:55834574852 2023-10-06T04:43:36.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.419+0000 7f2515ffb700 1 -- 172.21.15.17:0/2715571240 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2510015090 con 0x7f25200ca910 2023-10-06T04:43:36.423 INFO:teuthology.orchestra.run.smithi017.stdout:55834574853 2023-10-06T04:43:36.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.421+0000 7fa7572ac700 1 -- 172.21.15.17:0/542574256 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa73c0670a0 msgr2=0x7fa73c069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.421+0000 7fa7572ac700 1 --2- 172.21.15.17:0/542574256 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa73c0670a0 0x7fa73c069550 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa75006c280 tx=0x7fa74c009040 comp rx=0 tx=0).stop 2023-10-06T04:43:36.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.421+0000 7fa7572ac700 1 -- 172.21.15.17:0/542574256 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa750068000 msgr2=0x7fa7501639c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.421+0000 7fa7572ac700 1 --2- 172.21.15.17:0/542574256 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa750068000 0x7fa7501639c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa74000b810 tx=0x7fa7400091d0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.421+0000 7faa780e3700 1 -- 172.21.15.17:0/1905951167 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7faa54066f30 msgr2=0x7faa540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.421+0000 7faa780e3700 1 --2- 172.21.15.17:0/1905951167 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7faa54066f30 0x7faa540693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7faa68009fd0 tx=0x7faa68009820 comp rx=0 tx=0).stop 2023-10-06T04:43:36.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.421+0000 7faa780e3700 1 -- 172.21.15.17:0/1905951167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa700cb190 msgr2=0x7faa700b4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.421+0000 7faa780e3700 1 --2- 172.21.15.17:0/1905951167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa700cb190 0x7faa700b4e00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7faa60014000 tx=0x7faa60015000 comp rx=0 tx=0).stop 2023-10-06T04:43:36.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.423+0000 7faa780e3700 1 -- 172.21.15.17:0/1905951167 shutdown_connections 2023-10-06T04:43:36.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.423+0000 7faa780e3700 1 --2- 172.21.15.17:0/1905951167 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7faa54066f30 0x7faa540693e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.423+0000 7faa780e3700 1 --2- 172.21.15.17:0/1905951167 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa70161e40 0x7faa7015b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.423+0000 7faa780e3700 1 --2- 172.21.15.17:0/1905951167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa700cb190 0x7faa700b4e00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.423+0000 7faa780e3700 1 --2- 172.21.15.17:0/1905951167 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faa700cb560 0x7faa700b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.423+0000 7faa780e3700 1 -- 172.21.15.17:0/1905951167 >> 172.21.15.17:0/1905951167 conn(0x7faa700cd140 msgr2=0x7faa700cd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:36.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.423+0000 7faa780e3700 1 -- 172.21.15.17:0/1905951167 shutdown_connections 2023-10-06T04:43:36.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.423+0000 7faa780e3700 1 -- 172.21.15.17:0/1905951167 wait complete. 2023-10-06T04:43:36.425 INFO:teuthology.orchestra.run.smithi017.stdout:55834574852 2023-10-06T04:43:36.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.424+0000 7fa7572ac700 1 -- 172.21.15.17:0/542574256 shutdown_connections 2023-10-06T04:43:36.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.424+0000 7fa7572ac700 1 --2- 172.21.15.17:0/542574256 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa73c0670a0 0x7fa73c069550 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.424+0000 7fa7572ac700 1 --2- 172.21.15.17:0/542574256 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa750156690 0x7fa7500c2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.424+0000 7fa7572ac700 1 --2- 172.21.15.17:0/542574256 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa750068000 0x7fa7501639c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.424+0000 7fa7572ac700 1 --2- 172.21.15.17:0/542574256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7500c9eb0 0x7fa7500c23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.424+0000 7fa7572ac700 1 -- 172.21.15.17:0/542574256 >> 172.21.15.17:0/542574256 conn(0x7fa75006d030 msgr2=0x7fa7500c8b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:36.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.425+0000 7fa7572ac700 1 -- 172.21.15.17:0/542574256 shutdown_connections 2023-10-06T04:43:36.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.426+0000 7fa7572ac700 1 -- 172.21.15.17:0/542574256 wait complete. 2023-10-06T04:43:36.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.427+0000 7f2527ece700 1 -- 172.21.15.17:0/2715571240 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2504066f30 msgr2=0x7f25040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.427+0000 7f2527ece700 1 --2- 172.21.15.17:0/2715571240 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2504066f30 0x7f25040693e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f251c003080 tx=0x7f251c017000 comp rx=0 tx=0).stop 2023-10-06T04:43:36.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.427+0000 7f2527ece700 1 -- 172.21.15.17:0/2715571240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25200ca910 msgr2=0x7f25200af740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.427+0000 7f2527ece700 1 --2- 172.21.15.17:0/2715571240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25200ca910 0x7f25200af740 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f251000c880 tx=0x7f2510008040 comp rx=0 tx=0).stop 2023-10-06T04:43:36.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.428+0000 7f2527ece700 1 -- 172.21.15.17:0/2715571240 shutdown_connections 2023-10-06T04:43:36.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.428+0000 7f2527ece700 1 --2- 172.21.15.17:0/2715571240 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2504066f30 0x7f25040693e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.428+0000 7f2527ece700 1 --2- 172.21.15.17:0/2715571240 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f252015dad0 0x7f25200afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.428+0000 7f2527ece700 1 --2- 172.21.15.17:0/2715571240 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f252006e750 0x7f25200b09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.428+0000 7f2527ece700 1 --2- 172.21.15.17:0/2715571240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25200ca910 0x7f25200af740 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.428+0000 7f2527ece700 1 -- 172.21.15.17:0/2715571240 >> 172.21.15.17:0/2715571240 conn(0x7f25200ccd10 msgr2=0x7f25200c2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:36.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.428+0000 7f333e0b9700 1 -- 172.21.15.17:0/1056744136 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3324067000 msgr2=0x7f33240694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.428+0000 7f333e0b9700 1 --2- 172.21.15.17:0/1056744136 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3324067000 0x7f33240694b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3328006fd0 tx=0x7f3328008040 comp rx=0 tx=0).stop 2023-10-06T04:43:36.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.428+0000 7f333e0b9700 1 -- 172.21.15.17:0/1056744136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33380abbe0 msgr2=0x7f333816e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.428+0000 7f333e0b9700 1 --2- 172.21.15.17:0/1056744136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33380abbe0 0x7f333816e900 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f332c015000 tx=0x7f332c016000 comp rx=0 tx=0).stop 2023-10-06T04:43:36.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.428+0000 7fa08a906700 1 -- 172.21.15.17:0/3738111744 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fa064005830 con 0x7fa0840cb190 2023-10-06T04:43:36.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.428+0000 7f333e0b9700 1 -- 172.21.15.17:0/1056744136 shutdown_connections 2023-10-06T04:43:36.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.428+0000 7f333e0b9700 1 --2- 172.21.15.17:0/1056744136 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3324067000 0x7f33240694b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.428+0000 7f333e0b9700 1 --2- 172.21.15.17:0/1056744136 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33380bfff0 0x7f3338150000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.428+0000 7f333e0b9700 1 --2- 172.21.15.17:0/1056744136 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f333806a570 0x7f3338151f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.428+0000 7f333e0b9700 1 --2- 172.21.15.17:0/1056744136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33380abbe0 0x7f333816e900 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.428+0000 7f333e0b9700 1 -- 172.21.15.17:0/1056744136 >> 172.21.15.17:0/1056744136 conn(0x7f33380cd600 msgr2=0x7f33380c8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:36.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.428+0000 7fa06bfff700 1 -- 172.21.15.17:0/3738111744 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa074017020 con 0x7fa0840cb190 2023-10-06T04:43:36.432 INFO:teuthology.orchestra.run.smithi017.stdout:55834574852 2023-10-06T04:43:36.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.427+0000 7fa7adeb3700 1 -- 172.21.15.17:0/46417346 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa788005830 con 0x7fa7a806a860 2023-10-06T04:43:36.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.428+0000 7fa78f7fe700 1 -- 172.21.15.17:0/46417346 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa7a0056bf0 con 0x7fa7a806a860 2023-10-06T04:43:36.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.430+0000 7f333e0b9700 1 -- 172.21.15.17:0/1056744136 shutdown_connections 2023-10-06T04:43:36.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.430+0000 7f333e0b9700 1 -- 172.21.15.17:0/1056744136 wait complete. 2023-10-06T04:43:36.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.430+0000 7f2527ece700 1 -- 172.21.15.17:0/2715571240 shutdown_connections 2023-10-06T04:43:36.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.430+0000 7f2527ece700 1 -- 172.21.15.17:0/2715571240 wait complete. 2023-10-06T04:43:36.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.432+0000 7fa08a906700 1 -- 172.21.15.17:0/3738111744 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa070066f30 msgr2=0x7fa0700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.432+0000 7fa08a906700 1 --2- 172.21.15.17:0/3738111744 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa070066f30 0x7fa0700693e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa08415d690 tx=0x7fa078009040 comp rx=0 tx=0).stop 2023-10-06T04:43:36.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.432+0000 7fa08a906700 1 -- 172.21.15.17:0/3738111744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0840cb190 msgr2=0x7fa084157600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.432+0000 7fa08a906700 1 --2- 172.21.15.17:0/3738111744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0840cb190 0x7fa084157600 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa07400c5c0 tx=0x7fa074007f70 comp rx=0 tx=0).stop 2023-10-06T04:43:36.440 INFO:teuthology.orchestra.run.smithi017.stdout:55834574852 2023-10-06T04:43:36.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.440+0000 7fdf06683700 1 -- 172.21.15.17:0/3124007792 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdf001575a0 con 0x7fdf000ae380 2023-10-06T04:43:36.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.441+0000 7fa08a906700 1 -- 172.21.15.17:0/3738111744 shutdown_connections 2023-10-06T04:43:36.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.441+0000 7fa08a906700 1 --2- 172.21.15.17:0/3738111744 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa070066f30 0x7fa0700693e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.441+0000 7fa08a906700 1 --2- 172.21.15.17:0/3738111744 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa08406caa0 0x7fa084160170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.441+0000 7fa08a906700 1 --2- 172.21.15.17:0/3738111744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0840cb190 0x7fa084157600 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.441+0000 7fa08a906700 1 --2- 172.21.15.17:0/3738111744 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa084161e40 0x7fa08406c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.441+0000 7fa08a906700 1 -- 172.21.15.17:0/3738111744 >> 172.21.15.17:0/3738111744 conn(0x7fa0840cd140 msgr2=0x7fa0840cd730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:36.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.442+0000 7fa7adeb3700 1 -- 172.21.15.17:0/46417346 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa794066f60 msgr2=0x7fa794069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.442+0000 7fa7adeb3700 1 --2- 172.21.15.17:0/46417346 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa794066f60 0x7fa794069410 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa7a80cc3c0 tx=0x7fa798008040 comp rx=0 tx=0).stop 2023-10-06T04:43:36.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.442+0000 7fa7adeb3700 1 -- 172.21.15.17:0/46417346 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7a806a860 msgr2=0x7fa7a80c2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.442+0000 7fa7adeb3700 1 --2- 172.21.15.17:0/46417346 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7a806a860 0x7fa7a80c2410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0012000 tx=0x7fa7a0018000 comp rx=0 tx=0).stop 2023-10-06T04:43:36.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.442+0000 7fdef7fff700 1 -- 172.21.15.17:0/3124007792 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdf001575a0 con 0x7fdf000ae380 2023-10-06T04:43:36.444 INFO:teuthology.orchestra.run.smithi017.stdout:55834574853 2023-10-06T04:43:36.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.444+0000 7f1cf8ff6700 1 -- 172.21.15.17:0/3931095914 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f1cf40c4310 con 0x7f1cf406bd30 2023-10-06T04:43:36.446 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2023-10-06T04:43:36.447 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-10-06T04:43:36.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.445+0000 7fa7adeb3700 1 -- 172.21.15.17:0/46417346 shutdown_connections 2023-10-06T04:43:36.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.445+0000 7fa7adeb3700 1 --2- 172.21.15.17:0/46417346 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa794066f60 0x7fa794069410 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.445+0000 7fa7adeb3700 1 --2- 172.21.15.17:0/46417346 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa7a80ac950 0x7fa7a81486b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.445+0000 7fa7adeb3700 1 --2- 172.21.15.17:0/46417346 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7a806a860 0x7fa7a80c2410 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.445+0000 7fa7adeb3700 1 --2- 172.21.15.17:0/46417346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7a80c70d0 0x7fa7a8158fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.445+0000 7fa7adeb3700 1 -- 172.21.15.17:0/46417346 >> 172.21.15.17:0/46417346 conn(0x7fa7a80cd600 msgr2=0x7fa7a80cba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:36.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.445+0000 7f1ce27fc700 1 -- 172.21.15.17:0/3931095914 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1cf40c4310 con 0x7f1cf406bd30 2023-10-06T04:43:36.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.445+0000 7fdf06683700 1 -- 172.21.15.17:0/3124007792 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fdee0066f30 msgr2=0x7fdee00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.445+0000 7fdf06683700 1 --2- 172.21.15.17:0/3124007792 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fdee0066f30 0x7fdee00693e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdef800a010 tx=0x7fdef8017000 comp rx=0 tx=0).stop 2023-10-06T04:43:36.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.445+0000 7fdf06683700 1 -- 172.21.15.17:0/3124007792 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf000ae380 msgr2=0x7fdf00157f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.445+0000 7fdf06683700 1 --2- 172.21.15.17:0/3124007792 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf000ae380 0x7fdf00157f40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdef000ecf0 tx=0x7fdef000b040 comp rx=0 tx=0).stop 2023-10-06T04:43:36.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.445+0000 7fdf06683700 1 -- 172.21.15.17:0/3124007792 shutdown_connections 2023-10-06T04:43:36.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.445+0000 7fdf06683700 1 --2- 172.21.15.17:0/3124007792 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fdee0066f30 0x7fdee00693e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.445+0000 7fdf06683700 1 --2- 172.21.15.17:0/3124007792 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf000ae380 0x7fdf00157f40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.445+0000 7fdf06683700 1 --2- 172.21.15.17:0/3124007792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf0006af20 0x7fdf00151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.445+0000 7fdf06683700 1 --2- 172.21.15.17:0/3124007792 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf0006b2f0 0x7fdf001713f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.445+0000 7fdf06683700 1 -- 172.21.15.17:0/3124007792 >> 172.21.15.17:0/3124007792 conn(0x7fdf000cd420 msgr2=0x7fdf000ca9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:36.449 INFO:teuthology.orchestra.run.smithi017.stdout:55834574852 2023-10-06T04:43:36.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.446+0000 7fa08a906700 1 -- 172.21.15.17:0/3738111744 shutdown_connections 2023-10-06T04:43:36.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.446+0000 7fa08a906700 1 -- 172.21.15.17:0/3738111744 wait complete. 2023-10-06T04:43:36.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.447+0000 7fa7adeb3700 1 -- 172.21.15.17:0/46417346 shutdown_connections 2023-10-06T04:43:36.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.447+0000 7fa7adeb3700 1 -- 172.21.15.17:0/46417346 wait complete. 2023-10-06T04:43:36.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.448+0000 7fdf06683700 1 -- 172.21.15.17:0/3124007792 shutdown_connections 2023-10-06T04:43:36.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.448+0000 7f1cf8ff6700 1 -- 172.21.15.17:0/3931095914 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1cd4066f30 msgr2=0x7f1cd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.448+0000 7f1cf8ff6700 1 --2- 172.21.15.17:0/3931095914 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1cd4066f30 0x7f1cd40693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1cf40c2c80 tx=0x7f1ce80090f0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.448+0000 7f1cf8ff6700 1 -- 172.21.15.17:0/3931095914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cf406bd30 msgr2=0x7f1cf40c38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:36.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.448+0000 7f1cf8ff6700 1 --2- 172.21.15.17:0/3931095914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cf406bd30 0x7f1cf40c38f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1ce400b5e0 tx=0x7f1ce40090f0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.449+0000 7fdf06683700 1 -- 172.21.15.17:0/3124007792 wait complete. 2023-10-06T04:43:36.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.451+0000 7f1cf8ff6700 1 -- 172.21.15.17:0/3931095914 shutdown_connections 2023-10-06T04:43:36.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.451+0000 7f1cf8ff6700 1 --2- 172.21.15.17:0/3931095914 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1cd4066f30 0x7f1cd40693e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.451+0000 7f1cf8ff6700 1 --2- 172.21.15.17:0/3931095914 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1cf40c70f0 0x7f1cf4182a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.451+0000 7f1cf8ff6700 1 --2- 172.21.15.17:0/3931095914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cf406bd30 0x7f1cf40c38f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.451+0000 7f1cf8ff6700 1 --2- 172.21.15.17:0/3931095914 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1cf406e750 0x7f1cf4182540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:36.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.451+0000 7f1cf8ff6700 1 -- 172.21.15.17:0/3931095914 >> 172.21.15.17:0/3931095914 conn(0x7f1cf40ccd10 msgr2=0x7f1cf40871d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:36.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.451+0000 7f1cf8ff6700 1 -- 172.21.15.17:0/3931095914 shutdown_connections 2023-10-06T04:43:36.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:36.451+0000 7f1cf8ff6700 1 -- 172.21.15.17:0/3931095914 wait complete. 2023-10-06T04:43:36.454 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2023-10-06T04:43:36.455 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2023-10-06T04:43:36.464 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2023-10-06T04:43:36.471 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2023-10-06T04:43:36.472 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2023-10-06T04:43:36.474 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.6 2023-10-06T04:43:37.447 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T04:43:37.448 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T04:43:37.455 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T04:43:37.455 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T04:43:37.465 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T04:43:37.472 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T04:43:37.473 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T04:43:37.475 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T04:43:37.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.631+0000 7f4cbef75700 1 Processor -- start 2023-10-06T04:43:37.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.631+0000 7f4cbef75700 1 -- start start 2023-10-06T04:43:37.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.633+0000 7f4cbef75700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4cb80c7620 0x7f4cb806e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.633+0000 7f4cbef75700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f4cb8087ad0 0x7f4cb806e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.633+0000 7f4cbef75700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cb80cb800 con 0x7f4cb8087700 2023-10-06T04:43:37.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.633+0000 7f4cbef75700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cb80cbc90 con 0x7f4cb80c7620 2023-10-06T04:43:37.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.633+0000 7f4cbef75700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cb80cabf0 con 0x7f4cb8087ad0 2023-10-06T04:43:37.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.633+0000 7f4cb7fff700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4cb80c7620 0x7f4cb806e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:37.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.633+0000 7f4cb7fff700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4cb80c7620 0x7f4cb806e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32956/0 (socket says 172.21.15.17:32956) 2023-10-06T04:43:37.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.633+0000 7f4cb7fff700 1 -- 172.21.15.17:0/4017704476 learned_addr learned my addr 172.21.15.17:0/4017704476 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:37.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.634+0000 7f4cbd512700 1 --2- 172.21.15.17:0/4017704476 >> v2:172.21.15.136:3300/0 conn(0x7f4cb8087ad0 0x7f4cb806e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:37.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.634+0000 7f4cb7fff700 1 -- 172.21.15.17:0/4017704476 >> v2:172.21.15.136:3300/0 conn(0x7f4cb8087ad0 msgr2=0x7f4cb806e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:37.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.634+0000 7f4cb7fff700 1 --2- 172.21.15.17:0/4017704476 >> v2:172.21.15.136:3300/0 conn(0x7f4cb8087ad0 0x7f4cb806e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.634+0000 7f4cb7fff700 1 -- 172.21.15.17:0/4017704476 >> v1:172.21.15.136:6789/0 conn(0x7f4cb8087700 legacy=0x7f4cb80c6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:37.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.634+0000 7f4cb7fff700 1 -- 172.21.15.17:0/4017704476 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb80caed0 con 0x7f4cb80c7620 2023-10-06T04:43:37.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.634+0000 7f4cb7fff700 1 --2- 172.21.15.17:0/4017704476 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cb80c7620 0x7f4cb806e210 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4cb80c68b0 tx=0x7f4cb0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee632d07a8b9a154 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:37.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.635+0000 7f4cbd512700 1 --2- 172.21.15.17:0/4017704476 >> v2:172.21.15.136:3300/0 conn(0x7f4cb8087ad0 0x7f4cb806e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:43:37.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.635+0000 7f4cb77fe700 1 -- 172.21.15.17:0/4017704476 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb000e070 con 0x7f4cb80c7620 2023-10-06T04:43:37.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.635+0000 7f4cb77fe700 1 -- 172.21.15.17:0/4017704476 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb000ba50 con 0x7f4cb80c7620 2023-10-06T04:43:37.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.635+0000 7f4cb77fe700 1 -- 172.21.15.17:0/4017704476 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb00092e0 con 0x7f4cb80c7620 2023-10-06T04:43:37.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.636+0000 7f4cbef75700 1 -- 172.21.15.17:0/4017704476 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cb80c7620 msgr2=0x7f4cb806e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:37.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.636+0000 7f4cbef75700 1 --2- 172.21.15.17:0/4017704476 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cb80c7620 0x7f4cb806e210 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4cb80c68b0 tx=0x7f4cb0009840 comp rx=0 tx=0).stop 2023-10-06T04:43:37.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.636+0000 7f4cbef75700 1 -- 172.21.15.17:0/4017704476 shutdown_connections 2023-10-06T04:43:37.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.636+0000 7f4cbef75700 1 --2- 172.21.15.17:0/4017704476 >> v2:172.21.15.136:3300/0 conn(0x7f4cb8087ad0 0x7f4cb806e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.636+0000 7f4cbef75700 1 --2- 172.21.15.17:0/4017704476 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cb80c7620 0x7f4cb806e210 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.637+0000 7f4cbef75700 1 -- 172.21.15.17:0/4017704476 >> 172.21.15.17:0/4017704476 conn(0x7f4cb80ccd10 msgr2=0x7f4cb80c8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:37.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.637+0000 7f4cbef75700 1 -- 172.21.15.17:0/4017704476 shutdown_connections 2023-10-06T04:43:37.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.637+0000 7f4cbef75700 1 -- 172.21.15.17:0/4017704476 wait complete. 2023-10-06T04:43:37.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.639+0000 7f4cbef75700 1 Processor -- start 2023-10-06T04:43:37.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.639+0000 7f4cbef75700 1 -- start start 2023-10-06T04:43:37.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.640+0000 7f4cbef75700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cb8087700 0x7f4cb80ae220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.640+0000 7f4cbef75700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4cb8087ad0 0x7f4cb80c3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.640+0000 7f4cbef75700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4cb80c7620 0x7f4cb8168ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.640+0000 7f4cbef75700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb817ff80 con 0x7f4cb8087700 2023-10-06T04:43:37.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.640+0000 7f4cbef75700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb8169530 con 0x7f4cb80c7620 2023-10-06T04:43:37.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.640+0000 7f4cbef75700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb8169800 con 0x7f4cb8087ad0 2023-10-06T04:43:37.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.641+0000 7f4cbcd11700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cb8087700 0x7f4cb80ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:37.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.641+0000 7f4cbcd11700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cb8087700 0x7f4cb80ae220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32960/0 (socket says 172.21.15.17:32960) 2023-10-06T04:43:37.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.641+0000 7f4cbcd11700 1 -- 172.21.15.17:0/2254827455 learned_addr learned my addr 172.21.15.17:0/2254827455 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:37.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.641+0000 7f4cbcd11700 1 -- 172.21.15.17:0/2254827455 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4cb8087ad0 msgr2=0x7f4cb80c3dc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T04:43:37.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.642+0000 7f4cbcd11700 1 --2- 172.21.15.17:0/2254827455 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4cb8087ad0 0x7f4cb80c3dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.642+0000 7f4cbcd11700 1 -- 172.21.15.17:0/2254827455 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4cb80c7620 msgr2=0x7f4cb8168ff0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T04:43:37.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.642+0000 7f4cbcd11700 1 --2- 172.21.15.17:0/2254827455 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4cb80c7620 0x7f4cb8168ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.642+0000 7f4cbcd11700 1 -- 172.21.15.17:0/2254827455 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb0009ae0 con 0x7f4cb8087700 2023-10-06T04:43:37.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.642+0000 7f4cbcd11700 1 --2- 172.21.15.17:0/2254827455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cb8087700 0x7f4cb80ae220 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4ca800c4e0 tx=0x7f4ca800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:37.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.642+0000 7f4cb4ff9700 1 -- 172.21.15.17:0/2254827455 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca8011590 con 0x7f4cb8087700 2023-10-06T04:43:37.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.642+0000 7f4cb4ff9700 1 -- 172.21.15.17:0/2254827455 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca8011710 con 0x7f4cb8087700 2023-10-06T04:43:37.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.642+0000 7f4cb4ff9700 1 -- 172.21.15.17:0/2254827455 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca8011ad0 con 0x7f4cb8087700 2023-10-06T04:43:37.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.643+0000 7f4cbef75700 1 -- 172.21.15.17:0/2254827455 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cb817f930 con 0x7f4cb8087700 2023-10-06T04:43:37.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.643+0000 7f4cbef75700 1 -- 172.21.15.17:0/2254827455 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cb817f580 con 0x7f4cb8087700 2023-10-06T04:43:37.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.647+0000 7f4cb4ff9700 1 -- 172.21.15.17:0/2254827455 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4ca801b3b0 con 0x7f4cb8087700 2023-10-06T04:43:37.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.647+0000 7f4cb4ff9700 1 --2- 172.21.15.17:0/2254827455 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f4ca4067080 0x7f4ca4069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.647+0000 7f4cb4ff9700 1 -- 172.21.15.17:0/2254827455 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4ca8083bc0 con 0x7f4cb8087700 2023-10-06T04:43:37.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.648+0000 7f4cbef75700 1 -- 172.21.15.17:0/2254827455 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c980052b0 con 0x7f4cb8087700 2023-10-06T04:43:37.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.649+0000 7f5d20d88700 1 Processor -- start 2023-10-06T04:43:37.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.649+0000 7f5d20d88700 1 -- start start 2023-10-06T04:43:37.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.650+0000 7f5d20d88700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f5d1c06e920 0x7f5d1c0c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.650+0000 7f5d20d88700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d1c0cb780 con 0x7f5d1c155990 2023-10-06T04:43:37.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.650+0000 7f5d20d88700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d1c0cab70 con 0x7f5d1c1555c0 2023-10-06T04:43:37.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.650+0000 7f5d20d88700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d1c0cae50 con 0x7f5d1c06e920 2023-10-06T04:43:37.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.651+0000 7f5d1a59c700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f5d1c1555c0 0x7f5d1c06e210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.17:37480/0 (socket says 172.21.15.17:37480) 2023-10-06T04:43:37.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.651+0000 7f5d1a59c700 1 -- 172.21.15.17:0/3610754897 learned_addr learned my addr 172.21.15.17:0/3610754897 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:37.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.651+0000 7f5d19d9b700 1 --2- 172.21.15.17:0/3610754897 >> v2:172.21.15.136:3300/0 conn(0x7f5d1c06e920 0x7f5d1c0c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:37.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.652+0000 7f5d1959a700 1 -- 172.21.15.17:0/3610754897 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 219437114 0 0) 0x7f5d1c0cab70 con 0x7f5d1c1555c0 2023-10-06T04:43:37.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.652+0000 7f5d1959a700 1 -- 172.21.15.17:0/3610754897 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d04003570 con 0x7f5d1c1555c0 2023-10-06T04:43:37.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.652+0000 7f4cb7fff700 1 --2- 172.21.15.17:0/2254827455 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f4ca4067080 0x7f4ca4069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:37.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.653+0000 7f4cb7fff700 1 --2- 172.21.15.17:0/2254827455 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f4ca4067080 0x7f4ca4069530 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4cb806aaa0 tx=0x7f4cb0018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:37.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.653+0000 7f5d1959a700 1 -- 172.21.15.17:0/3610754897 <== mon.1 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3932940674 0 0) 0x7f5d04003570 con 0x7f5d1c1555c0 2023-10-06T04:43:37.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.653+0000 7f5d1959a700 1 -- 172.21.15.17:0/3610754897 >> v2:172.21.15.136:3300/0 conn(0x7f5d1c06e920 msgr2=0x7f5d1c0c9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:37.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.653+0000 7f5d1959a700 1 --2- 172.21.15.17:0/3610754897 >> v2:172.21.15.136:3300/0 conn(0x7f5d1c06e920 0x7f5d1c0c9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.653+0000 7f5d1959a700 1 -- 172.21.15.17:0/3610754897 >> v1:172.21.15.17:6789/0 conn(0x7f5d1c155990 legacy=0x7f5d1c069fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:37.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.653+0000 7f5d1959a700 1 -- 172.21.15.17:0/3610754897 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d1c0cb130 con 0x7f5d1c1555c0 2023-10-06T04:43:37.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.653+0000 7f5d1959a700 1 -- 172.21.15.17:0/3610754897 <== mon.1 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4268781140 0 0) 0x7f5d14005050 con 0x7f5d1c1555c0 2023-10-06T04:43:37.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.653+0000 7f5d1959a700 1 -- 172.21.15.17:0/3610754897 >> v1:172.21.15.136:6789/0 conn(0x7f5d1c1555c0 legacy=0x7f5d1c06e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:37.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.653+0000 7f5d1959a700 1 --2- 172.21.15.17:0/3610754897 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d04003a60 0x7f5d04003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.653+0000 7f5d1959a700 1 --2- 172.21.15.17:0/3610754897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d04004810 0x7f5d04004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.653+0000 7f5d1959a700 1 --2- 172.21.15.17:0/3610754897 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5d040051c0 0x7f5d0400dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.653+0000 7f5d1959a700 1 -- 172.21.15.17:0/3610754897 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1c0cae50 con 0x7f5d04004810 2023-10-06T04:43:37.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.653+0000 7f5d1959a700 1 -- 172.21.15.17:0/3610754897 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0400e370 con 0x7f5d04003a60 2023-10-06T04:43:37.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.653+0000 7f5d1959a700 1 -- 172.21.15.17:0/3610754897 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0400e530 con 0x7f5d040051c0 2023-10-06T04:43:37.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.653+0000 7f5d19d9b700 1 --2- 172.21.15.17:0/3610754897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d04004810 0x7f5d04004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:37.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.654+0000 7f5d19d9b700 1 -- 172.21.15.17:0/3610754897 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5d040051c0 msgr2=0x7f5d0400dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:37.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.654+0000 7f5d19d9b700 1 --2- 172.21.15.17:0/3610754897 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5d040051c0 0x7f5d0400dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.654+0000 7f5d19d9b700 1 -- 172.21.15.17:0/3610754897 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d04003a60 msgr2=0x7f5d04003e70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T04:43:37.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.654+0000 7f5d19d9b700 1 --2- 172.21.15.17:0/3610754897 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d04003a60 0x7f5d04003e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.654+0000 7f5d19d9b700 1 -- 172.21.15.17:0/3610754897 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d1c0cb130 con 0x7f5d04004810 2023-10-06T04:43:37.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.654+0000 7f5d19d9b700 1 --2- 172.21.15.17:0/3610754897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d04004810 0x7f5d04004c80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c06ed20 tx=0x7f5d0c00a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=443006e9c96cc889 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:37.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.654+0000 7f5d1ad9d700 1 -- 172.21.15.17:0/3610754897 reap_dead start 2023-10-06T04:43:37.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.657+0000 7f4cb4ff9700 1 -- 172.21.15.17:0/2254827455 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ca8017080 con 0x7f4cb8087700 2023-10-06T04:43:37.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.657+0000 7f5d1959a700 1 -- 172.21.15.17:0/3610754897 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0c0131a0 con 0x7f5d04004810 2023-10-06T04:43:37.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.657+0000 7f5d1959a700 1 -- 172.21.15.17:0/3610754897 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d0c013300 con 0x7f5d04004810 2023-10-06T04:43:37.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.657+0000 7f5d1959a700 1 -- 172.21.15.17:0/3610754897 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0c013470 con 0x7f5d04004810 2023-10-06T04:43:37.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.658+0000 7f5d20d88700 1 -- 172.21.15.17:0/3610754897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d04004810 msgr2=0x7f5d04004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:37.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.658+0000 7f5d20d88700 1 --2- 172.21.15.17:0/3610754897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d04004810 0x7f5d04004c80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c06ed20 tx=0x7f5d0c00a330 comp rx=0 tx=0).stop 2023-10-06T04:43:37.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.658+0000 7f5d20d88700 1 -- 172.21.15.17:0/3610754897 shutdown_connections 2023-10-06T04:43:37.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.658+0000 7f5d20d88700 1 --2- 172.21.15.17:0/3610754897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d04004810 0x7f5d04004c80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.658+0000 7f5d20d88700 1 -- 172.21.15.17:0/3610754897 >> 172.21.15.17:0/3610754897 conn(0x7f5d1c0ccd10 msgr2=0x7f5d1c0c8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:37.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.658+0000 7f5d20d88700 1 -- 172.21.15.17:0/3610754897 shutdown_connections 2023-10-06T04:43:37.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.658+0000 7f5d20d88700 1 -- 172.21.15.17:0/3610754897 wait complete. 2023-10-06T04:43:37.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.660+0000 7f5d20d88700 1 Processor -- start 2023-10-06T04:43:37.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.660+0000 7f5d20d88700 1 -- start start 2023-10-06T04:43:37.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.661+0000 7f5d20d88700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5d04004810 0x7f5d1c0c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.661+0000 7f5d20d88700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d1c1661a0 0x7f5d1c152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.661+0000 7f5d20d88700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d1c0c2250 0x7f5d1c0c26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.661+0000 7f5d20d88700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1c0c2bf0 con 0x7f5d1c0c2250 2023-10-06T04:43:37.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.661+0000 7f5d20d88700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1c0c6320 con 0x7f5d1c1661a0 2023-10-06T04:43:37.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.661+0000 7f5d20d88700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1c166610 con 0x7f5d04004810 2023-10-06T04:43:37.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.662+0000 7f5d1ad9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d1c0c2250 0x7f5d1c0c26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:37.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.662+0000 7f5d1ad9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d1c0c2250 0x7f5d1c0c26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32972/0 (socket says 172.21.15.17:32972) 2023-10-06T04:43:37.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.662+0000 7f5d1ad9d700 1 -- 172.21.15.17:0/7130669 learned_addr learned my addr 172.21.15.17:0/7130669 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:37.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.662+0000 7f5d1ad9d700 1 -- 172.21.15.17:0/7130669 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5d04004810 msgr2=0x7f5d1c0c53a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T04:43:37.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.662+0000 7f5d1ad9d700 1 --2- 172.21.15.17:0/7130669 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5d04004810 0x7f5d1c0c53a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.662+0000 7f5d1ad9d700 1 -- 172.21.15.17:0/7130669 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d1c1661a0 msgr2=0x7f5d1c152a70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T04:43:37.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.662+0000 7f5d1ad9d700 1 --2- 172.21.15.17:0/7130669 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d1c1661a0 0x7f5d1c152a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.662+0000 7f5d1ad9d700 1 -- 172.21.15.17:0/7130669 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d1c0c5a80 con 0x7f5d1c0c2250 2023-10-06T04:43:37.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.663+0000 7f5d1ad9d700 1 --2- 172.21.15.17:0/7130669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d1c0c2250 0x7f5d1c0c26b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c064dd0 tx=0x7f5d10007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:37.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.663+0000 7f5d0a7fc700 1 -- 172.21.15.17:0/7130669 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d100072e0 con 0x7f5d1c0c2250 2023-10-06T04:43:37.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.663+0000 7f5d0a7fc700 1 -- 172.21.15.17:0/7130669 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d10007440 con 0x7f5d1c0c2250 2023-10-06T04:43:37.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.663+0000 7f5d0a7fc700 1 -- 172.21.15.17:0/7130669 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d10005810 con 0x7f5d1c0c2250 2023-10-06T04:43:37.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.663+0000 7f5d20d88700 1 -- 172.21.15.17:0/7130669 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d1c0c5d60 con 0x7f5d1c0c2250 2023-10-06T04:43:37.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.664+0000 7f5d20d88700 1 -- 172.21.15.17:0/7130669 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d1c166950 con 0x7f5d1c0c2250 2023-10-06T04:43:37.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.667+0000 7f5d0a7fc700 1 -- 172.21.15.17:0/7130669 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5d10005c40 con 0x7f5d1c0c2250 2023-10-06T04:43:37.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.668+0000 7f5d0a7fc700 1 --2- 172.21.15.17:0/7130669 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5d04068ae0 0x7f5d0406af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.668+0000 7f5d0a7fc700 1 -- 172.21.15.17:0/7130669 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5d10083770 con 0x7f5d1c0c2250 2023-10-06T04:43:37.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.668+0000 7f5d1a59c700 1 --2- 172.21.15.17:0/7130669 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5d04068ae0 0x7f5d0406af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:37.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.669+0000 7f5d1a59c700 1 --2- 172.21.15.17:0/7130669 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5d04068ae0 0x7f5d0406af90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5d140013b0 tx=0x7f5d14005140 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:37.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.670+0000 7f5d20d88700 1 -- 172.21.15.17:0/7130669 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d000052b0 con 0x7f5d1c0c2250 2023-10-06T04:43:37.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.677+0000 7f5d0a7fc700 1 -- 172.21.15.17:0/7130669 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5d1004b5a0 con 0x7f5d1c0c2250 2023-10-06T04:43:37.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.706+0000 7f1f34342700 1 Processor -- start 2023-10-06T04:43:37.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.706+0000 7f1f34342700 1 -- start start 2023-10-06T04:43:37.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.706+0000 7f6ba8f88700 1 Processor -- start 2023-10-06T04:43:37.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.706+0000 7f6ba8f88700 1 -- start start 2023-10-06T04:43:37.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.707+0000 7f53bd579700 1 Processor -- start 2023-10-06T04:43:37.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.707+0000 7f1f34342700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1f2c15d940 0x7f1f2c0c6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.707+0000 7f1f34342700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f2c06e920 0x7f1f2c0c73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.707+0000 7f1f34342700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f2c0cb720 con 0x7f1f2c15dd10 2023-10-06T04:43:37.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.707+0000 7f1f34342700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f2c0ca870 con 0x7f1f2c15d940 2023-10-06T04:43:37.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.707+0000 7f1f34342700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c0cab10 con 0x7f1f2c06e920 2023-10-06T04:43:37.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.708+0000 7f6ba8f88700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6ba406e920 0x7f6ba41646c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.708+0000 7f6ba8f88700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ba40c69c0 con 0x7f6ba40ca200 2023-10-06T04:43:37.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.708+0000 7f6ba8f88700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ba40ca700 con 0x7f6ba4159600 2023-10-06T04:43:37.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.708+0000 7f6ba8f88700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ba40aacd0 con 0x7f6ba406e920 2023-10-06T04:43:37.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.708+0000 7f1f320de700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1f2c15d940 0x7f1f2c0c6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:37.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.708+0000 7f1f320de700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1f2c15d940 0x7f1f2c0c6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32986/0 (socket says 172.21.15.17:32986) 2023-10-06T04:43:37.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.708+0000 7f1f320de700 1 -- 172.21.15.17:0/3683344242 learned_addr learned my addr 172.21.15.17:0/3683344242 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:37.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.708+0000 7f1f328df700 1 --2- 172.21.15.17:0/3683344242 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f2c06e920 0x7f1f2c0c73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:37.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.708+0000 7f1f320de700 1 -- 172.21.15.17:0/3683344242 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f2c06e920 msgr2=0x7f1f2c0c73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:37.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.708+0000 7f1f320de700 1 --2- 172.21.15.17:0/3683344242 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f2c06e920 0x7f1f2c0c73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.708+0000 7f1f320de700 1 -- 172.21.15.17:0/3683344242 >> v1:172.21.15.17:6789/0 conn(0x7f1f2c15dd10 legacy=0x7f1f2c06e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:37.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.708+0000 7f1f320de700 1 -- 172.21.15.17:0/3683344242 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f2c0cadf0 con 0x7f1f2c15d940 2023-10-06T04:43:37.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.709+0000 7f1f328df700 1 --2- 172.21.15.17:0/3683344242 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f2c06e920 0x7f1f2c0c73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:43:37.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.709+0000 7f1f320de700 1 --2- 172.21.15.17:0/3683344242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f2c15d940 0x7f1f2c0c6e70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c0099b0 tx=0x7f1f1c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=677323445255b003 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:37.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.707+0000 7f53bd579700 1 -- start start 2023-10-06T04:43:37.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.709+0000 7f53bd579700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f53b80c6ee0 0x7f53b8069ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.709+0000 7f53bd579700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f53b815de40 0x7f53b806a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.709+0000 7f53bd579700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53b80cc610 con 0x7f53b80c72b0 2023-10-06T04:43:37.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.709+0000 7f53bd579700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53b80af620 con 0x7f53b815de40 2023-10-06T04:43:37.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.709+0000 7f53bd579700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53b806aa30 con 0x7f53b80c6ee0 2023-10-06T04:43:37.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.709+0000 7f53b6ffd700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f53b80c6ee0 0x7f53b8069ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:37.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.709+0000 7f53b6ffd700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f53b80c6ee0 0x7f53b8069ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.17:33064/0 (socket says 172.21.15.17:33064) 2023-10-06T04:43:37.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.709+0000 7f53b6ffd700 1 -- 172.21.15.17:0/2855983102 learned_addr learned my addr 172.21.15.17:0/2855983102 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:37.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.709+0000 7f6ba1d9b700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f6ba40ca200 0x7f6ba406e210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:36008/0 (socket says 172.21.15.17:36008) 2023-10-06T04:43:37.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.709+0000 7f6ba1d9b700 1 -- 172.21.15.17:0/1511229903 learned_addr learned my addr 172.21.15.17:0/1511229903 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:37.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.709+0000 7f1f310dc700 1 -- 172.21.15.17:0/3683344242 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c009ea0 con 0x7f1f2c15d940 2023-10-06T04:43:37.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.709+0000 7f1f310dc700 1 -- 172.21.15.17:0/3683344242 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f1c00b760 con 0x7f1f2c15d940 2023-10-06T04:43:37.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.709+0000 7f1f310dc700 1 -- 172.21.15.17:0/3683344242 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c00bb00 con 0x7f1f2c15d940 2023-10-06T04:43:37.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.709+0000 7f53b6ffd700 1 -- 172.21.15.17:0/2855983102 >> v2:172.21.15.17:3300/0 conn(0x7f53b815de40 msgr2=0x7f53b806a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:37.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.709+0000 7f53b6ffd700 1 --2- 172.21.15.17:0/2855983102 >> v2:172.21.15.17:3300/0 conn(0x7f53b815de40 0x7f53b806a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.709+0000 7f53b6ffd700 1 -- 172.21.15.17:0/2855983102 >> v1:172.21.15.136:6789/0 conn(0x7f53b80c72b0 legacy=0x7f53b815d730 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T04:43:37.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.709+0000 7f53b6ffd700 1 -- 172.21.15.17:0/2855983102 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b806ad10 con 0x7f53b80c6ee0 2023-10-06T04:43:37.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.710+0000 7f53b6ffd700 1 --2- 172.21.15.17:0/2855983102 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f53b80c6ee0 0x7f53b8069ec0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f53b80ca170 tx=0x7f53ac009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb38258bb975003c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:37.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.710+0000 7f53b5ffb700 1 -- 172.21.15.17:0/2855983102 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ac00b820 con 0x7f53b80c6ee0 2023-10-06T04:43:37.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.710+0000 7f53b5ffb700 1 -- 172.21.15.17:0/2855983102 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ac00b980 con 0x7f53b80c6ee0 2023-10-06T04:43:37.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.710+0000 7f53b5ffb700 1 -- 172.21.15.17:0/2855983102 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ac00bd20 con 0x7f53b80c6ee0 2023-10-06T04:43:37.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.710+0000 7f1f34342700 1 -- 172.21.15.17:0/3683344242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f2c15d940 msgr2=0x7f1f2c0c6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:37.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.710+0000 7f1f34342700 1 --2- 172.21.15.17:0/3683344242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f2c15d940 0x7f1f2c0c6e70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c0099b0 tx=0x7f1f1c009250 comp rx=0 tx=0).stop 2023-10-06T04:43:37.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.710+0000 7f1f34342700 1 -- 172.21.15.17:0/3683344242 shutdown_connections 2023-10-06T04:43:37.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.710+0000 7f1f34342700 1 --2- 172.21.15.17:0/3683344242 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f2c06e920 0x7f1f2c0c73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.711+0000 7f1f34342700 1 --2- 172.21.15.17:0/3683344242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f2c15d940 0x7f1f2c0c6e70 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.711+0000 7f1f34342700 1 -- 172.21.15.17:0/3683344242 >> 172.21.15.17:0/3683344242 conn(0x7f1f2c06d030 msgr2=0x7f1f2c0cc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:37.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.711+0000 7f1f34342700 1 -- 172.21.15.17:0/3683344242 shutdown_connections 2023-10-06T04:43:37.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.711+0000 7f1f34342700 1 -- 172.21.15.17:0/3683344242 wait complete. 2023-10-06T04:43:37.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.711+0000 7f53bd579700 1 -- 172.21.15.17:0/2855983102 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f53b80c6ee0 msgr2=0x7f53b8069ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:37.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.711+0000 7f53bd579700 1 --2- 172.21.15.17:0/2855983102 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f53b80c6ee0 0x7f53b8069ec0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f53b80ca170 tx=0x7f53ac009250 comp rx=0 tx=0).stop 2023-10-06T04:43:37.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.711+0000 7f53bd579700 1 -- 172.21.15.17:0/2855983102 shutdown_connections 2023-10-06T04:43:37.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.711+0000 7f53bd579700 1 --2- 172.21.15.17:0/2855983102 >> v2:172.21.15.17:3300/0 conn(0x7f53b815de40 0x7f53b806a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.711+0000 7f53bd579700 1 --2- 172.21.15.17:0/2855983102 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f53b80c6ee0 0x7f53b8069ec0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.711+0000 7f53bd579700 1 -- 172.21.15.17:0/2855983102 >> 172.21.15.17:0/2855983102 conn(0x7f53b806e3e0 msgr2=0x7f53b806e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:37.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.711+0000 7f6ba159a700 1 -- 172.21.15.17:0/1511229903 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2243205059 0 0) 0x7f6ba40c69c0 con 0x7f6ba40ca200 2023-10-06T04:43:37.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.711+0000 7f6ba159a700 1 -- 172.21.15.17:0/1511229903 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b8c003570 con 0x7f6ba40ca200 2023-10-06T04:43:37.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.711+0000 7f6ba159a700 1 -- 172.21.15.17:0/1511229903 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1041181322 0 0) 0x7f6ba40ca700 con 0x7f6ba4159600 2023-10-06T04:43:37.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.711+0000 7f6ba159a700 1 -- 172.21.15.17:0/1511229903 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ba40c69c0 con 0x7f6ba4159600 2023-10-06T04:43:37.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.711+0000 7f53bd579700 1 -- 172.21.15.17:0/2855983102 shutdown_connections 2023-10-06T04:43:37.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.711+0000 7f53bd579700 1 -- 172.21.15.17:0/2855983102 wait complete. 2023-10-06T04:43:37.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.712+0000 7f1f34342700 1 Processor -- start 2023-10-06T04:43:37.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.712+0000 7f1f34342700 1 -- start start 2023-10-06T04:43:37.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.713+0000 7f1f34342700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f2c06e920 0x7f1f2c1525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.713+0000 7f1f34342700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f2c15d940 0x7f1f2c06aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.713+0000 7f1f34342700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f2c15dd10 0x7f1f2c06afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.713+0000 7f1f34342700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c0c5580 con 0x7f1f2c06e920 2023-10-06T04:43:37.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.713+0000 7f1f34342700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c1578e0 con 0x7f1f2c15d940 2023-10-06T04:43:37.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.713+0000 7f1f34342700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c157bc0 con 0x7f1f2c15dd10 2023-10-06T04:43:37.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.713+0000 7f1f320de700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f2c06e920 0x7f1f2c1525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:37.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.713+0000 7f1f320de700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f2c06e920 0x7f1f2c1525f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33008/0 (socket says 172.21.15.17:33008) 2023-10-06T04:43:37.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.713+0000 7f1f320de700 1 -- 172.21.15.17:0/3543474226 learned_addr learned my addr 172.21.15.17:0/3543474226 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:37.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.713+0000 7f6ba2d9d700 1 --2- 172.21.15.17:0/1511229903 >> v2:172.21.15.136:3300/0 conn(0x7f6ba406e920 0x7f6ba41646c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:37.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.713+0000 7f1f318dd700 1 --2- 172.21.15.17:0/3543474226 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f2c15d940 0x7f1f2c06aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:37.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.713+0000 7f53bd579700 1 Processor -- start 2023-10-06T04:43:37.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.713+0000 7f53bd579700 1 -- start start 2023-10-06T04:43:37.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.713+0000 7f6ba159a700 1 -- 172.21.15.17:0/1511229903 <== mon.1 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2693767116 0 0) 0x7f6ba40c69c0 con 0x7f6ba4159600 2023-10-06T04:43:37.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.713+0000 7f6ba159a700 1 -- 172.21.15.17:0/1511229903 >> v2:172.21.15.136:3300/0 conn(0x7f6ba406e920 msgr2=0x7f6ba41646c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:37.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.713+0000 7f6ba159a700 1 --2- 172.21.15.17:0/1511229903 >> v2:172.21.15.136:3300/0 conn(0x7f6ba406e920 0x7f6ba41646c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.713+0000 7f6ba159a700 1 -- 172.21.15.17:0/1511229903 >> v1:172.21.15.17:6789/0 conn(0x7f6ba40ca200 legacy=0x7f6ba406e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:37.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.713+0000 7f6ba159a700 1 -- 172.21.15.17:0/1511229903 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba40ca9e0 con 0x7f6ba4159600 2023-10-06T04:43:37.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.713+0000 7f6ba159a700 1 -- 172.21.15.17:0/1511229903 <== mon.1 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4268781140 0 0) 0x7f6b98001320 con 0x7f6ba4159600 2023-10-06T04:43:37.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.713+0000 7f6ba159a700 1 -- 172.21.15.17:0/1511229903 >> v1:172.21.15.136:6789/0 conn(0x7f6ba4159600 legacy=0x7f6ba40aa5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:37.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.713+0000 7f6ba159a700 1 --2- 172.21.15.17:0/1511229903 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6b8c004cd0 0x7f6b8c0050a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.713+0000 7f6ba159a700 1 --2- 172.21.15.17:0/1511229903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b8c0037b0 0x7f6b8c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.713+0000 7f6ba159a700 1 --2- 172.21.15.17:0/1511229903 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6b8c004230 0x7f6b8c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.713+0000 7f6ba159a700 1 -- 172.21.15.17:0/1511229903 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b94001230 con 0x7f6b8c0037b0 2023-10-06T04:43:37.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.713+0000 7f6ba159a700 1 -- 172.21.15.17:0/1511229903 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba40aacd0 con 0x7f6b8c004cd0 2023-10-06T04:43:37.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.713+0000 7f6ba159a700 1 -- 172.21.15.17:0/1511229903 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8c00c2d0 con 0x7f6b8c004230 2023-10-06T04:43:37.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.714+0000 7f6ba1d9b700 1 --2- 172.21.15.17:0/1511229903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b8c0037b0 0x7f6b8c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:37.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.714+0000 7f6ba259c700 1 --2- 172.21.15.17:0/1511229903 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6b8c004cd0 0x7f6b8c0050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:37.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.714+0000 7f6ba259c700 1 -- 172.21.15.17:0/1511229903 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6b8c004230 msgr2=0x7f6b8c00ba60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T04:43:37.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.714+0000 7f6ba259c700 1 --2- 172.21.15.17:0/1511229903 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6b8c004230 0x7f6b8c00ba60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.714+0000 7f6ba259c700 1 -- 172.21.15.17:0/1511229903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b8c0037b0 msgr2=0x7f6b8c003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:37.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.714+0000 7f6ba259c700 1 --2- 172.21.15.17:0/1511229903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b8c0037b0 0x7f6b8c003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.714+0000 7f6ba259c700 1 -- 172.21.15.17:0/1511229903 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba40ca9e0 con 0x7f6b8c004cd0 2023-10-06T04:43:37.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.714+0000 7f6ba259c700 1 --2- 172.21.15.17:0/1511229903 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6b8c004cd0 0x7f6b8c0050a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6b9800c160 tx=0x7f6b98002d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12ba08c29c426495 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:37.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.714+0000 7f53bd579700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53b80c6ee0 0x7f53b8146b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.714+0000 7f53bd579700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f53b80c72b0 0x7f53b81470c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.714+0000 7f53bd579700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f53b815de40 0x7f53b8143e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.714+0000 7f53bd579700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b81452a0 con 0x7f53b80c6ee0 2023-10-06T04:43:37.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.714+0000 7f53bd579700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b8145580 con 0x7f53b80c72b0 2023-10-06T04:43:37.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.714+0000 7f53bd579700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b8145860 con 0x7f53b815de40 2023-10-06T04:43:37.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.715+0000 7f53b77fe700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f53b815de40 0x7f53b8143e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:37.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.715+0000 7f53b6ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53b80c6ee0 0x7f53b8146b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:37.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.714+0000 7f1f320de700 1 -- 172.21.15.17:0/3543474226 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f2c15dd10 msgr2=0x7f1f2c06afd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T04:43:37.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.714+0000 7f1f320de700 1 --2- 172.21.15.17:0/3543474226 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f2c15dd10 0x7f1f2c06afd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.714+0000 7f1f320de700 1 -- 172.21.15.17:0/3543474226 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f2c15d940 msgr2=0x7f1f2c06aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:37.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.714+0000 7f1f320de700 1 --2- 172.21.15.17:0/3543474226 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f2c15d940 0x7f1f2c06aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.714+0000 7f1f320de700 1 -- 172.21.15.17:0/3543474226 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f24009a20 con 0x7f1f2c06e920 2023-10-06T04:43:37.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.715+0000 7f1f320de700 1 --2- 172.21.15.17:0/3543474226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f2c06e920 0x7f1f2c1525f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c0648b0 tx=0x7f1f1c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:37.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.715+0000 7f78176bf700 1 Processor -- start 2023-10-06T04:43:37.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.715+0000 7f78176bf700 1 -- start start 2023-10-06T04:43:37.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.716+0000 7f78176bf700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f781015d940 0x7f78100c6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.716+0000 7f78176bf700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f781015dd10 0x7f78100c73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.716+0000 7f78176bf700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78100cb720 con 0x7f781006e210 2023-10-06T04:43:37.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.716+0000 7f78176bf700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78100ca870 con 0x7f781015dd10 2023-10-06T04:43:37.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.716+0000 7f78176bf700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78100cab10 con 0x7f781015d940 2023-10-06T04:43:37.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.715+0000 7f53b6ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53b80c6ee0 0x7f53b8146b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33038/0 (socket says 172.21.15.17:33038) 2023-10-06T04:43:37.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.715+0000 7f53b77fe700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f53b815de40 0x7f53b8143e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.17:36410/0 (socket says 172.21.15.17:36410) 2023-10-06T04:43:37.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.715+0000 7f53b6ffd700 1 -- 172.21.15.17:0/2417914217 learned_addr learned my addr 172.21.15.17:0/2417914217 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:37.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.715+0000 7f53b77fe700 1 -- 172.21.15.17:0/2417914217 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f53b80c72b0 msgr2=0x7f53b81470c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T04:43:37.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.715+0000 7f53b77fe700 1 --2- 172.21.15.17:0/2417914217 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f53b80c72b0 0x7f53b81470c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.715+0000 7f53b77fe700 1 -- 172.21.15.17:0/2417914217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53b80c6ee0 msgr2=0x7f53b8146b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:37.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.715+0000 7f53b77fe700 1 --2- 172.21.15.17:0/2417914217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53b80c6ee0 0x7f53b8146b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.715+0000 7f53b77fe700 1 -- 172.21.15.17:0/2417914217 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ac0094f0 con 0x7f53b815de40 2023-10-06T04:43:37.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.715+0000 7f53b77fe700 1 --2- 172.21.15.17:0/2417914217 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f53b815de40 0x7f53b8143e90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f53b0009fd0 tx=0x7f53b0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:37.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.715+0000 7f539effd700 1 -- 172.21.15.17:0/2417914217 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b000c7e0 con 0x7f53b815de40 2023-10-06T04:43:37.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.716+0000 7f539effd700 1 -- 172.21.15.17:0/2417914217 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b000c980 con 0x7f53b815de40 2023-10-06T04:43:37.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.716+0000 7f539effd700 1 -- 172.21.15.17:0/2417914217 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b000cd40 con 0x7f53b815de40 2023-10-06T04:43:37.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.717+0000 7f53bd579700 1 -- 172.21.15.17:0/2417914217 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53b8145b40 con 0x7f53b815de40 2023-10-06T04:43:37.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.717+0000 7f53bd579700 1 -- 172.21.15.17:0/2417914217 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53b8144fa0 con 0x7f53b815de40 2023-10-06T04:43:37.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.714+0000 7f6ba159a700 1 -- 172.21.15.17:0/1511229903 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9800ca10 con 0x7f6b8c004cd0 2023-10-06T04:43:37.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.715+0000 7f6ba2d9d700 1 -- 172.21.15.17:0/1511229903 reap_dead start 2023-10-06T04:43:37.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.715+0000 7f6ba159a700 1 -- 172.21.15.17:0/1511229903 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9800cb70 con 0x7f6b8c004cd0 2023-10-06T04:43:37.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.715+0000 7f6ba159a700 1 -- 172.21.15.17:0/1511229903 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b98012420 con 0x7f6b8c004cd0 2023-10-06T04:43:37.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.716+0000 7f6ba8f88700 1 -- 172.21.15.17:0/1511229903 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6b8c004cd0 msgr2=0x7f6b8c0050a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:37.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.716+0000 7f6ba8f88700 1 --2- 172.21.15.17:0/1511229903 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6b8c004cd0 0x7f6b8c0050a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6b9800c160 tx=0x7f6b98002d60 comp rx=0 tx=0).stop 2023-10-06T04:43:37.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.717+0000 7f1f227fc700 1 -- 172.21.15.17:0/3543474226 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c011e30 con 0x7f1f2c06e920 2023-10-06T04:43:37.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.717+0000 7f1f227fc700 1 -- 172.21.15.17:0/3543474226 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f1c01c460 con 0x7f1f2c06e920 2023-10-06T04:43:37.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.717+0000 7f1f227fc700 1 -- 172.21.15.17:0/3543474226 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c01c800 con 0x7f1f2c06e920 2023-10-06T04:43:37.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.717+0000 7f1f34342700 1 -- 172.21.15.17:0/3543474226 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f1c0094f0 con 0x7f1f2c06e920 2023-10-06T04:43:37.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.717+0000 7f1f34342700 1 -- 172.21.15.17:0/3543474226 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f2c158180 con 0x7f1f2c06e920 2023-10-06T04:43:37.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.717+0000 7f7815c5c700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f781006e210 0x7f7810161750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:36022/0 (socket says 172.21.15.17:36022) 2023-10-06T04:43:37.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.717+0000 7f7815c5c700 1 -- 172.21.15.17:0/2650560540 learned_addr learned my addr 172.21.15.17:0/2650560540 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:37.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.718+0000 7f7814c5a700 1 --2- 172.21.15.17:0/2650560540 >> v2:172.21.15.17:3300/0 conn(0x7f781015dd10 0x7f78100c73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:37.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.718+0000 7f7814c5a700 1 -- 172.21.15.17:0/2650560540 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f781015d940 msgr2=0x7f78100c6e70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T04:43:37.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.718+0000 7f7814c5a700 1 --2- 172.21.15.17:0/2650560540 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f781015d940 0x7f78100c6e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.718+0000 7f7814c5a700 1 -- 172.21.15.17:0/2650560540 >> v1:172.21.15.17:6789/0 conn(0x7f781006e210 legacy=0x7f7810161750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:37.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.718+0000 7f7814c5a700 1 -- 172.21.15.17:0/2650560540 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78100cadf0 con 0x7f781015dd10 2023-10-06T04:43:37.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.718+0000 7f53bd579700 1 -- 172.21.15.17:0/2417914217 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53b8146060 con 0x7f53b815de40 2023-10-06T04:43:37.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.718+0000 7f6ba8f88700 1 -- 172.21.15.17:0/1511229903 shutdown_connections 2023-10-06T04:43:37.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.718+0000 7f6ba8f88700 1 --2- 172.21.15.17:0/1511229903 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6b8c004cd0 0x7f6b8c0050a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.718+0000 7f6ba8f88700 1 -- 172.21.15.17:0/1511229903 >> 172.21.15.17:0/1511229903 conn(0x7f6ba40ccd10 msgr2=0x7f6ba40c8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:37.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.719+0000 7f6ba8f88700 1 -- 172.21.15.17:0/1511229903 shutdown_connections 2023-10-06T04:43:37.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.719+0000 7f539effd700 1 -- 172.21.15.17:0/2417914217 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f53b0014620 con 0x7f53b815de40 2023-10-06T04:43:37.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.719+0000 7f7814c5a700 1 --2- 172.21.15.17:0/2650560540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f781015dd10 0x7f78100c73b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f78000098e0 tx=0x7f78000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c525777428f83e3e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:37.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.719+0000 7f6ba8f88700 1 -- 172.21.15.17:0/1511229903 wait complete. 2023-10-06T04:43:37.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.719+0000 7f539effd700 1 --2- 172.21.15.17:0/2417914217 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f53a4066fb0 0x7f53a4069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.720+0000 7f539effd700 1 -- 172.21.15.17:0/2417914217 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f53b0084590 con 0x7f53b815de40 2023-10-06T04:43:37.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.720+0000 7f7807fff700 1 -- 172.21.15.17:0/2650560540 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7800009e80 con 0x7f781015dd10 2023-10-06T04:43:37.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.720+0000 7f7807fff700 1 -- 172.21.15.17:0/2650560540 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780000b860 con 0x7f781015dd10 2023-10-06T04:43:37.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.720+0000 7f7807fff700 1 -- 172.21.15.17:0/2650560540 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780000bc20 con 0x7f781015dd10 2023-10-06T04:43:37.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.720+0000 7f6ba8f88700 1 Processor -- start 2023-10-06T04:43:37.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.720+0000 7f6ba8f88700 1 -- start start 2023-10-06T04:43:37.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.721+0000 7f78176bf700 1 -- 172.21.15.17:0/2650560540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f781015dd10 msgr2=0x7f78100c73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:37.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.721+0000 7f78176bf700 1 --2- 172.21.15.17:0/2650560540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f781015dd10 0x7f78100c73b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f78000098e0 tx=0x7f78000091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.721+0000 7f78176bf700 1 -- 172.21.15.17:0/2650560540 shutdown_connections 2023-10-06T04:43:37.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.721+0000 7f78176bf700 1 --2- 172.21.15.17:0/2650560540 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f781015d940 0x7f78100c6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.721+0000 7f78176bf700 1 --2- 172.21.15.17:0/2650560540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f781015dd10 0x7f78100c73b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.721+0000 7f78176bf700 1 -- 172.21.15.17:0/2650560540 >> 172.21.15.17:0/2650560540 conn(0x7f781006d030 msgr2=0x7f78100cc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:37.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.721+0000 7f78176bf700 1 -- 172.21.15.17:0/2650560540 shutdown_connections 2023-10-06T04:43:37.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.721+0000 7f53b6ffd700 1 --2- 172.21.15.17:0/2417914217 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f53a4066fb0 0x7f53a4069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:37.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.722+0000 7f6ba8f88700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b8c004cd0 0x7f6ba4157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.722+0000 7f6ba8f88700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ba40ad430 0x7f6ba40ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.722+0000 7f6ba8f88700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6ba40c58d0 0x7f6ba40c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.722+0000 7f6ba8f88700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba40b1c40 con 0x7f6b8c004cd0 2023-10-06T04:43:37.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.722+0000 7f6ba8f88700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba40c62b0 con 0x7f6ba40ad430 2023-10-06T04:43:37.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.722+0000 7f6ba8f88700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba40af120 con 0x7f6ba40c58d0 2023-10-06T04:43:37.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.721+0000 7f1f0ffff700 1 -- 172.21.15.17:0/3543474226 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f2c063ff0 con 0x7f1f2c06e920 2023-10-06T04:43:37.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.722+0000 7f53b6ffd700 1 --2- 172.21.15.17:0/2417914217 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f53a4066fb0 0x7f53a4069460 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f53ac003080 tx=0x7f53ac016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:37.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.722+0000 7f6ba2d9d700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6ba40c58d0 0x7f6ba40c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:37.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.722+0000 7f6ba2d9d700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6ba40c58d0 0x7f6ba40c5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.17:36428/0 (socket says 172.21.15.17:36428) 2023-10-06T04:43:37.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.722+0000 7f6ba2d9d700 1 -- 172.21.15.17:0/1074317017 learned_addr learned my addr 172.21.15.17:0/1074317017 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:37.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.722+0000 7f6ba1d9b700 1 --2- 172.21.15.17:0/1074317017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ba40ad430 0x7f6ba40ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:37.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.721+0000 7f78176bf700 1 -- 172.21.15.17:0/2650560540 wait complete. 2023-10-06T04:43:37.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.723+0000 7f78176bf700 1 Processor -- start 2023-10-06T04:43:37.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.723+0000 7f78176bf700 1 -- start start 2023-10-06T04:43:37.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.722+0000 7f1f227fc700 1 -- 172.21.15.17:0/3543474226 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1f1c01cc30 con 0x7f1f2c06e920 2023-10-06T04:43:37.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.723+0000 7f1f227fc700 1 --2- 172.21.15.17:0/3543474226 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1f10067080 0x7f1f10069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.723+0000 7f1f227fc700 1 -- 172.21.15.17:0/3543474226 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1f1c0869d0 con 0x7f1f2c06e920 2023-10-06T04:43:37.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.723+0000 7f1f318dd700 1 --2- 172.21.15.17:0/3543474226 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1f10067080 0x7f1f10069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:37.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.723+0000 7f1f318dd700 1 --2- 172.21.15.17:0/3543474226 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1f10067080 0x7f1f10069530 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c0b2080 tx=0x7f1f28007e20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:37.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.723+0000 7f6ba1d9b700 1 -- 172.21.15.17:0/1074317017 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6ba40c58d0 msgr2=0x7f6ba40c5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:37.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.723+0000 7f6ba1d9b700 1 --2- 172.21.15.17:0/1074317017 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6ba40c58d0 0x7f6ba40c5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.723+0000 7f6ba1d9b700 1 -- 172.21.15.17:0/1074317017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b8c004cd0 msgr2=0x7f6ba4157fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:37.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.723+0000 7f6ba1d9b700 1 --2- 172.21.15.17:0/1074317017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b8c004cd0 0x7f6ba4157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.723+0000 7f6ba1d9b700 1 -- 172.21.15.17:0/1074317017 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba40b0410 con 0x7f6ba40ad430 2023-10-06T04:43:37.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.724+0000 7f539effd700 1 -- 172.21.15.17:0/2417914217 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f53b004c5a0 con 0x7f53b815de40 2023-10-06T04:43:37.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.724+0000 7f78176bf700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f781006e210 0x7f781015e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.724+0000 7f78176bf700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f781015d940 0x7f78100c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.724+0000 7f78176bf700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f781015dd10 0x7f781006b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.724+0000 7f78176bf700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78100c43e0 con 0x7f781015d940 2023-10-06T04:43:37.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.724+0000 7f78176bf700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78100c5220 con 0x7f781006e210 2023-10-06T04:43:37.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.724+0000 7f78176bf700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f781006bda0 con 0x7f781015dd10 2023-10-06T04:43:37.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.724+0000 7f781545b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f781006e210 0x7f781015e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:37.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.724+0000 7f781545b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f781006e210 0x7f781015e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.17:33106/0 (socket says 172.21.15.17:33106) 2023-10-06T04:43:37.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.724+0000 7f781545b700 1 -- 172.21.15.17:0/3248031901 learned_addr learned my addr 172.21.15.17:0/3248031901 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:37.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.724+0000 7f7814c5a700 1 --2- 172.21.15.17:0/3248031901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f781015d940 0x7f78100c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:37.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.725+0000 7f7814c5a700 1 -- 172.21.15.17:0/3248031901 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f781015dd10 msgr2=0x7f781006b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:37.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.725+0000 7f7814c5a700 1 --2- 172.21.15.17:0/3248031901 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f781015dd10 0x7f781006b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.725+0000 7f7814c5a700 1 -- 172.21.15.17:0/3248031901 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f781006e210 msgr2=0x7f781015e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:37.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.725+0000 7f7814c5a700 1 --2- 172.21.15.17:0/3248031901 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f781006e210 0x7f781015e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.725+0000 7f7814c5a700 1 -- 172.21.15.17:0/3248031901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7800009420 con 0x7f781015d940 2023-10-06T04:43:37.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.725+0000 7f781545b700 1 --2- 172.21.15.17:0/3248031901 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f781006e210 0x7f781015e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:43:37.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.725+0000 7f6ba1d9b700 1 --2- 172.21.15.17:0/1074317017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ba40ad430 0x7f6ba40ad8a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6b94007420 tx=0x7f6b94001d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:37.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.725+0000 7f7814c5a700 1 --2- 172.21.15.17:0/3248031901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f781015d940 0x7f78100c3ea0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7800016000 tx=0x7f7800017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:37.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.725+0000 7f6b927fc700 1 -- 172.21.15.17:0/1074317017 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9400fa70 con 0x7f6ba40ad430 2023-10-06T04:43:37.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.725+0000 7f6b927fc700 1 -- 172.21.15.17:0/1074317017 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9400fbd0 con 0x7f6ba40ad430 2023-10-06T04:43:37.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.725+0000 7f6ba8f88700 1 -- 172.21.15.17:0/1074317017 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba40af370 con 0x7f6ba40ad430 2023-10-06T04:43:37.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.725+0000 7f6b927fc700 1 -- 172.21.15.17:0/1074317017 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b940133b0 con 0x7f6ba40ad430 2023-10-06T04:43:37.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.725+0000 7f6ba8f88700 1 -- 172.21.15.17:0/1074317017 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba40af930 con 0x7f6ba40ad430 2023-10-06T04:43:37.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.725+0000 7fe570f5c700 1 Processor -- start 2023-10-06T04:43:37.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.726+0000 7f6ba8f88700 1 -- 172.21.15.17:0/1074317017 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba4063ff0 con 0x7f6ba40ad430 2023-10-06T04:43:37.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.725+0000 7fe570f5c700 1 -- start start 2023-10-06T04:43:37.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.727+0000 7fe570f5c700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe56c15d910 0x7fe56c0b15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.727+0000 7fe570f5c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe56c15dce0 0x7fe56c0b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.727+0000 7fe570f5c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe56c0ce630 0x7fe56c0cead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.727+0000 7fe570f5c700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe56c06a1c0 con 0x7fe56c15d910 2023-10-06T04:43:37.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.727+0000 7fe570f5c700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe56c0cf010 con 0x7fe56c0ce630 2023-10-06T04:43:37.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.727+0000 7fe570f5c700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c0695b0 con 0x7fe56c15dce0 2023-10-06T04:43:37.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.727+0000 7fe56a59c700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe56c15d910 0x7fe56c0b15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:37.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.727+0000 7fe56a59c700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe56c15d910 0x7fe56c0b15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33084/0 (socket says 172.21.15.17:33084) 2023-10-06T04:43:37.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.727+0000 7fe56a59c700 1 -- 172.21.15.17:0/2147384830 learned_addr learned my addr 172.21.15.17:0/2147384830 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:37.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.727+0000 7fe569d9b700 1 --2- 172.21.15.17:0/2147384830 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe56c15dce0 0x7fe56c0b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:37.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.727+0000 7fe56ad9d700 1 --2- 172.21.15.17:0/2147384830 >> v2:172.21.15.136:3300/0 conn(0x7fe56c0ce630 0x7fe56c0cead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:37.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.727+0000 7f6b927fc700 1 -- 172.21.15.17:0/1074317017 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6b940137e0 con 0x7f6ba40ad430 2023-10-06T04:43:37.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.727+0000 7f6b927fc700 1 --2- 172.21.15.17:0/1074317017 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6b84066f30 0x7f6b840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.727+0000 7f6b927fc700 1 -- 172.21.15.17:0/1074317017 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6b94084650 con 0x7f6ba40ad430 2023-10-06T04:43:37.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.727+0000 7fe56a59c700 1 -- 172.21.15.17:0/2147384830 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe56c15dce0 msgr2=0x7fe56c0b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:37.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.727+0000 7fe56a59c700 1 --2- 172.21.15.17:0/2147384830 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe56c15dce0 0x7fe56c0b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.727+0000 7fe56a59c700 1 -- 172.21.15.17:0/2147384830 >> v2:172.21.15.136:3300/0 conn(0x7fe56c0ce630 msgr2=0x7fe56c0cead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:37.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.727+0000 7fe56a59c700 1 --2- 172.21.15.17:0/2147384830 >> v2:172.21.15.136:3300/0 conn(0x7fe56c0ce630 0x7fe56c0cead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.727+0000 7fe56a59c700 1 -- 172.21.15.17:0/2147384830 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe56c069890 con 0x7fe56c15d910 2023-10-06T04:43:37.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.728+0000 7fe56ad9d700 1 --2- 172.21.15.17:0/2147384830 >> v2:172.21.15.136:3300/0 conn(0x7fe56c0ce630 0x7fe56c0cead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:43:37.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.728+0000 7fe56a59c700 1 --2- 172.21.15.17:0/2147384830 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe56c15d910 0x7fe56c0b15b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe56c06f810 tx=0x7fe55c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cccd83505dbfa4a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:37.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.728+0000 7f6ba259c700 1 --2- 172.21.15.17:0/1074317017 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6b84066f30 0x7f6b840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:37.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.729+0000 7f6ba259c700 1 --2- 172.21.15.17:0/1074317017 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6b84066f30 0x7f6b840693e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6b9800c160 tx=0x7f6b98017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:37.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.730+0000 7fe56959a700 1 -- 172.21.15.17:0/2147384830 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c00b860 con 0x7fe56c15d910 2023-10-06T04:43:37.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.730+0000 7f1f227fc700 1 -- 172.21.15.17:0/3543474226 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1f1c053ac0 con 0x7f1f2c06e920 2023-10-06T04:43:37.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.730+0000 7f78057fa700 1 -- 172.21.15.17:0/3248031901 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780001f070 con 0x7f781015d940 2023-10-06T04:43:37.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.730+0000 7f78057fa700 1 -- 172.21.15.17:0/3248031901 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7800000d10 con 0x7f781015d940 2023-10-06T04:43:37.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.730+0000 7f78057fa700 1 -- 172.21.15.17:0/3248031901 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780000bc00 con 0x7f781015d940 2023-10-06T04:43:37.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.730+0000 7fe56959a700 1 -- 172.21.15.17:0/2147384830 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55c00b9c0 con 0x7fe56c15d910 2023-10-06T04:43:37.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.730+0000 7fe56959a700 1 -- 172.21.15.17:0/2147384830 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c00bd60 con 0x7fe56c15d910 2023-10-06T04:43:37.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.730+0000 7f78176bf700 1 -- 172.21.15.17:0/3248031901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78100c4610 con 0x7f781015d940 2023-10-06T04:43:37.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.730+0000 7f78176bf700 1 -- 172.21.15.17:0/3248031901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78100c4bd0 con 0x7f781015d940 2023-10-06T04:43:37.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.732+0000 7f6b927fc700 1 -- 172.21.15.17:0/1074317017 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6b94051760 con 0x7f6ba40ad430 2023-10-06T04:43:37.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.732+0000 7f78057fa700 1 -- 172.21.15.17:0/3248031901 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7800023070 con 0x7f781015d940 2023-10-06T04:43:37.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.733+0000 7f78176bf700 1 -- 172.21.15.17:0/3248031901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f00052b0 con 0x7f781015d940 2023-10-06T04:43:37.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.733+0000 7f78057fa700 1 --2- 172.21.15.17:0/3248031901 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f77f4066f30 0x7f77f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.733+0000 7f78057fa700 1 -- 172.21.15.17:0/3248031901 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7800085650 con 0x7f781015d940 2023-10-06T04:43:37.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.733+0000 7f781545b700 1 --2- 172.21.15.17:0/3248031901 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f77f4066f30 0x7f77f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:37.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.734+0000 7f781545b700 1 --2- 172.21.15.17:0/3248031901 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f77f4066f30 0x7f77f40693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7808009f60 tx=0x7f78080091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:37.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.740+0000 7fe570f5c700 1 -- 172.21.15.17:0/2147384830 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe56c15d910 msgr2=0x7fe56c0b15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:37.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.740+0000 7fe570f5c700 1 --2- 172.21.15.17:0/2147384830 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe56c15d910 0x7fe56c0b15b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe56c06f810 tx=0x7fe55c009250 comp rx=0 tx=0).stop 2023-10-06T04:43:37.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.743+0000 7fe570f5c700 1 -- 172.21.15.17:0/2147384830 shutdown_connections 2023-10-06T04:43:37.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.743+0000 7fe570f5c700 1 --2- 172.21.15.17:0/2147384830 >> v2:172.21.15.136:3300/0 conn(0x7fe56c0ce630 0x7fe56c0cead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.743+0000 7fe570f5c700 1 --2- 172.21.15.17:0/2147384830 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe56c15d910 0x7fe56c0b15b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.743+0000 7fe570f5c700 1 --2- 172.21.15.17:0/2147384830 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe56c15dce0 0x7fe56c0b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.743+0000 7fe570f5c700 1 -- 172.21.15.17:0/2147384830 >> 172.21.15.17:0/2147384830 conn(0x7fe56c067df0 msgr2=0x7fe56c0681f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:37.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.743+0000 7f78057fa700 1 -- 172.21.15.17:0/3248031901 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7800052810 con 0x7f781015d940 2023-10-06T04:43:37.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.744+0000 7f9625706700 1 Processor -- start 2023-10-06T04:43:37.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.744+0000 7f9625706700 1 -- start start 2023-10-06T04:43:37.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.745+0000 7f9625706700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f96201550d0 0x7f9620069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.745+0000 7f9625706700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f962006a310 0x7f962006e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.745+0000 7f9625706700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9620159470 con 0x7f962006e9f0 2023-10-06T04:43:37.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.745+0000 7f9625706700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f962006bde0 con 0x7f96201550d0 2023-10-06T04:43:37.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.745+0000 7f9625706700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f962006a760 con 0x7f962006a310 2023-10-06T04:43:37.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.745+0000 7f961e7fc700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f962006a310 0x7f962006e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:37.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.745+0000 7f961effd700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f96201550d0 0x7f9620069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:37.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.746+0000 7f961e7fc700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f962006a310 0x7f962006e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.17:36460/0 (socket says 172.21.15.17:36460) 2023-10-06T04:43:37.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.746+0000 7f961e7fc700 1 -- 172.21.15.17:0/1215181191 learned_addr learned my addr 172.21.15.17:0/1215181191 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:37.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.746+0000 7fe570f5c700 1 -- 172.21.15.17:0/2147384830 shutdown_connections 2023-10-06T04:43:37.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.746+0000 7fe570f5c700 1 -- 172.21.15.17:0/2147384830 wait complete. 2023-10-06T04:43:37.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.748+0000 7fe570f5c700 1 Processor -- start 2023-10-06T04:43:37.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.746+0000 7f961e7fc700 1 -- 172.21.15.17:0/1215181191 >> v2:172.21.15.136:3300/0 conn(0x7f96201550d0 msgr2=0x7f9620069dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:37.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.746+0000 7f961e7fc700 1 --2- 172.21.15.17:0/1215181191 >> v2:172.21.15.136:3300/0 conn(0x7f96201550d0 0x7f9620069dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.746+0000 7f961e7fc700 1 -- 172.21.15.17:0/1215181191 >> v1:172.21.15.136:6789/0 conn(0x7f962006e9f0 legacy=0x7f962015b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:37.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.746+0000 7f961dffb700 1 -- 172.21.15.17:0/1215181191 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2578530922 0 0) 0x7f9620159470 con 0x7f962006e9f0 2023-10-06T04:43:37.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.746+0000 7f961e7fc700 1 -- 172.21.15.17:0/1215181191 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96201554a0 con 0x7f962006a310 2023-10-06T04:43:37.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.746+0000 7f961e7fc700 1 --2- 172.21.15.17:0/1215181191 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f962006a310 0x7f962006e4b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f96140099b0 tx=0x7f9614009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c3fda5f5738b8d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:37.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.746+0000 7f961dffb700 1 -- 172.21.15.17:0/1215181191 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9614009ea0 con 0x7f962006a310 2023-10-06T04:43:37.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.746+0000 7f961dffb700 1 -- 172.21.15.17:0/1215181191 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961400b860 con 0x7f962006a310 2023-10-06T04:43:37.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.746+0000 7f961dffb700 1 -- 172.21.15.17:0/1215181191 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961400bc00 con 0x7f962006a310 2023-10-06T04:43:37.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.747+0000 7f9625706700 1 -- 172.21.15.17:0/1215181191 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f962006a310 msgr2=0x7f962006e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:37.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.747+0000 7f9625706700 1 --2- 172.21.15.17:0/1215181191 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f962006a310 0x7f962006e4b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f96140099b0 tx=0x7f9614009250 comp rx=0 tx=0).stop 2023-10-06T04:43:37.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.748+0000 7f9625706700 1 -- 172.21.15.17:0/1215181191 shutdown_connections 2023-10-06T04:43:37.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.748+0000 7f9625706700 1 --2- 172.21.15.17:0/1215181191 >> v2:172.21.15.136:3300/0 conn(0x7f96201550d0 0x7f9620069dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.748+0000 7f9625706700 1 --2- 172.21.15.17:0/1215181191 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f962006a310 0x7f962006e4b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.748+0000 7f9625706700 1 -- 172.21.15.17:0/1215181191 >> 172.21.15.17:0/1215181191 conn(0x7f96200ccd10 msgr2=0x7f96200c8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:37.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.748+0000 7fe570f5c700 1 -- start start 2023-10-06T04:43:37.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.749+0000 7fe570f5c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe56c0ce630 0x7fe56c1613e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.749+0000 7fe570f5c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe56c15d910 0x7fe56c15c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.749+0000 7fe570f5c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe56c15dce0 0x7fe56c15c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.749+0000 7fe570f5c700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c13d350 con 0x7fe56c0ce630 2023-10-06T04:43:37.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.749+0000 7fe570f5c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c0cd8b0 con 0x7fe56c15d910 2023-10-06T04:43:37.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.749+0000 7fe570f5c700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c13ca70 con 0x7fe56c15dce0 2023-10-06T04:43:37.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.750+0000 7fe56a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe56c0ce630 0x7fe56c1613e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:37.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.750+0000 7fe56a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe56c0ce630 0x7fe56c1613e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33098/0 (socket says 172.21.15.17:33098) 2023-10-06T04:43:37.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.750+0000 7fe56a59c700 1 -- 172.21.15.17:0/2323707636 learned_addr learned my addr 172.21.15.17:0/2323707636 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:37.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.750+0000 7fe56ad9d700 1 --2- 172.21.15.17:0/2323707636 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe56c15dce0 0x7fe56c15c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:37.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.750+0000 7fe569d9b700 1 --2- 172.21.15.17:0/2323707636 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe56c15d910 0x7fe56c15c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:37.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.750+0000 7fe56ad9d700 1 -- 172.21.15.17:0/2323707636 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe56c15d910 msgr2=0x7fe56c15c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:37.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.750+0000 7fe56ad9d700 1 --2- 172.21.15.17:0/2323707636 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe56c15d910 0x7fe56c15c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.750+0000 7fe56ad9d700 1 -- 172.21.15.17:0/2323707636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe56c0ce630 msgr2=0x7fe56c1613e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:37.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.750+0000 7fe56ad9d700 1 --2- 172.21.15.17:0/2323707636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe56c0ce630 0x7fe56c1613e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.750+0000 7fe56ad9d700 1 -- 172.21.15.17:0/2323707636 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe55c0094f0 con 0x7fe56c15dce0 2023-10-06T04:43:37.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.751+0000 7fe56ad9d700 1 --2- 172.21.15.17:0/2323707636 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe56c15dce0 0x7fe56c15c7f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe56000e8a0 tx=0x7fe560008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:37.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.751+0000 7fe55a7fc700 1 -- 172.21.15.17:0/2323707636 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe560013410 con 0x7fe56c15dce0 2023-10-06T04:43:37.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.751+0000 7fe55a7fc700 1 -- 172.21.15.17:0/2323707636 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe560013570 con 0x7fe56c15dce0 2023-10-06T04:43:37.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.751+0000 7fe55a7fc700 1 -- 172.21.15.17:0/2323707636 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe560013930 con 0x7fe56c15dce0 2023-10-06T04:43:37.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.752+0000 7fe56a59c700 1 --2- 172.21.15.17:0/2323707636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe56c0ce630 0x7fe56c1613e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:43:37.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.750+0000 7f9625706700 1 -- 172.21.15.17:0/1215181191 shutdown_connections 2023-10-06T04:43:37.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.750+0000 7f9625706700 1 -- 172.21.15.17:0/1215181191 wait complete. 2023-10-06T04:43:37.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.752+0000 7f9625706700 1 Processor -- start 2023-10-06T04:43:37.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.753+0000 7f9625706700 1 -- start start 2023-10-06T04:43:37.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.754+0000 7f9625706700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f962006a310 0x7f96200cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.754+0000 7f9625706700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f962006e9f0 0x7f96200ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.754+0000 7f9625706700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96201550d0 0x7f9620149cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.754+0000 7f9625706700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962014ae30 con 0x7f962006e9f0 2023-10-06T04:43:37.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.754+0000 7f9625706700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96200cade0 con 0x7f962006a310 2023-10-06T04:43:37.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.754+0000 7f9625706700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96200cb060 con 0x7f96201550d0 2023-10-06T04:43:37.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.754+0000 7f961effd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f962006a310 0x7f96200cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:37.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.754+0000 7f961effd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f962006a310 0x7f96200cbcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.17:33152/0 (socket says 172.21.15.17:33152) 2023-10-06T04:43:37.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.754+0000 7f961effd700 1 -- 172.21.15.17:0/2368744333 learned_addr learned my addr 172.21.15.17:0/2368744333 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:37.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.754+0000 7f961f7fe700 1 --2- 172.21.15.17:0/2368744333 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96201550d0 0x7f9620149cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:37.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.754+0000 7f961e7fc700 1 --2- 172.21.15.17:0/2368744333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f962006e9f0 0x7f96200ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:37.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.754+0000 7f961effd700 1 -- 172.21.15.17:0/2368744333 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96201550d0 msgr2=0x7f9620149cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:37.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.754+0000 7f961effd700 1 --2- 172.21.15.17:0/2368744333 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96201550d0 0x7f9620149cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.754+0000 7f961effd700 1 -- 172.21.15.17:0/2368744333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f962006e9f0 msgr2=0x7f96200ca8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:37.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.754+0000 7f961effd700 1 --2- 172.21.15.17:0/2368744333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f962006e9f0 0x7f96200ca8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:37.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.754+0000 7f961effd700 1 -- 172.21.15.17:0/2368744333 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96140094f0 con 0x7f962006a310 2023-10-06T04:43:37.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.755+0000 7f961effd700 1 --2- 172.21.15.17:0/2368744333 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f962006a310 0x7f96200cbcd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f961000e930 tx=0x7f96100091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:37.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.755+0000 7fe570f5c700 1 -- 172.21.15.17:0/2323707636 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe56c0cd5d0 con 0x7fe56c15dce0 2023-10-06T04:43:37.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.755+0000 7fe570f5c700 1 -- 172.21.15.17:0/2323707636 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe56c13cfe0 con 0x7fe56c15dce0 2023-10-06T04:43:37.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.757+0000 7fe55a7fc700 1 -- 172.21.15.17:0/2323707636 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe560013ca0 con 0x7fe56c15dce0 2023-10-06T04:43:37.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.758+0000 7fe55a7fc700 1 --2- 172.21.15.17:0/2323707636 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe554067160 0x7fe554069610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.758+0000 7fe55a7fc700 1 -- 172.21.15.17:0/2323707636 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe560084320 con 0x7fe56c15dce0 2023-10-06T04:43:37.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.759+0000 7fe56a59c700 1 --2- 172.21.15.17:0/2323707636 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe554067160 0x7fe554069610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:37.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.760+0000 7fe570f5c700 1 -- 172.21.15.17:0/2323707636 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe56c13d500 con 0x7fe56c15dce0 2023-10-06T04:43:37.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.760+0000 7fe56a59c700 1 --2- 172.21.15.17:0/2323707636 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe554067160 0x7fe554069610 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe55c003080 tx=0x7fe55c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:37.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.760+0000 7f9606ffd700 1 -- 172.21.15.17:0/2368744333 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9610013680 con 0x7f962006a310 2023-10-06T04:43:37.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.760+0000 7f9606ffd700 1 -- 172.21.15.17:0/2368744333 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96100137e0 con 0x7f962006a310 2023-10-06T04:43:37.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.760+0000 7f9606ffd700 1 -- 172.21.15.17:0/2368744333 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9610013b80 con 0x7f962006a310 2023-10-06T04:43:37.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.761+0000 7f9625706700 1 -- 172.21.15.17:0/2368744333 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96200cb340 con 0x7f962006a310 2023-10-06T04:43:37.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.761+0000 7f9625706700 1 -- 172.21.15.17:0/2368744333 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f962014aac0 con 0x7f962006a310 2023-10-06T04:43:37.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.763+0000 7f9606ffd700 1 -- 172.21.15.17:0/2368744333 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f961000c460 con 0x7f962006a310 2023-10-06T04:43:37.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.764+0000 7f9606ffd700 1 --2- 172.21.15.17:0/2368744333 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9608067190 0x7f9608069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:37.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.764+0000 7f9606ffd700 1 -- 172.21.15.17:0/2368744333 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f96100847d0 con 0x7f962006a310 2023-10-06T04:43:37.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.764+0000 7f961e7fc700 1 --2- 172.21.15.17:0/2368744333 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9608067190 0x7f9608069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:37.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.765+0000 7f961e7fc700 1 --2- 172.21.15.17:0/2368744333 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9608067190 0x7f9608069640 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f96140099b0 tx=0x7f9614017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:37.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.771+0000 7f9625706700 1 -- 172.21.15.17:0/2368744333 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96000052b0 con 0x7f962006a310 2023-10-06T04:43:37.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.775+0000 7fe55a7fc700 1 -- 172.21.15.17:0/2323707636 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe56c13d500 con 0x7fe56c15dce0 2023-10-06T04:43:37.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:37.782+0000 7f9606ffd700 1 -- 172.21.15.17:0/2368744333 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f96100518c0 con 0x7f962006a310 2023-10-06T04:43:38.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.061+0000 7f4cbef75700 1 -- 172.21.15.17:0/2254827455 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4c98005560 con 0x7f4cb8087700 2023-10-06T04:43:38.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.068+0000 7f5d20d88700 1 -- 172.21.15.17:0/7130669 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f5d00005560 con 0x7f5d1c0c2250 2023-10-06T04:43:38.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.069+0000 7f5d0a7fc700 1 -- 172.21.15.17:0/7130669 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5d10017070 con 0x7f5d1c0c2250 2023-10-06T04:43:38.071 INFO:teuthology.orchestra.run.smithi017.stdout:55834574854 2023-10-06T04:43:38.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.073+0000 7f4cb4ff9700 1 -- 172.21.15.17:0/2254827455 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4ca8054780 con 0x7f4cb8087700 2023-10-06T04:43:38.074 INFO:teuthology.orchestra.run.smithi017.stdout:55834574853 2023-10-06T04:43:38.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.075+0000 7f5d20d88700 1 -- 172.21.15.17:0/7130669 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5d04068ae0 msgr2=0x7f5d0406af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:38.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.075+0000 7f5d20d88700 1 --2- 172.21.15.17:0/7130669 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5d04068ae0 0x7f5d0406af90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5d140013b0 tx=0x7f5d14005140 comp rx=0 tx=0).stop 2023-10-06T04:43:38.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.075+0000 7f5d20d88700 1 -- 172.21.15.17:0/7130669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d1c0c2250 msgr2=0x7f5d1c0c26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:38.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.075+0000 7f5d20d88700 1 --2- 172.21.15.17:0/7130669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d1c0c2250 0x7f5d1c0c26b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c064dd0 tx=0x7f5d10007d30 comp rx=0 tx=0).stop 2023-10-06T04:43:38.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.075+0000 7f5d20d88700 1 -- 172.21.15.17:0/7130669 shutdown_connections 2023-10-06T04:43:38.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.075+0000 7f5d20d88700 1 --2- 172.21.15.17:0/7130669 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5d04068ae0 0x7f5d0406af90 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5d140013b0 tx=0x7f5d14005140 comp rx=0 tx=0).stop 2023-10-06T04:43:38.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.075+0000 7f5d20d88700 1 --2- 172.21.15.17:0/7130669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d1c0c2250 0x7f5d1c0c26b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.075+0000 7f5d20d88700 1 --2- 172.21.15.17:0/7130669 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5d04004810 0x7f5d1c0c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.075+0000 7f5d20d88700 1 --2- 172.21.15.17:0/7130669 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d1c1661a0 0x7f5d1c152a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.075+0000 7f5d20d88700 1 -- 172.21.15.17:0/7130669 >> 172.21.15.17:0/7130669 conn(0x7f5d1c0ccd10 msgr2=0x7f5d1c154d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:38.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.085+0000 7f5d20d88700 1 -- 172.21.15.17:0/7130669 shutdown_connections 2023-10-06T04:43:38.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.086+0000 7f4cbef75700 1 -- 172.21.15.17:0/2254827455 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f4ca4067080 msgr2=0x7f4ca4069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:38.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.086+0000 7f4cbef75700 1 --2- 172.21.15.17:0/2254827455 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f4ca4067080 0x7f4ca4069530 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4cb806aaa0 tx=0x7f4cb0018000 comp rx=0 tx=0).stop 2023-10-06T04:43:38.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.086+0000 7f4cbef75700 1 -- 172.21.15.17:0/2254827455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cb8087700 msgr2=0x7f4cb80ae220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:38.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.086+0000 7f4cbef75700 1 --2- 172.21.15.17:0/2254827455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cb8087700 0x7f4cb80ae220 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4ca800c4e0 tx=0x7f4ca800c8a0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.086+0000 7f5d20d88700 1 -- 172.21.15.17:0/7130669 wait complete. 2023-10-06T04:43:38.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.086+0000 7f4cbef75700 1 -- 172.21.15.17:0/2254827455 shutdown_connections 2023-10-06T04:43:38.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.086+0000 7f4cbef75700 1 --2- 172.21.15.17:0/2254827455 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f4ca4067080 0x7f4ca4069530 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.086+0000 7f4cbef75700 1 --2- 172.21.15.17:0/2254827455 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4cb80c7620 0x7f4cb8168ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.086+0000 7f4cbef75700 1 --2- 172.21.15.17:0/2254827455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cb8087700 0x7f4cb80ae220 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.086+0000 7f4cbef75700 1 --2- 172.21.15.17:0/2254827455 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4cb8087ad0 0x7f4cb80c3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.086+0000 7f4cbef75700 1 -- 172.21.15.17:0/2254827455 >> 172.21.15.17:0/2254827455 conn(0x7f4cb80ccd10 msgr2=0x7f4cb80c2580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:38.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.086+0000 7f4cbef75700 1 -- 172.21.15.17:0/2254827455 shutdown_connections 2023-10-06T04:43:38.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.087+0000 7f4cbef75700 1 -- 172.21.15.17:0/2254827455 wait complete. 2023-10-06T04:43:38.108 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2023-10-06T04:43:38.108 DEBUG:teuthology.parallel:result is None 2023-10-06T04:43:38.109 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-10-06T04:43:38.109 DEBUG:teuthology.parallel:result is None 2023-10-06T04:43:38.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.117+0000 7f78176bf700 1 -- 172.21.15.17:0/3248031901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f77f0005830 con 0x7f781015d940 2023-10-06T04:43:38.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.117+0000 7f78057fa700 1 -- 172.21.15.17:0/3248031901 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f780002a030 con 0x7f781015d940 2023-10-06T04:43:38.119 INFO:teuthology.orchestra.run.smithi017.stdout:55834574854 2023-10-06T04:43:38.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.121+0000 7f78176bf700 1 -- 172.21.15.17:0/3248031901 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f77f4066f30 msgr2=0x7f77f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:38.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.121+0000 7f78176bf700 1 --2- 172.21.15.17:0/3248031901 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f77f4066f30 0x7f77f40693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7808009f60 tx=0x7f78080091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.121+0000 7f78176bf700 1 -- 172.21.15.17:0/3248031901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f781015d940 msgr2=0x7f78100c3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:38.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.121+0000 7f78176bf700 1 --2- 172.21.15.17:0/3248031901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f781015d940 0x7f78100c3ea0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7800016000 tx=0x7f7800017000 comp rx=0 tx=0).stop 2023-10-06T04:43:38.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.122+0000 7f78176bf700 1 -- 172.21.15.17:0/3248031901 shutdown_connections 2023-10-06T04:43:38.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.122+0000 7f78176bf700 1 --2- 172.21.15.17:0/3248031901 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f77f4066f30 0x7f77f40693e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.122+0000 7f78176bf700 1 --2- 172.21.15.17:0/3248031901 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f781015dd10 0x7f781006b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.122+0000 7f78176bf700 1 --2- 172.21.15.17:0/3248031901 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f781006e210 0x7f781015e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.122+0000 7f78176bf700 1 --2- 172.21.15.17:0/3248031901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f781015d940 0x7f78100c3ea0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.122+0000 7f78176bf700 1 -- 172.21.15.17:0/3248031901 >> 172.21.15.17:0/3248031901 conn(0x7f781006d030 msgr2=0x7f781014b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:38.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.123+0000 7f78176bf700 1 -- 172.21.15.17:0/3248031901 shutdown_connections 2023-10-06T04:43:38.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.123+0000 7f78176bf700 1 -- 172.21.15.17:0/3248031901 wait complete. 2023-10-06T04:43:38.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.126+0000 7f6ba8f88700 1 -- 172.21.15.17:0/1074317017 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6ba40c6c60 con 0x7f6ba40ad430 2023-10-06T04:43:38.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.133+0000 7f6b927fc700 1 -- 172.21.15.17:0/1074317017 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6b94054d80 con 0x7f6ba40ad430 2023-10-06T04:43:38.134 INFO:teuthology.orchestra.run.smithi017.stdout:55834574854 2023-10-06T04:43:38.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.133+0000 7f1f0ffff700 1 -- 172.21.15.17:0/3543474226 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1f2c063ff0 con 0x7f1f2c06e920 2023-10-06T04:43:38.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.133+0000 7f1f227fc700 1 -- 172.21.15.17:0/3543474226 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1f1c009350 con 0x7f1f2c06e920 2023-10-06T04:43:38.135 INFO:teuthology.orchestra.run.smithi017.stdout:55834574853 2023-10-06T04:43:38.138 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2023-10-06T04:43:38.139 DEBUG:teuthology.parallel:result is None 2023-10-06T04:43:38.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.136+0000 7f6ba8f88700 1 -- 172.21.15.17:0/1074317017 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6b84066f30 msgr2=0x7f6b840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:38.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.136+0000 7f6ba8f88700 1 --2- 172.21.15.17:0/1074317017 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6b84066f30 0x7f6b840693e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6b9800c160 tx=0x7f6b98017000 comp rx=0 tx=0).stop 2023-10-06T04:43:38.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.136+0000 7f6ba8f88700 1 -- 172.21.15.17:0/1074317017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ba40ad430 msgr2=0x7f6ba40ad8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:38.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.136+0000 7f6ba8f88700 1 --2- 172.21.15.17:0/1074317017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ba40ad430 0x7f6ba40ad8a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6b94007420 tx=0x7f6b94001d20 comp rx=0 tx=0).stop 2023-10-06T04:43:38.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.137+0000 7f6ba8f88700 1 -- 172.21.15.17:0/1074317017 shutdown_connections 2023-10-06T04:43:38.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.137+0000 7f6ba8f88700 1 --2- 172.21.15.17:0/1074317017 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6b84066f30 0x7f6b840693e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.137+0000 7f6ba8f88700 1 --2- 172.21.15.17:0/1074317017 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6ba40c58d0 0x7f6ba40c5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.137+0000 7f6ba8f88700 1 --2- 172.21.15.17:0/1074317017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b8c004cd0 0x7f6ba4157fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.137+0000 7f6ba8f88700 1 --2- 172.21.15.17:0/1074317017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ba40ad430 0x7f6ba40ad8a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.137+0000 7f6ba8f88700 1 -- 172.21.15.17:0/1074317017 >> 172.21.15.17:0/1074317017 conn(0x7f6ba40ccd10 msgr2=0x7f6ba40c8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:38.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.137+0000 7f1f0ffff700 1 -- 172.21.15.17:0/3543474226 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1f10067080 msgr2=0x7f1f10069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:38.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.137+0000 7f1f0ffff700 1 --2- 172.21.15.17:0/3543474226 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1f10067080 0x7f1f10069530 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c0b2080 tx=0x7f1f28007e20 comp rx=0 tx=0).stop 2023-10-06T04:43:38.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.137+0000 7f1f0ffff700 1 -- 172.21.15.17:0/3543474226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f2c06e920 msgr2=0x7f1f2c1525f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:38.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.137+0000 7f1f0ffff700 1 --2- 172.21.15.17:0/3543474226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f2c06e920 0x7f1f2c1525f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c0648b0 tx=0x7f1f1c016000 comp rx=0 tx=0).stop 2023-10-06T04:43:38.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.137+0000 7f1f0ffff700 1 -- 172.21.15.17:0/3543474226 shutdown_connections 2023-10-06T04:43:38.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.137+0000 7f1f0ffff700 1 --2- 172.21.15.17:0/3543474226 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1f10067080 0x7f1f10069530 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.137+0000 7f1f0ffff700 1 --2- 172.21.15.17:0/3543474226 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f2c15dd10 0x7f1f2c06afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.137+0000 7f1f0ffff700 1 --2- 172.21.15.17:0/3543474226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f2c06e920 0x7f1f2c1525f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.137+0000 7f1f0ffff700 1 --2- 172.21.15.17:0/3543474226 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f2c15d940 0x7f1f2c06aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.137+0000 7f1f0ffff700 1 -- 172.21.15.17:0/3543474226 >> 172.21.15.17:0/3543474226 conn(0x7f1f2c06d030 msgr2=0x7f1f2c15a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:38.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.137+0000 7f1f0ffff700 1 -- 172.21.15.17:0/3543474226 shutdown_connections 2023-10-06T04:43:38.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.137+0000 7f1f0ffff700 1 -- 172.21.15.17:0/3543474226 wait complete. 2023-10-06T04:43:38.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.138+0000 7f53bd579700 1 -- 172.21.15.17:0/2417914217 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f53b8063ff0 con 0x7f53b815de40 2023-10-06T04:43:38.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.139+0000 7f539effd700 1 -- 172.21.15.17:0/2417914217 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f53b8146060 con 0x7f53b815de40 2023-10-06T04:43:38.143 INFO:teuthology.orchestra.run.smithi017.stdout:55834574853 2023-10-06T04:43:38.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.141+0000 7f53bd579700 1 -- 172.21.15.17:0/2417914217 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f53a4066fb0 msgr2=0x7f53a4069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:38.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.141+0000 7f6ba8f88700 1 -- 172.21.15.17:0/1074317017 shutdown_connections 2023-10-06T04:43:38.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.141+0000 7f53bd579700 1 --2- 172.21.15.17:0/2417914217 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f53a4066fb0 0x7f53a4069460 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f53ac003080 tx=0x7f53ac016000 comp rx=0 tx=0).stop 2023-10-06T04:43:38.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.141+0000 7f53bd579700 1 -- 172.21.15.17:0/2417914217 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f53b815de40 msgr2=0x7f53b8143e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:38.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.141+0000 7f53bd579700 1 --2- 172.21.15.17:0/2417914217 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f53b815de40 0x7f53b8143e90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f53b0009fd0 tx=0x7f53b0009780 comp rx=0 tx=0).stop 2023-10-06T04:43:38.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.141+0000 7f6ba8f88700 1 -- 172.21.15.17:0/1074317017 wait complete. 2023-10-06T04:43:38.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.141+0000 7f53bd579700 1 -- 172.21.15.17:0/2417914217 shutdown_connections 2023-10-06T04:43:38.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.141+0000 7f53bd579700 1 --2- 172.21.15.17:0/2417914217 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f53a4066fb0 0x7f53a4069460 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.141+0000 7f53bd579700 1 --2- 172.21.15.17:0/2417914217 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f53b815de40 0x7f53b8143e90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.141+0000 7f53bd579700 1 --2- 172.21.15.17:0/2417914217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53b80c6ee0 0x7f53b8146b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.141+0000 7f53bd579700 1 --2- 172.21.15.17:0/2417914217 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f53b80c72b0 0x7f53b81470c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.141+0000 7f53bd579700 1 -- 172.21.15.17:0/2417914217 >> 172.21.15.17:0/2417914217 conn(0x7f53b806e3e0 msgr2=0x7f53b80affc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:38.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.144+0000 7f53bd579700 1 -- 172.21.15.17:0/2417914217 shutdown_connections 2023-10-06T04:43:38.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.144+0000 7f53bd579700 1 -- 172.21.15.17:0/2417914217 wait complete. 2023-10-06T04:43:38.159 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2023-10-06T04:43:38.160 DEBUG:teuthology.parallel:result is None 2023-10-06T04:43:38.160 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2023-10-06T04:43:38.160 DEBUG:teuthology.parallel:result is None 2023-10-06T04:43:38.162 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2023-10-06T04:43:38.163 DEBUG:teuthology.parallel:result is None 2023-10-06T04:43:38.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.163+0000 7fe570f5c700 1 -- 172.21.15.17:0/2323707636 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fe56c13d500 con 0x7fe56c15dce0 2023-10-06T04:43:38.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.163+0000 7fe55a7fc700 1 -- 172.21.15.17:0/2323707636 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe56c13d500 con 0x7fe56c15dce0 2023-10-06T04:43:38.165 INFO:teuthology.orchestra.run.smithi017.stdout:55834574853 2023-10-06T04:43:38.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.165+0000 7f9625706700 1 -- 172.21.15.17:0/2368744333 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9600005560 con 0x7f962006a310 2023-10-06T04:43:38.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.165+0000 7fe570f5c700 1 -- 172.21.15.17:0/2323707636 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe554067160 msgr2=0x7fe554069610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:38.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.165+0000 7fe570f5c700 1 --2- 172.21.15.17:0/2323707636 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe554067160 0x7fe554069610 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe55c003080 tx=0x7fe55c017000 comp rx=0 tx=0).stop 2023-10-06T04:43:38.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.165+0000 7fe570f5c700 1 -- 172.21.15.17:0/2323707636 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe56c15dce0 msgr2=0x7fe56c15c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:38.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.165+0000 7fe570f5c700 1 --2- 172.21.15.17:0/2323707636 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe56c15dce0 0x7fe56c15c7f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe56000e8a0 tx=0x7fe560008040 comp rx=0 tx=0).stop 2023-10-06T04:43:38.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.166+0000 7fe570f5c700 1 -- 172.21.15.17:0/2323707636 shutdown_connections 2023-10-06T04:43:38.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.166+0000 7fe570f5c700 1 --2- 172.21.15.17:0/2323707636 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe554067160 0x7fe554069610 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.166+0000 7fe570f5c700 1 --2- 172.21.15.17:0/2323707636 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe56c15dce0 0x7fe56c15c7f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.166+0000 7fe570f5c700 1 --2- 172.21.15.17:0/2323707636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe56c0ce630 0x7fe56c1613e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.166+0000 7fe570f5c700 1 --2- 172.21.15.17:0/2323707636 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe56c15d910 0x7fe56c15c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.166+0000 7fe570f5c700 1 -- 172.21.15.17:0/2323707636 >> 172.21.15.17:0/2323707636 conn(0x7fe56c067df0 msgr2=0x7fe56c0add30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:38.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.166+0000 7fe570f5c700 1 -- 172.21.15.17:0/2323707636 shutdown_connections 2023-10-06T04:43:38.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.166+0000 7fe570f5c700 1 -- 172.21.15.17:0/2323707636 wait complete. 2023-10-06T04:43:38.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.166+0000 7f9606ffd700 1 -- 172.21.15.17:0/2368744333 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9610021020 con 0x7f962006a310 2023-10-06T04:43:38.170 INFO:teuthology.orchestra.run.smithi017.stdout:55834574853 2023-10-06T04:43:38.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.168+0000 7f9625706700 1 -- 172.21.15.17:0/2368744333 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9608067190 msgr2=0x7f9608069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:38.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.168+0000 7f9625706700 1 --2- 172.21.15.17:0/2368744333 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9608067190 0x7f9608069640 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f96140099b0 tx=0x7f9614017000 comp rx=0 tx=0).stop 2023-10-06T04:43:38.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.168+0000 7f9625706700 1 -- 172.21.15.17:0/2368744333 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f962006a310 msgr2=0x7f96200cbcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:38.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.168+0000 7f9625706700 1 --2- 172.21.15.17:0/2368744333 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f962006a310 0x7f96200cbcd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f961000e930 tx=0x7f96100091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.168+0000 7f9625706700 1 -- 172.21.15.17:0/2368744333 shutdown_connections 2023-10-06T04:43:38.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.168+0000 7f9625706700 1 --2- 172.21.15.17:0/2368744333 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9608067190 0x7f9608069640 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.168+0000 7f9625706700 1 --2- 172.21.15.17:0/2368744333 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96201550d0 0x7f9620149cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.168+0000 7f9625706700 1 --2- 172.21.15.17:0/2368744333 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f962006a310 0x7f96200cbcd0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.168+0000 7f9625706700 1 --2- 172.21.15.17:0/2368744333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f962006e9f0 0x7f96200ca8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.168+0000 7f9625706700 1 -- 172.21.15.17:0/2368744333 >> 172.21.15.17:0/2368744333 conn(0x7f96200ccd10 msgr2=0x7f962014d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:38.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.169+0000 7f9625706700 1 -- 172.21.15.17:0/2368744333 shutdown_connections 2023-10-06T04:43:38.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.169+0000 7f9625706700 1 -- 172.21.15.17:0/2368744333 wait complete. 2023-10-06T04:43:38.180 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.6 2023-10-06T04:43:38.180 DEBUG:teuthology.parallel:result is None 2023-10-06T04:43:38.183 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2023-10-06T04:43:38.183 DEBUG:teuthology.parallel:result is None 2023-10-06T04:43:38.183 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T04:43:38.183 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:43:38.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.339+0000 7ff142633700 1 Processor -- start 2023-10-06T04:43:38.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.339+0000 7ff142633700 1 -- start start 2023-10-06T04:43:38.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.340+0000 7ff142633700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff13c159630 0x7ff13c0cd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:38.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.340+0000 7ff142633700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff13c0cd590 0x7ff13c0ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:38.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.340+0000 7ff142633700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff13c0ce840 0x7ff13c15d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:38.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.340+0000 7ff142633700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff13c0cda00 con 0x7ff13c159630 2023-10-06T04:43:38.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.340+0000 7ff142633700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff13c0cfc80 con 0x7ff13c0cd590 2023-10-06T04:43:38.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.340+0000 7ff142633700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c0cf070 con 0x7ff13c0ce840 2023-10-06T04:43:38.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.340+0000 7ff13bfff700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff13c159630 0x7ff13c0cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:38.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.340+0000 7ff13bfff700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff13c159630 0x7ff13c0cd050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33126/0 (socket says 172.21.15.17:33126) 2023-10-06T04:43:38.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.340+0000 7ff13bfff700 1 -- 172.21.15.17:0/181193745 learned_addr learned my addr 172.21.15.17:0/181193745 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:38.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.341+0000 7ff13b7fe700 1 --2- 172.21.15.17:0/181193745 >> v2:172.21.15.136:3300/0 conn(0x7ff13c0cd590 0x7ff13c0ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:38.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.341+0000 7ff140bd0700 1 --2- 172.21.15.17:0/181193745 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff13c0ce840 0x7ff13c15d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:38.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.341+0000 7ff13bfff700 1 -- 172.21.15.17:0/181193745 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff13c0ce840 msgr2=0x7ff13c15d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:38.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.341+0000 7ff13bfff700 1 --2- 172.21.15.17:0/181193745 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff13c0ce840 0x7ff13c15d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.341+0000 7ff13bfff700 1 -- 172.21.15.17:0/181193745 >> v2:172.21.15.136:3300/0 conn(0x7ff13c0cd590 msgr2=0x7ff13c0ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:38.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.341+0000 7ff13bfff700 1 --2- 172.21.15.17:0/181193745 >> v2:172.21.15.136:3300/0 conn(0x7ff13c0cd590 0x7ff13c0ce300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.341+0000 7ff13bfff700 1 -- 172.21.15.17:0/181193745 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13c0cf350 con 0x7ff13c159630 2023-10-06T04:43:38.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.341+0000 7ff13bfff700 1 --2- 172.21.15.17:0/181193745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff13c159630 0x7ff13c0cd050 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff13c04bc70 tx=0x7ff124009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb2cf568bcc0140 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:38.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.341+0000 7ff13affd700 1 -- 172.21.15.17:0/181193745 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12400b860 con 0x7ff13c159630 2023-10-06T04:43:38.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.341+0000 7ff13affd700 1 -- 172.21.15.17:0/181193745 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff12400b9c0 con 0x7ff13c159630 2023-10-06T04:43:38.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.341+0000 7ff13affd700 1 -- 172.21.15.17:0/181193745 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12400bd60 con 0x7ff13c159630 2023-10-06T04:43:38.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.341+0000 7ff142633700 1 -- 172.21.15.17:0/181193745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff13c159630 msgr2=0x7ff13c0cd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:38.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.341+0000 7ff142633700 1 --2- 172.21.15.17:0/181193745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff13c159630 0x7ff13c0cd050 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff13c04bc70 tx=0x7ff124009250 comp rx=0 tx=0).stop 2023-10-06T04:43:38.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.342+0000 7ff142633700 1 -- 172.21.15.17:0/181193745 shutdown_connections 2023-10-06T04:43:38.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.342+0000 7ff142633700 1 --2- 172.21.15.17:0/181193745 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff13c0ce840 0x7ff13c15d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.342+0000 7ff142633700 1 --2- 172.21.15.17:0/181193745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff13c159630 0x7ff13c0cd050 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.342+0000 7ff142633700 1 --2- 172.21.15.17:0/181193745 >> v2:172.21.15.136:3300/0 conn(0x7ff13c0cd590 0x7ff13c0ce300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.342+0000 7ff142633700 1 -- 172.21.15.17:0/181193745 >> 172.21.15.17:0/181193745 conn(0x7ff13c06cff0 msgr2=0x7ff13c06d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:38.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.342+0000 7ff142633700 1 -- 172.21.15.17:0/181193745 shutdown_connections 2023-10-06T04:43:38.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.342+0000 7ff142633700 1 -- 172.21.15.17:0/181193745 wait complete. 2023-10-06T04:43:38.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.343+0000 7ff142633700 1 Processor -- start 2023-10-06T04:43:38.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.343+0000 7ff142633700 1 -- start start 2023-10-06T04:43:38.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.344+0000 7ff142633700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff13c0cd590 0x7ff13c0ca150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:38.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.344+0000 7ff142633700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff13c0ce840 0x7ff13c14e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:38.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.344+0000 7ff142633700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff13c159630 0x7ff13c15c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:38.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.344+0000 7ff142633700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c15f0c0 con 0x7ff13c0ce840 2023-10-06T04:43:38.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.344+0000 7ff142633700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c14ee20 con 0x7ff13c159630 2023-10-06T04:43:38.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.344+0000 7ff142633700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c15c9b0 con 0x7ff13c0cd590 2023-10-06T04:43:38.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.344+0000 7ff13b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff13c0ce840 0x7ff13c14e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:38.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.344+0000 7ff13b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff13c0ce840 0x7ff13c14e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33134/0 (socket says 172.21.15.17:33134) 2023-10-06T04:43:38.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.344+0000 7ff13b7fe700 1 -- 172.21.15.17:0/3348440370 learned_addr learned my addr 172.21.15.17:0/3348440370 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:38.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.344+0000 7ff13bfff700 1 --2- 172.21.15.17:0/3348440370 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff13c0cd590 0x7ff13c0ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:38.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.344+0000 7ff140bd0700 1 --2- 172.21.15.17:0/3348440370 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff13c159630 0x7ff13c15c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:38.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.344+0000 7ff13b7fe700 1 -- 172.21.15.17:0/3348440370 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff13c0cd590 msgr2=0x7ff13c0ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:38.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.344+0000 7ff13b7fe700 1 --2- 172.21.15.17:0/3348440370 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff13c0cd590 0x7ff13c0ca150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.344+0000 7ff13b7fe700 1 -- 172.21.15.17:0/3348440370 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff13c159630 msgr2=0x7ff13c15c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:38.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.344+0000 7ff13b7fe700 1 --2- 172.21.15.17:0/3348440370 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff13c159630 0x7ff13c15c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.344+0000 7ff13b7fe700 1 -- 172.21.15.17:0/3348440370 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1240094f0 con 0x7ff13c0ce840 2023-10-06T04:43:38.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.344+0000 7ff140bd0700 1 --2- 172.21.15.17:0/3348440370 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff13c159630 0x7ff13c15c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:43:38.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.344+0000 7ff13b7fe700 1 --2- 172.21.15.17:0/3348440370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff13c0ce840 0x7ff13c14e8e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff12c00d890 tx=0x7ff12c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:38.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.344+0000 7ff133fff700 1 -- 172.21.15.17:0/3348440370 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12c0125f0 con 0x7ff13c0ce840 2023-10-06T04:43:38.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.344+0000 7ff133fff700 1 -- 172.21.15.17:0/3348440370 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff12c012750 con 0x7ff13c0ce840 2023-10-06T04:43:38.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.344+0000 7ff142633700 1 -- 172.21.15.17:0/3348440370 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff13c0c9cc0 con 0x7ff13c0ce840 2023-10-06T04:43:38.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.344+0000 7ff133fff700 1 -- 172.21.15.17:0/3348440370 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12c012ad0 con 0x7ff13c0ce840 2023-10-06T04:43:38.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.344+0000 7ff142633700 1 -- 172.21.15.17:0/3348440370 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff13c0c9390 con 0x7ff13c0ce840 2023-10-06T04:43:38.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.345+0000 7ff142633700 1 -- 172.21.15.17:0/3348440370 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff13c063ff0 con 0x7ff13c0ce840 2023-10-06T04:43:38.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.346+0000 7ff133fff700 1 -- 172.21.15.17:0/3348440370 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff12c01e460 con 0x7ff13c0ce840 2023-10-06T04:43:38.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.346+0000 7ff133fff700 1 --2- 172.21.15.17:0/3348440370 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff11c066f30 0x7ff11c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:38.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.346+0000 7ff133fff700 1 -- 172.21.15.17:0/3348440370 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff12c084cf0 con 0x7ff13c0ce840 2023-10-06T04:43:38.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.346+0000 7ff13bfff700 1 --2- 172.21.15.17:0/3348440370 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff11c066f30 0x7ff11c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:38.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.347+0000 7ff13bfff700 1 --2- 172.21.15.17:0/3348440370 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff11c066f30 0x7ff11c0693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff13c04bc70 tx=0x7ff124017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:38.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.350+0000 7ff133fff700 1 -- 172.21.15.17:0/3348440370 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff12c089070 con 0x7ff13c0ce840 2023-10-06T04:43:38.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.539+0000 7ff142633700 1 -- 172.21.15.17:0/3348440370 --> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff13c0cdea0 con 0x7ff11c066f30 2023-10-06T04:43:38.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.547+0000 7ff133fff700 1 -- 172.21.15.17:0/3348440370 <== mgr.4104 v2:172.21.15.17:6832/90424 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286857 (secure 0 0 0) 0x7ff13c0cdea0 con 0x7ff11c066f30 2023-10-06T04:43:38.555 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:43:38.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.550+0000 7ff142633700 1 -- 172.21.15.17:0/3348440370 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff11c066f30 msgr2=0x7ff11c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:38.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.550+0000 7ff142633700 1 --2- 172.21.15.17:0/3348440370 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff11c066f30 0x7ff11c0693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff13c04bc70 tx=0x7ff124017000 comp rx=0 tx=0).stop 2023-10-06T04:43:38.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.550+0000 7ff142633700 1 -- 172.21.15.17:0/3348440370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff13c0ce840 msgr2=0x7ff13c14e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:38.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.550+0000 7ff142633700 1 --2- 172.21.15.17:0/3348440370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff13c0ce840 0x7ff13c14e8e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff12c00d890 tx=0x7ff12c008040 comp rx=0 tx=0).stop 2023-10-06T04:43:38.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.550+0000 7ff142633700 1 -- 172.21.15.17:0/3348440370 shutdown_connections 2023-10-06T04:43:38.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.550+0000 7ff142633700 1 --2- 172.21.15.17:0/3348440370 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff11c066f30 0x7ff11c0693e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.550+0000 7ff142633700 1 --2- 172.21.15.17:0/3348440370 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff13c159630 0x7ff13c15c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.550+0000 7ff142633700 1 --2- 172.21.15.17:0/3348440370 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff13c0cd590 0x7ff13c0ca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.550+0000 7ff142633700 1 --2- 172.21.15.17:0/3348440370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff13c0ce840 0x7ff13c14e8e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.550+0000 7ff142633700 1 -- 172.21.15.17:0/3348440370 >> 172.21.15.17:0/3348440370 conn(0x7ff13c06cff0 msgr2=0x7ff13c0b2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:38.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.551+0000 7ff142633700 1 -- 172.21.15.17:0/3348440370 shutdown_connections 2023-10-06T04:43:38.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.551+0000 7ff142633700 1 -- 172.21.15.17:0/3348440370 wait complete. 2023-10-06T04:43:38.561 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-06T04:43:38.564 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-06T04:43:38.337496+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381224,"kb_used_data":2920,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593496,"statfs":{"total":773094113280,"available":770655739904,"internally_reserved":0,"allocated":2990080,"data_stored":1816092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.546969"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.811950+0000","last_change":"2023-10-06T04:43:29.806928+0000","last_active":"2023-10-06T04:43:29.811950+0000","last_peered":"2023-10-06T04:43:29.811950+0000","last_clean":"2023-10-06T04:43:29.811950+0000","last_became_active":"2023-10-06T04:43:29.806647+0000","last_became_peered":"2023-10-06T04:43:29.806647+0000","last_unstale":"2023-10-06T04:43:29.811950+0000","last_undegraded":"2023-10-06T04:43:29.811950+0000","last_fullsized":"2023-10-06T04:43:29.811950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:36.599513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.822106+0000","last_change":"2023-10-06T04:43:29.816979+0000","last_active":"2023-10-06T04:43:29.822106+0000","last_peered":"2023-10-06T04:43:29.822106+0000","last_clean":"2023-10-06T04:43:29.822106+0000","last_became_active":"2023-10-06T04:43:29.812045+0000","last_became_peered":"2023-10-06T04:43:29.812045+0000","last_unstale":"2023-10-06T04:43:29.822106+0000","last_undegraded":"2023-10-06T04:43:29.822106+0000","last_fullsized":"2023-10-06T04:43:29.822106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:23:24.496576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818087+0000","last_change":"2023-10-06T04:43:29.811591+0000","last_active":"2023-10-06T04:43:29.818087+0000","last_peered":"2023-10-06T04:43:29.818087+0000","last_clean":"2023-10-06T04:43:29.818087+0000","last_became_active":"2023-10-06T04:43:29.810621+0000","last_became_peered":"2023-10-06T04:43:29.810621+0000","last_unstale":"2023-10-06T04:43:29.818087+0000","last_undegraded":"2023-10-06T04:43:29.818087+0000","last_fullsized":"2023-10-06T04:43:29.818087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:58.730973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.813045+0000","last_change":"2023-10-06T04:43:29.810774+0000","last_active":"2023-10-06T04:43:29.813045+0000","last_peered":"2023-10-06T04:43:29.813045+0000","last_clean":"2023-10-06T04:43:29.813045+0000","last_became_active":"2023-10-06T04:43:29.810469+0000","last_became_peered":"2023-10-06T04:43:29.810469+0000","last_unstale":"2023-10-06T04:43:29.813045+0000","last_undegraded":"2023-10-06T04:43:29.813045+0000","last_fullsized":"2023-10-06T04:43:29.813045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:00:08.876120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.809045+0000","last_change":"2023-10-06T04:43:29.804144+0000","last_active":"2023-10-06T04:43:29.809045+0000","last_peered":"2023-10-06T04:43:29.809045+0000","last_clean":"2023-10-06T04:43:29.809045+0000","last_became_active":"2023-10-06T04:43:29.803873+0000","last_became_peered":"2023-10-06T04:43:29.803873+0000","last_unstale":"2023-10-06T04:43:29.809045+0000","last_undegraded":"2023-10-06T04:43:29.809045+0000","last_fullsized":"2023-10-06T04:43:29.809045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:01.271919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.819195+0000","last_change":"2023-10-06T04:43:29.816295+0000","last_active":"2023-10-06T04:43:29.819195+0000","last_peered":"2023-10-06T04:43:29.819195+0000","last_clean":"2023-10-06T04:43:29.819195+0000","last_became_active":"2023-10-06T04:43:29.815965+0000","last_became_peered":"2023-10-06T04:43:29.815965+0000","last_unstale":"2023-10-06T04:43:29.819195+0000","last_undegraded":"2023-10-06T04:43:29.819195+0000","last_fullsized":"2023-10-06T04:43:29.819195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:55:19.523530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.820937+0000","last_change":"2023-10-06T04:43:29.807856+0000","last_active":"2023-10-06T04:43:29.820937+0000","last_peered":"2023-10-06T04:43:29.820937+0000","last_clean":"2023-10-06T04:43:29.820937+0000","last_became_active":"2023-10-06T04:43:29.807253+0000","last_became_peered":"2023-10-06T04:43:29.807253+0000","last_unstale":"2023-10-06T04:43:29.820937+0000","last_undegraded":"2023-10-06T04:43:29.820937+0000","last_fullsized":"2023-10-06T04:43:29.820937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:15:36.021668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.822161+0000","last_change":"2023-10-06T04:43:29.817890+0000","last_active":"2023-10-06T04:43:29.822161+0000","last_peered":"2023-10-06T04:43:29.822161+0000","last_clean":"2023-10-06T04:43:29.822161+0000","last_became_active":"2023-10-06T04:43:29.817653+0000","last_became_peered":"2023-10-06T04:43:29.817653+0000","last_unstale":"2023-10-06T04:43:29.822161+0000","last_undegraded":"2023-10-06T04:43:29.822161+0000","last_fullsized":"2023-10-06T04:43:29.822161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:11.685749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.816847+0000","last_change":"2023-10-06T04:43:29.815194+0000","last_active":"2023-10-06T04:43:29.816847+0000","last_peered":"2023-10-06T04:43:29.816847+0000","last_clean":"2023-10-06T04:43:29.816847+0000","last_became_active":"2023-10-06T04:43:29.814925+0000","last_became_peered":"2023-10-06T04:43:29.814925+0000","last_unstale":"2023-10-06T04:43:29.816847+0000","last_undegraded":"2023-10-06T04:43:29.816847+0000","last_fullsized":"2023-10-06T04:43:29.816847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:52.381232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.817067+0000","last_change":"2023-10-06T04:43:29.811845+0000","last_active":"2023-10-06T04:43:29.817067+0000","last_peered":"2023-10-06T04:43:29.817067+0000","last_clean":"2023-10-06T04:43:29.817067+0000","last_became_active":"2023-10-06T04:43:29.811569+0000","last_became_peered":"2023-10-06T04:43:29.811569+0000","last_unstale":"2023-10-06T04:43:29.817067+0000","last_undegraded":"2023-10-06T04:43:29.817067+0000","last_fullsized":"2023-10-06T04:43:29.817067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:11.452212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.819391+0000","last_change":"2023-10-06T04:43:29.815826+0000","last_active":"2023-10-06T04:43:29.819391+0000","last_peered":"2023-10-06T04:43:29.819391+0000","last_clean":"2023-10-06T04:43:29.819391+0000","last_became_active":"2023-10-06T04:43:29.811044+0000","last_became_peered":"2023-10-06T04:43:29.811044+0000","last_unstale":"2023-10-06T04:43:29.819391+0000","last_undegraded":"2023-10-06T04:43:29.819391+0000","last_fullsized":"2023-10-06T04:43:29.819391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:51.734715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818330+0000","last_change":"2023-10-06T04:43:29.816792+0000","last_active":"2023-10-06T04:43:29.818330+0000","last_peered":"2023-10-06T04:43:29.818330+0000","last_clean":"2023-10-06T04:43:29.818330+0000","last_became_active":"2023-10-06T04:43:29.816556+0000","last_became_peered":"2023-10-06T04:43:29.816556+0000","last_unstale":"2023-10-06T04:43:29.818330+0000","last_undegraded":"2023-10-06T04:43:29.818330+0000","last_fullsized":"2023-10-06T04:43:29.818330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:01:47.259709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.811880+0000","last_change":"2023-10-06T04:43:29.808514+0000","last_active":"2023-10-06T04:43:29.811880+0000","last_peered":"2023-10-06T04:43:29.811880+0000","last_clean":"2023-10-06T04:43:29.811880+0000","last_became_active":"2023-10-06T04:43:29.808290+0000","last_became_peered":"2023-10-06T04:43:29.808290+0000","last_unstale":"2023-10-06T04:43:29.811880+0000","last_undegraded":"2023-10-06T04:43:29.811880+0000","last_fullsized":"2023-10-06T04:43:29.811880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:41.895629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.816945+0000","last_change":"2023-10-06T04:43:29.810539+0000","last_active":"2023-10-06T04:43:29.816945+0000","last_peered":"2023-10-06T04:43:29.816945+0000","last_clean":"2023-10-06T04:43:29.816945+0000","last_became_active":"2023-10-06T04:43:29.809976+0000","last_became_peered":"2023-10-06T04:43:29.809976+0000","last_unstale":"2023-10-06T04:43:29.816945+0000","last_undegraded":"2023-10-06T04:43:29.816945+0000","last_fullsized":"2023-10-06T04:43:29.816945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:07.658289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.820956+0000","last_change":"2023-10-06T04:43:29.808047+0000","last_active":"2023-10-06T04:43:29.820956+0000","last_peered":"2023-10-06T04:43:29.820956+0000","last_clean":"2023-10-06T04:43:29.820956+0000","last_became_active":"2023-10-06T04:43:29.807598+0000","last_became_peered":"2023-10-06T04:43:29.807598+0000","last_unstale":"2023-10-06T04:43:29.820956+0000","last_undegraded":"2023-10-06T04:43:29.820956+0000","last_fullsized":"2023-10-06T04:43:29.820956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:11.685749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.815174+0000","last_change":"2023-10-06T04:43:29.807538+0000","last_active":"2023-10-06T04:43:29.815174+0000","last_peered":"2023-10-06T04:43:29.815174+0000","last_clean":"2023-10-06T04:43:29.815174+0000","last_became_active":"2023-10-06T04:43:29.807299+0000","last_became_peered":"2023-10-06T04:43:29.807299+0000","last_unstale":"2023-10-06T04:43:29.815174+0000","last_undegraded":"2023-10-06T04:43:29.815174+0000","last_fullsized":"2023-10-06T04:43:29.815174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:15:36.021668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.817840+0000","last_change":"2023-10-06T04:43:29.816450+0000","last_active":"2023-10-06T04:43:29.817840+0000","last_peered":"2023-10-06T04:43:29.817840+0000","last_clean":"2023-10-06T04:43:29.817840+0000","last_became_active":"2023-10-06T04:43:29.816180+0000","last_became_peered":"2023-10-06T04:43:29.816180+0000","last_unstale":"2023-10-06T04:43:29.817840+0000","last_undegraded":"2023-10-06T04:43:29.817840+0000","last_fullsized":"2023-10-06T04:43:29.817840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:45.205428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818676+0000","last_change":"2023-10-06T04:43:29.815225+0000","last_active":"2023-10-06T04:43:29.818676+0000","last_peered":"2023-10-06T04:43:29.818676+0000","last_clean":"2023-10-06T04:43:29.818676+0000","last_became_active":"2023-10-06T04:43:29.814940+0000","last_became_peered":"2023-10-06T04:43:29.814940+0000","last_unstale":"2023-10-06T04:43:29.818676+0000","last_undegraded":"2023-10-06T04:43:29.818676+0000","last_fullsized":"2023-10-06T04:43:29.818676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:01.271919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.815444+0000","last_change":"2023-10-06T04:43:29.814413+0000","last_active":"2023-10-06T04:43:29.815444+0000","last_peered":"2023-10-06T04:43:29.815444+0000","last_clean":"2023-10-06T04:43:29.815444+0000","last_became_active":"2023-10-06T04:43:29.814183+0000","last_became_peered":"2023-10-06T04:43:29.814183+0000","last_unstale":"2023-10-06T04:43:29.815444+0000","last_undegraded":"2023-10-06T04:43:29.815444+0000","last_fullsized":"2023-10-06T04:43:29.815444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:13.446695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.819145+0000","last_change":"2023-10-06T04:43:29.816764+0000","last_active":"2023-10-06T04:43:29.819145+0000","last_peered":"2023-10-06T04:43:29.819145+0000","last_clean":"2023-10-06T04:43:29.819145+0000","last_became_active":"2023-10-06T04:43:29.816331+0000","last_became_peered":"2023-10-06T04:43:29.816331+0000","last_unstale":"2023-10-06T04:43:29.819145+0000","last_undegraded":"2023-10-06T04:43:29.819145+0000","last_fullsized":"2023-10-06T04:43:29.819145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:30.317282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.820849+0000","last_change":"2023-10-06T04:43:29.808614+0000","last_active":"2023-10-06T04:43:29.820849+0000","last_peered":"2023-10-06T04:43:29.820849+0000","last_clean":"2023-10-06T04:43:29.820849+0000","last_became_active":"2023-10-06T04:43:29.808340+0000","last_became_peered":"2023-10-06T04:43:29.808340+0000","last_unstale":"2023-10-06T04:43:29.820849+0000","last_undegraded":"2023-10-06T04:43:29.820849+0000","last_fullsized":"2023-10-06T04:43:29.820849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:34.271308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.804371+0000","last_change":"2023-10-06T04:43:29.802581+0000","last_active":"2023-10-06T04:43:29.804371+0000","last_peered":"2023-10-06T04:43:29.804371+0000","last_clean":"2023-10-06T04:43:29.804371+0000","last_became_active":"2023-10-06T04:43:29.802296+0000","last_became_peered":"2023-10-06T04:43:29.802296+0000","last_unstale":"2023-10-06T04:43:29.804371+0000","last_undegraded":"2023-10-06T04:43:29.804371+0000","last_fullsized":"2023-10-06T04:43:29.804371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:34.271308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.812033+0000","last_change":"2023-10-06T04:43:29.807277+0000","last_active":"2023-10-06T04:43:29.812033+0000","last_peered":"2023-10-06T04:43:29.812033+0000","last_clean":"2023-10-06T04:43:29.812033+0000","last_became_active":"2023-10-06T04:43:29.807007+0000","last_became_peered":"2023-10-06T04:43:29.807007+0000","last_unstale":"2023-10-06T04:43:29.812033+0000","last_undegraded":"2023-10-06T04:43:29.812033+0000","last_fullsized":"2023-10-06T04:43:29.812033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:51.734715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.820779+0000","last_change":"2023-10-06T04:43:29.807216+0000","last_active":"2023-10-06T04:43:29.820779+0000","last_peered":"2023-10-06T04:43:29.820779+0000","last_clean":"2023-10-06T04:43:29.820779+0000","last_became_active":"2023-10-06T04:43:29.806926+0000","last_became_peered":"2023-10-06T04:43:29.806926+0000","last_unstale":"2023-10-06T04:43:29.820779+0000","last_undegraded":"2023-10-06T04:43:29.820779+0000","last_fullsized":"2023-10-06T04:43:29.820779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:45.205428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.811127+0000","last_change":"2023-10-06T04:43:29.809554+0000","last_active":"2023-10-06T04:43:29.811127+0000","last_peered":"2023-10-06T04:43:29.811127+0000","last_clean":"2023-10-06T04:43:29.811127+0000","last_became_active":"2023-10-06T04:43:29.809289+0000","last_became_peered":"2023-10-06T04:43:29.809289+0000","last_unstale":"2023-10-06T04:43:29.811127+0000","last_undegraded":"2023-10-06T04:43:29.811127+0000","last_fullsized":"2023-10-06T04:43:29.811127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:11.685749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.807574+0000","last_change":"2023-10-06T04:43:29.802420+0000","last_active":"2023-10-06T04:43:29.807574+0000","last_peered":"2023-10-06T04:43:29.807574+0000","last_clean":"2023-10-06T04:43:29.807574+0000","last_became_active":"2023-10-06T04:43:29.802164+0000","last_became_peered":"2023-10-06T04:43:29.802164+0000","last_unstale":"2023-10-06T04:43:29.807574+0000","last_undegraded":"2023-10-06T04:43:29.807574+0000","last_fullsized":"2023-10-06T04:43:29.807574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:40.869182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.822213+0000","last_change":"2023-10-06T04:43:29.820720+0000","last_active":"2023-10-06T04:43:29.822213+0000","last_peered":"2023-10-06T04:43:29.822213+0000","last_clean":"2023-10-06T04:43:29.822213+0000","last_became_active":"2023-10-06T04:43:29.817226+0000","last_became_peered":"2023-10-06T04:43:29.817226+0000","last_unstale":"2023-10-06T04:43:29.822213+0000","last_undegraded":"2023-10-06T04:43:29.822213+0000","last_fullsized":"2023-10-06T04:43:29.822213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:45.205428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.821084+0000","last_change":"2023-10-06T04:43:28.805712+0000","last_active":"2023-10-06T04:43:29.821084+0000","last_peered":"2023-10-06T04:43:29.821084+0000","last_clean":"2023-10-06T04:43:29.821084+0000","last_became_active":"2023-10-06T04:43:28.805368+0000","last_became_peered":"2023-10-06T04:43:28.805368+0000","last_unstale":"2023-10-06T04:43:29.821084+0000","last_undegraded":"2023-10-06T04:43:29.821084+0000","last_fullsized":"2023-10-06T04:43:29.821084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:12.441174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.808717+0000","last_change":"2023-10-06T04:43:29.806230+0000","last_active":"2023-10-06T04:43:29.808717+0000","last_peered":"2023-10-06T04:43:29.808717+0000","last_clean":"2023-10-06T04:43:29.808717+0000","last_became_active":"2023-10-06T04:43:29.805977+0000","last_became_peered":"2023-10-06T04:43:29.805977+0000","last_unstale":"2023-10-06T04:43:29.808717+0000","last_undegraded":"2023-10-06T04:43:29.808717+0000","last_fullsized":"2023-10-06T04:43:29.808717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:11.727749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.791893+0000","last_change":"2023-10-06T04:43:28.810385+0000","last_active":"2023-10-06T04:43:29.791893+0000","last_peered":"2023-10-06T04:43:29.791893+0000","last_clean":"2023-10-06T04:43:29.791893+0000","last_became_active":"2023-10-06T04:43:28.810187+0000","last_became_peered":"2023-10-06T04:43:28.810187+0000","last_unstale":"2023-10-06T04:43:29.791893+0000","last_undegraded":"2023-10-06T04:43:29.791893+0000","last_fullsized":"2023-10-06T04:43:29.791893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:40.890108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.804061+0000","last_change":"2023-10-06T04:43:29.799004+0000","last_active":"2023-10-06T04:43:29.804061+0000","last_peered":"2023-10-06T04:43:29.804061+0000","last_clean":"2023-10-06T04:43:29.804061+0000","last_became_active":"2023-10-06T04:43:29.798724+0000","last_became_peered":"2023-10-06T04:43:29.798724+0000","last_unstale":"2023-10-06T04:43:29.804061+0000","last_undegraded":"2023-10-06T04:43:29.804061+0000","last_fullsized":"2023-10-06T04:43:29.804061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:11.685749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.799049+0000","last_change":"2023-10-06T04:43:28.807299+0000","last_active":"2023-10-06T04:43:29.799049+0000","last_peered":"2023-10-06T04:43:29.799049+0000","last_clean":"2023-10-06T04:43:29.799049+0000","last_became_active":"2023-10-06T04:43:28.806721+0000","last_became_peered":"2023-10-06T04:43:28.806721+0000","last_unstale":"2023-10-06T04:43:29.799049+0000","last_undegraded":"2023-10-06T04:43:29.799049+0000","last_fullsized":"2023-10-06T04:43:29.799049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:50:16.072055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.820353+0000","last_change":"2023-10-06T04:43:29.816337+0000","last_active":"2023-10-06T04:43:29.820353+0000","last_peered":"2023-10-06T04:43:29.820353+0000","last_clean":"2023-10-06T04:43:29.820353+0000","last_became_active":"2023-10-06T04:43:29.816020+0000","last_became_peered":"2023-10-06T04:43:29.816020+0000","last_unstale":"2023-10-06T04:43:29.820353+0000","last_undegraded":"2023-10-06T04:43:29.820353+0000","last_fullsized":"2023-10-06T04:43:29.820353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:40.869182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.796225+0000","last_change":"2023-10-06T04:43:28.805467+0000","last_active":"2023-10-06T04:43:29.796225+0000","last_peered":"2023-10-06T04:43:29.796225+0000","last_clean":"2023-10-06T04:43:29.796225+0000","last_became_active":"2023-10-06T04:43:28.804827+0000","last_became_peered":"2023-10-06T04:43:28.804827+0000","last_unstale":"2023-10-06T04:43:29.796225+0000","last_undegraded":"2023-10-06T04:43:29.796225+0000","last_fullsized":"2023-10-06T04:43:29.796225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:01:46.254188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.808207+0000","last_change":"2023-10-06T04:43:29.806347+0000","last_active":"2023-10-06T04:43:29.808207+0000","last_peered":"2023-10-06T04:43:29.808207+0000","last_clean":"2023-10-06T04:43:29.808207+0000","last_became_active":"2023-10-06T04:43:29.803738+0000","last_became_peered":"2023-10-06T04:43:29.803738+0000","last_unstale":"2023-10-06T04:43:29.808207+0000","last_undegraded":"2023-10-06T04:43:29.808207+0000","last_fullsized":"2023-10-06T04:43:29.808207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:54.115093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.806979+0000","last_change":"2023-10-06T04:43:28.808150+0000","last_active":"2023-10-06T04:43:29.806979+0000","last_peered":"2023-10-06T04:43:29.806979+0000","last_clean":"2023-10-06T04:43:29.806979+0000","last_became_active":"2023-10-06T04:43:28.807880+0000","last_became_peered":"2023-10-06T04:43:28.807880+0000","last_unstale":"2023-10-06T04:43:29.806979+0000","last_undegraded":"2023-10-06T04:43:29.806979+0000","last_fullsized":"2023-10-06T04:43:29.806979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:40.890108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.815591+0000","last_change":"2023-10-06T04:43:29.813344+0000","last_active":"2023-10-06T04:43:29.815591+0000","last_peered":"2023-10-06T04:43:29.815591+0000","last_clean":"2023-10-06T04:43:29.815591+0000","last_became_active":"2023-10-06T04:43:29.813115+0000","last_became_peered":"2023-10-06T04:43:29.813115+0000","last_unstale":"2023-10-06T04:43:29.815591+0000","last_undegraded":"2023-10-06T04:43:29.815591+0000","last_fullsized":"2023-10-06T04:43:29.815591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:52.381232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.815998+0000","last_change":"2023-10-06T04:43:28.807514+0000","last_active":"2023-10-06T04:43:29.815998+0000","last_peered":"2023-10-06T04:43:29.815998+0000","last_clean":"2023-10-06T04:43:29.815998+0000","last_became_active":"2023-10-06T04:43:28.807226+0000","last_became_peered":"2023-10-06T04:43:28.807226+0000","last_unstale":"2023-10-06T04:43:29.815998+0000","last_undegraded":"2023-10-06T04:43:29.815998+0000","last_fullsized":"2023-10-06T04:43:29.815998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:54:35.372982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.812081+0000","last_change":"2023-10-06T04:43:29.810145+0000","last_active":"2023-10-06T04:43:29.812081+0000","last_peered":"2023-10-06T04:43:29.812081+0000","last_clean":"2023-10-06T04:43:29.812081+0000","last_became_active":"2023-10-06T04:43:29.809512+0000","last_became_peered":"2023-10-06T04:43:29.809512+0000","last_unstale":"2023-10-06T04:43:29.812081+0000","last_undegraded":"2023-10-06T04:43:29.812081+0000","last_fullsized":"2023-10-06T04:43:29.812081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:15:36.021668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.825075+0000","last_change":"2023-10-06T04:43:28.803587+0000","last_active":"2023-10-06T04:43:29.825075+0000","last_peered":"2023-10-06T04:43:29.825075+0000","last_clean":"2023-10-06T04:43:29.825075+0000","last_became_active":"2023-10-06T04:43:28.801777+0000","last_became_peered":"2023-10-06T04:43:28.801777+0000","last_unstale":"2023-10-06T04:43:29.825075+0000","last_undegraded":"2023-10-06T04:43:29.825075+0000","last_fullsized":"2023-10-06T04:43:29.825075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:56.458010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818645+0000","last_change":"2023-10-06T04:43:29.815592+0000","last_active":"2023-10-06T04:43:29.818645+0000","last_peered":"2023-10-06T04:43:29.818645+0000","last_clean":"2023-10-06T04:43:29.818645+0000","last_became_active":"2023-10-06T04:43:29.815322+0000","last_became_peered":"2023-10-06T04:43:29.815322+0000","last_unstale":"2023-10-06T04:43:29.818645+0000","last_undegraded":"2023-10-06T04:43:29.818645+0000","last_fullsized":"2023-10-06T04:43:29.818645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:10.192264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.817564+0000","last_change":"2023-10-06T04:43:28.802843+0000","last_active":"2023-10-06T04:43:29.817564+0000","last_peered":"2023-10-06T04:43:29.817564+0000","last_clean":"2023-10-06T04:43:29.817564+0000","last_became_active":"2023-10-06T04:43:28.802554+0000","last_became_peered":"2023-10-06T04:43:28.802554+0000","last_unstale":"2023-10-06T04:43:29.817564+0000","last_undegraded":"2023-10-06T04:43:29.817564+0000","last_fullsized":"2023-10-06T04:43:29.817564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:00:07.870599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.808168+0000","last_change":"2023-10-06T04:43:29.805945+0000","last_active":"2023-10-06T04:43:29.808168+0000","last_peered":"2023-10-06T04:43:29.808168+0000","last_clean":"2023-10-06T04:43:29.808168+0000","last_became_active":"2023-10-06T04:43:29.805658+0000","last_became_peered":"2023-10-06T04:43:29.805658+0000","last_unstale":"2023-10-06T04:43:29.808168+0000","last_undegraded":"2023-10-06T04:43:29.808168+0000","last_fullsized":"2023-10-06T04:43:29.808168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:38.867495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.795558+0000","last_change":"2023-10-06T04:43:28.797338+0000","last_active":"2023-10-06T04:43:29.795558+0000","last_peered":"2023-10-06T04:43:29.795558+0000","last_clean":"2023-10-06T04:43:29.795558+0000","last_became_active":"2023-10-06T04:43:28.797048+0000","last_became_peered":"2023-10-06T04:43:28.797048+0000","last_unstale":"2023-10-06T04:43:29.795558+0000","last_undegraded":"2023-10-06T04:43:29.795558+0000","last_fullsized":"2023-10-06T04:43:29.795558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:40.890108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.822225+0000","last_change":"2023-10-06T04:43:29.820733+0000","last_active":"2023-10-06T04:43:29.822225+0000","last_peered":"2023-10-06T04:43:29.822225+0000","last_clean":"2023-10-06T04:43:29.822225+0000","last_became_active":"2023-10-06T04:43:29.817165+0000","last_became_peered":"2023-10-06T04:43:29.817165+0000","last_unstale":"2023-10-06T04:43:29.822225+0000","last_undegraded":"2023-10-06T04:43:29.822225+0000","last_fullsized":"2023-10-06T04:43:29.822225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:34.271308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.795120+0000","last_change":"2023-10-06T04:43:28.806709+0000","last_active":"2023-10-06T04:43:29.795120+0000","last_peered":"2023-10-06T04:43:29.795120+0000","last_clean":"2023-10-06T04:43:29.795120+0000","last_became_active":"2023-10-06T04:43:28.806455+0000","last_became_peered":"2023-10-06T04:43:28.806455+0000","last_unstale":"2023-10-06T04:43:29.795120+0000","last_undegraded":"2023-10-06T04:43:29.795120+0000","last_fullsized":"2023-10-06T04:43:29.795120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:05.582666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.810403+0000","last_change":"2023-10-06T04:43:29.807303+0000","last_active":"2023-10-06T04:43:29.810403+0000","last_peered":"2023-10-06T04:43:29.810403+0000","last_clean":"2023-10-06T04:43:29.810403+0000","last_became_active":"2023-10-06T04:43:29.807034+0000","last_became_peered":"2023-10-06T04:43:29.807034+0000","last_unstale":"2023-10-06T04:43:29.810403+0000","last_undegraded":"2023-10-06T04:43:29.810403+0000","last_fullsized":"2023-10-06T04:43:29.810403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:51.734715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.820164+0000","last_change":"2023-10-06T04:43:28.807312+0000","last_active":"2023-10-06T04:43:29.820164+0000","last_peered":"2023-10-06T04:43:29.820164+0000","last_clean":"2023-10-06T04:43:29.820164+0000","last_became_active":"2023-10-06T04:43:28.807035+0000","last_became_peered":"2023-10-06T04:43:28.807035+0000","last_unstale":"2023-10-06T04:43:29.820164+0000","last_undegraded":"2023-10-06T04:43:29.820164+0000","last_fullsized":"2023-10-06T04:43:29.820164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:35.593992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818496+0000","last_change":"2023-10-06T04:43:29.816482+0000","last_active":"2023-10-06T04:43:29.818496+0000","last_peered":"2023-10-06T04:43:29.818496+0000","last_clean":"2023-10-06T04:43:29.818496+0000","last_became_active":"2023-10-06T04:43:29.816211+0000","last_became_peered":"2023-10-06T04:43:29.816211+0000","last_unstale":"2023-10-06T04:43:29.818496+0000","last_undegraded":"2023-10-06T04:43:29.818496+0000","last_fullsized":"2023-10-06T04:43:29.818496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:34.271308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.820686+0000","last_change":"2023-10-06T04:43:28.805958+0000","last_active":"2023-10-06T04:43:29.820686+0000","last_peered":"2023-10-06T04:43:29.820686+0000","last_clean":"2023-10-06T04:43:29.820686+0000","last_became_active":"2023-10-06T04:43:28.805675+0000","last_became_peered":"2023-10-06T04:43:28.805675+0000","last_unstale":"2023-10-06T04:43:29.820686+0000","last_undegraded":"2023-10-06T04:43:29.820686+0000","last_fullsized":"2023-10-06T04:43:29.820686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:54.712639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.822181+0000","last_change":"2023-10-06T04:43:29.819947+0000","last_active":"2023-10-06T04:43:29.822181+0000","last_peered":"2023-10-06T04:43:29.822181+0000","last_clean":"2023-10-06T04:43:29.822181+0000","last_became_active":"2023-10-06T04:43:29.819674+0000","last_became_peered":"2023-10-06T04:43:29.819674+0000","last_unstale":"2023-10-06T04:43:29.822181+0000","last_undegraded":"2023-10-06T04:43:29.822181+0000","last_fullsized":"2023-10-06T04:43:29.822181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:51:05.152644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.817116+0000","last_change":"2023-10-06T04:43:28.805900+0000","last_active":"2023-10-06T04:43:29.817116+0000","last_peered":"2023-10-06T04:43:29.817116+0000","last_clean":"2023-10-06T04:43:29.817116+0000","last_became_active":"2023-10-06T04:43:28.805647+0000","last_became_peered":"2023-10-06T04:43:28.805647+0000","last_unstale":"2023-10-06T04:43:29.817116+0000","last_undegraded":"2023-10-06T04:43:29.817116+0000","last_fullsized":"2023-10-06T04:43:29.817116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:37.340861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.814241+0000","last_change":"2023-10-06T04:43:29.809549+0000","last_active":"2023-10-06T04:43:29.814241+0000","last_peered":"2023-10-06T04:43:29.814241+0000","last_clean":"2023-10-06T04:43:29.814241+0000","last_became_active":"2023-10-06T04:43:29.809252+0000","last_became_peered":"2023-10-06T04:43:29.809252+0000","last_unstale":"2023-10-06T04:43:29.814241+0000","last_undegraded":"2023-10-06T04:43:29.814241+0000","last_fullsized":"2023-10-06T04:43:29.814241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:52.381232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.816103+0000","last_change":"2023-10-06T04:43:28.809092+0000","last_active":"2023-10-06T04:43:29.816103+0000","last_peered":"2023-10-06T04:43:29.816103+0000","last_clean":"2023-10-06T04:43:29.816103+0000","last_became_active":"2023-10-06T04:43:28.808653+0000","last_became_peered":"2023-10-06T04:43:28.808653+0000","last_unstale":"2023-10-06T04:43:29.816103+0000","last_undegraded":"2023-10-06T04:43:29.816103+0000","last_fullsized":"2023-10-06T04:43:29.816103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:39.863661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.813196+0000","last_change":"2023-10-06T04:43:29.812475+0000","last_active":"2023-10-06T04:43:29.813196+0000","last_peered":"2023-10-06T04:43:29.813196+0000","last_clean":"2023-10-06T04:43:29.813196+0000","last_became_active":"2023-10-06T04:43:29.812062+0000","last_became_peered":"2023-10-06T04:43:29.812062+0000","last_unstale":"2023-10-06T04:43:29.813196+0000","last_undegraded":"2023-10-06T04:43:29.813196+0000","last_fullsized":"2023-10-06T04:43:29.813196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:38.346382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.810452+0000","last_change":"2023-10-06T04:43:28.807693+0000","last_active":"2023-10-06T04:43:29.810452+0000","last_peered":"2023-10-06T04:43:29.810452+0000","last_clean":"2023-10-06T04:43:29.810452+0000","last_became_active":"2023-10-06T04:43:28.807432+0000","last_became_peered":"2023-10-06T04:43:28.807432+0000","last_unstale":"2023-10-06T04:43:29.810452+0000","last_undegraded":"2023-10-06T04:43:29.810452+0000","last_fullsized":"2023-10-06T04:43:29.810452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:50:16.072055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.809065+0000","last_change":"2023-10-06T04:43:29.805692+0000","last_active":"2023-10-06T04:43:29.809065+0000","last_peered":"2023-10-06T04:43:29.809065+0000","last_clean":"2023-10-06T04:43:29.809065+0000","last_became_active":"2023-10-06T04:43:29.805453+0000","last_became_peered":"2023-10-06T04:43:29.805453+0000","last_unstale":"2023-10-06T04:43:29.809065+0000","last_undegraded":"2023-10-06T04:43:29.809065+0000","last_fullsized":"2023-10-06T04:43:29.809065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:24:11.932858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.817215+0000","last_change":"2023-10-06T04:43:28.807062+0000","last_active":"2023-10-06T04:43:29.817215+0000","last_peered":"2023-10-06T04:43:29.817215+0000","last_clean":"2023-10-06T04:43:29.817215+0000","last_became_active":"2023-10-06T04:43:28.806751+0000","last_became_peered":"2023-10-06T04:43:28.806751+0000","last_unstale":"2023-10-06T04:43:29.817215+0000","last_undegraded":"2023-10-06T04:43:29.817215+0000","last_fullsized":"2023-10-06T04:43:29.817215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:54.712639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.819043+0000","last_change":"2023-10-06T04:43:29.815942+0000","last_active":"2023-10-06T04:43:29.819043+0000","last_peered":"2023-10-06T04:43:29.819043+0000","last_clean":"2023-10-06T04:43:29.819043+0000","last_became_active":"2023-10-06T04:43:29.815608+0000","last_became_peered":"2023-10-06T04:43:29.815608+0000","last_unstale":"2023-10-06T04:43:29.819043+0000","last_undegraded":"2023-10-06T04:43:29.819043+0000","last_fullsized":"2023-10-06T04:43:29.819043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:39:19.542778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.808258+0000","last_change":"2023-10-06T04:43:28.811867+0000","last_active":"2023-10-06T04:43:29.808258+0000","last_peered":"2023-10-06T04:43:29.808258+0000","last_clean":"2023-10-06T04:43:29.808258+0000","last_became_active":"2023-10-06T04:43:28.811616+0000","last_became_peered":"2023-10-06T04:43:28.811616+0000","last_unstale":"2023-10-06T04:43:29.808258+0000","last_undegraded":"2023-10-06T04:43:29.808258+0000","last_fullsized":"2023-10-06T04:43:29.808258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:56.458010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818108+0000","last_change":"2023-10-06T04:43:29.813764+0000","last_active":"2023-10-06T04:43:29.818108+0000","last_peered":"2023-10-06T04:43:29.818108+0000","last_clean":"2023-10-06T04:43:29.818108+0000","last_became_active":"2023-10-06T04:43:29.811411+0000","last_became_peered":"2023-10-06T04:43:29.811411+0000","last_unstale":"2023-10-06T04:43:29.818108+0000","last_undegraded":"2023-10-06T04:43:29.818108+0000","last_fullsized":"2023-10-06T04:43:29.818108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:11.727749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.797267+0000","last_change":"2023-10-06T04:43:28.804269+0000","last_active":"2023-10-06T04:43:29.797267+0000","last_peered":"2023-10-06T04:43:29.797267+0000","last_clean":"2023-10-06T04:43:29.797267+0000","last_became_active":"2023-10-06T04:43:28.802873+0000","last_became_peered":"2023-10-06T04:43:28.802873+0000","last_unstale":"2023-10-06T04:43:29.797267+0000","last_undegraded":"2023-10-06T04:43:29.797267+0000","last_fullsized":"2023-10-06T04:43:29.797267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:35.593992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.819304+0000","last_change":"2023-10-06T04:43:29.816924+0000","last_active":"2023-10-06T04:43:29.819304+0000","last_peered":"2023-10-06T04:43:29.819304+0000","last_clean":"2023-10-06T04:43:29.819304+0000","last_became_active":"2023-10-06T04:43:29.816649+0000","last_became_peered":"2023-10-06T04:43:29.816649+0000","last_unstale":"2023-10-06T04:43:29.819304+0000","last_undegraded":"2023-10-06T04:43:29.819304+0000","last_fullsized":"2023-10-06T04:43:29.819304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:38.867495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.798836+0000","last_change":"2023-10-06T04:43:28.812483+0000","last_active":"2023-10-06T04:43:29.798836+0000","last_peered":"2023-10-06T04:43:29.798836+0000","last_clean":"2023-10-06T04:43:29.798836+0000","last_became_active":"2023-10-06T04:43:28.812205+0000","last_became_peered":"2023-10-06T04:43:28.812205+0000","last_unstale":"2023-10-06T04:43:29.798836+0000","last_undegraded":"2023-10-06T04:43:29.798836+0000","last_fullsized":"2023-10-06T04:43:29.798836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:01:46.254188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.817975+0000","last_change":"2023-10-06T04:43:29.816479+0000","last_active":"2023-10-06T04:43:29.817975+0000","last_peered":"2023-10-06T04:43:29.817975+0000","last_clean":"2023-10-06T04:43:29.817975+0000","last_became_active":"2023-10-06T04:43:29.816006+0000","last_became_peered":"2023-10-06T04:43:29.816006+0000","last_unstale":"2023-10-06T04:43:29.817975+0000","last_undegraded":"2023-10-06T04:43:29.817975+0000","last_fullsized":"2023-10-06T04:43:29.817975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:24:11.932858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.821469+0000","last_change":"2023-10-06T04:43:28.807674+0000","last_active":"2023-10-06T04:43:29.821469+0000","last_peered":"2023-10-06T04:43:29.821469+0000","last_clean":"2023-10-06T04:43:29.821469+0000","last_became_active":"2023-10-06T04:43:28.807392+0000","last_became_peered":"2023-10-06T04:43:28.807392+0000","last_unstale":"2023-10-06T04:43:29.821469+0000","last_undegraded":"2023-10-06T04:43:29.821469+0000","last_fullsized":"2023-10-06T04:43:29.821469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:12.441174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.799442+0000","last_change":"2023-10-06T04:43:24.001927+0000","last_active":"2023-10-06T04:43:29.799442+0000","last_peered":"2023-10-06T04:43:29.799442+0000","last_clean":"2023-10-06T04:43:29.799442+0000","last_became_active":"2023-10-06T04:43:24.001591+0000","last_became_peered":"2023-10-06T04:43:24.001591+0000","last_unstale":"2023-10-06T04:43:29.799442+0000","last_undegraded":"2023-10-06T04:43:29.799442+0000","last_fullsized":"2023-10-06T04:43:29.799442+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:47.262845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818998+0000","last_change":"2023-10-06T04:43:29.818539+0000","last_active":"2023-10-06T04:43:29.818998+0000","last_peered":"2023-10-06T04:43:29.818998+0000","last_clean":"2023-10-06T04:43:29.818998+0000","last_became_active":"2023-10-06T04:43:29.818295+0000","last_became_peered":"2023-10-06T04:43:29.818295+0000","last_unstale":"2023-10-06T04:43:29.818998+0000","last_undegraded":"2023-10-06T04:43:29.818998+0000","last_fullsized":"2023-10-06T04:43:29.818998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:45.205428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.799574+0000","last_change":"2023-10-06T04:43:23.708597+0000","last_active":"2023-10-06T04:43:29.799574+0000","last_peered":"2023-10-06T04:43:29.799574+0000","last_clean":"2023-10-06T04:43:29.799574+0000","last_became_active":"2023-10-06T04:43:23.708317+0000","last_became_peered":"2023-10-06T04:43:23.708317+0000","last_unstale":"2023-10-06T04:43:29.799574+0000","last_undegraded":"2023-10-06T04:43:29.799574+0000","last_fullsized":"2023-10-06T04:43:29.799574+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:56.213068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:43:32.252260+0000","last_change":"2023-10-06T04:43:28.806470+0000","last_active":"2023-10-06T04:43:32.252260+0000","last_peered":"2023-10-06T04:43:32.252260+0000","last_clean":"2023-10-06T04:43:32.252260+0000","last_became_active":"2023-10-06T04:43:28.806176+0000","last_became_peered":"2023-10-06T04:43:28.806176+0000","last_unstale":"2023-10-06T04:43:32.252260+0000","last_undegraded":"2023-10-06T04:43:32.252260+0000","last_fullsized":"2023-10-06T04:43:32.252260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:56.458010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818530+0000","last_change":"2023-10-06T04:43:29.814129+0000","last_active":"2023-10-06T04:43:29.818530+0000","last_peered":"2023-10-06T04:43:29.818530+0000","last_clean":"2023-10-06T04:43:29.818530+0000","last_became_active":"2023-10-06T04:43:29.813867+0000","last_became_peered":"2023-10-06T04:43:29.813867+0000","last_unstale":"2023-10-06T04:43:29.818530+0000","last_undegraded":"2023-10-06T04:43:29.818530+0000","last_fullsized":"2023-10-06T04:43:29.818530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:23:24.496576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.791895+0000","last_change":"2023-10-06T04:43:23.708753+0000","last_active":"2023-10-06T04:43:29.791895+0000","last_peered":"2023-10-06T04:43:29.791895+0000","last_clean":"2023-10-06T04:43:29.791895+0000","last_became_active":"2023-10-06T04:43:23.708483+0000","last_became_peered":"2023-10-06T04:43:23.708483+0000","last_unstale":"2023-10-06T04:43:29.791895+0000","last_undegraded":"2023-10-06T04:43:29.791895+0000","last_fullsized":"2023-10-06T04:43:29.791895+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:47.262845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.794480+0000","last_change":"2023-10-06T04:43:23.706116+0000","last_active":"2023-10-06T04:43:29.794480+0000","last_peered":"2023-10-06T04:43:29.794480+0000","last_clean":"2023-10-06T04:43:29.794480+0000","last_became_active":"2023-10-06T04:43:23.705090+0000","last_became_peered":"2023-10-06T04:43:23.705090+0000","last_unstale":"2023-10-06T04:43:29.794480+0000","last_undegraded":"2023-10-06T04:43:29.794480+0000","last_fullsized":"2023-10-06T04:43:29.794480+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:29.869173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.795459+0000","last_change":"2023-10-06T04:43:28.802676+0000","last_active":"2023-10-06T04:43:29.795459+0000","last_peered":"2023-10-06T04:43:29.795459+0000","last_clean":"2023-10-06T04:43:29.795459+0000","last_became_active":"2023-10-06T04:43:28.802303+0000","last_became_peered":"2023-10-06T04:43:28.802303+0000","last_unstale":"2023-10-06T04:43:29.795459+0000","last_undegraded":"2023-10-06T04:43:29.795459+0000","last_fullsized":"2023-10-06T04:43:29.795459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:12.441174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.808974+0000","last_change":"2023-10-06T04:43:29.805169+0000","last_active":"2023-10-06T04:43:29.808974+0000","last_peered":"2023-10-06T04:43:29.808974+0000","last_clean":"2023-10-06T04:43:29.808974+0000","last_became_active":"2023-10-06T04:43:29.804916+0000","last_became_peered":"2023-10-06T04:43:29.804916+0000","last_unstale":"2023-10-06T04:43:29.808974+0000","last_undegraded":"2023-10-06T04:43:29.808974+0000","last_fullsized":"2023-10-06T04:43:29.808974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:23:24.496576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.795261+0000","last_change":"2023-10-06T04:43:24.002162+0000","last_active":"2023-10-06T04:43:29.795261+0000","last_peered":"2023-10-06T04:43:29.795261+0000","last_clean":"2023-10-06T04:43:29.795261+0000","last_became_active":"2023-10-06T04:43:24.001883+0000","last_became_peered":"2023-10-06T04:43:24.001883+0000","last_unstale":"2023-10-06T04:43:29.795261+0000","last_undegraded":"2023-10-06T04:43:29.795261+0000","last_fullsized":"2023-10-06T04:43:29.795261+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:51:11.168258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.791973+0000","last_change":"2023-10-06T04:43:28.805313+0000","last_active":"2023-10-06T04:43:29.791973+0000","last_peered":"2023-10-06T04:43:29.791973+0000","last_clean":"2023-10-06T04:43:29.791973+0000","last_became_active":"2023-10-06T04:43:28.805065+0000","last_became_peered":"2023-10-06T04:43:28.805065+0000","last_unstale":"2023-10-06T04:43:29.791973+0000","last_undegraded":"2023-10-06T04:43:29.791973+0000","last_fullsized":"2023-10-06T04:43:29.791973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:56.458010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.817957+0000","last_change":"2023-10-06T04:43:29.816196+0000","last_active":"2023-10-06T04:43:29.817957+0000","last_peered":"2023-10-06T04:43:29.817957+0000","last_clean":"2023-10-06T04:43:29.817957+0000","last_became_active":"2023-10-06T04:43:29.815882+0000","last_became_peered":"2023-10-06T04:43:29.815882+0000","last_unstale":"2023-10-06T04:43:29.817957+0000","last_undegraded":"2023-10-06T04:43:29.817957+0000","last_fullsized":"2023-10-06T04:43:29.817957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:51:05.152644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.794366+0000","last_change":"2023-10-06T04:43:24.002057+0000","last_active":"2023-10-06T04:43:29.794366+0000","last_peered":"2023-10-06T04:43:29.794366+0000","last_clean":"2023-10-06T04:43:29.794366+0000","last_became_active":"2023-10-06T04:43:24.001809+0000","last_became_peered":"2023-10-06T04:43:24.001809+0000","last_unstale":"2023-10-06T04:43:29.794366+0000","last_undegraded":"2023-10-06T04:43:29.794366+0000","last_fullsized":"2023-10-06T04:43:29.794366+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:49.693980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.798128+0000","last_change":"2023-10-06T04:43:28.808523+0000","last_active":"2023-10-06T04:43:29.798128+0000","last_peered":"2023-10-06T04:43:29.798128+0000","last_clean":"2023-10-06T04:43:29.798128+0000","last_became_active":"2023-10-06T04:43:28.808269+0000","last_became_peered":"2023-10-06T04:43:28.808269+0000","last_unstale":"2023-10-06T04:43:29.798128+0000","last_undegraded":"2023-10-06T04:43:29.798128+0000","last_fullsized":"2023-10-06T04:43:29.798128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:27.759735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.820605+0000","last_change":"2023-10-06T04:43:29.819416+0000","last_active":"2023-10-06T04:43:29.820605+0000","last_peered":"2023-10-06T04:43:29.820605+0000","last_clean":"2023-10-06T04:43:29.820605+0000","last_became_active":"2023-10-06T04:43:29.819099+0000","last_became_peered":"2023-10-06T04:43:29.819099+0000","last_unstale":"2023-10-06T04:43:29.820605+0000","last_undegraded":"2023-10-06T04:43:29.820605+0000","last_fullsized":"2023-10-06T04:43:29.820605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:54:36.378503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.804775+0000","last_change":"2023-10-06T04:43:24.002394+0000","last_active":"2023-10-06T04:43:29.804775+0000","last_peered":"2023-10-06T04:43:29.804775+0000","last_clean":"2023-10-06T04:43:29.804775+0000","last_became_active":"2023-10-06T04:43:24.001915+0000","last_became_peered":"2023-10-06T04:43:24.001915+0000","last_unstale":"2023-10-06T04:43:29.804775+0000","last_undegraded":"2023-10-06T04:43:29.804775+0000","last_fullsized":"2023-10-06T04:43:29.804775+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:45.031820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.797339+0000","last_change":"2023-10-06T04:43:28.806465+0000","last_active":"2023-10-06T04:43:29.797339+0000","last_peered":"2023-10-06T04:43:29.797339+0000","last_clean":"2023-10-06T04:43:29.797339+0000","last_became_active":"2023-10-06T04:43:28.806021+0000","last_became_peered":"2023-10-06T04:43:28.806021+0000","last_unstale":"2023-10-06T04:43:29.797339+0000","last_undegraded":"2023-10-06T04:43:29.797339+0000","last_fullsized":"2023-10-06T04:43:29.797339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:40.890108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.809755+0000","last_change":"2023-10-06T04:43:29.806132+0000","last_active":"2023-10-06T04:43:29.809755+0000","last_peered":"2023-10-06T04:43:29.809755+0000","last_clean":"2023-10-06T04:43:29.809755+0000","last_became_active":"2023-10-06T04:43:29.805881+0000","last_became_peered":"2023-10-06T04:43:29.805881+0000","last_unstale":"2023-10-06T04:43:29.809755+0000","last_undegraded":"2023-10-06T04:43:29.809755+0000","last_fullsized":"2023-10-06T04:43:29.809755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:07.658289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.808437+0000","last_change":"2023-10-06T04:43:24.002424+0000","last_active":"2023-10-06T04:43:29.808437+0000","last_peered":"2023-10-06T04:43:29.808437+0000","last_clean":"2023-10-06T04:43:29.808437+0000","last_became_active":"2023-10-06T04:43:24.002147+0000","last_became_peered":"2023-10-06T04:43:24.002147+0000","last_unstale":"2023-10-06T04:43:29.808437+0000","last_undegraded":"2023-10-06T04:43:29.808437+0000","last_fullsized":"2023-10-06T04:43:29.808437+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:45.031820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.792081+0000","last_change":"2023-10-06T04:43:28.808630+0000","last_active":"2023-10-06T04:43:29.792081+0000","last_peered":"2023-10-06T04:43:29.792081+0000","last_clean":"2023-10-06T04:43:29.792081+0000","last_became_active":"2023-10-06T04:43:28.808363+0000","last_became_peered":"2023-10-06T04:43:28.808363+0000","last_unstale":"2023-10-06T04:43:29.792081+0000","last_undegraded":"2023-10-06T04:43:29.792081+0000","last_fullsized":"2023-10-06T04:43:29.792081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:35.593992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818694+0000","last_change":"2023-10-06T04:43:29.817659+0000","last_active":"2023-10-06T04:43:29.818694+0000","last_peered":"2023-10-06T04:43:29.818694+0000","last_clean":"2023-10-06T04:43:29.818694+0000","last_became_active":"2023-10-06T04:43:29.817387+0000","last_became_peered":"2023-10-06T04:43:29.817387+0000","last_unstale":"2023-10-06T04:43:29.818694+0000","last_undegraded":"2023-10-06T04:43:29.818694+0000","last_fullsized":"2023-10-06T04:43:29.818694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:15:36.021668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.808409+0000","last_change":"2023-10-06T04:43:23.707408+0000","last_active":"2023-10-06T04:43:29.808409+0000","last_peered":"2023-10-06T04:43:29.808409+0000","last_clean":"2023-10-06T04:43:29.808409+0000","last_became_active":"2023-10-06T04:43:23.707115+0000","last_became_peered":"2023-10-06T04:43:23.707115+0000","last_unstale":"2023-10-06T04:43:29.808409+0000","last_undegraded":"2023-10-06T04:43:29.808409+0000","last_fullsized":"2023-10-06T04:43:29.808409+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:56.213068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.806647+0000","last_change":"2023-10-06T04:43:28.808825+0000","last_active":"2023-10-06T04:43:29.806647+0000","last_peered":"2023-10-06T04:43:29.806647+0000","last_clean":"2023-10-06T04:43:29.806647+0000","last_became_active":"2023-10-06T04:43:28.808542+0000","last_became_peered":"2023-10-06T04:43:28.808542+0000","last_unstale":"2023-10-06T04:43:29.806647+0000","last_undegraded":"2023-10-06T04:43:29.806647+0000","last_fullsized":"2023-10-06T04:43:29.806647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:01:46.254188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.815131+0000","last_change":"2023-10-06T04:43:29.811314+0000","last_active":"2023-10-06T04:43:29.815131+0000","last_peered":"2023-10-06T04:43:29.815131+0000","last_clean":"2023-10-06T04:43:29.815131+0000","last_became_active":"2023-10-06T04:43:29.811044+0000","last_became_peered":"2023-10-06T04:43:29.811044+0000","last_unstale":"2023-10-06T04:43:29.815131+0000","last_undegraded":"2023-10-06T04:43:29.815131+0000","last_fullsized":"2023-10-06T04:43:29.815131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:11.452212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818464+0000","last_change":"2023-10-06T04:43:28.804002+0000","last_active":"2023-10-06T04:43:29.818464+0000","last_peered":"2023-10-06T04:43:29.818464+0000","last_clean":"2023-10-06T04:43:29.818464+0000","last_became_active":"2023-10-06T04:43:28.803300+0000","last_became_peered":"2023-10-06T04:43:28.803300+0000","last_unstale":"2023-10-06T04:43:29.818464+0000","last_undegraded":"2023-10-06T04:43:29.818464+0000","last_fullsized":"2023-10-06T04:43:29.818464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:35.593992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.812023+0000","last_change":"2023-10-06T04:43:29.802812+0000","last_active":"2023-10-06T04:43:29.812023+0000","last_peered":"2023-10-06T04:43:29.812023+0000","last_clean":"2023-10-06T04:43:29.812023+0000","last_became_active":"2023-10-06T04:43:29.802567+0000","last_became_peered":"2023-10-06T04:43:29.802567+0000","last_unstale":"2023-10-06T04:43:29.812023+0000","last_undegraded":"2023-10-06T04:43:29.812023+0000","last_fullsized":"2023-10-06T04:43:29.812023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:28.765256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.821708+0000","last_change":"2023-10-06T04:43:28.811329+0000","last_active":"2023-10-06T04:43:29.821708+0000","last_peered":"2023-10-06T04:43:29.821708+0000","last_clean":"2023-10-06T04:43:29.821708+0000","last_became_active":"2023-10-06T04:43:28.811100+0000","last_became_peered":"2023-10-06T04:43:28.811100+0000","last_unstale":"2023-10-06T04:43:29.821708+0000","last_undegraded":"2023-10-06T04:43:29.821708+0000","last_fullsized":"2023-10-06T04:43:29.821708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:27.759735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.814112+0000","last_change":"2023-10-06T04:43:29.809102+0000","last_active":"2023-10-06T04:43:29.814112+0000","last_peered":"2023-10-06T04:43:29.814112+0000","last_clean":"2023-10-06T04:43:29.814112+0000","last_became_active":"2023-10-06T04:43:29.808096+0000","last_became_peered":"2023-10-06T04:43:29.808096+0000","last_unstale":"2023-10-06T04:43:29.814112+0000","last_undegraded":"2023-10-06T04:43:29.814112+0000","last_fullsized":"2023-10-06T04:43:29.814112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:11.842098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.821722+0000","last_change":"2023-10-06T04:43:28.812260+0000","last_active":"2023-10-06T04:43:29.821722+0000","last_peered":"2023-10-06T04:43:29.821722+0000","last_clean":"2023-10-06T04:43:29.821722+0000","last_became_active":"2023-10-06T04:43:28.811921+0000","last_became_peered":"2023-10-06T04:43:28.811921+0000","last_unstale":"2023-10-06T04:43:29.821722+0000","last_undegraded":"2023-10-06T04:43:29.821722+0000","last_fullsized":"2023-10-06T04:43:29.821722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:12.441174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818129+0000","last_change":"2023-10-06T04:43:29.814258+0000","last_active":"2023-10-06T04:43:29.818129+0000","last_peered":"2023-10-06T04:43:29.818129+0000","last_clean":"2023-10-06T04:43:29.818129+0000","last_became_active":"2023-10-06T04:43:29.811381+0000","last_became_peered":"2023-10-06T04:43:29.811381+0000","last_unstale":"2023-10-06T04:43:29.818129+0000","last_undegraded":"2023-10-06T04:43:29.818129+0000","last_fullsized":"2023-10-06T04:43:29.818129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:13:38.871291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.815419+0000","last_change":"2023-10-06T04:43:28.805288+0000","last_active":"2023-10-06T04:43:29.815419+0000","last_peered":"2023-10-06T04:43:29.815419+0000","last_clean":"2023-10-06T04:43:29.815419+0000","last_became_active":"2023-10-06T04:43:28.805005+0000","last_became_peered":"2023-10-06T04:43:28.805005+0000","last_unstale":"2023-10-06T04:43:29.815419+0000","last_undegraded":"2023-10-06T04:43:29.815419+0000","last_fullsized":"2023-10-06T04:43:29.815419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:05.582666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.815062+0000","last_change":"2023-10-06T04:43:29.808059+0000","last_active":"2023-10-06T04:43:29.815062+0000","last_peered":"2023-10-06T04:43:29.815062+0000","last_clean":"2023-10-06T04:43:29.815062+0000","last_became_active":"2023-10-06T04:43:29.806717+0000","last_became_peered":"2023-10-06T04:43:29.806717+0000","last_unstale":"2023-10-06T04:43:29.815062+0000","last_undegraded":"2023-10-06T04:43:29.815062+0000","last_fullsized":"2023-10-06T04:43:29.815062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:01.271919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.822315+0000","last_change":"2023-10-06T04:43:28.805496+0000","last_active":"2023-10-06T04:43:29.822315+0000","last_peered":"2023-10-06T04:43:29.822315+0000","last_clean":"2023-10-06T04:43:29.822315+0000","last_became_active":"2023-10-06T04:43:28.805197+0000","last_became_peered":"2023-10-06T04:43:28.805197+0000","last_unstale":"2023-10-06T04:43:29.822315+0000","last_undegraded":"2023-10-06T04:43:29.822315+0000","last_fullsized":"2023-10-06T04:43:29.822315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:27.759735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818411+0000","last_change":"2023-10-06T04:43:29.815066+0000","last_active":"2023-10-06T04:43:29.818411+0000","last_peered":"2023-10-06T04:43:29.818411+0000","last_clean":"2023-10-06T04:43:29.818411+0000","last_became_active":"2023-10-06T04:43:29.814792+0000","last_became_peered":"2023-10-06T04:43:29.814792+0000","last_unstale":"2023-10-06T04:43:29.818411+0000","last_undegraded":"2023-10-06T04:43:29.818411+0000","last_fullsized":"2023-10-06T04:43:29.818411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:54.115093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.812529+0000","last_change":"2023-10-06T04:43:29.809634+0000","last_active":"2023-10-06T04:43:29.812529+0000","last_peered":"2023-10-06T04:43:29.812529+0000","last_clean":"2023-10-06T04:43:29.812529+0000","last_became_active":"2023-10-06T04:43:29.809444+0000","last_became_peered":"2023-10-06T04:43:29.809444+0000","last_unstale":"2023-10-06T04:43:29.812529+0000","last_undegraded":"2023-10-06T04:43:29.812529+0000","last_fullsized":"2023-10-06T04:43:29.812529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:06.588187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.808156+0000","last_change":"2023-10-06T04:43:29.806722+0000","last_active":"2023-10-06T04:43:29.808156+0000","last_peered":"2023-10-06T04:43:29.808156+0000","last_clean":"2023-10-06T04:43:29.808156+0000","last_became_active":"2023-10-06T04:43:29.805603+0000","last_became_peered":"2023-10-06T04:43:29.805603+0000","last_unstale":"2023-10-06T04:43:29.808156+0000","last_undegraded":"2023-10-06T04:43:29.808156+0000","last_fullsized":"2023-10-06T04:43:29.808156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:10.192264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818169+0000","last_change":"2023-10-06T04:43:29.814788+0000","last_active":"2023-10-06T04:43:29.818169+0000","last_peered":"2023-10-06T04:43:29.818169+0000","last_clean":"2023-10-06T04:43:29.818169+0000","last_became_active":"2023-10-06T04:43:29.814509+0000","last_became_peered":"2023-10-06T04:43:29.814509+0000","last_unstale":"2023-10-06T04:43:29.818169+0000","last_undegraded":"2023-10-06T04:43:29.818169+0000","last_fullsized":"2023-10-06T04:43:29.818169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:21:23.533461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818470+0000","last_change":"2023-10-06T04:43:29.816479+0000","last_active":"2023-10-06T04:43:29.818470+0000","last_peered":"2023-10-06T04:43:29.818470+0000","last_clean":"2023-10-06T04:43:29.818470+0000","last_became_active":"2023-10-06T04:43:29.816181+0000","last_became_peered":"2023-10-06T04:43:29.816181+0000","last_unstale":"2023-10-06T04:43:29.818470+0000","last_undegraded":"2023-10-06T04:43:29.818470+0000","last_fullsized":"2023-10-06T04:43:29.818470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:23:24.496576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.810410+0000","last_change":"2023-10-06T04:43:29.808166+0000","last_active":"2023-10-06T04:43:29.810410+0000","last_peered":"2023-10-06T04:43:29.810410+0000","last_clean":"2023-10-06T04:43:29.810410+0000","last_became_active":"2023-10-06T04:43:29.807853+0000","last_became_peered":"2023-10-06T04:43:29.807853+0000","last_unstale":"2023-10-06T04:43:29.810410+0000","last_undegraded":"2023-10-06T04:43:29.810410+0000","last_fullsized":"2023-10-06T04:43:29.810410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:57.350546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298108,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073732,"statfs":{"total":96636764160,"available":96331501568,"internally_reserved":0,"allocated":839680,"data_stored":670963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":78843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298080,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073760,"statfs":{"total":96636764160,"available":96331530240,"internally_reserved":0,"allocated":811008,"data_stored":669211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297504,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074336,"statfs":{"total":96636764160,"available":96332120064,"internally_reserved":0,"allocated":221184,"data_stored":79397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":78843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.1280000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.0499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297504,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074336,"statfs":{"total":96636764160,"available":96332120064,"internally_reserved":0,"allocated":221184,"data_stored":78933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297520,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074320,"statfs":{"total":96636764160,"available":96332103680,"internally_reserved":0,"allocated":237568,"data_stored":80435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":79467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:43:38.572 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:43:38.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.721+0000 7f2f6917c700 1 Processor -- start 2023-10-06T04:43:38.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.721+0000 7f2f6917c700 1 -- start start 2023-10-06T04:43:38.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.722+0000 7f2f6917c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2f641572e0 0x7f2f641576b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:38.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.722+0000 7f2f6917c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f6415b1c0 0x7f2f6415b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:38.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.722+0000 7f2f6917c700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2f640b1680 0x7f2f640b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:38.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.722+0000 7f2f6917c700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f6415bb70 con 0x7f2f640b1680 2023-10-06T04:43:38.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.722+0000 7f2f6917c700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f640b3000 con 0x7f2f641572e0 2023-10-06T04:43:38.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.722+0000 7f2f6917c700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f640b23f0 con 0x7f2f6415b1c0 2023-10-06T04:43:38.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.722+0000 7f2f6359e700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2f640b1680 0x7f2f640b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:38.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.722+0000 7f2f6359e700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2f640b1680 0x7f2f640b1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33136/0 (socket says 172.21.15.17:33136) 2023-10-06T04:43:38.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.722+0000 7f2f6359e700 1 -- 172.21.15.17:0/47572622 learned_addr learned my addr 172.21.15.17:0/47572622 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:38.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.723+0000 7f2f6259c700 1 --2- 172.21.15.17:0/47572622 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f6415b1c0 0x7f2f6415b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:38.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.723+0000 7f2f62d9d700 1 --2- 172.21.15.17:0/47572622 >> v2:172.21.15.136:3300/0 conn(0x7f2f641572e0 0x7f2f641576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:38.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.723+0000 7f2f6359e700 1 -- 172.21.15.17:0/47572622 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f6415b1c0 msgr2=0x7f2f6415b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:38.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.723+0000 7f2f6359e700 1 --2- 172.21.15.17:0/47572622 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f6415b1c0 0x7f2f6415b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.723+0000 7f2f6359e700 1 -- 172.21.15.17:0/47572622 >> v2:172.21.15.136:3300/0 conn(0x7f2f641572e0 msgr2=0x7f2f641576b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:38.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.723+0000 7f2f6359e700 1 --2- 172.21.15.17:0/47572622 >> v2:172.21.15.136:3300/0 conn(0x7f2f641572e0 0x7f2f641576b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.723+0000 7f2f6359e700 1 -- 172.21.15.17:0/47572622 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f640b26d0 con 0x7f2f640b1680 2023-10-06T04:43:38.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.723+0000 7f2f62d9d700 1 --2- 172.21.15.17:0/47572622 >> v2:172.21.15.136:3300/0 conn(0x7f2f641572e0 0x7f2f641576b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:43:38.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.723+0000 7f2f6359e700 1 --2- 172.21.15.17:0/47572622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f640b1680 0x7f2f640b1b00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2f6406b1e0 tx=0x7f2f54009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=368f7509ae5cae28 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:38.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.723+0000 7f2f61d9b700 1 -- 172.21.15.17:0/47572622 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5400e070 con 0x7f2f640b1680 2023-10-06T04:43:38.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.723+0000 7f2f61d9b700 1 -- 172.21.15.17:0/47572622 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5400ba50 con 0x7f2f640b1680 2023-10-06T04:43:38.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.723+0000 7f2f61d9b700 1 -- 172.21.15.17:0/47572622 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f540092e0 con 0x7f2f640b1680 2023-10-06T04:43:38.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.723+0000 7f2f6917c700 1 -- 172.21.15.17:0/47572622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f640b1680 msgr2=0x7f2f640b1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:38.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.723+0000 7f2f6917c700 1 --2- 172.21.15.17:0/47572622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f640b1680 0x7f2f640b1b00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2f6406b1e0 tx=0x7f2f54009840 comp rx=0 tx=0).stop 2023-10-06T04:43:38.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.724+0000 7f2f6917c700 1 -- 172.21.15.17:0/47572622 shutdown_connections 2023-10-06T04:43:38.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.724+0000 7f2f6917c700 1 --2- 172.21.15.17:0/47572622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f640b1680 0x7f2f640b1b00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.724+0000 7f2f6917c700 1 --2- 172.21.15.17:0/47572622 >> v2:172.21.15.136:3300/0 conn(0x7f2f641572e0 0x7f2f641576b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.724+0000 7f2f6917c700 1 --2- 172.21.15.17:0/47572622 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f6415b1c0 0x7f2f6415b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.724+0000 7f2f6917c700 1 -- 172.21.15.17:0/47572622 >> 172.21.15.17:0/47572622 conn(0x7f2f6406cd40 msgr2=0x7f2f64087fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:38.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.724+0000 7f2f6917c700 1 -- 172.21.15.17:0/47572622 shutdown_connections 2023-10-06T04:43:38.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.724+0000 7f2f6917c700 1 -- 172.21.15.17:0/47572622 wait complete. 2023-10-06T04:43:38.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.725+0000 7f2f6917c700 1 Processor -- start 2023-10-06T04:43:38.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.725+0000 7f2f6917c700 1 -- start start 2023-10-06T04:43:38.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.726+0000 7f2f6917c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f640b1680 0x7f2f640adc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:38.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.726+0000 7f2f6917c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f641572e0 0x7f2f6415a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:38.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.726+0000 7f2f6917c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f6415b1c0 0x7f2f640cda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:38.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.726+0000 7f2f6917c700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f640ac0f0 con 0x7f2f640b1680 2023-10-06T04:43:38.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.726+0000 7f2f6917c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f640ad3d0 con 0x7f2f641572e0 2023-10-06T04:43:38.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.726+0000 7f2f6917c700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f640ab470 con 0x7f2f6415b1c0 2023-10-06T04:43:38.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.726+0000 7f2f62d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f640b1680 0x7f2f640adc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:38.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.726+0000 7f2f62d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f640b1680 0x7f2f640adc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33152/0 (socket says 172.21.15.17:33152) 2023-10-06T04:43:38.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.726+0000 7f2f62d9d700 1 -- 172.21.15.17:0/1756468332 learned_addr learned my addr 172.21.15.17:0/1756468332 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:38.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.726+0000 7f2f6359e700 1 --2- 172.21.15.17:0/1756468332 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f6415b1c0 0x7f2f640cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:38.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.726+0000 7f2f6259c700 1 --2- 172.21.15.17:0/1756468332 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f641572e0 0x7f2f6415a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:38.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.726+0000 7f2f62d9d700 1 -- 172.21.15.17:0/1756468332 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f6415b1c0 msgr2=0x7f2f640cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:38.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.726+0000 7f2f62d9d700 1 --2- 172.21.15.17:0/1756468332 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f6415b1c0 0x7f2f640cda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.726+0000 7f2f62d9d700 1 -- 172.21.15.17:0/1756468332 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f641572e0 msgr2=0x7f2f6415a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:38.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.726+0000 7f2f62d9d700 1 --2- 172.21.15.17:0/1756468332 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f641572e0 0x7f2f6415a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.726+0000 7f2f62d9d700 1 -- 172.21.15.17:0/1756468332 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f54009ae0 con 0x7f2f640b1680 2023-10-06T04:43:38.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.726+0000 7f2f6259c700 1 --2- 172.21.15.17:0/1756468332 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f641572e0 0x7f2f6415a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:43:38.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.726+0000 7f2f62d9d700 1 --2- 172.21.15.17:0/1756468332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f640b1680 0x7f2f640adc40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c00c830 tx=0x7f2f5c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:38.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.726+0000 7f2f5affd700 1 -- 172.21.15.17:0/1756468332 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c011600 con 0x7f2f640b1680 2023-10-06T04:43:38.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.726+0000 7f2f5affd700 1 -- 172.21.15.17:0/1756468332 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5c011760 con 0x7f2f640b1680 2023-10-06T04:43:38.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.726+0000 7f2f6917c700 1 -- 172.21.15.17:0/1756468332 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f640ab750 con 0x7f2f640b1680 2023-10-06T04:43:38.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.726+0000 7f2f5affd700 1 -- 172.21.15.17:0/1756468332 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c011b20 con 0x7f2f640b1680 2023-10-06T04:43:38.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.726+0000 7f2f6917c700 1 -- 172.21.15.17:0/1756468332 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f640abd10 con 0x7f2f640b1680 2023-10-06T04:43:38.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.727+0000 7f2f6917c700 1 -- 172.21.15.17:0/1756468332 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f640ac230 con 0x7f2f640b1680 2023-10-06T04:43:38.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.728+0000 7f2f5affd700 1 -- 172.21.15.17:0/1756468332 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f5c00a3e0 con 0x7f2f640b1680 2023-10-06T04:43:38.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.728+0000 7f2f5affd700 1 --2- 172.21.15.17:0/1756468332 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2f44066f30 0x7f2f440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:38.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.728+0000 7f2f6259c700 1 --2- 172.21.15.17:0/1756468332 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2f44066f30 0x7f2f440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:38.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.728+0000 7f2f5affd700 1 -- 172.21.15.17:0/1756468332 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2f5c084b50 con 0x7f2f640b1680 2023-10-06T04:43:38.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.729+0000 7f2f6259c700 1 --2- 172.21.15.17:0/1756468332 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2f44066f30 0x7f2f440693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2f6416ba20 tx=0x7f2f4c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:38.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.732+0000 7f2f5affd700 1 -- 172.21.15.17:0/1756468332 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f640ac230 con 0x7f2f640b1680 2023-10-06T04:43:38.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.923+0000 7f2f6917c700 1 -- 172.21.15.17:0/1756468332 --> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2f640ac230 con 0x7f2f44066f30 2023-10-06T04:43:38.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.931+0000 7f2f5affd700 1 -- 172.21.15.17:0/1756468332 <== mgr.4104 v2:172.21.15.17:6832/90424 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286857 (secure 0 0 0) 0x7f2f640ac230 con 0x7f2f44066f30 2023-10-06T04:43:38.936 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:43:38.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.934+0000 7f2f6917c700 1 -- 172.21.15.17:0/1756468332 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2f44066f30 msgr2=0x7f2f440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:38.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.934+0000 7f2f6917c700 1 --2- 172.21.15.17:0/1756468332 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2f44066f30 0x7f2f440693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2f6416ba20 tx=0x7f2f4c008040 comp rx=0 tx=0).stop 2023-10-06T04:43:38.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.934+0000 7f2f6917c700 1 -- 172.21.15.17:0/1756468332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f640b1680 msgr2=0x7f2f640adc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:38.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.934+0000 7f2f6917c700 1 --2- 172.21.15.17:0/1756468332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f640b1680 0x7f2f640adc40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c00c830 tx=0x7f2f5c008040 comp rx=0 tx=0).stop 2023-10-06T04:43:38.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.934+0000 7f2f6917c700 1 -- 172.21.15.17:0/1756468332 shutdown_connections 2023-10-06T04:43:38.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.934+0000 7f2f6917c700 1 --2- 172.21.15.17:0/1756468332 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2f44066f30 0x7f2f440693e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.934+0000 7f2f6917c700 1 --2- 172.21.15.17:0/1756468332 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f6415b1c0 0x7f2f640cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.934+0000 7f2f6917c700 1 --2- 172.21.15.17:0/1756468332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f640b1680 0x7f2f640adc40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.934+0000 7f2f6917c700 1 --2- 172.21.15.17:0/1756468332 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f641572e0 0x7f2f6415a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:38.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.934+0000 7f2f6917c700 1 -- 172.21.15.17:0/1756468332 >> 172.21.15.17:0/1756468332 conn(0x7f2f6406cd40 msgr2=0x7f2f64155fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:38.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.934+0000 7f2f6917c700 1 -- 172.21.15.17:0/1756468332 shutdown_connections 2023-10-06T04:43:38.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:38.934+0000 7f2f6917c700 1 -- 172.21.15.17:0/1756468332 wait complete. 2023-10-06T04:43:38.940 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-06T04:43:38.948 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-06T04:43:38.337496+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381224,"kb_used_data":2920,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593496,"statfs":{"total":773094113280,"available":770655739904,"internally_reserved":0,"allocated":2990080,"data_stored":1816092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.546969"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.811950+0000","last_change":"2023-10-06T04:43:29.806928+0000","last_active":"2023-10-06T04:43:29.811950+0000","last_peered":"2023-10-06T04:43:29.811950+0000","last_clean":"2023-10-06T04:43:29.811950+0000","last_became_active":"2023-10-06T04:43:29.806647+0000","last_became_peered":"2023-10-06T04:43:29.806647+0000","last_unstale":"2023-10-06T04:43:29.811950+0000","last_undegraded":"2023-10-06T04:43:29.811950+0000","last_fullsized":"2023-10-06T04:43:29.811950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:36.599513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.822106+0000","last_change":"2023-10-06T04:43:29.816979+0000","last_active":"2023-10-06T04:43:29.822106+0000","last_peered":"2023-10-06T04:43:29.822106+0000","last_clean":"2023-10-06T04:43:29.822106+0000","last_became_active":"2023-10-06T04:43:29.812045+0000","last_became_peered":"2023-10-06T04:43:29.812045+0000","last_unstale":"2023-10-06T04:43:29.822106+0000","last_undegraded":"2023-10-06T04:43:29.822106+0000","last_fullsized":"2023-10-06T04:43:29.822106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:23:24.496576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818087+0000","last_change":"2023-10-06T04:43:29.811591+0000","last_active":"2023-10-06T04:43:29.818087+0000","last_peered":"2023-10-06T04:43:29.818087+0000","last_clean":"2023-10-06T04:43:29.818087+0000","last_became_active":"2023-10-06T04:43:29.810621+0000","last_became_peered":"2023-10-06T04:43:29.810621+0000","last_unstale":"2023-10-06T04:43:29.818087+0000","last_undegraded":"2023-10-06T04:43:29.818087+0000","last_fullsized":"2023-10-06T04:43:29.818087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:58.730973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.813045+0000","last_change":"2023-10-06T04:43:29.810774+0000","last_active":"2023-10-06T04:43:29.813045+0000","last_peered":"2023-10-06T04:43:29.813045+0000","last_clean":"2023-10-06T04:43:29.813045+0000","last_became_active":"2023-10-06T04:43:29.810469+0000","last_became_peered":"2023-10-06T04:43:29.810469+0000","last_unstale":"2023-10-06T04:43:29.813045+0000","last_undegraded":"2023-10-06T04:43:29.813045+0000","last_fullsized":"2023-10-06T04:43:29.813045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:00:08.876120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.809045+0000","last_change":"2023-10-06T04:43:29.804144+0000","last_active":"2023-10-06T04:43:29.809045+0000","last_peered":"2023-10-06T04:43:29.809045+0000","last_clean":"2023-10-06T04:43:29.809045+0000","last_became_active":"2023-10-06T04:43:29.803873+0000","last_became_peered":"2023-10-06T04:43:29.803873+0000","last_unstale":"2023-10-06T04:43:29.809045+0000","last_undegraded":"2023-10-06T04:43:29.809045+0000","last_fullsized":"2023-10-06T04:43:29.809045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:01.271919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.819195+0000","last_change":"2023-10-06T04:43:29.816295+0000","last_active":"2023-10-06T04:43:29.819195+0000","last_peered":"2023-10-06T04:43:29.819195+0000","last_clean":"2023-10-06T04:43:29.819195+0000","last_became_active":"2023-10-06T04:43:29.815965+0000","last_became_peered":"2023-10-06T04:43:29.815965+0000","last_unstale":"2023-10-06T04:43:29.819195+0000","last_undegraded":"2023-10-06T04:43:29.819195+0000","last_fullsized":"2023-10-06T04:43:29.819195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:55:19.523530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.820937+0000","last_change":"2023-10-06T04:43:29.807856+0000","last_active":"2023-10-06T04:43:29.820937+0000","last_peered":"2023-10-06T04:43:29.820937+0000","last_clean":"2023-10-06T04:43:29.820937+0000","last_became_active":"2023-10-06T04:43:29.807253+0000","last_became_peered":"2023-10-06T04:43:29.807253+0000","last_unstale":"2023-10-06T04:43:29.820937+0000","last_undegraded":"2023-10-06T04:43:29.820937+0000","last_fullsized":"2023-10-06T04:43:29.820937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:15:36.021668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.822161+0000","last_change":"2023-10-06T04:43:29.817890+0000","last_active":"2023-10-06T04:43:29.822161+0000","last_peered":"2023-10-06T04:43:29.822161+0000","last_clean":"2023-10-06T04:43:29.822161+0000","last_became_active":"2023-10-06T04:43:29.817653+0000","last_became_peered":"2023-10-06T04:43:29.817653+0000","last_unstale":"2023-10-06T04:43:29.822161+0000","last_undegraded":"2023-10-06T04:43:29.822161+0000","last_fullsized":"2023-10-06T04:43:29.822161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:11.685749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.816847+0000","last_change":"2023-10-06T04:43:29.815194+0000","last_active":"2023-10-06T04:43:29.816847+0000","last_peered":"2023-10-06T04:43:29.816847+0000","last_clean":"2023-10-06T04:43:29.816847+0000","last_became_active":"2023-10-06T04:43:29.814925+0000","last_became_peered":"2023-10-06T04:43:29.814925+0000","last_unstale":"2023-10-06T04:43:29.816847+0000","last_undegraded":"2023-10-06T04:43:29.816847+0000","last_fullsized":"2023-10-06T04:43:29.816847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:52.381232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.817067+0000","last_change":"2023-10-06T04:43:29.811845+0000","last_active":"2023-10-06T04:43:29.817067+0000","last_peered":"2023-10-06T04:43:29.817067+0000","last_clean":"2023-10-06T04:43:29.817067+0000","last_became_active":"2023-10-06T04:43:29.811569+0000","last_became_peered":"2023-10-06T04:43:29.811569+0000","last_unstale":"2023-10-06T04:43:29.817067+0000","last_undegraded":"2023-10-06T04:43:29.817067+0000","last_fullsized":"2023-10-06T04:43:29.817067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:11.452212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.819391+0000","last_change":"2023-10-06T04:43:29.815826+0000","last_active":"2023-10-06T04:43:29.819391+0000","last_peered":"2023-10-06T04:43:29.819391+0000","last_clean":"2023-10-06T04:43:29.819391+0000","last_became_active":"2023-10-06T04:43:29.811044+0000","last_became_peered":"2023-10-06T04:43:29.811044+0000","last_unstale":"2023-10-06T04:43:29.819391+0000","last_undegraded":"2023-10-06T04:43:29.819391+0000","last_fullsized":"2023-10-06T04:43:29.819391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:51.734715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818330+0000","last_change":"2023-10-06T04:43:29.816792+0000","last_active":"2023-10-06T04:43:29.818330+0000","last_peered":"2023-10-06T04:43:29.818330+0000","last_clean":"2023-10-06T04:43:29.818330+0000","last_became_active":"2023-10-06T04:43:29.816556+0000","last_became_peered":"2023-10-06T04:43:29.816556+0000","last_unstale":"2023-10-06T04:43:29.818330+0000","last_undegraded":"2023-10-06T04:43:29.818330+0000","last_fullsized":"2023-10-06T04:43:29.818330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:01:47.259709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.811880+0000","last_change":"2023-10-06T04:43:29.808514+0000","last_active":"2023-10-06T04:43:29.811880+0000","last_peered":"2023-10-06T04:43:29.811880+0000","last_clean":"2023-10-06T04:43:29.811880+0000","last_became_active":"2023-10-06T04:43:29.808290+0000","last_became_peered":"2023-10-06T04:43:29.808290+0000","last_unstale":"2023-10-06T04:43:29.811880+0000","last_undegraded":"2023-10-06T04:43:29.811880+0000","last_fullsized":"2023-10-06T04:43:29.811880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:41.895629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.816945+0000","last_change":"2023-10-06T04:43:29.810539+0000","last_active":"2023-10-06T04:43:29.816945+0000","last_peered":"2023-10-06T04:43:29.816945+0000","last_clean":"2023-10-06T04:43:29.816945+0000","last_became_active":"2023-10-06T04:43:29.809976+0000","last_became_peered":"2023-10-06T04:43:29.809976+0000","last_unstale":"2023-10-06T04:43:29.816945+0000","last_undegraded":"2023-10-06T04:43:29.816945+0000","last_fullsized":"2023-10-06T04:43:29.816945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:07.658289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.820956+0000","last_change":"2023-10-06T04:43:29.808047+0000","last_active":"2023-10-06T04:43:29.820956+0000","last_peered":"2023-10-06T04:43:29.820956+0000","last_clean":"2023-10-06T04:43:29.820956+0000","last_became_active":"2023-10-06T04:43:29.807598+0000","last_became_peered":"2023-10-06T04:43:29.807598+0000","last_unstale":"2023-10-06T04:43:29.820956+0000","last_undegraded":"2023-10-06T04:43:29.820956+0000","last_fullsized":"2023-10-06T04:43:29.820956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:11.685749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.815174+0000","last_change":"2023-10-06T04:43:29.807538+0000","last_active":"2023-10-06T04:43:29.815174+0000","last_peered":"2023-10-06T04:43:29.815174+0000","last_clean":"2023-10-06T04:43:29.815174+0000","last_became_active":"2023-10-06T04:43:29.807299+0000","last_became_peered":"2023-10-06T04:43:29.807299+0000","last_unstale":"2023-10-06T04:43:29.815174+0000","last_undegraded":"2023-10-06T04:43:29.815174+0000","last_fullsized":"2023-10-06T04:43:29.815174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:15:36.021668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.817840+0000","last_change":"2023-10-06T04:43:29.816450+0000","last_active":"2023-10-06T04:43:29.817840+0000","last_peered":"2023-10-06T04:43:29.817840+0000","last_clean":"2023-10-06T04:43:29.817840+0000","last_became_active":"2023-10-06T04:43:29.816180+0000","last_became_peered":"2023-10-06T04:43:29.816180+0000","last_unstale":"2023-10-06T04:43:29.817840+0000","last_undegraded":"2023-10-06T04:43:29.817840+0000","last_fullsized":"2023-10-06T04:43:29.817840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:45.205428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818676+0000","last_change":"2023-10-06T04:43:29.815225+0000","last_active":"2023-10-06T04:43:29.818676+0000","last_peered":"2023-10-06T04:43:29.818676+0000","last_clean":"2023-10-06T04:43:29.818676+0000","last_became_active":"2023-10-06T04:43:29.814940+0000","last_became_peered":"2023-10-06T04:43:29.814940+0000","last_unstale":"2023-10-06T04:43:29.818676+0000","last_undegraded":"2023-10-06T04:43:29.818676+0000","last_fullsized":"2023-10-06T04:43:29.818676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:01.271919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.815444+0000","last_change":"2023-10-06T04:43:29.814413+0000","last_active":"2023-10-06T04:43:29.815444+0000","last_peered":"2023-10-06T04:43:29.815444+0000","last_clean":"2023-10-06T04:43:29.815444+0000","last_became_active":"2023-10-06T04:43:29.814183+0000","last_became_peered":"2023-10-06T04:43:29.814183+0000","last_unstale":"2023-10-06T04:43:29.815444+0000","last_undegraded":"2023-10-06T04:43:29.815444+0000","last_fullsized":"2023-10-06T04:43:29.815444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:13.446695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.819145+0000","last_change":"2023-10-06T04:43:29.816764+0000","last_active":"2023-10-06T04:43:29.819145+0000","last_peered":"2023-10-06T04:43:29.819145+0000","last_clean":"2023-10-06T04:43:29.819145+0000","last_became_active":"2023-10-06T04:43:29.816331+0000","last_became_peered":"2023-10-06T04:43:29.816331+0000","last_unstale":"2023-10-06T04:43:29.819145+0000","last_undegraded":"2023-10-06T04:43:29.819145+0000","last_fullsized":"2023-10-06T04:43:29.819145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:30.317282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.820849+0000","last_change":"2023-10-06T04:43:29.808614+0000","last_active":"2023-10-06T04:43:29.820849+0000","last_peered":"2023-10-06T04:43:29.820849+0000","last_clean":"2023-10-06T04:43:29.820849+0000","last_became_active":"2023-10-06T04:43:29.808340+0000","last_became_peered":"2023-10-06T04:43:29.808340+0000","last_unstale":"2023-10-06T04:43:29.820849+0000","last_undegraded":"2023-10-06T04:43:29.820849+0000","last_fullsized":"2023-10-06T04:43:29.820849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:34.271308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.804371+0000","last_change":"2023-10-06T04:43:29.802581+0000","last_active":"2023-10-06T04:43:29.804371+0000","last_peered":"2023-10-06T04:43:29.804371+0000","last_clean":"2023-10-06T04:43:29.804371+0000","last_became_active":"2023-10-06T04:43:29.802296+0000","last_became_peered":"2023-10-06T04:43:29.802296+0000","last_unstale":"2023-10-06T04:43:29.804371+0000","last_undegraded":"2023-10-06T04:43:29.804371+0000","last_fullsized":"2023-10-06T04:43:29.804371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:34.271308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.812033+0000","last_change":"2023-10-06T04:43:29.807277+0000","last_active":"2023-10-06T04:43:29.812033+0000","last_peered":"2023-10-06T04:43:29.812033+0000","last_clean":"2023-10-06T04:43:29.812033+0000","last_became_active":"2023-10-06T04:43:29.807007+0000","last_became_peered":"2023-10-06T04:43:29.807007+0000","last_unstale":"2023-10-06T04:43:29.812033+0000","last_undegraded":"2023-10-06T04:43:29.812033+0000","last_fullsized":"2023-10-06T04:43:29.812033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:51.734715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.820779+0000","last_change":"2023-10-06T04:43:29.807216+0000","last_active":"2023-10-06T04:43:29.820779+0000","last_peered":"2023-10-06T04:43:29.820779+0000","last_clean":"2023-10-06T04:43:29.820779+0000","last_became_active":"2023-10-06T04:43:29.806926+0000","last_became_peered":"2023-10-06T04:43:29.806926+0000","last_unstale":"2023-10-06T04:43:29.820779+0000","last_undegraded":"2023-10-06T04:43:29.820779+0000","last_fullsized":"2023-10-06T04:43:29.820779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:45.205428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.811127+0000","last_change":"2023-10-06T04:43:29.809554+0000","last_active":"2023-10-06T04:43:29.811127+0000","last_peered":"2023-10-06T04:43:29.811127+0000","last_clean":"2023-10-06T04:43:29.811127+0000","last_became_active":"2023-10-06T04:43:29.809289+0000","last_became_peered":"2023-10-06T04:43:29.809289+0000","last_unstale":"2023-10-06T04:43:29.811127+0000","last_undegraded":"2023-10-06T04:43:29.811127+0000","last_fullsized":"2023-10-06T04:43:29.811127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:11.685749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.807574+0000","last_change":"2023-10-06T04:43:29.802420+0000","last_active":"2023-10-06T04:43:29.807574+0000","last_peered":"2023-10-06T04:43:29.807574+0000","last_clean":"2023-10-06T04:43:29.807574+0000","last_became_active":"2023-10-06T04:43:29.802164+0000","last_became_peered":"2023-10-06T04:43:29.802164+0000","last_unstale":"2023-10-06T04:43:29.807574+0000","last_undegraded":"2023-10-06T04:43:29.807574+0000","last_fullsized":"2023-10-06T04:43:29.807574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:40.869182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.822213+0000","last_change":"2023-10-06T04:43:29.820720+0000","last_active":"2023-10-06T04:43:29.822213+0000","last_peered":"2023-10-06T04:43:29.822213+0000","last_clean":"2023-10-06T04:43:29.822213+0000","last_became_active":"2023-10-06T04:43:29.817226+0000","last_became_peered":"2023-10-06T04:43:29.817226+0000","last_unstale":"2023-10-06T04:43:29.822213+0000","last_undegraded":"2023-10-06T04:43:29.822213+0000","last_fullsized":"2023-10-06T04:43:29.822213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:45.205428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.821084+0000","last_change":"2023-10-06T04:43:28.805712+0000","last_active":"2023-10-06T04:43:29.821084+0000","last_peered":"2023-10-06T04:43:29.821084+0000","last_clean":"2023-10-06T04:43:29.821084+0000","last_became_active":"2023-10-06T04:43:28.805368+0000","last_became_peered":"2023-10-06T04:43:28.805368+0000","last_unstale":"2023-10-06T04:43:29.821084+0000","last_undegraded":"2023-10-06T04:43:29.821084+0000","last_fullsized":"2023-10-06T04:43:29.821084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:12.441174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.808717+0000","last_change":"2023-10-06T04:43:29.806230+0000","last_active":"2023-10-06T04:43:29.808717+0000","last_peered":"2023-10-06T04:43:29.808717+0000","last_clean":"2023-10-06T04:43:29.808717+0000","last_became_active":"2023-10-06T04:43:29.805977+0000","last_became_peered":"2023-10-06T04:43:29.805977+0000","last_unstale":"2023-10-06T04:43:29.808717+0000","last_undegraded":"2023-10-06T04:43:29.808717+0000","last_fullsized":"2023-10-06T04:43:29.808717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:11.727749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.791893+0000","last_change":"2023-10-06T04:43:28.810385+0000","last_active":"2023-10-06T04:43:29.791893+0000","last_peered":"2023-10-06T04:43:29.791893+0000","last_clean":"2023-10-06T04:43:29.791893+0000","last_became_active":"2023-10-06T04:43:28.810187+0000","last_became_peered":"2023-10-06T04:43:28.810187+0000","last_unstale":"2023-10-06T04:43:29.791893+0000","last_undegraded":"2023-10-06T04:43:29.791893+0000","last_fullsized":"2023-10-06T04:43:29.791893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:40.890108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.804061+0000","last_change":"2023-10-06T04:43:29.799004+0000","last_active":"2023-10-06T04:43:29.804061+0000","last_peered":"2023-10-06T04:43:29.804061+0000","last_clean":"2023-10-06T04:43:29.804061+0000","last_became_active":"2023-10-06T04:43:29.798724+0000","last_became_peered":"2023-10-06T04:43:29.798724+0000","last_unstale":"2023-10-06T04:43:29.804061+0000","last_undegraded":"2023-10-06T04:43:29.804061+0000","last_fullsized":"2023-10-06T04:43:29.804061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:11.685749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.799049+0000","last_change":"2023-10-06T04:43:28.807299+0000","last_active":"2023-10-06T04:43:29.799049+0000","last_peered":"2023-10-06T04:43:29.799049+0000","last_clean":"2023-10-06T04:43:29.799049+0000","last_became_active":"2023-10-06T04:43:28.806721+0000","last_became_peered":"2023-10-06T04:43:28.806721+0000","last_unstale":"2023-10-06T04:43:29.799049+0000","last_undegraded":"2023-10-06T04:43:29.799049+0000","last_fullsized":"2023-10-06T04:43:29.799049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:50:16.072055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.820353+0000","last_change":"2023-10-06T04:43:29.816337+0000","last_active":"2023-10-06T04:43:29.820353+0000","last_peered":"2023-10-06T04:43:29.820353+0000","last_clean":"2023-10-06T04:43:29.820353+0000","last_became_active":"2023-10-06T04:43:29.816020+0000","last_became_peered":"2023-10-06T04:43:29.816020+0000","last_unstale":"2023-10-06T04:43:29.820353+0000","last_undegraded":"2023-10-06T04:43:29.820353+0000","last_fullsized":"2023-10-06T04:43:29.820353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:40.869182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.796225+0000","last_change":"2023-10-06T04:43:28.805467+0000","last_active":"2023-10-06T04:43:29.796225+0000","last_peered":"2023-10-06T04:43:29.796225+0000","last_clean":"2023-10-06T04:43:29.796225+0000","last_became_active":"2023-10-06T04:43:28.804827+0000","last_became_peered":"2023-10-06T04:43:28.804827+0000","last_unstale":"2023-10-06T04:43:29.796225+0000","last_undegraded":"2023-10-06T04:43:29.796225+0000","last_fullsized":"2023-10-06T04:43:29.796225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:01:46.254188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.808207+0000","last_change":"2023-10-06T04:43:29.806347+0000","last_active":"2023-10-06T04:43:29.808207+0000","last_peered":"2023-10-06T04:43:29.808207+0000","last_clean":"2023-10-06T04:43:29.808207+0000","last_became_active":"2023-10-06T04:43:29.803738+0000","last_became_peered":"2023-10-06T04:43:29.803738+0000","last_unstale":"2023-10-06T04:43:29.808207+0000","last_undegraded":"2023-10-06T04:43:29.808207+0000","last_fullsized":"2023-10-06T04:43:29.808207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:54.115093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.806979+0000","last_change":"2023-10-06T04:43:28.808150+0000","last_active":"2023-10-06T04:43:29.806979+0000","last_peered":"2023-10-06T04:43:29.806979+0000","last_clean":"2023-10-06T04:43:29.806979+0000","last_became_active":"2023-10-06T04:43:28.807880+0000","last_became_peered":"2023-10-06T04:43:28.807880+0000","last_unstale":"2023-10-06T04:43:29.806979+0000","last_undegraded":"2023-10-06T04:43:29.806979+0000","last_fullsized":"2023-10-06T04:43:29.806979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:40.890108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.815591+0000","last_change":"2023-10-06T04:43:29.813344+0000","last_active":"2023-10-06T04:43:29.815591+0000","last_peered":"2023-10-06T04:43:29.815591+0000","last_clean":"2023-10-06T04:43:29.815591+0000","last_became_active":"2023-10-06T04:43:29.813115+0000","last_became_peered":"2023-10-06T04:43:29.813115+0000","last_unstale":"2023-10-06T04:43:29.815591+0000","last_undegraded":"2023-10-06T04:43:29.815591+0000","last_fullsized":"2023-10-06T04:43:29.815591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:52.381232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.815998+0000","last_change":"2023-10-06T04:43:28.807514+0000","last_active":"2023-10-06T04:43:29.815998+0000","last_peered":"2023-10-06T04:43:29.815998+0000","last_clean":"2023-10-06T04:43:29.815998+0000","last_became_active":"2023-10-06T04:43:28.807226+0000","last_became_peered":"2023-10-06T04:43:28.807226+0000","last_unstale":"2023-10-06T04:43:29.815998+0000","last_undegraded":"2023-10-06T04:43:29.815998+0000","last_fullsized":"2023-10-06T04:43:29.815998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:54:35.372982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.812081+0000","last_change":"2023-10-06T04:43:29.810145+0000","last_active":"2023-10-06T04:43:29.812081+0000","last_peered":"2023-10-06T04:43:29.812081+0000","last_clean":"2023-10-06T04:43:29.812081+0000","last_became_active":"2023-10-06T04:43:29.809512+0000","last_became_peered":"2023-10-06T04:43:29.809512+0000","last_unstale":"2023-10-06T04:43:29.812081+0000","last_undegraded":"2023-10-06T04:43:29.812081+0000","last_fullsized":"2023-10-06T04:43:29.812081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:15:36.021668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.825075+0000","last_change":"2023-10-06T04:43:28.803587+0000","last_active":"2023-10-06T04:43:29.825075+0000","last_peered":"2023-10-06T04:43:29.825075+0000","last_clean":"2023-10-06T04:43:29.825075+0000","last_became_active":"2023-10-06T04:43:28.801777+0000","last_became_peered":"2023-10-06T04:43:28.801777+0000","last_unstale":"2023-10-06T04:43:29.825075+0000","last_undegraded":"2023-10-06T04:43:29.825075+0000","last_fullsized":"2023-10-06T04:43:29.825075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:56.458010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818645+0000","last_change":"2023-10-06T04:43:29.815592+0000","last_active":"2023-10-06T04:43:29.818645+0000","last_peered":"2023-10-06T04:43:29.818645+0000","last_clean":"2023-10-06T04:43:29.818645+0000","last_became_active":"2023-10-06T04:43:29.815322+0000","last_became_peered":"2023-10-06T04:43:29.815322+0000","last_unstale":"2023-10-06T04:43:29.818645+0000","last_undegraded":"2023-10-06T04:43:29.818645+0000","last_fullsized":"2023-10-06T04:43:29.818645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:10.192264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.817564+0000","last_change":"2023-10-06T04:43:28.802843+0000","last_active":"2023-10-06T04:43:29.817564+0000","last_peered":"2023-10-06T04:43:29.817564+0000","last_clean":"2023-10-06T04:43:29.817564+0000","last_became_active":"2023-10-06T04:43:28.802554+0000","last_became_peered":"2023-10-06T04:43:28.802554+0000","last_unstale":"2023-10-06T04:43:29.817564+0000","last_undegraded":"2023-10-06T04:43:29.817564+0000","last_fullsized":"2023-10-06T04:43:29.817564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:00:07.870599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.808168+0000","last_change":"2023-10-06T04:43:29.805945+0000","last_active":"2023-10-06T04:43:29.808168+0000","last_peered":"2023-10-06T04:43:29.808168+0000","last_clean":"2023-10-06T04:43:29.808168+0000","last_became_active":"2023-10-06T04:43:29.805658+0000","last_became_peered":"2023-10-06T04:43:29.805658+0000","last_unstale":"2023-10-06T04:43:29.808168+0000","last_undegraded":"2023-10-06T04:43:29.808168+0000","last_fullsized":"2023-10-06T04:43:29.808168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:38.867495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.795558+0000","last_change":"2023-10-06T04:43:28.797338+0000","last_active":"2023-10-06T04:43:29.795558+0000","last_peered":"2023-10-06T04:43:29.795558+0000","last_clean":"2023-10-06T04:43:29.795558+0000","last_became_active":"2023-10-06T04:43:28.797048+0000","last_became_peered":"2023-10-06T04:43:28.797048+0000","last_unstale":"2023-10-06T04:43:29.795558+0000","last_undegraded":"2023-10-06T04:43:29.795558+0000","last_fullsized":"2023-10-06T04:43:29.795558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:40.890108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.822225+0000","last_change":"2023-10-06T04:43:29.820733+0000","last_active":"2023-10-06T04:43:29.822225+0000","last_peered":"2023-10-06T04:43:29.822225+0000","last_clean":"2023-10-06T04:43:29.822225+0000","last_became_active":"2023-10-06T04:43:29.817165+0000","last_became_peered":"2023-10-06T04:43:29.817165+0000","last_unstale":"2023-10-06T04:43:29.822225+0000","last_undegraded":"2023-10-06T04:43:29.822225+0000","last_fullsized":"2023-10-06T04:43:29.822225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:34.271308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.795120+0000","last_change":"2023-10-06T04:43:28.806709+0000","last_active":"2023-10-06T04:43:29.795120+0000","last_peered":"2023-10-06T04:43:29.795120+0000","last_clean":"2023-10-06T04:43:29.795120+0000","last_became_active":"2023-10-06T04:43:28.806455+0000","last_became_peered":"2023-10-06T04:43:28.806455+0000","last_unstale":"2023-10-06T04:43:29.795120+0000","last_undegraded":"2023-10-06T04:43:29.795120+0000","last_fullsized":"2023-10-06T04:43:29.795120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:05.582666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.810403+0000","last_change":"2023-10-06T04:43:29.807303+0000","last_active":"2023-10-06T04:43:29.810403+0000","last_peered":"2023-10-06T04:43:29.810403+0000","last_clean":"2023-10-06T04:43:29.810403+0000","last_became_active":"2023-10-06T04:43:29.807034+0000","last_became_peered":"2023-10-06T04:43:29.807034+0000","last_unstale":"2023-10-06T04:43:29.810403+0000","last_undegraded":"2023-10-06T04:43:29.810403+0000","last_fullsized":"2023-10-06T04:43:29.810403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:51.734715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.820164+0000","last_change":"2023-10-06T04:43:28.807312+0000","last_active":"2023-10-06T04:43:29.820164+0000","last_peered":"2023-10-06T04:43:29.820164+0000","last_clean":"2023-10-06T04:43:29.820164+0000","last_became_active":"2023-10-06T04:43:28.807035+0000","last_became_peered":"2023-10-06T04:43:28.807035+0000","last_unstale":"2023-10-06T04:43:29.820164+0000","last_undegraded":"2023-10-06T04:43:29.820164+0000","last_fullsized":"2023-10-06T04:43:29.820164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:35.593992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818496+0000","last_change":"2023-10-06T04:43:29.816482+0000","last_active":"2023-10-06T04:43:29.818496+0000","last_peered":"2023-10-06T04:43:29.818496+0000","last_clean":"2023-10-06T04:43:29.818496+0000","last_became_active":"2023-10-06T04:43:29.816211+0000","last_became_peered":"2023-10-06T04:43:29.816211+0000","last_unstale":"2023-10-06T04:43:29.818496+0000","last_undegraded":"2023-10-06T04:43:29.818496+0000","last_fullsized":"2023-10-06T04:43:29.818496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:34.271308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.820686+0000","last_change":"2023-10-06T04:43:28.805958+0000","last_active":"2023-10-06T04:43:29.820686+0000","last_peered":"2023-10-06T04:43:29.820686+0000","last_clean":"2023-10-06T04:43:29.820686+0000","last_became_active":"2023-10-06T04:43:28.805675+0000","last_became_peered":"2023-10-06T04:43:28.805675+0000","last_unstale":"2023-10-06T04:43:29.820686+0000","last_undegraded":"2023-10-06T04:43:29.820686+0000","last_fullsized":"2023-10-06T04:43:29.820686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:54.712639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.822181+0000","last_change":"2023-10-06T04:43:29.819947+0000","last_active":"2023-10-06T04:43:29.822181+0000","last_peered":"2023-10-06T04:43:29.822181+0000","last_clean":"2023-10-06T04:43:29.822181+0000","last_became_active":"2023-10-06T04:43:29.819674+0000","last_became_peered":"2023-10-06T04:43:29.819674+0000","last_unstale":"2023-10-06T04:43:29.822181+0000","last_undegraded":"2023-10-06T04:43:29.822181+0000","last_fullsized":"2023-10-06T04:43:29.822181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:51:05.152644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.817116+0000","last_change":"2023-10-06T04:43:28.805900+0000","last_active":"2023-10-06T04:43:29.817116+0000","last_peered":"2023-10-06T04:43:29.817116+0000","last_clean":"2023-10-06T04:43:29.817116+0000","last_became_active":"2023-10-06T04:43:28.805647+0000","last_became_peered":"2023-10-06T04:43:28.805647+0000","last_unstale":"2023-10-06T04:43:29.817116+0000","last_undegraded":"2023-10-06T04:43:29.817116+0000","last_fullsized":"2023-10-06T04:43:29.817116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:37.340861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.814241+0000","last_change":"2023-10-06T04:43:29.809549+0000","last_active":"2023-10-06T04:43:29.814241+0000","last_peered":"2023-10-06T04:43:29.814241+0000","last_clean":"2023-10-06T04:43:29.814241+0000","last_became_active":"2023-10-06T04:43:29.809252+0000","last_became_peered":"2023-10-06T04:43:29.809252+0000","last_unstale":"2023-10-06T04:43:29.814241+0000","last_undegraded":"2023-10-06T04:43:29.814241+0000","last_fullsized":"2023-10-06T04:43:29.814241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:25:52.381232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.816103+0000","last_change":"2023-10-06T04:43:28.809092+0000","last_active":"2023-10-06T04:43:29.816103+0000","last_peered":"2023-10-06T04:43:29.816103+0000","last_clean":"2023-10-06T04:43:29.816103+0000","last_became_active":"2023-10-06T04:43:28.808653+0000","last_became_peered":"2023-10-06T04:43:28.808653+0000","last_unstale":"2023-10-06T04:43:29.816103+0000","last_undegraded":"2023-10-06T04:43:29.816103+0000","last_fullsized":"2023-10-06T04:43:29.816103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:39.863661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.813196+0000","last_change":"2023-10-06T04:43:29.812475+0000","last_active":"2023-10-06T04:43:29.813196+0000","last_peered":"2023-10-06T04:43:29.813196+0000","last_clean":"2023-10-06T04:43:29.813196+0000","last_became_active":"2023-10-06T04:43:29.812062+0000","last_became_peered":"2023-10-06T04:43:29.812062+0000","last_unstale":"2023-10-06T04:43:29.813196+0000","last_undegraded":"2023-10-06T04:43:29.813196+0000","last_fullsized":"2023-10-06T04:43:29.813196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:38.346382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.810452+0000","last_change":"2023-10-06T04:43:28.807693+0000","last_active":"2023-10-06T04:43:29.810452+0000","last_peered":"2023-10-06T04:43:29.810452+0000","last_clean":"2023-10-06T04:43:29.810452+0000","last_became_active":"2023-10-06T04:43:28.807432+0000","last_became_peered":"2023-10-06T04:43:28.807432+0000","last_unstale":"2023-10-06T04:43:29.810452+0000","last_undegraded":"2023-10-06T04:43:29.810452+0000","last_fullsized":"2023-10-06T04:43:29.810452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:50:16.072055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.809065+0000","last_change":"2023-10-06T04:43:29.805692+0000","last_active":"2023-10-06T04:43:29.809065+0000","last_peered":"2023-10-06T04:43:29.809065+0000","last_clean":"2023-10-06T04:43:29.809065+0000","last_became_active":"2023-10-06T04:43:29.805453+0000","last_became_peered":"2023-10-06T04:43:29.805453+0000","last_unstale":"2023-10-06T04:43:29.809065+0000","last_undegraded":"2023-10-06T04:43:29.809065+0000","last_fullsized":"2023-10-06T04:43:29.809065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:24:11.932858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.817215+0000","last_change":"2023-10-06T04:43:28.807062+0000","last_active":"2023-10-06T04:43:29.817215+0000","last_peered":"2023-10-06T04:43:29.817215+0000","last_clean":"2023-10-06T04:43:29.817215+0000","last_became_active":"2023-10-06T04:43:28.806751+0000","last_became_peered":"2023-10-06T04:43:28.806751+0000","last_unstale":"2023-10-06T04:43:29.817215+0000","last_undegraded":"2023-10-06T04:43:29.817215+0000","last_fullsized":"2023-10-06T04:43:29.817215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:54.712639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.819043+0000","last_change":"2023-10-06T04:43:29.815942+0000","last_active":"2023-10-06T04:43:29.819043+0000","last_peered":"2023-10-06T04:43:29.819043+0000","last_clean":"2023-10-06T04:43:29.819043+0000","last_became_active":"2023-10-06T04:43:29.815608+0000","last_became_peered":"2023-10-06T04:43:29.815608+0000","last_unstale":"2023-10-06T04:43:29.819043+0000","last_undegraded":"2023-10-06T04:43:29.819043+0000","last_fullsized":"2023-10-06T04:43:29.819043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:39:19.542778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.808258+0000","last_change":"2023-10-06T04:43:28.811867+0000","last_active":"2023-10-06T04:43:29.808258+0000","last_peered":"2023-10-06T04:43:29.808258+0000","last_clean":"2023-10-06T04:43:29.808258+0000","last_became_active":"2023-10-06T04:43:28.811616+0000","last_became_peered":"2023-10-06T04:43:28.811616+0000","last_unstale":"2023-10-06T04:43:29.808258+0000","last_undegraded":"2023-10-06T04:43:29.808258+0000","last_fullsized":"2023-10-06T04:43:29.808258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:56.458010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818108+0000","last_change":"2023-10-06T04:43:29.813764+0000","last_active":"2023-10-06T04:43:29.818108+0000","last_peered":"2023-10-06T04:43:29.818108+0000","last_clean":"2023-10-06T04:43:29.818108+0000","last_became_active":"2023-10-06T04:43:29.811411+0000","last_became_peered":"2023-10-06T04:43:29.811411+0000","last_unstale":"2023-10-06T04:43:29.818108+0000","last_undegraded":"2023-10-06T04:43:29.818108+0000","last_fullsized":"2023-10-06T04:43:29.818108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:11.727749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.797267+0000","last_change":"2023-10-06T04:43:28.804269+0000","last_active":"2023-10-06T04:43:29.797267+0000","last_peered":"2023-10-06T04:43:29.797267+0000","last_clean":"2023-10-06T04:43:29.797267+0000","last_became_active":"2023-10-06T04:43:28.802873+0000","last_became_peered":"2023-10-06T04:43:28.802873+0000","last_unstale":"2023-10-06T04:43:29.797267+0000","last_undegraded":"2023-10-06T04:43:29.797267+0000","last_fullsized":"2023-10-06T04:43:29.797267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:35.593992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.819304+0000","last_change":"2023-10-06T04:43:29.816924+0000","last_active":"2023-10-06T04:43:29.819304+0000","last_peered":"2023-10-06T04:43:29.819304+0000","last_clean":"2023-10-06T04:43:29.819304+0000","last_became_active":"2023-10-06T04:43:29.816649+0000","last_became_peered":"2023-10-06T04:43:29.816649+0000","last_unstale":"2023-10-06T04:43:29.819304+0000","last_undegraded":"2023-10-06T04:43:29.819304+0000","last_fullsized":"2023-10-06T04:43:29.819304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:58:38.867495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.798836+0000","last_change":"2023-10-06T04:43:28.812483+0000","last_active":"2023-10-06T04:43:29.798836+0000","last_peered":"2023-10-06T04:43:29.798836+0000","last_clean":"2023-10-06T04:43:29.798836+0000","last_became_active":"2023-10-06T04:43:28.812205+0000","last_became_peered":"2023-10-06T04:43:28.812205+0000","last_unstale":"2023-10-06T04:43:29.798836+0000","last_undegraded":"2023-10-06T04:43:29.798836+0000","last_fullsized":"2023-10-06T04:43:29.798836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:01:46.254188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.817975+0000","last_change":"2023-10-06T04:43:29.816479+0000","last_active":"2023-10-06T04:43:29.817975+0000","last_peered":"2023-10-06T04:43:29.817975+0000","last_clean":"2023-10-06T04:43:29.817975+0000","last_became_active":"2023-10-06T04:43:29.816006+0000","last_became_peered":"2023-10-06T04:43:29.816006+0000","last_unstale":"2023-10-06T04:43:29.817975+0000","last_undegraded":"2023-10-06T04:43:29.817975+0000","last_fullsized":"2023-10-06T04:43:29.817975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:24:11.932858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.821469+0000","last_change":"2023-10-06T04:43:28.807674+0000","last_active":"2023-10-06T04:43:29.821469+0000","last_peered":"2023-10-06T04:43:29.821469+0000","last_clean":"2023-10-06T04:43:29.821469+0000","last_became_active":"2023-10-06T04:43:28.807392+0000","last_became_peered":"2023-10-06T04:43:28.807392+0000","last_unstale":"2023-10-06T04:43:29.821469+0000","last_undegraded":"2023-10-06T04:43:29.821469+0000","last_fullsized":"2023-10-06T04:43:29.821469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:12.441174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.799442+0000","last_change":"2023-10-06T04:43:24.001927+0000","last_active":"2023-10-06T04:43:29.799442+0000","last_peered":"2023-10-06T04:43:29.799442+0000","last_clean":"2023-10-06T04:43:29.799442+0000","last_became_active":"2023-10-06T04:43:24.001591+0000","last_became_peered":"2023-10-06T04:43:24.001591+0000","last_unstale":"2023-10-06T04:43:29.799442+0000","last_undegraded":"2023-10-06T04:43:29.799442+0000","last_fullsized":"2023-10-06T04:43:29.799442+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:47.262845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818998+0000","last_change":"2023-10-06T04:43:29.818539+0000","last_active":"2023-10-06T04:43:29.818998+0000","last_peered":"2023-10-06T04:43:29.818998+0000","last_clean":"2023-10-06T04:43:29.818998+0000","last_became_active":"2023-10-06T04:43:29.818295+0000","last_became_peered":"2023-10-06T04:43:29.818295+0000","last_unstale":"2023-10-06T04:43:29.818998+0000","last_undegraded":"2023-10-06T04:43:29.818998+0000","last_fullsized":"2023-10-06T04:43:29.818998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:45.205428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.799574+0000","last_change":"2023-10-06T04:43:23.708597+0000","last_active":"2023-10-06T04:43:29.799574+0000","last_peered":"2023-10-06T04:43:29.799574+0000","last_clean":"2023-10-06T04:43:29.799574+0000","last_became_active":"2023-10-06T04:43:23.708317+0000","last_became_peered":"2023-10-06T04:43:23.708317+0000","last_unstale":"2023-10-06T04:43:29.799574+0000","last_undegraded":"2023-10-06T04:43:29.799574+0000","last_fullsized":"2023-10-06T04:43:29.799574+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:56.213068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T04:43:32.252260+0000","last_change":"2023-10-06T04:43:28.806470+0000","last_active":"2023-10-06T04:43:32.252260+0000","last_peered":"2023-10-06T04:43:32.252260+0000","last_clean":"2023-10-06T04:43:32.252260+0000","last_became_active":"2023-10-06T04:43:28.806176+0000","last_became_peered":"2023-10-06T04:43:28.806176+0000","last_unstale":"2023-10-06T04:43:32.252260+0000","last_undegraded":"2023-10-06T04:43:32.252260+0000","last_fullsized":"2023-10-06T04:43:32.252260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:56.458010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818530+0000","last_change":"2023-10-06T04:43:29.814129+0000","last_active":"2023-10-06T04:43:29.818530+0000","last_peered":"2023-10-06T04:43:29.818530+0000","last_clean":"2023-10-06T04:43:29.818530+0000","last_became_active":"2023-10-06T04:43:29.813867+0000","last_became_peered":"2023-10-06T04:43:29.813867+0000","last_unstale":"2023-10-06T04:43:29.818530+0000","last_undegraded":"2023-10-06T04:43:29.818530+0000","last_fullsized":"2023-10-06T04:43:29.818530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:23:24.496576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.791895+0000","last_change":"2023-10-06T04:43:23.708753+0000","last_active":"2023-10-06T04:43:29.791895+0000","last_peered":"2023-10-06T04:43:29.791895+0000","last_clean":"2023-10-06T04:43:29.791895+0000","last_became_active":"2023-10-06T04:43:23.708483+0000","last_became_peered":"2023-10-06T04:43:23.708483+0000","last_unstale":"2023-10-06T04:43:29.791895+0000","last_undegraded":"2023-10-06T04:43:29.791895+0000","last_fullsized":"2023-10-06T04:43:29.791895+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:47.262845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.794480+0000","last_change":"2023-10-06T04:43:23.706116+0000","last_active":"2023-10-06T04:43:29.794480+0000","last_peered":"2023-10-06T04:43:29.794480+0000","last_clean":"2023-10-06T04:43:29.794480+0000","last_became_active":"2023-10-06T04:43:23.705090+0000","last_became_peered":"2023-10-06T04:43:23.705090+0000","last_unstale":"2023-10-06T04:43:29.794480+0000","last_undegraded":"2023-10-06T04:43:29.794480+0000","last_fullsized":"2023-10-06T04:43:29.794480+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:29.869173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.795459+0000","last_change":"2023-10-06T04:43:28.802676+0000","last_active":"2023-10-06T04:43:29.795459+0000","last_peered":"2023-10-06T04:43:29.795459+0000","last_clean":"2023-10-06T04:43:29.795459+0000","last_became_active":"2023-10-06T04:43:28.802303+0000","last_became_peered":"2023-10-06T04:43:28.802303+0000","last_unstale":"2023-10-06T04:43:29.795459+0000","last_undegraded":"2023-10-06T04:43:29.795459+0000","last_fullsized":"2023-10-06T04:43:29.795459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:12.441174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.808974+0000","last_change":"2023-10-06T04:43:29.805169+0000","last_active":"2023-10-06T04:43:29.808974+0000","last_peered":"2023-10-06T04:43:29.808974+0000","last_clean":"2023-10-06T04:43:29.808974+0000","last_became_active":"2023-10-06T04:43:29.804916+0000","last_became_peered":"2023-10-06T04:43:29.804916+0000","last_unstale":"2023-10-06T04:43:29.808974+0000","last_undegraded":"2023-10-06T04:43:29.808974+0000","last_fullsized":"2023-10-06T04:43:29.808974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:23:24.496576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.795261+0000","last_change":"2023-10-06T04:43:24.002162+0000","last_active":"2023-10-06T04:43:29.795261+0000","last_peered":"2023-10-06T04:43:29.795261+0000","last_clean":"2023-10-06T04:43:29.795261+0000","last_became_active":"2023-10-06T04:43:24.001883+0000","last_became_peered":"2023-10-06T04:43:24.001883+0000","last_unstale":"2023-10-06T04:43:29.795261+0000","last_undegraded":"2023-10-06T04:43:29.795261+0000","last_fullsized":"2023-10-06T04:43:29.795261+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:51:11.168258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.791973+0000","last_change":"2023-10-06T04:43:28.805313+0000","last_active":"2023-10-06T04:43:29.791973+0000","last_peered":"2023-10-06T04:43:29.791973+0000","last_clean":"2023-10-06T04:43:29.791973+0000","last_became_active":"2023-10-06T04:43:28.805065+0000","last_became_peered":"2023-10-06T04:43:28.805065+0000","last_unstale":"2023-10-06T04:43:29.791973+0000","last_undegraded":"2023-10-06T04:43:29.791973+0000","last_fullsized":"2023-10-06T04:43:29.791973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:56.458010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.817957+0000","last_change":"2023-10-06T04:43:29.816196+0000","last_active":"2023-10-06T04:43:29.817957+0000","last_peered":"2023-10-06T04:43:29.817957+0000","last_clean":"2023-10-06T04:43:29.817957+0000","last_became_active":"2023-10-06T04:43:29.815882+0000","last_became_peered":"2023-10-06T04:43:29.815882+0000","last_unstale":"2023-10-06T04:43:29.817957+0000","last_undegraded":"2023-10-06T04:43:29.817957+0000","last_fullsized":"2023-10-06T04:43:29.817957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:51:05.152644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.794366+0000","last_change":"2023-10-06T04:43:24.002057+0000","last_active":"2023-10-06T04:43:29.794366+0000","last_peered":"2023-10-06T04:43:29.794366+0000","last_clean":"2023-10-06T04:43:29.794366+0000","last_became_active":"2023-10-06T04:43:24.001809+0000","last_became_peered":"2023-10-06T04:43:24.001809+0000","last_unstale":"2023-10-06T04:43:29.794366+0000","last_undegraded":"2023-10-06T04:43:29.794366+0000","last_fullsized":"2023-10-06T04:43:29.794366+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:49.693980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.798128+0000","last_change":"2023-10-06T04:43:28.808523+0000","last_active":"2023-10-06T04:43:29.798128+0000","last_peered":"2023-10-06T04:43:29.798128+0000","last_clean":"2023-10-06T04:43:29.798128+0000","last_became_active":"2023-10-06T04:43:28.808269+0000","last_became_peered":"2023-10-06T04:43:28.808269+0000","last_unstale":"2023-10-06T04:43:29.798128+0000","last_undegraded":"2023-10-06T04:43:29.798128+0000","last_fullsized":"2023-10-06T04:43:29.798128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:27.759735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.820605+0000","last_change":"2023-10-06T04:43:29.819416+0000","last_active":"2023-10-06T04:43:29.820605+0000","last_peered":"2023-10-06T04:43:29.820605+0000","last_clean":"2023-10-06T04:43:29.820605+0000","last_became_active":"2023-10-06T04:43:29.819099+0000","last_became_peered":"2023-10-06T04:43:29.819099+0000","last_unstale":"2023-10-06T04:43:29.820605+0000","last_undegraded":"2023-10-06T04:43:29.820605+0000","last_fullsized":"2023-10-06T04:43:29.820605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:54:36.378503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.804775+0000","last_change":"2023-10-06T04:43:24.002394+0000","last_active":"2023-10-06T04:43:29.804775+0000","last_peered":"2023-10-06T04:43:29.804775+0000","last_clean":"2023-10-06T04:43:29.804775+0000","last_became_active":"2023-10-06T04:43:24.001915+0000","last_became_peered":"2023-10-06T04:43:24.001915+0000","last_unstale":"2023-10-06T04:43:29.804775+0000","last_undegraded":"2023-10-06T04:43:29.804775+0000","last_fullsized":"2023-10-06T04:43:29.804775+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:45.031820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.797339+0000","last_change":"2023-10-06T04:43:28.806465+0000","last_active":"2023-10-06T04:43:29.797339+0000","last_peered":"2023-10-06T04:43:29.797339+0000","last_clean":"2023-10-06T04:43:29.797339+0000","last_became_active":"2023-10-06T04:43:28.806021+0000","last_became_peered":"2023-10-06T04:43:28.806021+0000","last_unstale":"2023-10-06T04:43:29.797339+0000","last_undegraded":"2023-10-06T04:43:29.797339+0000","last_fullsized":"2023-10-06T04:43:29.797339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:40.890108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.809755+0000","last_change":"2023-10-06T04:43:29.806132+0000","last_active":"2023-10-06T04:43:29.809755+0000","last_peered":"2023-10-06T04:43:29.809755+0000","last_clean":"2023-10-06T04:43:29.809755+0000","last_became_active":"2023-10-06T04:43:29.805881+0000","last_became_peered":"2023-10-06T04:43:29.805881+0000","last_unstale":"2023-10-06T04:43:29.809755+0000","last_undegraded":"2023-10-06T04:43:29.809755+0000","last_fullsized":"2023-10-06T04:43:29.809755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:07.658289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.808437+0000","last_change":"2023-10-06T04:43:24.002424+0000","last_active":"2023-10-06T04:43:29.808437+0000","last_peered":"2023-10-06T04:43:29.808437+0000","last_clean":"2023-10-06T04:43:29.808437+0000","last_became_active":"2023-10-06T04:43:24.002147+0000","last_became_peered":"2023-10-06T04:43:24.002147+0000","last_unstale":"2023-10-06T04:43:29.808437+0000","last_undegraded":"2023-10-06T04:43:29.808437+0000","last_fullsized":"2023-10-06T04:43:29.808437+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:45.031820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.792081+0000","last_change":"2023-10-06T04:43:28.808630+0000","last_active":"2023-10-06T04:43:29.792081+0000","last_peered":"2023-10-06T04:43:29.792081+0000","last_clean":"2023-10-06T04:43:29.792081+0000","last_became_active":"2023-10-06T04:43:28.808363+0000","last_became_peered":"2023-10-06T04:43:28.808363+0000","last_unstale":"2023-10-06T04:43:29.792081+0000","last_undegraded":"2023-10-06T04:43:29.792081+0000","last_fullsized":"2023-10-06T04:43:29.792081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:35.593992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818694+0000","last_change":"2023-10-06T04:43:29.817659+0000","last_active":"2023-10-06T04:43:29.818694+0000","last_peered":"2023-10-06T04:43:29.818694+0000","last_clean":"2023-10-06T04:43:29.818694+0000","last_became_active":"2023-10-06T04:43:29.817387+0000","last_became_peered":"2023-10-06T04:43:29.817387+0000","last_unstale":"2023-10-06T04:43:29.818694+0000","last_undegraded":"2023-10-06T04:43:29.818694+0000","last_fullsized":"2023-10-06T04:43:29.818694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:15:36.021668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.808409+0000","last_change":"2023-10-06T04:43:23.707408+0000","last_active":"2023-10-06T04:43:29.808409+0000","last_peered":"2023-10-06T04:43:29.808409+0000","last_clean":"2023-10-06T04:43:29.808409+0000","last_became_active":"2023-10-06T04:43:23.707115+0000","last_became_peered":"2023-10-06T04:43:23.707115+0000","last_unstale":"2023-10-06T04:43:29.808409+0000","last_undegraded":"2023-10-06T04:43:29.808409+0000","last_fullsized":"2023-10-06T04:43:29.808409+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:56.213068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.806647+0000","last_change":"2023-10-06T04:43:28.808825+0000","last_active":"2023-10-06T04:43:29.806647+0000","last_peered":"2023-10-06T04:43:29.806647+0000","last_clean":"2023-10-06T04:43:29.806647+0000","last_became_active":"2023-10-06T04:43:28.808542+0000","last_became_peered":"2023-10-06T04:43:28.808542+0000","last_unstale":"2023-10-06T04:43:29.806647+0000","last_undegraded":"2023-10-06T04:43:29.806647+0000","last_fullsized":"2023-10-06T04:43:29.806647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:01:46.254188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.815131+0000","last_change":"2023-10-06T04:43:29.811314+0000","last_active":"2023-10-06T04:43:29.815131+0000","last_peered":"2023-10-06T04:43:29.815131+0000","last_clean":"2023-10-06T04:43:29.815131+0000","last_became_active":"2023-10-06T04:43:29.811044+0000","last_became_peered":"2023-10-06T04:43:29.811044+0000","last_unstale":"2023-10-06T04:43:29.815131+0000","last_undegraded":"2023-10-06T04:43:29.815131+0000","last_fullsized":"2023-10-06T04:43:29.815131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:11.452212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818464+0000","last_change":"2023-10-06T04:43:28.804002+0000","last_active":"2023-10-06T04:43:29.818464+0000","last_peered":"2023-10-06T04:43:29.818464+0000","last_clean":"2023-10-06T04:43:29.818464+0000","last_became_active":"2023-10-06T04:43:28.803300+0000","last_became_peered":"2023-10-06T04:43:28.803300+0000","last_unstale":"2023-10-06T04:43:29.818464+0000","last_undegraded":"2023-10-06T04:43:29.818464+0000","last_fullsized":"2023-10-06T04:43:29.818464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:35.593992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.812023+0000","last_change":"2023-10-06T04:43:29.802812+0000","last_active":"2023-10-06T04:43:29.812023+0000","last_peered":"2023-10-06T04:43:29.812023+0000","last_clean":"2023-10-06T04:43:29.812023+0000","last_became_active":"2023-10-06T04:43:29.802567+0000","last_became_peered":"2023-10-06T04:43:29.802567+0000","last_unstale":"2023-10-06T04:43:29.812023+0000","last_undegraded":"2023-10-06T04:43:29.812023+0000","last_fullsized":"2023-10-06T04:43:29.812023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:28.765256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.821708+0000","last_change":"2023-10-06T04:43:28.811329+0000","last_active":"2023-10-06T04:43:29.821708+0000","last_peered":"2023-10-06T04:43:29.821708+0000","last_clean":"2023-10-06T04:43:29.821708+0000","last_became_active":"2023-10-06T04:43:28.811100+0000","last_became_peered":"2023-10-06T04:43:28.811100+0000","last_unstale":"2023-10-06T04:43:29.821708+0000","last_undegraded":"2023-10-06T04:43:29.821708+0000","last_fullsized":"2023-10-06T04:43:29.821708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:27.759735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.814112+0000","last_change":"2023-10-06T04:43:29.809102+0000","last_active":"2023-10-06T04:43:29.814112+0000","last_peered":"2023-10-06T04:43:29.814112+0000","last_clean":"2023-10-06T04:43:29.814112+0000","last_became_active":"2023-10-06T04:43:29.808096+0000","last_became_peered":"2023-10-06T04:43:29.808096+0000","last_unstale":"2023-10-06T04:43:29.814112+0000","last_undegraded":"2023-10-06T04:43:29.814112+0000","last_fullsized":"2023-10-06T04:43:29.814112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:11.842098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.821722+0000","last_change":"2023-10-06T04:43:28.812260+0000","last_active":"2023-10-06T04:43:29.821722+0000","last_peered":"2023-10-06T04:43:29.821722+0000","last_clean":"2023-10-06T04:43:29.821722+0000","last_became_active":"2023-10-06T04:43:28.811921+0000","last_became_peered":"2023-10-06T04:43:28.811921+0000","last_unstale":"2023-10-06T04:43:29.821722+0000","last_undegraded":"2023-10-06T04:43:29.821722+0000","last_fullsized":"2023-10-06T04:43:29.821722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:12.441174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818129+0000","last_change":"2023-10-06T04:43:29.814258+0000","last_active":"2023-10-06T04:43:29.818129+0000","last_peered":"2023-10-06T04:43:29.818129+0000","last_clean":"2023-10-06T04:43:29.818129+0000","last_became_active":"2023-10-06T04:43:29.811381+0000","last_became_peered":"2023-10-06T04:43:29.811381+0000","last_unstale":"2023-10-06T04:43:29.818129+0000","last_undegraded":"2023-10-06T04:43:29.818129+0000","last_fullsized":"2023-10-06T04:43:29.818129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:13:38.871291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.815419+0000","last_change":"2023-10-06T04:43:28.805288+0000","last_active":"2023-10-06T04:43:29.815419+0000","last_peered":"2023-10-06T04:43:29.815419+0000","last_clean":"2023-10-06T04:43:29.815419+0000","last_became_active":"2023-10-06T04:43:28.805005+0000","last_became_peered":"2023-10-06T04:43:28.805005+0000","last_unstale":"2023-10-06T04:43:29.815419+0000","last_undegraded":"2023-10-06T04:43:29.815419+0000","last_fullsized":"2023-10-06T04:43:29.815419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:05.582666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.815062+0000","last_change":"2023-10-06T04:43:29.808059+0000","last_active":"2023-10-06T04:43:29.815062+0000","last_peered":"2023-10-06T04:43:29.815062+0000","last_clean":"2023-10-06T04:43:29.815062+0000","last_became_active":"2023-10-06T04:43:29.806717+0000","last_became_peered":"2023-10-06T04:43:29.806717+0000","last_unstale":"2023-10-06T04:43:29.815062+0000","last_undegraded":"2023-10-06T04:43:29.815062+0000","last_fullsized":"2023-10-06T04:43:29.815062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:01.271919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.822315+0000","last_change":"2023-10-06T04:43:28.805496+0000","last_active":"2023-10-06T04:43:29.822315+0000","last_peered":"2023-10-06T04:43:29.822315+0000","last_clean":"2023-10-06T04:43:29.822315+0000","last_became_active":"2023-10-06T04:43:28.805197+0000","last_became_peered":"2023-10-06T04:43:28.805197+0000","last_unstale":"2023-10-06T04:43:29.822315+0000","last_undegraded":"2023-10-06T04:43:29.822315+0000","last_fullsized":"2023-10-06T04:43:29.822315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:27.778983+0000","last_clean_scrub_stamp":"2023-10-06T04:43:27.778983+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:27.759735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818411+0000","last_change":"2023-10-06T04:43:29.815066+0000","last_active":"2023-10-06T04:43:29.818411+0000","last_peered":"2023-10-06T04:43:29.818411+0000","last_clean":"2023-10-06T04:43:29.818411+0000","last_became_active":"2023-10-06T04:43:29.814792+0000","last_became_peered":"2023-10-06T04:43:29.814792+0000","last_unstale":"2023-10-06T04:43:29.818411+0000","last_undegraded":"2023-10-06T04:43:29.818411+0000","last_fullsized":"2023-10-06T04:43:29.818411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:54.115093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.812529+0000","last_change":"2023-10-06T04:43:29.809634+0000","last_active":"2023-10-06T04:43:29.812529+0000","last_peered":"2023-10-06T04:43:29.812529+0000","last_clean":"2023-10-06T04:43:29.812529+0000","last_became_active":"2023-10-06T04:43:29.809444+0000","last_became_peered":"2023-10-06T04:43:29.809444+0000","last_unstale":"2023-10-06T04:43:29.812529+0000","last_undegraded":"2023-10-06T04:43:29.812529+0000","last_fullsized":"2023-10-06T04:43:29.812529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:06.588187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.808156+0000","last_change":"2023-10-06T04:43:29.806722+0000","last_active":"2023-10-06T04:43:29.808156+0000","last_peered":"2023-10-06T04:43:29.808156+0000","last_clean":"2023-10-06T04:43:29.808156+0000","last_became_active":"2023-10-06T04:43:29.805603+0000","last_became_peered":"2023-10-06T04:43:29.805603+0000","last_unstale":"2023-10-06T04:43:29.808156+0000","last_undegraded":"2023-10-06T04:43:29.808156+0000","last_fullsized":"2023-10-06T04:43:29.808156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:10.192264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818169+0000","last_change":"2023-10-06T04:43:29.814788+0000","last_active":"2023-10-06T04:43:29.818169+0000","last_peered":"2023-10-06T04:43:29.818169+0000","last_clean":"2023-10-06T04:43:29.818169+0000","last_became_active":"2023-10-06T04:43:29.814509+0000","last_became_peered":"2023-10-06T04:43:29.814509+0000","last_unstale":"2023-10-06T04:43:29.818169+0000","last_undegraded":"2023-10-06T04:43:29.818169+0000","last_fullsized":"2023-10-06T04:43:29.818169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:21:23.533461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.818470+0000","last_change":"2023-10-06T04:43:29.816479+0000","last_active":"2023-10-06T04:43:29.818470+0000","last_peered":"2023-10-06T04:43:29.818470+0000","last_clean":"2023-10-06T04:43:29.818470+0000","last_became_active":"2023-10-06T04:43:29.816181+0000","last_became_peered":"2023-10-06T04:43:29.816181+0000","last_unstale":"2023-10-06T04:43:29.818470+0000","last_undegraded":"2023-10-06T04:43:29.818470+0000","last_fullsized":"2023-10-06T04:43:29.818470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:23:24.496576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T04:43:29.810410+0000","last_change":"2023-10-06T04:43:29.808166+0000","last_active":"2023-10-06T04:43:29.810410+0000","last_peered":"2023-10-06T04:43:29.810410+0000","last_clean":"2023-10-06T04:43:29.810410+0000","last_became_active":"2023-10-06T04:43:29.807853+0000","last_became_peered":"2023-10-06T04:43:29.807853+0000","last_unstale":"2023-10-06T04:43:29.810410+0000","last_undegraded":"2023-10-06T04:43:29.810410+0000","last_fullsized":"2023-10-06T04:43:29.810410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:28.784504+0000","last_clean_scrub_stamp":"2023-10-06T04:43:28.784504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:57.350546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298108,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073732,"statfs":{"total":96636764160,"available":96331501568,"internally_reserved":0,"allocated":839680,"data_stored":670963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":78843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298080,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073760,"statfs":{"total":96636764160,"available":96331530240,"internally_reserved":0,"allocated":811008,"data_stored":669211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297504,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074336,"statfs":{"total":96636764160,"available":96332120064,"internally_reserved":0,"allocated":221184,"data_stored":79397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":78843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.1280000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.0499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297504,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074336,"statfs":{"total":96636764160,"available":96332120064,"internally_reserved":0,"allocated":221184,"data_stored":78933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297520,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074320,"statfs":{"total":96636764160,"available":96332103680,"internally_reserved":0,"allocated":237568,"data_stored":80435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":79467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:43:38.954 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T04:43:38.954 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-06T04:43:38.954 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-06T04:43:38.955 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-06T04:43:39.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.103+0000 7f59bd539700 1 Processor -- start 2023-10-06T04:43:39.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.104+0000 7f59bd539700 1 -- start start 2023-10-06T04:43:39.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.104+0000 7f59bd539700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f59b8159630 0x7f59b80cd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:39.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.104+0000 7f59bd539700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59b80cda00 con 0x7f59b80cea10 2023-10-06T04:43:39.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.104+0000 7f59bd539700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59b80cfc80 con 0x7f59b80cd590 2023-10-06T04:43:39.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.104+0000 7f59bd539700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b80cee90 con 0x7f59b8159630 2023-10-06T04:43:39.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.104+0000 7f59b77fe700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f59b80cea10 0x7f59b80b02d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:36028/0 (socket says 172.21.15.17:36028) 2023-10-06T04:43:39.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.105+0000 7f59b77fe700 1 -- 172.21.15.17:0/2067737420 learned_addr learned my addr 172.21.15.17:0/2067737420 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:39.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.105+0000 7f59b6ffd700 1 --2- 172.21.15.17:0/2067737420 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f59b8159630 0x7f59b80cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:39.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.105+0000 7f59b5ffb700 1 -- 172.21.15.17:0/2067737420 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 506734692 0 0) 0x7f59b80cda00 con 0x7f59b80cea10 2023-10-06T04:43:39.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.105+0000 7f59b5ffb700 1 -- 172.21.15.17:0/2067737420 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59a4003570 con 0x7f59b80cea10 2023-10-06T04:43:39.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.105+0000 7f59b5ffb700 1 -- 172.21.15.17:0/2067737420 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3652315788 0 0) 0x7f59b80cfc80 con 0x7f59b80cd590 2023-10-06T04:43:39.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.105+0000 7f59b5ffb700 1 -- 172.21.15.17:0/2067737420 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59b80cda00 con 0x7f59b80cd590 2023-10-06T04:43:39.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.105+0000 7f59b5ffb700 1 -- 172.21.15.17:0/2067737420 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2138713387 0 0) 0x7f59a4003570 con 0x7f59b80cea10 2023-10-06T04:43:39.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.105+0000 7f59b5ffb700 1 -- 172.21.15.17:0/2067737420 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f59b8159630 msgr2=0x7f59b80cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:39.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.105+0000 7f59b5ffb700 1 --2- 172.21.15.17:0/2067737420 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f59b8159630 0x7f59b80cd050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:39.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.105+0000 7f59b5ffb700 1 -- 172.21.15.17:0/2067737420 >> v1:172.21.15.136:6789/0 conn(0x7f59b80cd590 legacy=0x7f59b80ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:39.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.105+0000 7f59b5ffb700 1 -- 172.21.15.17:0/2067737420 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b80cf070 con 0x7f59b80cea10 2023-10-06T04:43:39.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.105+0000 7f59b6ffd700 1 --2- 172.21.15.17:0/2067737420 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f59b8159630 0x7f59b80cd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:43:39.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.105+0000 7f59b5ffb700 1 -- 172.21.15.17:0/2067737420 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4268781140 0 0) 0x7f59a80017f0 con 0x7f59b80cea10 2023-10-06T04:43:39.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.105+0000 7f59b5ffb700 1 -- 172.21.15.17:0/2067737420 >> v1:172.21.15.17:6789/0 conn(0x7f59b80cea10 legacy=0x7f59b80b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:39.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.105+0000 7f59b5ffb700 1 --2- 172.21.15.17:0/2067737420 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59a4003c20 0x7f59a4003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:39.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.105+0000 7f59b5ffb700 1 --2- 172.21.15.17:0/2067737420 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f59b8159630 0x7f59a4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:39.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.105+0000 7f59b5ffb700 1 --2- 172.21.15.17:0/2067737420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59a4004d50 0x7f59a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:39.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.105+0000 7f59b5ffb700 1 -- 172.21.15.17:0/2067737420 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b80cee90 con 0x7f59a4004d50 2023-10-06T04:43:39.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.105+0000 7f59b5ffb700 1 -- 172.21.15.17:0/2067737420 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a400bb10 con 0x7f59a4003c20 2023-10-06T04:43:39.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.105+0000 7f59b5ffb700 1 -- 172.21.15.17:0/2067737420 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a400bca0 con 0x7f59b8159630 2023-10-06T04:43:39.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.105+0000 7f59b77fe700 1 --2- 172.21.15.17:0/2067737420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59a4004d50 0x7f59a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:39.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.105+0000 7f59b6ffd700 1 --2- 172.21.15.17:0/2067737420 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59a4003c20 0x7f59a4003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:39.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.105+0000 7f59b67fc700 1 --2- 172.21.15.17:0/2067737420 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f59b8159630 0x7f59a4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:39.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.106+0000 7f59b77fe700 1 -- 172.21.15.17:0/2067737420 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f59b8159630 msgr2=0x7f59a4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:39.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.106+0000 7f59b77fe700 1 --2- 172.21.15.17:0/2067737420 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f59b8159630 0x7f59a4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:39.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.106+0000 7f59b77fe700 1 -- 172.21.15.17:0/2067737420 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59a4003c20 msgr2=0x7f59a4003ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:39.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.106+0000 7f59b77fe700 1 --2- 172.21.15.17:0/2067737420 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59a4003c20 0x7f59a4003ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:39.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.106+0000 7f59b77fe700 1 -- 172.21.15.17:0/2067737420 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b0009420 con 0x7f59a4004d50 2023-10-06T04:43:39.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.106+0000 7f59b77fe700 1 --2- 172.21.15.17:0/2067737420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59a4004d50 0x7f59a40051c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f59a800ab90 tx=0x7f59a800a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8de760326b566de server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:39.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.106+0000 7f59b5ffb700 1 -- 172.21.15.17:0/2067737420 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a800c550 con 0x7f59a4004d50 2023-10-06T04:43:39.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.106+0000 7f59b5ffb700 1 -- 172.21.15.17:0/2067737420 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a800c6d0 con 0x7f59a4004d50 2023-10-06T04:43:39.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.106+0000 7f59b5ffb700 1 -- 172.21.15.17:0/2067737420 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a800ca90 con 0x7f59a4004d50 2023-10-06T04:43:39.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.106+0000 7f59bd539700 1 -- 172.21.15.17:0/2067737420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59a4004d50 msgr2=0x7f59a40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:39.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.106+0000 7f59bd539700 1 --2- 172.21.15.17:0/2067737420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59a4004d50 0x7f59a40051c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f59a800ab90 tx=0x7f59a800a1c0 comp rx=0 tx=0).stop 2023-10-06T04:43:39.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.106+0000 7f59b77fe700 1 -- 172.21.15.17:0/2067737420 reap_dead start 2023-10-06T04:43:39.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.106+0000 7f59bd539700 1 -- 172.21.15.17:0/2067737420 shutdown_connections 2023-10-06T04:43:39.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.106+0000 7f59bd539700 1 -- 172.21.15.17:0/2067737420 >> 172.21.15.17:0/2067737420 conn(0x7f59b806cff0 msgr2=0x7f59b806d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:39.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.107+0000 7f59bd539700 1 -- 172.21.15.17:0/2067737420 shutdown_connections 2023-10-06T04:43:39.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.107+0000 7f59bd539700 1 -- 172.21.15.17:0/2067737420 wait complete. 2023-10-06T04:43:39.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.108+0000 7f59bd539700 1 Processor -- start 2023-10-06T04:43:39.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.108+0000 7f59bd539700 1 -- start start 2023-10-06T04:43:39.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.108+0000 7f59bd539700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59b814eb80 0x7f59b815c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:39.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.108+0000 7f59bd539700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f59b80c8c90 0x7f59b80b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:39.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.108+0000 7f59bd539700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59b80ca280 0x7f59b80b4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:39.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.108+0000 7f59bd539700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b815c9c0 con 0x7f59b814eb80 2023-10-06T04:43:39.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.108+0000 7f59bd539700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b80c91e0 con 0x7f59b80ca280 2023-10-06T04:43:39.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.108+0000 7f59bd539700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b80c94c0 con 0x7f59b80c8c90 2023-10-06T04:43:39.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.109+0000 7f59b6ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59b814eb80 0x7f59b815c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:39.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.109+0000 7f59b6ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59b814eb80 0x7f59b815c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33176/0 (socket says 172.21.15.17:33176) 2023-10-06T04:43:39.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.109+0000 7f59b6ffd700 1 -- 172.21.15.17:0/2549086239 learned_addr learned my addr 172.21.15.17:0/2549086239 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:39.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.109+0000 7f59b77fe700 1 --2- 172.21.15.17:0/2549086239 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59b80ca280 0x7f59b80b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:39.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.109+0000 7f59b67fc700 1 --2- 172.21.15.17:0/2549086239 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f59b80c8c90 0x7f59b80b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:39.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.109+0000 7f59b6ffd700 1 -- 172.21.15.17:0/2549086239 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f59b80c8c90 msgr2=0x7f59b80b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:39.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.109+0000 7f59b6ffd700 1 --2- 172.21.15.17:0/2549086239 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f59b80c8c90 0x7f59b80b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:39.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.109+0000 7f59b6ffd700 1 -- 172.21.15.17:0/2549086239 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59b80ca280 msgr2=0x7f59b80b4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:39.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.109+0000 7f59b6ffd700 1 --2- 172.21.15.17:0/2549086239 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59b80ca280 0x7f59b80b4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:39.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.109+0000 7f59b6ffd700 1 -- 172.21.15.17:0/2549086239 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b80c97a0 con 0x7f59b814eb80 2023-10-06T04:43:39.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.109+0000 7f59b77fe700 1 --2- 172.21.15.17:0/2549086239 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59b80ca280 0x7f59b80b4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:43:39.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.109+0000 7f59b6ffd700 1 --2- 172.21.15.17:0/2549086239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59b814eb80 0x7f59b815c480 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f59b0011d70 tx=0x7f59b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:39.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.109+0000 7f59aeffd700 1 -- 172.21.15.17:0/2549086239 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b000fcd0 con 0x7f59b814eb80 2023-10-06T04:43:39.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.109+0000 7f59aeffd700 1 -- 172.21.15.17:0/2549086239 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b000fe30 con 0x7f59b814eb80 2023-10-06T04:43:39.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.109+0000 7f59bd539700 1 -- 172.21.15.17:0/2549086239 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b80c9a80 con 0x7f59b814eb80 2023-10-06T04:43:39.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.109+0000 7f59aeffd700 1 -- 172.21.15.17:0/2549086239 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b001d6b0 con 0x7f59b814eb80 2023-10-06T04:43:39.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.109+0000 7f59bd539700 1 -- 172.21.15.17:0/2549086239 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b814ef80 con 0x7f59b814eb80 2023-10-06T04:43:39.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.110+0000 7f59bd539700 1 -- 172.21.15.17:0/2549086239 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b8063ff0 con 0x7f59b814eb80 2023-10-06T04:43:39.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.111+0000 7f59aeffd700 1 -- 172.21.15.17:0/2549086239 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f59b001daa0 con 0x7f59b814eb80 2023-10-06T04:43:39.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.111+0000 7f59aeffd700 1 --2- 172.21.15.17:0/2549086239 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5998066f30 0x7f59980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:39.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.111+0000 7f59aeffd700 1 -- 172.21.15.17:0/2549086239 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f59b0018070 con 0x7f59b814eb80 2023-10-06T04:43:39.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.111+0000 7f59b67fc700 1 --2- 172.21.15.17:0/2549086239 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5998066f30 0x7f59980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:39.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.111+0000 7f59b67fc700 1 --2- 172.21.15.17:0/2549086239 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5998066f30 0x7f59980693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f59a0007e40 tx=0x7f59a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:39.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.115+0000 7f59aeffd700 1 -- 172.21.15.17:0/2549086239 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f59b00526f0 con 0x7f59b814eb80 2023-10-06T04:43:39.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.355+0000 7f59bd539700 1 -- 172.21.15.17:0/2549086239 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f59b80cdea0 con 0x7f59b814eb80 2023-10-06T04:43:39.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.355+0000 7f59aeffd700 1 -- 172.21.15.17:0/2549086239 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f59b0055d10 con 0x7f59b814eb80 2023-10-06T04:43:39.358 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:43:39.358 INFO:teuthology.orchestra.run.smithi017.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-06T04:43:39.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.357+0000 7f59bd539700 1 -- 172.21.15.17:0/2549086239 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5998066f30 msgr2=0x7f59980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:39.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.357+0000 7f59bd539700 1 --2- 172.21.15.17:0/2549086239 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5998066f30 0x7f59980693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f59a0007e40 tx=0x7f59a0009040 comp rx=0 tx=0).stop 2023-10-06T04:43:39.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.357+0000 7f59bd539700 1 -- 172.21.15.17:0/2549086239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59b814eb80 msgr2=0x7f59b815c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:39.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.357+0000 7f59bd539700 1 --2- 172.21.15.17:0/2549086239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59b814eb80 0x7f59b815c480 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f59b0011d70 tx=0x7f59b00091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:39.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.357+0000 7f59bd539700 1 -- 172.21.15.17:0/2549086239 shutdown_connections 2023-10-06T04:43:39.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.357+0000 7f59bd539700 1 --2- 172.21.15.17:0/2549086239 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5998066f30 0x7f59980693e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:39.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.357+0000 7f59bd539700 1 --2- 172.21.15.17:0/2549086239 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59b80ca280 0x7f59b80b4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:39.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.357+0000 7f59bd539700 1 --2- 172.21.15.17:0/2549086239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59b814eb80 0x7f59b815c480 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:39.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.357+0000 7f59bd539700 1 --2- 172.21.15.17:0/2549086239 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f59b80c8c90 0x7f59b80b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:39.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.357+0000 7f59bd539700 1 -- 172.21.15.17:0/2549086239 >> 172.21.15.17:0/2549086239 conn(0x7f59b806cff0 msgr2=0x7f59b80b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:39.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.357+0000 7f59bd539700 1 -- 172.21.15.17:0/2549086239 shutdown_connections 2023-10-06T04:43:39.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.357+0000 7f59bd539700 1 -- 172.21.15.17:0/2549086239 wait complete. 2023-10-06T04:43:39.371 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-06T04:43:39.372 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:43:39.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.488+0000 7f5a9c6eb700 1 Processor -- start 2023-10-06T04:43:39.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.488+0000 7f5a9c6eb700 1 -- start start 2023-10-06T04:43:39.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.489+0000 7f5a9c6eb700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f5a941576b0 0x7f5a940b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:39.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.489+0000 7f5a9c6eb700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a940b3000 con 0x7f5a941572e0 2023-10-06T04:43:39.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.489+0000 7f5a9c6eb700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a940b23f0 con 0x7f5a9415b8d0 2023-10-06T04:43:39.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.489+0000 7f5a9c6eb700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a940b26d0 con 0x7f5a941576b0 2023-10-06T04:43:39.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.489+0000 7f5a9a487700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f5a941572e0 0x7f5a9415b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:36042/0 (socket says 172.21.15.17:36042) 2023-10-06T04:43:39.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.489+0000 7f5a9a487700 1 -- 172.21.15.17:0/1808753898 learned_addr learned my addr 172.21.15.17:0/1808753898 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:39.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.490+0000 7f5a99485700 1 -- 172.21.15.17:0/1808753898 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1720069522 0 0) 0x7f5a940b3000 con 0x7f5a941572e0 2023-10-06T04:43:39.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.490+0000 7f5a99485700 1 -- 172.21.15.17:0/1808753898 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a80003570 con 0x7f5a941572e0 2023-10-06T04:43:39.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.490+0000 7f5a9ac88700 1 --2- 172.21.15.17:0/1808753898 >> v2:172.21.15.136:3300/0 conn(0x7f5a941576b0 0x7f5a940b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:39.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.490+0000 7f5a99485700 1 -- 172.21.15.17:0/1808753898 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 839891283 0 0) 0x7f5a80003570 con 0x7f5a941572e0 2023-10-06T04:43:39.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.490+0000 7f5a99485700 1 -- 172.21.15.17:0/1808753898 >> v2:172.21.15.136:3300/0 conn(0x7f5a941576b0 msgr2=0x7f5a940b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:39.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.490+0000 7f5a99485700 1 --2- 172.21.15.17:0/1808753898 >> v2:172.21.15.136:3300/0 conn(0x7f5a941576b0 0x7f5a940b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:39.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.490+0000 7f5a99485700 1 -- 172.21.15.17:0/1808753898 >> v1:172.21.15.136:6789/0 conn(0x7f5a9415b8d0 legacy=0x7f5a940b1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:39.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.490+0000 7f5a99485700 1 -- 172.21.15.17:0/1808753898 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a940b29b0 con 0x7f5a941572e0 2023-10-06T04:43:39.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.490+0000 7f5a99485700 1 -- 172.21.15.17:0/1808753898 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4268781140 0 0) 0x7f5a90001470 con 0x7f5a941572e0 2023-10-06T04:43:39.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.490+0000 7f5a99485700 1 -- 172.21.15.17:0/1808753898 >> v1:172.21.15.17:6789/0 conn(0x7f5a941572e0 legacy=0x7f5a9415b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:39.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.490+0000 7f5a99485700 1 --2- 172.21.15.17:0/1808753898 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5a80003a60 0x7f5a80003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:39.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.490+0000 7f5a99485700 1 --2- 172.21.15.17:0/1808753898 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a80004810 0x7f5a80004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:39.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.490+0000 7f5a99485700 1 --2- 172.21.15.17:0/1808753898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a800052e0 0x7f5a8000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:39.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.490+0000 7f5a99485700 1 -- 172.21.15.17:0/1808753898 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a940b26d0 con 0x7f5a800052e0 2023-10-06T04:43:39.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.490+0000 7f5a99485700 1 -- 172.21.15.17:0/1808753898 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8000c190 con 0x7f5a80004810 2023-10-06T04:43:39.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.490+0000 7f5a99485700 1 -- 172.21.15.17:0/1808753898 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8000c350 con 0x7f5a80003a60 2023-10-06T04:43:39.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.490+0000 7f5a9ac88700 1 --2- 172.21.15.17:0/1808753898 >> v2:172.21.15.136:3300/0 conn(0x7f5a941576b0 0x7f5a940b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:43:39.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.490+0000 7f5a9ac88700 1 --2- 172.21.15.17:0/1808753898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a800052e0 0x7f5a8000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:39.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.490+0000 7f5a9a487700 1 --2- 172.21.15.17:0/1808753898 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5a80003a60 0x7f5a80003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:39.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.490+0000 7f5a99c86700 1 --2- 172.21.15.17:0/1808753898 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a80004810 0x7f5a80004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:39.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.491+0000 7f5a9ac88700 1 -- 172.21.15.17:0/1808753898 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5a80003a60 msgr2=0x7f5a80003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:39.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.491+0000 7f5a9ac88700 1 --2- 172.21.15.17:0/1808753898 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5a80003a60 0x7f5a80003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:39.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.491+0000 7f5a9ac88700 1 -- 172.21.15.17:0/1808753898 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a80004810 msgr2=0x7f5a80004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:39.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.491+0000 7f5a9ac88700 1 --2- 172.21.15.17:0/1808753898 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a80004810 0x7f5a80004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:39.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.491+0000 7f5a9ac88700 1 -- 172.21.15.17:0/1808753898 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a80003570 con 0x7f5a800052e0 2023-10-06T04:43:39.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.491+0000 7f5a9ac88700 1 -- 172.21.15.17:0/1808753898 reap_dead start 2023-10-06T04:43:39.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.491+0000 7f5a9ac88700 1 --2- 172.21.15.17:0/1808753898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a800052e0 0x7f5a8000ba60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c007580 tx=0x7f5a8c0097a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ee14676f42f0dca server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:39.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.491+0000 7f5a99485700 1 -- 172.21.15.17:0/1808753898 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c009ad0 con 0x7f5a800052e0 2023-10-06T04:43:39.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.491+0000 7f5a99485700 1 -- 172.21.15.17:0/1808753898 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8c007dd0 con 0x7f5a800052e0 2023-10-06T04:43:39.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.491+0000 7f5a99485700 1 -- 172.21.15.17:0/1808753898 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c014650 con 0x7f5a800052e0 2023-10-06T04:43:39.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.491+0000 7f5a9c6eb700 1 -- 172.21.15.17:0/1808753898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a800052e0 msgr2=0x7f5a8000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:39.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.491+0000 7f5a9c6eb700 1 --2- 172.21.15.17:0/1808753898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a800052e0 0x7f5a8000ba60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c007580 tx=0x7f5a8c0097a0 comp rx=0 tx=0).stop 2023-10-06T04:43:39.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.491+0000 7f5a9c6eb700 1 -- 172.21.15.17:0/1808753898 shutdown_connections 2023-10-06T04:43:39.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.491+0000 7f5a9c6eb700 1 --2- 172.21.15.17:0/1808753898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a800052e0 0x7f5a8000ba60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:39.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.491+0000 7f5a9c6eb700 1 -- 172.21.15.17:0/1808753898 >> 172.21.15.17:0/1808753898 conn(0x7f5a9406cd40 msgr2=0x7f5a94087fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:39.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.492+0000 7f5a9c6eb700 1 -- 172.21.15.17:0/1808753898 shutdown_connections 2023-10-06T04:43:39.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.492+0000 7f5a9c6eb700 1 -- 172.21.15.17:0/1808753898 wait complete. 2023-10-06T04:43:39.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.493+0000 7f5a9c6eb700 1 Processor -- start 2023-10-06T04:43:39.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.493+0000 7f5a9c6eb700 1 -- start start 2023-10-06T04:43:39.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.493+0000 7f5a9c6eb700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a800052e0 0x7f5a9409bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:39.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.493+0000 7f5a9c6eb700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5a94151300 0x7f5a940addd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:39.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.493+0000 7f5a9c6eb700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a94151770 0x7f5a940ae310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:39.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.493+0000 7f5a9c6eb700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a94098ac0 con 0x7f5a94151770 2023-10-06T04:43:39.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.493+0000 7f5a9c6eb700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a940aeba0 con 0x7f5a800052e0 2023-10-06T04:43:39.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.493+0000 7f5a9c6eb700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a94098d10 con 0x7f5a94151300 2023-10-06T04:43:39.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.493+0000 7f5a9ac88700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a94151770 0x7f5a940ae310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:39.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.493+0000 7f5a9ac88700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a94151770 0x7f5a940ae310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33190/0 (socket says 172.21.15.17:33190) 2023-10-06T04:43:39.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.493+0000 7f5a9ac88700 1 -- 172.21.15.17:0/3860425699 learned_addr learned my addr 172.21.15.17:0/3860425699 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:39.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.494+0000 7f5a9ac88700 1 -- 172.21.15.17:0/3860425699 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5a94151300 msgr2=0x7f5a940addd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:39.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.494+0000 7f5a9a487700 1 --2- 172.21.15.17:0/3860425699 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a800052e0 0x7f5a9409bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:39.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.494+0000 7f5a99c86700 1 --2- 172.21.15.17:0/3860425699 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5a94151300 0x7f5a940addd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:39.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.494+0000 7f5a9ac88700 1 --2- 172.21.15.17:0/3860425699 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5a94151300 0x7f5a940addd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:39.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.494+0000 7f5a9ac88700 1 -- 172.21.15.17:0/3860425699 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a800052e0 msgr2=0x7f5a9409bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:39.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.494+0000 7f5a9ac88700 1 --2- 172.21.15.17:0/3860425699 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a800052e0 0x7f5a9409bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:39.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.494+0000 7f5a9ac88700 1 -- 172.21.15.17:0/3860425699 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a94098ff0 con 0x7f5a94151770 2023-10-06T04:43:39.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.494+0000 7f5a9a487700 1 --2- 172.21.15.17:0/3860425699 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a800052e0 0x7f5a9409bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:43:39.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.494+0000 7f5a99c86700 1 --2- 172.21.15.17:0/3860425699 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5a94151300 0x7f5a940addd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:43:39.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.494+0000 7f5a9ac88700 1 --2- 172.21.15.17:0/3860425699 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a94151770 0x7f5a940ae310 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5a94088980 tx=0x7f5a8c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:39.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.494+0000 7f5a8a7fc700 1 -- 172.21.15.17:0/3860425699 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c01e620 con 0x7f5a94151770 2023-10-06T04:43:39.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.494+0000 7f5a8a7fc700 1 -- 172.21.15.17:0/3860425699 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8c01e780 con 0x7f5a94151770 2023-10-06T04:43:39.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.494+0000 7f5a9c6eb700 1 -- 172.21.15.17:0/3860425699 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a940992d0 con 0x7f5a94151770 2023-10-06T04:43:39.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.494+0000 7f5a8a7fc700 1 -- 172.21.15.17:0/3860425699 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c01eb20 con 0x7f5a94151770 2023-10-06T04:43:39.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.494+0000 7f5a9c6eb700 1 -- 172.21.15.17:0/3860425699 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a94099890 con 0x7f5a94151770 2023-10-06T04:43:39.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.495+0000 7f5a9c6eb700 1 -- 172.21.15.17:0/3860425699 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a94063ff0 con 0x7f5a94151770 2023-10-06T04:43:39.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.495+0000 7f5a8a7fc700 1 -- 172.21.15.17:0/3860425699 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5a8c01c3a0 con 0x7f5a94151770 2023-10-06T04:43:39.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.496+0000 7f5a8a7fc700 1 --2- 172.21.15.17:0/3860425699 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5a78066f30 0x7f5a780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:39.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.496+0000 7f5a8a7fc700 1 -- 172.21.15.17:0/3860425699 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5a8c086410 con 0x7f5a94151770 2023-10-06T04:43:39.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.496+0000 7f5a9a487700 1 --2- 172.21.15.17:0/3860425699 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5a78066f30 0x7f5a780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:39.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.496+0000 7f5a9a487700 1 --2- 172.21.15.17:0/3860425699 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5a78066f30 0x7f5a780693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5a90001ce0 tx=0x7f5a90009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:39.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.500+0000 7f5a8a7fc700 1 -- 172.21.15.17:0/3860425699 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a8c0535d0 con 0x7f5a94151770 2023-10-06T04:43:39.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.695+0000 7f5a9c6eb700 1 -- 172.21.15.17:0/3860425699 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a940afbf0 con 0x7f5a94151770 2023-10-06T04:43:39.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.696+0000 7f5a8a7fc700 1 -- 172.21.15.17:0/3860425699 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f5a8c05c090 con 0x7f5a94151770 2023-10-06T04:43:39.698 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:43:39.698 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":21,"fsid":"780777c4-2b25-4d35-9058-c9f2d62e3ad9","created":"2023-10-06T04:43:10.578520+0000","modified":"2023-10-06T04:43:30.789916+0000","last_up_change":"2023-10-06T04:43:20.682958+0000","last_in_change":"2023-10-06T04:43:12.978917+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:43:21.795733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:43:22.389592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:43:26.914728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:43:28.173678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"84737b08-575c-46dd-9488-073ae8504494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6809","nonce":90656},{"type":"v1","addr":"172.21.15.17:6811","nonce":90656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":90656},{"type":"v1","addr":"172.21.15.17:6814","nonce":90656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":90656},{"type":"v1","addr":"172.21.15.17:6822","nonce":90656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":90656},{"type":"v1","addr":"172.21.15.17:6818","nonce":90656}]},"public_addr":"172.21.15.17:6811/90656","cluster_addr":"172.21.15.17:6814/90656","heartbeat_back_addr":"172.21.15.17:6822/90656","heartbeat_front_addr":"172.21.15.17:6818/90656","state":["exists","up"]},{"osd":1,"uuid":"dffeb740-58a2-4fd6-8ff1-a0a11a2cc709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":90655},{"type":"v1","addr":"172.21.15.17:6801","nonce":90655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":90655},{"type":"v1","addr":"172.21.15.17:6803","nonce":90655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":90655},{"type":"v1","addr":"172.21.15.17:6807","nonce":90655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":90655},{"type":"v1","addr":"172.21.15.17:6805","nonce":90655}]},"public_addr":"172.21.15.17:6801/90655","cluster_addr":"172.21.15.17:6803/90655","heartbeat_back_addr":"172.21.15.17:6807/90655","heartbeat_front_addr":"172.21.15.17:6805/90655","state":["exists","up"]},{"osd":2,"uuid":"48bd6831-763d-48c2-b515-e02c216d608b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":90657},{"type":"v1","addr":"172.21.15.17:6810","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":90657},{"type":"v1","addr":"172.21.15.17:6815","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":90657},{"type":"v1","addr":"172.21.15.17:6823","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":90657},{"type":"v1","addr":"172.21.15.17:6819","nonce":90657}]},"public_addr":"172.21.15.17:6810/90657","cluster_addr":"172.21.15.17:6815/90657","heartbeat_back_addr":"172.21.15.17:6823/90657","heartbeat_front_addr":"172.21.15.17:6819/90657","state":["exists","up"]},{"osd":3,"uuid":"ae7dbb23-abe7-4bd3-a4df-6f5963d6804c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":90688},{"type":"v1","addr":"172.21.15.17:6825","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":90688},{"type":"v1","addr":"172.21.15.17:6827","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":90688},{"type":"v1","addr":"172.21.15.17:6831","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":90688},{"type":"v1","addr":"172.21.15.17:6829","nonce":90688}]},"public_addr":"172.21.15.17:6825/90688","cluster_addr":"172.21.15.17:6827/90688","heartbeat_back_addr":"172.21.15.17:6831/90688","heartbeat_front_addr":"172.21.15.17:6829/90688","state":["exists","up"]},{"osd":4,"uuid":"29991fb4-1667-4ea3-aca0-d55db27f3bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":90902},{"type":"v1","addr":"172.21.15.136:6801","nonce":90902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":90902},{"type":"v1","addr":"172.21.15.136:6803","nonce":90902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":90902},{"type":"v1","addr":"172.21.15.136:6807","nonce":90902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":90902},{"type":"v1","addr":"172.21.15.136:6805","nonce":90902}]},"public_addr":"172.21.15.136:6801/90902","cluster_addr":"172.21.15.136:6803/90902","heartbeat_back_addr":"172.21.15.136:6807/90902","heartbeat_front_addr":"172.21.15.136:6805/90902","state":["exists","up"]},{"osd":5,"uuid":"398b4ff9-03fc-421f-882c-ba12aa088eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":90901},{"type":"v1","addr":"172.21.15.136:6809","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":90901},{"type":"v1","addr":"172.21.15.136:6811","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":90901},{"type":"v1","addr":"172.21.15.136:6815","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":90901},{"type":"v1","addr":"172.21.15.136:6813","nonce":90901}]},"public_addr":"172.21.15.136:6809/90901","cluster_addr":"172.21.15.136:6811/90901","heartbeat_back_addr":"172.21.15.136:6815/90901","heartbeat_front_addr":"172.21.15.136:6813/90901","state":["exists","up"]},{"osd":6,"uuid":"1bb91a72-4dab-4cdb-aa1d-2b8a9edf1ad0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":90927},{"type":"v1","addr":"172.21.15.136:6825","nonce":90927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":90927},{"type":"v1","addr":"172.21.15.136:6827","nonce":90927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":90927},{"type":"v1","addr":"172.21.15.136:6831","nonce":90927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":90927},{"type":"v1","addr":"172.21.15.136:6829","nonce":90927}]},"public_addr":"172.21.15.136:6825/90927","cluster_addr":"172.21.15.136:6827/90927","heartbeat_back_addr":"172.21.15.136:6831/90927","heartbeat_front_addr":"172.21.15.136:6829/90927","state":["exists","up"]},{"osd":7,"uuid":"719b654e-010d-4aa4-8c13-83fdde242b47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":90934},{"type":"v1","addr":"172.21.15.136:6817","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":90934},{"type":"v1","addr":"172.21.15.136:6819","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":90934},{"type":"v1","addr":"172.21.15.136:6824","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":90934},{"type":"v1","addr":"172.21.15.136:6821","nonce":90934}]},"public_addr":"172.21.15.136:6817/90934","cluster_addr":"172.21.15.136:6819/90934","heartbeat_back_addr":"172.21.15.136:6824/90934","heartbeat_front_addr":"172.21.15.136:6821/90934","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.157479+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.140520+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.190743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.231396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.156510+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.145822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.202888+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.139532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:43:39.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.698+0000 7f5a9c6eb700 1 -- 172.21.15.17:0/3860425699 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5a78066f30 msgr2=0x7f5a780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:39.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.698+0000 7f5a9c6eb700 1 --2- 172.21.15.17:0/3860425699 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5a78066f30 0x7f5a780693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5a90001ce0 tx=0x7f5a90009040 comp rx=0 tx=0).stop 2023-10-06T04:43:39.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.698+0000 7f5a9c6eb700 1 -- 172.21.15.17:0/3860425699 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a94151770 msgr2=0x7f5a940ae310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:39.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.698+0000 7f5a9c6eb700 1 --2- 172.21.15.17:0/3860425699 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a94151770 0x7f5a940ae310 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5a94088980 tx=0x7f5a8c018000 comp rx=0 tx=0).stop 2023-10-06T04:43:39.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.699+0000 7f5a9c6eb700 1 -- 172.21.15.17:0/3860425699 shutdown_connections 2023-10-06T04:43:39.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.699+0000 7f5a9c6eb700 1 --2- 172.21.15.17:0/3860425699 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5a78066f30 0x7f5a780693e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:39.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.699+0000 7f5a9c6eb700 1 --2- 172.21.15.17:0/3860425699 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a94151770 0x7f5a940ae310 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:39.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.699+0000 7f5a9c6eb700 1 --2- 172.21.15.17:0/3860425699 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a800052e0 0x7f5a9409bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:39.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.699+0000 7f5a9c6eb700 1 --2- 172.21.15.17:0/3860425699 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5a94151300 0x7f5a940addd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:39.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.699+0000 7f5a9c6eb700 1 -- 172.21.15.17:0/3860425699 >> 172.21.15.17:0/3860425699 conn(0x7f5a9406cd40 msgr2=0x7f5a940b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:39.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.699+0000 7f5a9c6eb700 1 -- 172.21.15.17:0/3860425699 shutdown_connections 2023-10-06T04:43:39.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.699+0000 7f5a9c6eb700 1 -- 172.21.15.17:0/3860425699 wait complete. 2023-10-06T04:43:39.713 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:43:21.795733+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:43:22.389592+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:43:26.914728+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:43:28.173678+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:43:39.714 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:43:39.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.834+0000 7f72ab7d0700 1 Processor -- start 2023-10-06T04:43:39.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.834+0000 7f72ab7d0700 1 -- start start 2023-10-06T04:43:39.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.835+0000 7f72ab7d0700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f72a40cabc0 0x7f72a41571d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:39.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.835+0000 7f72ab7d0700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f72a40b2250 0x7f72a4157710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:39.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.835+0000 7f72ab7d0700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72a415b300 con 0x7f72a40b1e80 2023-10-06T04:43:39.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.835+0000 7f72ab7d0700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72a415c200 con 0x7f72a40cabc0 2023-10-06T04:43:39.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.835+0000 7f72ab7d0700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72a4157c50 con 0x7f72a40b2250 2023-10-06T04:43:39.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.835+0000 7f72a8d6b700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f72a40cabc0 0x7f72a41571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:39.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.835+0000 7f72a8d6b700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f72a40cabc0 0x7f72a41571d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33204/0 (socket says 172.21.15.17:33204) 2023-10-06T04:43:39.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.835+0000 7f72a8d6b700 1 -- 172.21.15.17:0/1557802301 learned_addr learned my addr 172.21.15.17:0/1557802301 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:39.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.836+0000 7f72a9d6d700 1 --2- 172.21.15.17:0/1557802301 >> v2:172.21.15.136:3300/0 conn(0x7f72a40b2250 0x7f72a4157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:39.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.836+0000 7f72a8d6b700 1 -- 172.21.15.17:0/1557802301 >> v2:172.21.15.136:3300/0 conn(0x7f72a40b2250 msgr2=0x7f72a4157710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:39.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.836+0000 7f72a8d6b700 1 --2- 172.21.15.17:0/1557802301 >> v2:172.21.15.136:3300/0 conn(0x7f72a40b2250 0x7f72a4157710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:39.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.836+0000 7f72a8d6b700 1 -- 172.21.15.17:0/1557802301 >> v1:172.21.15.136:6789/0 conn(0x7f72a40b1e80 legacy=0x7f72a406d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:39.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.836+0000 7f72a8d6b700 1 -- 172.21.15.17:0/1557802301 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a415b580 con 0x7f72a40cabc0 2023-10-06T04:43:39.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.836+0000 7f72a9d6d700 1 --2- 172.21.15.17:0/1557802301 >> v2:172.21.15.136:3300/0 conn(0x7f72a40b2250 0x7f72a4157710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:43:39.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.836+0000 7f72a8d6b700 1 --2- 172.21.15.17:0/1557802301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72a40cabc0 0x7f72a41571d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f72a4068fa0 tx=0x7f7298009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c97e86a4fd7cb9de server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:39.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.836+0000 7f72a3fff700 1 -- 172.21.15.17:0/1557802301 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729800b820 con 0x7f72a40cabc0 2023-10-06T04:43:39.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.836+0000 7f72a3fff700 1 -- 172.21.15.17:0/1557802301 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729800b980 con 0x7f72a40cabc0 2023-10-06T04:43:39.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.836+0000 7f72a3fff700 1 -- 172.21.15.17:0/1557802301 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729800bd20 con 0x7f72a40cabc0 2023-10-06T04:43:39.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.836+0000 7f72ab7d0700 1 -- 172.21.15.17:0/1557802301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72a40cabc0 msgr2=0x7f72a41571d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:39.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.836+0000 7f72ab7d0700 1 --2- 172.21.15.17:0/1557802301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72a40cabc0 0x7f72a41571d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f72a4068fa0 tx=0x7f7298009250 comp rx=0 tx=0).stop 2023-10-06T04:43:39.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.837+0000 7f72ab7d0700 1 -- 172.21.15.17:0/1557802301 shutdown_connections 2023-10-06T04:43:39.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.837+0000 7f72ab7d0700 1 --2- 172.21.15.17:0/1557802301 >> v2:172.21.15.136:3300/0 conn(0x7f72a40b2250 0x7f72a4157710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:39.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.837+0000 7f72ab7d0700 1 --2- 172.21.15.17:0/1557802301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72a40cabc0 0x7f72a41571d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:39.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.837+0000 7f72ab7d0700 1 -- 172.21.15.17:0/1557802301 >> 172.21.15.17:0/1557802301 conn(0x7f72a406f7b0 msgr2=0x7f72a40ae590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:39.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.837+0000 7f72ab7d0700 1 -- 172.21.15.17:0/1557802301 shutdown_connections 2023-10-06T04:43:39.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.837+0000 7f72ab7d0700 1 -- 172.21.15.17:0/1557802301 wait complete. 2023-10-06T04:43:39.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.838+0000 7f72ab7d0700 1 Processor -- start 2023-10-06T04:43:39.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.838+0000 7f72ab7d0700 1 -- start start 2023-10-06T04:43:39.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.839+0000 7f72ab7d0700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f72a40b1e80 0x7f72a40c6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:39.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.839+0000 7f72ab7d0700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72a40b2250 0x7f72a414fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:39.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.839+0000 7f72ab7d0700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f72a40cabc0 0x7f72a40b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:39.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.839+0000 7f72ab7d0700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a40c6750 con 0x7f72a40b2250 2023-10-06T04:43:39.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.839+0000 7f72ab7d0700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a40b09f0 con 0x7f72a40cabc0 2023-10-06T04:43:39.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.839+0000 7f72ab7d0700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a40c7c60 con 0x7f72a40b1e80 2023-10-06T04:43:39.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.839+0000 7f72a8d6b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72a40b2250 0x7f72a414fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:39.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.839+0000 7f72a8d6b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72a40b2250 0x7f72a414fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33208/0 (socket says 172.21.15.17:33208) 2023-10-06T04:43:39.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.839+0000 7f72a8d6b700 1 -- 172.21.15.17:0/540329630 learned_addr learned my addr 172.21.15.17:0/540329630 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:39.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.839+0000 7f72a956c700 1 --2- 172.21.15.17:0/540329630 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f72a40b1e80 0x7f72a40c6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:39.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.839+0000 7f72a9d6d700 1 --2- 172.21.15.17:0/540329630 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f72a40cabc0 0x7f72a40b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:39.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.839+0000 7f72a8d6b700 1 -- 172.21.15.17:0/540329630 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f72a40b1e80 msgr2=0x7f72a40c6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:39.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.839+0000 7f72a8d6b700 1 --2- 172.21.15.17:0/540329630 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f72a40b1e80 0x7f72a40c6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:39.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.839+0000 7f72a8d6b700 1 -- 172.21.15.17:0/540329630 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f72a40cabc0 msgr2=0x7f72a40b0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:39.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.839+0000 7f72a8d6b700 1 --2- 172.21.15.17:0/540329630 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f72a40cabc0 0x7f72a40b0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:39.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.839+0000 7f72a8d6b700 1 -- 172.21.15.17:0/540329630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72980094f0 con 0x7f72a40b2250 2023-10-06T04:43:39.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.839+0000 7f72a8d6b700 1 --2- 172.21.15.17:0/540329630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72a40b2250 0x7f72a414fec0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f72980094c0 tx=0x7f7298017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:39.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.839+0000 7f72a17fa700 1 -- 172.21.15.17:0/540329630 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7298026480 con 0x7f72a40b2250 2023-10-06T04:43:39.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.839+0000 7f72a17fa700 1 -- 172.21.15.17:0/540329630 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729801f070 con 0x7f72a40b2250 2023-10-06T04:43:39.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.839+0000 7f72ab7d0700 1 -- 172.21.15.17:0/540329630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72a40afde0 con 0x7f72a40b2250 2023-10-06T04:43:39.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.840+0000 7f72ab7d0700 1 -- 172.21.15.17:0/540329630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72a40b03a0 con 0x7f72a40b2250 2023-10-06T04:43:39.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.840+0000 7f72a17fa700 1 -- 172.21.15.17:0/540329630 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7298026830 con 0x7f72a40b2250 2023-10-06T04:43:39.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.840+0000 7f72ab7d0700 1 -- 172.21.15.17:0/540329630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72840052b0 con 0x7f72a40b2250 2023-10-06T04:43:39.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.841+0000 7f72a17fa700 1 -- 172.21.15.17:0/540329630 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7298026be0 con 0x7f72a40b2250 2023-10-06T04:43:39.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.841+0000 7f72a17fa700 1 --2- 172.21.15.17:0/540329630 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7290066f30 0x7f72900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:39.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.841+0000 7f72a17fa700 1 -- 172.21.15.17:0/540329630 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7298021070 con 0x7f72a40b2250 2023-10-06T04:43:39.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.841+0000 7f72a956c700 1 --2- 172.21.15.17:0/540329630 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7290066f30 0x7f72900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:39.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.842+0000 7f72a956c700 1 --2- 172.21.15.17:0/540329630 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7290066f30 0x7f72900693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f729c0016d0 tx=0x7f729c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:39.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:39.846+0000 7f72a17fa700 1 -- 172.21.15.17:0/540329630 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7298053510 con 0x7f72a40b2250 2023-10-06T04:43:40.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.039+0000 7f72ab7d0700 1 -- 172.21.15.17:0/540329630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7284005ae0 con 0x7f72a40b2250 2023-10-06T04:43:40.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.039+0000 7f72a17fa700 1 -- 172.21.15.17:0/540329630 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7298024380 con 0x7f72a40b2250 2023-10-06T04:43:40.042 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-10-06T04:43:40.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.041+0000 7f72ab7d0700 1 -- 172.21.15.17:0/540329630 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7290066f30 msgr2=0x7f72900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:40.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.041+0000 7f72ab7d0700 1 --2- 172.21.15.17:0/540329630 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7290066f30 0x7f72900693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f729c0016d0 tx=0x7f729c009040 comp rx=0 tx=0).stop 2023-10-06T04:43:40.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.041+0000 7f72ab7d0700 1 -- 172.21.15.17:0/540329630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72a40b2250 msgr2=0x7f72a414fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:40.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.041+0000 7f72ab7d0700 1 --2- 172.21.15.17:0/540329630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72a40b2250 0x7f72a414fec0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f72980094c0 tx=0x7f7298017000 comp rx=0 tx=0).stop 2023-10-06T04:43:40.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.041+0000 7f72ab7d0700 1 -- 172.21.15.17:0/540329630 shutdown_connections 2023-10-06T04:43:40.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.041+0000 7f72ab7d0700 1 --2- 172.21.15.17:0/540329630 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7290066f30 0x7f72900693e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:40.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.041+0000 7f72ab7d0700 1 --2- 172.21.15.17:0/540329630 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f72a40cabc0 0x7f72a40b0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:40.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.041+0000 7f72ab7d0700 1 --2- 172.21.15.17:0/540329630 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f72a40b1e80 0x7f72a40c6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:40.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.041+0000 7f72ab7d0700 1 --2- 172.21.15.17:0/540329630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72a40b2250 0x7f72a414fec0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:40.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.042+0000 7f72ab7d0700 1 -- 172.21.15.17:0/540329630 >> 172.21.15.17:0/540329630 conn(0x7f72a406f7b0 msgr2=0x7f72a415a880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:40.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.042+0000 7f72ab7d0700 1 -- 172.21.15.17:0/540329630 shutdown_connections 2023-10-06T04:43:40.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.042+0000 7f72ab7d0700 1 -- 172.21.15.17:0/540329630 wait complete. 2023-10-06T04:43:40.055 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:43:40.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.175+0000 7f48fcc44700 1 Processor -- start 2023-10-06T04:43:40.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.175+0000 7f48fcc44700 1 -- start start 2023-10-06T04:43:40.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.176+0000 7f48fcc44700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48f806d140 0x7f48f806f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:40.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.176+0000 7f48fcc44700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48f80d1120 con 0x7f48f80cabf0 2023-10-06T04:43:40.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.176+0000 7f48fcc44700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48f80d1400 con 0x7f48f8159b10 2023-10-06T04:43:40.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.176+0000 7f48fcc44700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f806e920 con 0x7f48f806d140 2023-10-06T04:43:40.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.176+0000 7f48f659c700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f48f80cabf0 0x7f48f80c7660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:36058/0 (socket says 172.21.15.17:36058) 2023-10-06T04:43:40.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.176+0000 7f48f659c700 1 -- 172.21.15.17:0/319298034 learned_addr learned my addr 172.21.15.17:0/319298034 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:40.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.177+0000 7f48f6d9d700 1 --2- 172.21.15.17:0/319298034 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48f806d140 0x7f48f806f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:40.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.177+0000 7f48f559a700 1 -- 172.21.15.17:0/319298034 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2351339973 0 0) 0x7f48f80d1120 con 0x7f48f80cabf0 2023-10-06T04:43:40.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.177+0000 7f48f559a700 1 -- 172.21.15.17:0/319298034 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48e4003570 con 0x7f48f80cabf0 2023-10-06T04:43:40.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.177+0000 7f48f559a700 1 -- 172.21.15.17:0/319298034 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3757401324 0 0) 0x7f48f80d1400 con 0x7f48f8159b10 2023-10-06T04:43:40.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.177+0000 7f48f559a700 1 -- 172.21.15.17:0/319298034 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48f80d1120 con 0x7f48f8159b10 2023-10-06T04:43:40.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.177+0000 7f48f6d9d700 1 -- 172.21.15.17:0/319298034 >> v1:172.21.15.136:6789/0 conn(0x7f48f8159b10 legacy=0x7f48f806f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:40.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.177+0000 7f48f6d9d700 1 -- 172.21.15.17:0/319298034 >> v1:172.21.15.17:6789/0 conn(0x7f48f80cabf0 legacy=0x7f48f80c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:40.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.177+0000 7f48f6d9d700 1 -- 172.21.15.17:0/319298034 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f806ec00 con 0x7f48f806d140 2023-10-06T04:43:40.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.177+0000 7f48f6d9d700 1 --2- 172.21.15.17:0/319298034 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48f806d140 0x7f48f806f830 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f48e8009e90 tx=0x7f48e8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=195e6eea280e6af6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:40.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.177+0000 7f48f559a700 1 -- 172.21.15.17:0/319298034 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e800e070 con 0x7f48f806d140 2023-10-06T04:43:40.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.177+0000 7f48f559a700 1 -- 172.21.15.17:0/319298034 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e800bb80 con 0x7f48f806d140 2023-10-06T04:43:40.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.177+0000 7f48f559a700 1 -- 172.21.15.17:0/319298034 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e8012430 con 0x7f48f806d140 2023-10-06T04:43:40.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.178+0000 7f48fcc44700 1 -- 172.21.15.17:0/319298034 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48f806d140 msgr2=0x7f48f806f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:40.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.178+0000 7f48fcc44700 1 --2- 172.21.15.17:0/319298034 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48f806d140 0x7f48f806f830 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f48e8009e90 tx=0x7f48e8009780 comp rx=0 tx=0).stop 2023-10-06T04:43:40.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.178+0000 7f48fcc44700 1 -- 172.21.15.17:0/319298034 shutdown_connections 2023-10-06T04:43:40.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.178+0000 7f48fcc44700 1 --2- 172.21.15.17:0/319298034 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48f806d140 0x7f48f806f830 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:40.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.178+0000 7f48fcc44700 1 -- 172.21.15.17:0/319298034 >> 172.21.15.17:0/319298034 conn(0x7f48f806cd40 msgr2=0x7f48f80d0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:40.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.178+0000 7f48fcc44700 1 -- 172.21.15.17:0/319298034 shutdown_connections 2023-10-06T04:43:40.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.178+0000 7f48fcc44700 1 -- 172.21.15.17:0/319298034 wait complete. 2023-10-06T04:43:40.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.179+0000 7f48fcc44700 1 Processor -- start 2023-10-06T04:43:40.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.179+0000 7f48fcc44700 1 -- start start 2023-10-06T04:43:40.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.180+0000 7f48fcc44700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48f806d140 0x7f48f809d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:40.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.180+0000 7f48fcc44700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48f80cabf0 0x7f48f8156be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:40.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.180+0000 7f48fcc44700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48f8159b10 0x7f48f80b5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:40.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.180+0000 7f48fcc44700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f8157120 con 0x7f48f8159b10 2023-10-06T04:43:40.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.180+0000 7f48fcc44700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f809c390 con 0x7f48f80cabf0 2023-10-06T04:43:40.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.180+0000 7f48fcc44700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f809c670 con 0x7f48f806d140 2023-10-06T04:43:40.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.180+0000 7f48f6d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48f8159b10 0x7f48f80b5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:40.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.180+0000 7f48f6d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48f8159b10 0x7f48f80b5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33214/0 (socket says 172.21.15.17:33214) 2023-10-06T04:43:40.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.180+0000 7f48f6d9d700 1 -- 172.21.15.17:0/2045584790 learned_addr learned my addr 172.21.15.17:0/2045584790 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:40.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.180+0000 7f48f659c700 1 --2- 172.21.15.17:0/2045584790 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48f806d140 0x7f48f809d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:40.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.180+0000 7f48f5d9b700 1 --2- 172.21.15.17:0/2045584790 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48f80cabf0 0x7f48f8156be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:40.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.180+0000 7f48f6d9d700 1 -- 172.21.15.17:0/2045584790 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48f806d140 msgr2=0x7f48f809d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:40.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.180+0000 7f48f6d9d700 1 --2- 172.21.15.17:0/2045584790 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48f806d140 0x7f48f809d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:40.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.180+0000 7f48f6d9d700 1 -- 172.21.15.17:0/2045584790 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48f80cabf0 msgr2=0x7f48f8156be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:40.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.180+0000 7f48f6d9d700 1 --2- 172.21.15.17:0/2045584790 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48f80cabf0 0x7f48f8156be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:40.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.180+0000 7f48f6d9d700 1 -- 172.21.15.17:0/2045584790 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e8009a20 con 0x7f48f8159b10 2023-10-06T04:43:40.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.180+0000 7f48f5d9b700 1 --2- 172.21.15.17:0/2045584790 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48f80cabf0 0x7f48f8156be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:43:40.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.180+0000 7f48f6d9d700 1 --2- 172.21.15.17:0/2045584790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48f8159b10 0x7f48f80b5b40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f48e8013000 tx=0x7f48e8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:40.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.180+0000 7f48ee7fc700 1 -- 172.21.15.17:0/2045584790 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e8012e00 con 0x7f48f8159b10 2023-10-06T04:43:40.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.180+0000 7f48ee7fc700 1 -- 172.21.15.17:0/2045584790 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e801b630 con 0x7f48f8159b10 2023-10-06T04:43:40.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.180+0000 7f48ee7fc700 1 -- 172.21.15.17:0/2045584790 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e801b9f0 con 0x7f48f8159b10 2023-10-06T04:43:40.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.180+0000 7f48fcc44700 1 -- 172.21.15.17:0/2045584790 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48f809c950 con 0x7f48f8159b10 2023-10-06T04:43:40.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.180+0000 7f48fcc44700 1 -- 172.21.15.17:0/2045584790 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48f809cf10 con 0x7f48f8159b10 2023-10-06T04:43:40.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.181+0000 7f48fcc44700 1 -- 172.21.15.17:0/2045584790 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48f804c380 con 0x7f48f8159b10 2023-10-06T04:43:40.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.182+0000 7f48ee7fc700 1 -- 172.21.15.17:0/2045584790 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f48e801c400 con 0x7f48f8159b10 2023-10-06T04:43:40.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.182+0000 7f48ee7fc700 1 --2- 172.21.15.17:0/2045584790 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f48d8066f30 0x7f48d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:40.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.182+0000 7f48f659c700 1 --2- 172.21.15.17:0/2045584790 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f48d8066f30 0x7f48d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:40.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.182+0000 7f48ee7fc700 1 -- 172.21.15.17:0/2045584790 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f48e8086090 con 0x7f48f8159b10 2023-10-06T04:43:40.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.183+0000 7f48f659c700 1 --2- 172.21.15.17:0/2045584790 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f48d8066f30 0x7f48d80693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f48f0001360 tx=0x7f48f0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:40.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.187+0000 7f48ee7fc700 1 -- 172.21.15.17:0/2045584790 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f48e80531a0 con 0x7f48f8159b10 2023-10-06T04:43:40.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.379+0000 7f48fcc44700 1 -- 172.21.15.17:0/2045584790 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f48f808a9f0 con 0x7f48f8159b10 2023-10-06T04:43:40.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.379+0000 7f48ee7fc700 1 -- 172.21.15.17:0/2045584790 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f48e80567c0 con 0x7f48f8159b10 2023-10-06T04:43:40.381 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-10-06T04:43:40.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.381+0000 7f48fcc44700 1 -- 172.21.15.17:0/2045584790 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f48d8066f30 msgr2=0x7f48d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:40.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.381+0000 7f48fcc44700 1 --2- 172.21.15.17:0/2045584790 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f48d8066f30 0x7f48d80693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f48f0001360 tx=0x7f48f0009040 comp rx=0 tx=0).stop 2023-10-06T04:43:40.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.381+0000 7f48fcc44700 1 -- 172.21.15.17:0/2045584790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48f8159b10 msgr2=0x7f48f80b5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:40.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.381+0000 7f48fcc44700 1 --2- 172.21.15.17:0/2045584790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48f8159b10 0x7f48f80b5b40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f48e8013000 tx=0x7f48e8019000 comp rx=0 tx=0).stop 2023-10-06T04:43:40.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.381+0000 7f48fcc44700 1 -- 172.21.15.17:0/2045584790 shutdown_connections 2023-10-06T04:43:40.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.381+0000 7f48fcc44700 1 --2- 172.21.15.17:0/2045584790 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f48d8066f30 0x7f48d80693e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:40.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.381+0000 7f48fcc44700 1 --2- 172.21.15.17:0/2045584790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48f8159b10 0x7f48f80b5b40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:40.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.381+0000 7f48fcc44700 1 --2- 172.21.15.17:0/2045584790 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48f806d140 0x7f48f809d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:40.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.381+0000 7f48fcc44700 1 --2- 172.21.15.17:0/2045584790 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48f80cabf0 0x7f48f8156be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:40.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.381+0000 7f48fcc44700 1 -- 172.21.15.17:0/2045584790 >> 172.21.15.17:0/2045584790 conn(0x7f48f806cd40 msgr2=0x7f48f815f240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:40.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.382+0000 7f48fcc44700 1 -- 172.21.15.17:0/2045584790 shutdown_connections 2023-10-06T04:43:40.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.382+0000 7f48fcc44700 1 -- 172.21.15.17:0/2045584790 wait complete. 2023-10-06T04:43:40.395 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:43:40.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.515+0000 7fa53d79b700 1 Processor -- start 2023-10-06T04:43:40.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.515+0000 7fa53d79b700 1 -- start start 2023-10-06T04:43:40.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.516+0000 7fa53d79b700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa5380b21e0 0x7fa5380b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:40.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.516+0000 7fa53d79b700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa53806d380 con 0x7fa5381596b0 2023-10-06T04:43:40.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.516+0000 7fa53d79b700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5380b5ac0 con 0x7fa5381592e0 2023-10-06T04:43:40.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.516+0000 7fa53d79b700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5380b5ff0 con 0x7fa5380b21e0 2023-10-06T04:43:40.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.516+0000 7fa5377fe700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa5380b21e0 0x7fa5380b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:40.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.516+0000 7fa5367fc700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fa5381596b0 0x7fa53806cc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:36070/0 (socket says 172.21.15.17:36070) 2023-10-06T04:43:40.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.516+0000 7fa5367fc700 1 -- 172.21.15.17:0/3293979332 learned_addr learned my addr 172.21.15.17:0/3293979332 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:40.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.516+0000 7fa5377fe700 1 -- 172.21.15.17:0/3293979332 >> v1:172.21.15.136:6789/0 conn(0x7fa5381592e0 legacy=0x7fa53806c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:40.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.516+0000 7fa5377fe700 1 -- 172.21.15.17:0/3293979332 >> v1:172.21.15.17:6789/0 conn(0x7fa5381596b0 legacy=0x7fa53806cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:40.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.516+0000 7fa5377fe700 1 -- 172.21.15.17:0/3293979332 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5380b0730 con 0x7fa5380b21e0 2023-10-06T04:43:40.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.517+0000 7fa5377fe700 1 --2- 172.21.15.17:0/3293979332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5380b21e0 0x7fa5380b4aa0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa528009e60 tx=0x7fa528009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db6d5767e158eda1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:40.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.517+0000 7fa535ffb700 1 -- 172.21.15.17:0/3293979332 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52800e070 con 0x7fa5380b21e0 2023-10-06T04:43:40.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.517+0000 7fa535ffb700 1 -- 172.21.15.17:0/3293979332 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa52800bc30 con 0x7fa5380b21e0 2023-10-06T04:43:40.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.517+0000 7fa535ffb700 1 -- 172.21.15.17:0/3293979332 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa528012430 con 0x7fa5380b21e0 2023-10-06T04:43:40.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.517+0000 7fa53d79b700 1 -- 172.21.15.17:0/3293979332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5380b21e0 msgr2=0x7fa5380b4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:40.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.517+0000 7fa53d79b700 1 --2- 172.21.15.17:0/3293979332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5380b21e0 0x7fa5380b4aa0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa528009e60 tx=0x7fa528009780 comp rx=0 tx=0).stop 2023-10-06T04:43:40.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.517+0000 7fa53d79b700 1 -- 172.21.15.17:0/3293979332 shutdown_connections 2023-10-06T04:43:40.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.517+0000 7fa53d79b700 1 --2- 172.21.15.17:0/3293979332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5380b21e0 0x7fa5380b4aa0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:40.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.517+0000 7fa53d79b700 1 -- 172.21.15.17:0/3293979332 >> 172.21.15.17:0/3293979332 conn(0x7fa53806da20 msgr2=0x7fa53806de20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:40.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.517+0000 7fa53d79b700 1 -- 172.21.15.17:0/3293979332 shutdown_connections 2023-10-06T04:43:40.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.517+0000 7fa53d79b700 1 -- 172.21.15.17:0/3293979332 wait complete. 2023-10-06T04:43:40.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.518+0000 7fa53d79b700 1 Processor -- start 2023-10-06T04:43:40.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.519+0000 7fa53d79b700 1 -- start start 2023-10-06T04:43:40.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.519+0000 7fa53d79b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5380b21e0 0x7fa538157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:40.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.519+0000 7fa53d79b700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5381592e0 0x7fa5380adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:40.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.519+0000 7fa53d79b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5381596b0 0x7fa5380ab320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:40.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.519+0000 7fa53d79b700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5380aec30 con 0x7fa5381596b0 2023-10-06T04:43:40.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.519+0000 7fa53d79b700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5380a88e0 con 0x7fa5380b21e0 2023-10-06T04:43:40.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.519+0000 7fa53d79b700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5380ae110 con 0x7fa5381592e0 2023-10-06T04:43:40.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.519+0000 7fa5377fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5381596b0 0x7fa5380ab320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:40.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.519+0000 7fa5377fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5381596b0 0x7fa5380ab320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33232/0 (socket says 172.21.15.17:33232) 2023-10-06T04:43:40.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.519+0000 7fa5377fe700 1 -- 172.21.15.17:0/2885533534 learned_addr learned my addr 172.21.15.17:0/2885533534 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:40.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.519+0000 7fa536ffd700 1 --2- 172.21.15.17:0/2885533534 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5380b21e0 0x7fa538157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:40.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.520+0000 7fa5367fc700 1 --2- 172.21.15.17:0/2885533534 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5381592e0 0x7fa5380adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:40.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.520+0000 7fa5377fe700 1 -- 172.21.15.17:0/2885533534 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5381592e0 msgr2=0x7fa5380adbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:40.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.520+0000 7fa5377fe700 1 --2- 172.21.15.17:0/2885533534 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5381592e0 0x7fa5380adbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:40.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.520+0000 7fa5377fe700 1 -- 172.21.15.17:0/2885533534 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5380b21e0 msgr2=0x7fa538157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:40.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.520+0000 7fa5377fe700 1 --2- 172.21.15.17:0/2885533534 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5380b21e0 0x7fa538157150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:40.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.520+0000 7fa5377fe700 1 -- 172.21.15.17:0/2885533534 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa528009a20 con 0x7fa5381596b0 2023-10-06T04:43:40.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.520+0000 7fa536ffd700 1 --2- 172.21.15.17:0/2885533534 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5380b21e0 0x7fa538157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:43:40.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.520+0000 7fa5367fc700 1 --2- 172.21.15.17:0/2885533534 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5381592e0 0x7fa5380adbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:43:40.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.520+0000 7fa5377fe700 1 --2- 172.21.15.17:0/2885533534 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5381596b0 0x7fa5380ab320 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa538089370 tx=0x7fa528019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:40.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.520+0000 7fa52effd700 1 -- 172.21.15.17:0/2885533534 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52801e700 con 0x7fa5381596b0 2023-10-06T04:43:40.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.520+0000 7fa52effd700 1 -- 172.21.15.17:0/2885533534 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa52801e880 con 0x7fa5381596b0 2023-10-06T04:43:40.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.520+0000 7fa53d79b700 1 -- 172.21.15.17:0/2885533534 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5380ae390 con 0x7fa5381596b0 2023-10-06T04:43:40.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.520+0000 7fa52effd700 1 -- 172.21.15.17:0/2885533534 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52801ec40 con 0x7fa5381596b0 2023-10-06T04:43:40.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.520+0000 7fa53d79b700 1 -- 172.21.15.17:0/2885533534 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5380ae950 con 0x7fa5381596b0 2023-10-06T04:43:40.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.521+0000 7fa53d79b700 1 -- 172.21.15.17:0/2885533534 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5380a86b0 con 0x7fa5381596b0 2023-10-06T04:43:40.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.521+0000 7fa52effd700 1 -- 172.21.15.17:0/2885533534 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa528024070 con 0x7fa5381596b0 2023-10-06T04:43:40.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.522+0000 7fa52effd700 1 --2- 172.21.15.17:0/2885533534 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa518066f30 0x7fa5180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:40.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.522+0000 7fa52effd700 1 -- 172.21.15.17:0/2885533534 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa5280870f0 con 0x7fa5381596b0 2023-10-06T04:43:40.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.522+0000 7fa536ffd700 1 --2- 172.21.15.17:0/2885533534 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa518066f30 0x7fa5180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:40.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.522+0000 7fa536ffd700 1 --2- 172.21.15.17:0/2885533534 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa518066f30 0x7fa5180693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa530007fd0 tx=0x7fa530009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:40.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.526+0000 7fa52effd700 1 -- 172.21.15.17:0/2885533534 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa5380a86b0 con 0x7fa5381596b0 2023-10-06T04:43:40.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.719+0000 7fa53d79b700 1 -- 172.21.15.17:0/2885533534 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa5380a8a90 con 0x7fa5381596b0 2023-10-06T04:43:40.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.719+0000 7fa52effd700 1 -- 172.21.15.17:0/2885533534 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa5380a8a90 con 0x7fa5381596b0 2023-10-06T04:43:40.722 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-10-06T04:43:40.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.722+0000 7fa53d79b700 1 -- 172.21.15.17:0/2885533534 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa518066f30 msgr2=0x7fa5180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:40.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.722+0000 7fa53d79b700 1 --2- 172.21.15.17:0/2885533534 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa518066f30 0x7fa5180693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa530007fd0 tx=0x7fa530009040 comp rx=0 tx=0).stop 2023-10-06T04:43:40.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.722+0000 7fa53d79b700 1 -- 172.21.15.17:0/2885533534 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5381596b0 msgr2=0x7fa5380ab320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:40.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.722+0000 7fa53d79b700 1 --2- 172.21.15.17:0/2885533534 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5381596b0 0x7fa5380ab320 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa538089370 tx=0x7fa528019000 comp rx=0 tx=0).stop 2023-10-06T04:43:40.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.722+0000 7fa53d79b700 1 -- 172.21.15.17:0/2885533534 shutdown_connections 2023-10-06T04:43:40.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.722+0000 7fa53d79b700 1 --2- 172.21.15.17:0/2885533534 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa518066f30 0x7fa5180693e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:40.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.722+0000 7fa53d79b700 1 --2- 172.21.15.17:0/2885533534 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5381596b0 0x7fa5380ab320 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:40.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.722+0000 7fa53d79b700 1 --2- 172.21.15.17:0/2885533534 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5380b21e0 0x7fa538157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:40.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.722+0000 7fa53d79b700 1 --2- 172.21.15.17:0/2885533534 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5381592e0 0x7fa5380adbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:40.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.722+0000 7fa53d79b700 1 -- 172.21.15.17:0/2885533534 >> 172.21.15.17:0/2885533534 conn(0x7fa53806da20 msgr2=0x7fa5381581f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:40.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.722+0000 7fa53d79b700 1 -- 172.21.15.17:0/2885533534 shutdown_connections 2023-10-06T04:43:40.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.722+0000 7fa53d79b700 1 -- 172.21.15.17:0/2885533534 wait complete. 2023-10-06T04:43:40.735 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:43:40.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.855+0000 7f3bf0fdd700 1 Processor -- start 2023-10-06T04:43:40.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.855+0000 7f3bf0fdd700 1 -- start start 2023-10-06T04:43:40.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.856+0000 7f3bf0fdd700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3bec0cabf0 0x7f3bec0c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:40.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.856+0000 7f3bf0fdd700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3bec159b10 0x7f3bec06f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:40.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.856+0000 7f3bf0fdd700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3bec06d140 0x7f3bec06f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:40.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.856+0000 7f3bf0fdd700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bec0d1120 con 0x7f3bec159b10 2023-10-06T04:43:40.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.856+0000 7f3bf0fdd700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bec0d1400 con 0x7f3bec06d140 2023-10-06T04:43:40.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.856+0000 7f3bf0fdd700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec06e920 con 0x7f3bec0cabf0 2023-10-06T04:43:40.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.856+0000 7f3be9d9b700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3bec159b10 0x7f3bec06f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:40.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.856+0000 7f3be9d9b700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3bec159b10 0x7f3bec06f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42612/0 (socket says 172.21.15.17:42612) 2023-10-06T04:43:40.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.856+0000 7f3be9d9b700 1 -- 172.21.15.17:0/4211510721 learned_addr learned my addr 172.21.15.17:0/4211510721 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:40.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.856+0000 7f3bead9d700 1 --2- 172.21.15.17:0/4211510721 >> v2:172.21.15.136:3300/0 conn(0x7f3bec06d140 0x7f3bec06f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:40.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.856+0000 7f3bea59c700 1 --2- 172.21.15.17:0/4211510721 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3bec0cabf0 0x7f3bec0c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:40.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.857+0000 7f3be9d9b700 1 -- 172.21.15.17:0/4211510721 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3bec0cabf0 msgr2=0x7f3bec0c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:40.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.857+0000 7f3be9d9b700 1 --2- 172.21.15.17:0/4211510721 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3bec0cabf0 0x7f3bec0c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:40.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.857+0000 7f3be9d9b700 1 -- 172.21.15.17:0/4211510721 >> v2:172.21.15.136:3300/0 conn(0x7f3bec06d140 msgr2=0x7f3bec06f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:40.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.857+0000 7f3be9d9b700 1 --2- 172.21.15.17:0/4211510721 >> v2:172.21.15.136:3300/0 conn(0x7f3bec06d140 0x7f3bec06f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:40.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.857+0000 7f3be9d9b700 1 -- 172.21.15.17:0/4211510721 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bec06ec00 con 0x7f3bec159b10 2023-10-06T04:43:40.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.857+0000 7f3bead9d700 1 --2- 172.21.15.17:0/4211510721 >> v2:172.21.15.136:3300/0 conn(0x7f3bec06d140 0x7f3bec06f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:43:40.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.857+0000 7f3bea59c700 1 --2- 172.21.15.17:0/4211510721 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3bec0cabf0 0x7f3bec0c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:43:40.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.857+0000 7f3be9d9b700 1 --2- 172.21.15.17:0/4211510721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bec159b10 0x7f3bec06f120 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3bec0d0620 tx=0x7f3bd4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bdfee4bc5ac34a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:40.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.857+0000 7f3be959a700 1 -- 172.21.15.17:0/4211510721 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd400b860 con 0x7f3bec159b10 2023-10-06T04:43:40.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.857+0000 7f3be959a700 1 -- 172.21.15.17:0/4211510721 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd400b9c0 con 0x7f3bec159b10 2023-10-06T04:43:40.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.857+0000 7f3be959a700 1 -- 172.21.15.17:0/4211510721 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd400bd60 con 0x7f3bec159b10 2023-10-06T04:43:40.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.857+0000 7f3bf0fdd700 1 -- 172.21.15.17:0/4211510721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bec159b10 msgr2=0x7f3bec06f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:40.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.857+0000 7f3bf0fdd700 1 --2- 172.21.15.17:0/4211510721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bec159b10 0x7f3bec06f120 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3bec0d0620 tx=0x7f3bd4009250 comp rx=0 tx=0).stop 2023-10-06T04:43:40.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.857+0000 7f3bf0fdd700 1 -- 172.21.15.17:0/4211510721 shutdown_connections 2023-10-06T04:43:40.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.857+0000 7f3bf0fdd700 1 --2- 172.21.15.17:0/4211510721 >> v2:172.21.15.136:3300/0 conn(0x7f3bec06d140 0x7f3bec06f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:40.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.857+0000 7f3bf0fdd700 1 --2- 172.21.15.17:0/4211510721 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3bec0cabf0 0x7f3bec0c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:40.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.857+0000 7f3bf0fdd700 1 --2- 172.21.15.17:0/4211510721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bec159b10 0x7f3bec06f120 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:40.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.857+0000 7f3bf0fdd700 1 -- 172.21.15.17:0/4211510721 >> 172.21.15.17:0/4211510721 conn(0x7f3bec06cd40 msgr2=0x7f3bec0d0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:40.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.858+0000 7f3bf0fdd700 1 -- 172.21.15.17:0/4211510721 shutdown_connections 2023-10-06T04:43:40.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.858+0000 7f3bf0fdd700 1 -- 172.21.15.17:0/4211510721 wait complete. 2023-10-06T04:43:40.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.859+0000 7f3bf0fdd700 1 Processor -- start 2023-10-06T04:43:40.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.859+0000 7f3bf0fdd700 1 -- start start 2023-10-06T04:43:40.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.859+0000 7f3bf0fdd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bec06d140 0x7f3bec0c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:40.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.859+0000 7f3bf0fdd700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3bec0cabf0 0x7f3bec0b4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:40.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.859+0000 7f3bf0fdd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bec159b10 0x7f3bec0b5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:40.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.859+0000 7f3bf0fdd700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec0b59c0 con 0x7f3bec06d140 2023-10-06T04:43:40.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.859+0000 7f3bf0fdd700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec0b4db0 con 0x7f3bec159b10 2023-10-06T04:43:40.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.859+0000 7f3bf0fdd700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec0b5090 con 0x7f3bec0cabf0 2023-10-06T04:43:40.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.860+0000 7f3bea59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bec06d140 0x7f3bec0c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:40.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.860+0000 7f3bea59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bec06d140 0x7f3bec0c6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42624/0 (socket says 172.21.15.17:42624) 2023-10-06T04:43:40.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.860+0000 7f3bea59c700 1 -- 172.21.15.17:0/4251597654 learned_addr learned my addr 172.21.15.17:0/4251597654 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:40.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.860+0000 7f3bead9d700 1 --2- 172.21.15.17:0/4251597654 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bec159b10 0x7f3bec0b5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:40.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.860+0000 7f3be9d9b700 1 --2- 172.21.15.17:0/4251597654 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3bec0cabf0 0x7f3bec0b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:40.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.860+0000 7f3bea59c700 1 -- 172.21.15.17:0/4251597654 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3bec0cabf0 msgr2=0x7f3bec0b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:40.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.860+0000 7f3bea59c700 1 --2- 172.21.15.17:0/4251597654 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3bec0cabf0 0x7f3bec0b4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:40.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.860+0000 7f3bea59c700 1 -- 172.21.15.17:0/4251597654 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bec159b10 msgr2=0x7f3bec0b5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:40.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.860+0000 7f3bea59c700 1 --2- 172.21.15.17:0/4251597654 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bec159b10 0x7f3bec0b5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:40.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.860+0000 7f3bea59c700 1 -- 172.21.15.17:0/4251597654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd40094f0 con 0x7f3bec06d140 2023-10-06T04:43:40.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.860+0000 7f3bea59c700 1 --2- 172.21.15.17:0/4251597654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bec06d140 0x7f3bec0c6cb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3be400c830 tx=0x7f3be4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:40.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.860+0000 7f3be27fc700 1 -- 172.21.15.17:0/4251597654 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be4005a00 con 0x7f3bec06d140 2023-10-06T04:43:40.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.860+0000 7f3be27fc700 1 -- 172.21.15.17:0/4251597654 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be4005b60 con 0x7f3bec06d140 2023-10-06T04:43:40.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.860+0000 7f3bf0fdd700 1 -- 172.21.15.17:0/4251597654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bec0b5370 con 0x7f3bec06d140 2023-10-06T04:43:40.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.860+0000 7f3be27fc700 1 -- 172.21.15.17:0/4251597654 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be4011600 con 0x7f3bec06d140 2023-10-06T04:43:40.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.860+0000 7f3bf0fdd700 1 -- 172.21.15.17:0/4251597654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bec0b4ac0 con 0x7f3bec06d140 2023-10-06T04:43:40.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.861+0000 7f3bf0fdd700 1 -- 172.21.15.17:0/4251597654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bec04c380 con 0x7f3bec06d140 2023-10-06T04:43:40.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.862+0000 7f3be27fc700 1 -- 172.21.15.17:0/4251597654 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3be4011970 con 0x7f3bec06d140 2023-10-06T04:43:40.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.862+0000 7f3be27fc700 1 --2- 172.21.15.17:0/4251597654 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3bcc066f30 0x7f3bcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:40.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.862+0000 7f3be27fc700 1 -- 172.21.15.17:0/4251597654 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3be4084400 con 0x7f3bec06d140 2023-10-06T04:43:40.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.862+0000 7f3be9d9b700 1 --2- 172.21.15.17:0/4251597654 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3bcc066f30 0x7f3bcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:40.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.862+0000 7f3be9d9b700 1 --2- 172.21.15.17:0/4251597654 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3bcc066f30 0x7f3bcc0693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3bec0d0620 tx=0x7f3bd4017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:40.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:40.866+0000 7f3be27fc700 1 -- 172.21.15.17:0/4251597654 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3be4054fa0 con 0x7f3bec06d140 2023-10-06T04:43:41.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.061+0000 7f3bf0fdd700 1 -- 172.21.15.17:0/4251597654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3bec071310 con 0x7f3bec06d140 2023-10-06T04:43:41.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.061+0000 7f3be27fc700 1 -- 172.21.15.17:0/4251597654 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3be4054b30 con 0x7f3bec06d140 2023-10-06T04:43:41.063 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-10-06T04:43:41.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.063+0000 7f3bf0fdd700 1 -- 172.21.15.17:0/4251597654 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3bcc066f30 msgr2=0x7f3bcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:41.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.063+0000 7f3bf0fdd700 1 --2- 172.21.15.17:0/4251597654 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3bcc066f30 0x7f3bcc0693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3bec0d0620 tx=0x7f3bd4017000 comp rx=0 tx=0).stop 2023-10-06T04:43:41.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.063+0000 7f3bf0fdd700 1 -- 172.21.15.17:0/4251597654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bec06d140 msgr2=0x7f3bec0c6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:41.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.063+0000 7f3bf0fdd700 1 --2- 172.21.15.17:0/4251597654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bec06d140 0x7f3bec0c6cb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3be400c830 tx=0x7f3be4008040 comp rx=0 tx=0).stop 2023-10-06T04:43:41.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.063+0000 7f3bf0fdd700 1 -- 172.21.15.17:0/4251597654 shutdown_connections 2023-10-06T04:43:41.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.063+0000 7f3bf0fdd700 1 --2- 172.21.15.17:0/4251597654 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3bcc066f30 0x7f3bcc0693e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:41.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.063+0000 7f3bf0fdd700 1 --2- 172.21.15.17:0/4251597654 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bec159b10 0x7f3bec0b5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:41.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.063+0000 7f3bf0fdd700 1 --2- 172.21.15.17:0/4251597654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bec06d140 0x7f3bec0c6cb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:41.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.063+0000 7f3bf0fdd700 1 --2- 172.21.15.17:0/4251597654 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3bec0cabf0 0x7f3bec0b4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:41.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.063+0000 7f3bf0fdd700 1 -- 172.21.15.17:0/4251597654 >> 172.21.15.17:0/4251597654 conn(0x7f3bec06cd40 msgr2=0x7f3bec158990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:41.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.064+0000 7f3bf0fdd700 1 -- 172.21.15.17:0/4251597654 shutdown_connections 2023-10-06T04:43:41.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.064+0000 7f3bf0fdd700 1 -- 172.21.15.17:0/4251597654 wait complete. 2023-10-06T04:43:41.077 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:43:41.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.194+0000 7f7d7ddaa700 1 Processor -- start 2023-10-06T04:43:41.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.194+0000 7f7d7ddaa700 1 -- start start 2023-10-06T04:43:41.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.195+0000 7f7d7ddaa700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7d780cf3b0 0x7f7d781594a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:41.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.195+0000 7f7d7ddaa700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d780cbd80 con 0x7f7d780af0a0 2023-10-06T04:43:41.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.195+0000 7f7d7ddaa700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d780af5f0 con 0x7f7d780ccfc0 2023-10-06T04:43:41.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.195+0000 7f7d7ddaa700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d780af8d0 con 0x7f7d780cf3b0 2023-10-06T04:43:41.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.195+0000 7f7d77fff700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7d780cf3b0 0x7f7d781594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:41.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.195+0000 7f7d7d5a9700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f7d780af0a0 0x7f7d780b0460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55346/0 (socket says 172.21.15.17:55346) 2023-10-06T04:43:41.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.195+0000 7f7d77fff700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7d780cf3b0 0x7f7d781594a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42632/0 (socket says 172.21.15.17:42632) 2023-10-06T04:43:41.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.195+0000 7f7d7d5a9700 1 -- 172.21.15.17:0/1380002391 learned_addr learned my addr 172.21.15.17:0/1380002391 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:41.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.195+0000 7f7d77fff700 1 -- 172.21.15.17:0/1380002391 >> v1:172.21.15.136:6789/0 conn(0x7f7d780ccfc0 legacy=0x7f7d780cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:41.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.195+0000 7f7d77fff700 1 -- 172.21.15.17:0/1380002391 >> v1:172.21.15.17:6789/0 conn(0x7f7d780af0a0 legacy=0x7f7d780b0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:41.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.195+0000 7f7d77fff700 1 -- 172.21.15.17:0/1380002391 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d780afbb0 con 0x7f7d780cf3b0 2023-10-06T04:43:41.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.195+0000 7f7d777fe700 1 -- 172.21.15.17:0/1380002391 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4137697291 0 0) 0x7f7d780cbd80 con 0x7f7d780af0a0 2023-10-06T04:43:41.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.196+0000 7f7d77fff700 1 --2- 172.21.15.17:0/1380002391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d780cf3b0 0x7f7d781594a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7d68009e90 tx=0x7f7d68009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c89840e9e543843 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:41.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.196+0000 7f7d777fe700 1 -- 172.21.15.17:0/1380002391 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6800e070 con 0x7f7d780cf3b0 2023-10-06T04:43:41.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.196+0000 7f7d777fe700 1 -- 172.21.15.17:0/1380002391 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6800bbf0 con 0x7f7d780cf3b0 2023-10-06T04:43:41.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.196+0000 7f7d777fe700 1 -- 172.21.15.17:0/1380002391 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d68012430 con 0x7f7d780cf3b0 2023-10-06T04:43:41.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.196+0000 7f7d7ddaa700 1 -- 172.21.15.17:0/1380002391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d780cf3b0 msgr2=0x7f7d781594a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:41.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.196+0000 7f7d7ddaa700 1 --2- 172.21.15.17:0/1380002391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d780cf3b0 0x7f7d781594a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7d68009e90 tx=0x7f7d68009780 comp rx=0 tx=0).stop 2023-10-06T04:43:41.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.196+0000 7f7d7ddaa700 1 -- 172.21.15.17:0/1380002391 shutdown_connections 2023-10-06T04:43:41.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.196+0000 7f7d7ddaa700 1 --2- 172.21.15.17:0/1380002391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d780cf3b0 0x7f7d781594a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:41.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.196+0000 7f7d7ddaa700 1 -- 172.21.15.17:0/1380002391 >> 172.21.15.17:0/1380002391 conn(0x7f7d7806cff0 msgr2=0x7f7d7806da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:41.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.196+0000 7f7d7ddaa700 1 -- 172.21.15.17:0/1380002391 shutdown_connections 2023-10-06T04:43:41.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.196+0000 7f7d7ddaa700 1 -- 172.21.15.17:0/1380002391 wait complete. 2023-10-06T04:43:41.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.197+0000 7f7d7ddaa700 1 Processor -- start 2023-10-06T04:43:41.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.198+0000 7f7d7ddaa700 1 -- start start 2023-10-06T04:43:41.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.198+0000 7f7d7ddaa700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7d780af0a0 0x7f7d78153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:41.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.198+0000 7f7d7ddaa700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7d780ccfc0 0x7f7d780b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:41.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.198+0000 7f7d7ddaa700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d780c9300 0x7f7d78156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:41.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.198+0000 7f7d7ddaa700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d78169c10 con 0x7f7d780c9300 2023-10-06T04:43:41.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.198+0000 7f7d7ddaa700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d780b5c90 con 0x7f7d780af0a0 2023-10-06T04:43:41.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.198+0000 7f7d7ddaa700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d780b53f0 con 0x7f7d780ccfc0 2023-10-06T04:43:41.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.198+0000 7f7d7d5a9700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d780c9300 0x7f7d78156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:41.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.198+0000 7f7d7d5a9700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d780c9300 0x7f7d78156ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42642/0 (socket says 172.21.15.17:42642) 2023-10-06T04:43:41.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.198+0000 7f7d7d5a9700 1 -- 172.21.15.17:0/31471931 learned_addr learned my addr 172.21.15.17:0/31471931 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:41.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.198+0000 7f7d77fff700 1 --2- 172.21.15.17:0/31471931 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7d780ccfc0 0x7f7d780b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:41.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.198+0000 7f7d7cda8700 1 --2- 172.21.15.17:0/31471931 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7d780af0a0 0x7f7d78153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:41.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.199+0000 7f7d7d5a9700 1 -- 172.21.15.17:0/31471931 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7d780ccfc0 msgr2=0x7f7d780b4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:41.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.199+0000 7f7d7d5a9700 1 --2- 172.21.15.17:0/31471931 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7d780ccfc0 0x7f7d780b4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:41.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.199+0000 7f7d7d5a9700 1 -- 172.21.15.17:0/31471931 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7d780af0a0 msgr2=0x7f7d78153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:41.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.199+0000 7f7d7d5a9700 1 --2- 172.21.15.17:0/31471931 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7d780af0a0 0x7f7d78153d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:41.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.199+0000 7f7d7d5a9700 1 -- 172.21.15.17:0/31471931 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d68009a20 con 0x7f7d780c9300 2023-10-06T04:43:41.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.199+0000 7f7d7d5a9700 1 --2- 172.21.15.17:0/31471931 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d780c9300 0x7f7d78156ba0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7d6000c500 tx=0x7f7d60007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:41.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.199+0000 7f7d74ff9700 1 -- 172.21.15.17:0/31471931 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d60005b30 con 0x7f7d780c9300 2023-10-06T04:43:41.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.199+0000 7f7d74ff9700 1 -- 172.21.15.17:0/31471931 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d60005c90 con 0x7f7d780c9300 2023-10-06T04:43:41.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.199+0000 7f7d7ddaa700 1 -- 172.21.15.17:0/31471931 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d780b56d0 con 0x7f7d780c9300 2023-10-06T04:43:41.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.199+0000 7f7d74ff9700 1 -- 172.21.15.17:0/31471931 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d60007320 con 0x7f7d780c9300 2023-10-06T04:43:41.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.199+0000 7f7d7ddaa700 1 -- 172.21.15.17:0/31471931 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d78154240 con 0x7f7d780c9300 2023-10-06T04:43:41.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.200+0000 7f7d7ddaa700 1 -- 172.21.15.17:0/31471931 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d7804c380 con 0x7f7d780c9300 2023-10-06T04:43:41.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.201+0000 7f7d74ff9700 1 -- 172.21.15.17:0/31471931 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d6001b3b0 con 0x7f7d780c9300 2023-10-06T04:43:41.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.201+0000 7f7d74ff9700 1 --2- 172.21.15.17:0/31471931 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7d58066f30 0x7f7d580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:41.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.201+0000 7f7d74ff9700 1 -- 172.21.15.17:0/31471931 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7d60083a00 con 0x7f7d780c9300 2023-10-06T04:43:41.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.201+0000 7f7d7cda8700 1 --2- 172.21.15.17:0/31471931 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7d58066f30 0x7f7d580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:41.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.201+0000 7f7d7cda8700 1 --2- 172.21.15.17:0/31471931 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7d58066f30 0x7f7d580693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7d70003a80 tx=0x7f7d70007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:41.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.205+0000 7f7d74ff9700 1 -- 172.21.15.17:0/31471931 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d60050b10 con 0x7f7d780c9300 2023-10-06T04:43:41.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.451+0000 7f7d7ddaa700 1 -- 172.21.15.17:0/31471931 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d78169d50 con 0x7f7d780c9300 2023-10-06T04:43:41.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.451+0000 7f7d74ff9700 1 -- 172.21.15.17:0/31471931 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f7d60017090 con 0x7f7d780c9300 2023-10-06T04:43:41.454 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:43:41.454 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/3001699743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3001699743},{"type":"v1","addr":"172.21.15.136:6833","nonce":3001699743}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/1891609455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1891609455},{"type":"v1","addr":"172.21.15.17:6835","nonce":1891609455}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/2697752124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":2697752124},{"type":"v1","addr":"172.21.15.17:6837","nonce":2697752124}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:43:29.199801+0000","modified":"2023-10-06T04:43:32.817081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6835/1496795591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":1496795591},{"type":"v1","addr":"172.21.15.136:6835","nonce":1496795591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:43:41.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.454+0000 7f7d7ddaa700 1 -- 172.21.15.17:0/31471931 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7d58066f30 msgr2=0x7f7d580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:41.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.454+0000 7f7d7ddaa700 1 --2- 172.21.15.17:0/31471931 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7d58066f30 0x7f7d580693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7d70003a80 tx=0x7f7d70007ec0 comp rx=0 tx=0).stop 2023-10-06T04:43:41.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.454+0000 7f7d7ddaa700 1 -- 172.21.15.17:0/31471931 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d780c9300 msgr2=0x7f7d78156ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:41.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.454+0000 7f7d7ddaa700 1 --2- 172.21.15.17:0/31471931 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d780c9300 0x7f7d78156ba0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7d6000c500 tx=0x7f7d60007f60 comp rx=0 tx=0).stop 2023-10-06T04:43:41.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.454+0000 7f7d7ddaa700 1 -- 172.21.15.17:0/31471931 shutdown_connections 2023-10-06T04:43:41.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.454+0000 7f7d7ddaa700 1 --2- 172.21.15.17:0/31471931 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7d58066f30 0x7f7d580693e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:41.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.454+0000 7f7d7ddaa700 1 --2- 172.21.15.17:0/31471931 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d780c9300 0x7f7d78156ba0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:41.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.454+0000 7f7d7ddaa700 1 --2- 172.21.15.17:0/31471931 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7d780af0a0 0x7f7d78153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:41.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.454+0000 7f7d7ddaa700 1 --2- 172.21.15.17:0/31471931 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7d780ccfc0 0x7f7d780b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:41.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.454+0000 7f7d7ddaa700 1 -- 172.21.15.17:0/31471931 >> 172.21.15.17:0/31471931 conn(0x7f7d7806cff0 msgr2=0x7f7d78158750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:41.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.454+0000 7f7d7ddaa700 1 -- 172.21.15.17:0/31471931 shutdown_connections 2023-10-06T04:43:41.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.454+0000 7f7d7ddaa700 1 -- 172.21.15.17:0/31471931 wait complete. 2023-10-06T04:43:41.458 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 7 2023-10-06T04:43:41.468 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:43:41.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.585+0000 7f1e0b528700 1 Processor -- start 2023-10-06T04:43:41.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.585+0000 7f1e0b528700 1 -- start start 2023-10-06T04:43:41.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.586+0000 7f1e0b528700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1e040cd760 0x7f1e040ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:41.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.586+0000 7f1e0b528700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1e040ce840 0x7f1e040b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:41.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.586+0000 7f1e0b528700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e040cfc80 con 0x7f1e04159630 2023-10-06T04:43:41.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.586+0000 7f1e0b528700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e040cf070 con 0x7f1e040cd760 2023-10-06T04:43:41.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.586+0000 7f1e0b528700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e040cf350 con 0x7f1e040ce840 2023-10-06T04:43:41.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.586+0000 7f1e092c4700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f1e04159630 0x7f1e040cd050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55360/0 (socket says 172.21.15.17:55360) 2023-10-06T04:43:41.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.586+0000 7f1e092c4700 1 -- 172.21.15.17:0/3175275025 learned_addr learned my addr 172.21.15.17:0/3175275025 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:41.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.586+0000 7f1e08ac3700 1 --2- 172.21.15.17:0/3175275025 >> v2:172.21.15.17:3300/0 conn(0x7f1e040cd760 0x7f1e040ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:41.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.587+0000 7f1e09ac5700 1 --2- 172.21.15.17:0/3175275025 >> v2:172.21.15.136:3300/0 conn(0x7f1e040ce840 0x7f1e040b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:41.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.587+0000 7f1e03fff700 1 -- 172.21.15.17:0/3175275025 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1188662097 0 0) 0x7f1e040cfc80 con 0x7f1e04159630 2023-10-06T04:43:41.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.587+0000 7f1e03fff700 1 -- 172.21.15.17:0/3175275025 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dec003570 con 0x7f1e04159630 2023-10-06T04:43:41.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.587+0000 7f1e08ac3700 1 -- 172.21.15.17:0/3175275025 >> v2:172.21.15.136:3300/0 conn(0x7f1e040ce840 msgr2=0x7f1e040b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:41.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.587+0000 7f1e08ac3700 1 --2- 172.21.15.17:0/3175275025 >> v2:172.21.15.136:3300/0 conn(0x7f1e040ce840 0x7f1e040b02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:41.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.587+0000 7f1e08ac3700 1 -- 172.21.15.17:0/3175275025 >> v1:172.21.15.17:6789/0 conn(0x7f1e04159630 legacy=0x7f1e040cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:41.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.587+0000 7f1e08ac3700 1 -- 172.21.15.17:0/3175275025 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e040cf630 con 0x7f1e040cd760 2023-10-06T04:43:41.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.587+0000 7f1e08ac3700 1 --2- 172.21.15.17:0/3175275025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e040cd760 0x7f1e040ce300 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1e0406eee0 tx=0x7f1df80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddce05c30a842905 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:41.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.587+0000 7f1e03fff700 1 -- 172.21.15.17:0/3175275025 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df8011630 con 0x7f1e040cd760 2023-10-06T04:43:41.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.587+0000 7f1e03fff700 1 -- 172.21.15.17:0/3175275025 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df8011790 con 0x7f1e040cd760 2023-10-06T04:43:41.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.587+0000 7f1e03fff700 1 -- 172.21.15.17:0/3175275025 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df8011b30 con 0x7f1e040cd760 2023-10-06T04:43:41.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.587+0000 7f1e0b528700 1 -- 172.21.15.17:0/3175275025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e040cd760 msgr2=0x7f1e040ce300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:41.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.587+0000 7f1e0b528700 1 --2- 172.21.15.17:0/3175275025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e040cd760 0x7f1e040ce300 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1e0406eee0 tx=0x7f1df80091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:41.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.588+0000 7f1e0b528700 1 -- 172.21.15.17:0/3175275025 shutdown_connections 2023-10-06T04:43:41.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.588+0000 7f1e0b528700 1 --2- 172.21.15.17:0/3175275025 >> v2:172.21.15.136:3300/0 conn(0x7f1e040ce840 0x7f1e040b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:41.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.588+0000 7f1e0b528700 1 --2- 172.21.15.17:0/3175275025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e040cd760 0x7f1e040ce300 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:41.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.588+0000 7f1e0b528700 1 -- 172.21.15.17:0/3175275025 >> 172.21.15.17:0/3175275025 conn(0x7f1e0406cff0 msgr2=0x7f1e0406d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:41.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.588+0000 7f1e0b528700 1 -- 172.21.15.17:0/3175275025 shutdown_connections 2023-10-06T04:43:41.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.588+0000 7f1e0b528700 1 -- 172.21.15.17:0/3175275025 wait complete. 2023-10-06T04:43:41.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.589+0000 7f1e0b528700 1 Processor -- start 2023-10-06T04:43:41.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.589+0000 7f1e0b528700 1 -- start start 2023-10-06T04:43:41.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.590+0000 7f1e0b528700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1e040cd760 0x7f1e040b4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:41.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.590+0000 7f1e0b528700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e040ce840 0x7f1e040b50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:41.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.590+0000 7f1e0b528700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1e04159630 0x7f1e0414f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:41.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.590+0000 7f1e0b528700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e041537f0 con 0x7f1e040ce840 2023-10-06T04:43:41.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.590+0000 7f1e0b528700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e04152be0 con 0x7f1e04159630 2023-10-06T04:43:41.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.590+0000 7f1e0b528700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e04152ec0 con 0x7f1e040cd760 2023-10-06T04:43:41.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.590+0000 7f1e08ac3700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e040ce840 0x7f1e040b50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:41.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.590+0000 7f1e08ac3700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e040ce840 0x7f1e040b50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42656/0 (socket says 172.21.15.17:42656) 2023-10-06T04:43:41.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.590+0000 7f1e08ac3700 1 -- 172.21.15.17:0/2744751700 learned_addr learned my addr 172.21.15.17:0/2744751700 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:41.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.590+0000 7f1e09ac5700 1 --2- 172.21.15.17:0/2744751700 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1e04159630 0x7f1e0414f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:41.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.590+0000 7f1e092c4700 1 --2- 172.21.15.17:0/2744751700 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1e040cd760 0x7f1e040b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:41.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.590+0000 7f1e08ac3700 1 -- 172.21.15.17:0/2744751700 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1e040cd760 msgr2=0x7f1e040b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:41.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.590+0000 7f1e08ac3700 1 --2- 172.21.15.17:0/2744751700 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1e040cd760 0x7f1e040b4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:41.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.590+0000 7f1e08ac3700 1 -- 172.21.15.17:0/2744751700 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1e04159630 msgr2=0x7f1e0414f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:41.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.590+0000 7f1e08ac3700 1 --2- 172.21.15.17:0/2744751700 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1e04159630 0x7f1e0414f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:41.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.590+0000 7f1e08ac3700 1 -- 172.21.15.17:0/2744751700 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df8009420 con 0x7f1e040ce840 2023-10-06T04:43:41.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.590+0000 7f1e092c4700 1 --2- 172.21.15.17:0/2744751700 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1e040cd760 0x7f1e040b4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:43:41.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.590+0000 7f1e08ac3700 1 --2- 172.21.15.17:0/2744751700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e040ce840 0x7f1e040b50c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1df80091e0 tx=0x7f1df8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:41.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.590+0000 7f1e017fa700 1 -- 172.21.15.17:0/2744751700 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df8011b10 con 0x7f1e040ce840 2023-10-06T04:43:41.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.590+0000 7f1e017fa700 1 -- 172.21.15.17:0/2744751700 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df80253f0 con 0x7f1e040ce840 2023-10-06T04:43:41.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.590+0000 7f1e0b528700 1 -- 172.21.15.17:0/2744751700 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e041531a0 con 0x7f1e040ce840 2023-10-06T04:43:41.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.590+0000 7f1e017fa700 1 -- 172.21.15.17:0/2744751700 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df80257b0 con 0x7f1e040ce840 2023-10-06T04:43:41.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.590+0000 7f1e0b528700 1 -- 172.21.15.17:0/2744751700 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e04152620 con 0x7f1e040ce840 2023-10-06T04:43:41.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.591+0000 7f1e0b528700 1 -- 172.21.15.17:0/2744751700 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e04063ff0 con 0x7f1e040ce840 2023-10-06T04:43:41.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.592+0000 7f1e017fa700 1 -- 172.21.15.17:0/2744751700 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1df8025be0 con 0x7f1e040ce840 2023-10-06T04:43:41.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.592+0000 7f1e017fa700 1 --2- 172.21.15.17:0/2744751700 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1df0066f30 0x7f1df00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:41.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.592+0000 7f1e017fa700 1 -- 172.21.15.17:0/2744751700 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1df8086010 con 0x7f1e040ce840 2023-10-06T04:43:41.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.592+0000 7f1e092c4700 1 --2- 172.21.15.17:0/2744751700 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1df0066f30 0x7f1df00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:41.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.593+0000 7f1e092c4700 1 --2- 172.21.15.17:0/2744751700 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1df0066f30 0x7f1df00693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc005c50 tx=0x7f1dfc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:41.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.596+0000 7f1e017fa700 1 -- 172.21.15.17:0/2744751700 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1df8053120 con 0x7f1e040ce840 2023-10-06T04:43:41.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.789+0000 7f1e0b528700 1 -- 172.21.15.17:0/2744751700 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e040c5d30 con 0x7f1e040ce840 2023-10-06T04:43:41.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.790+0000 7f1e017fa700 1 -- 172.21.15.17:0/2744751700 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f1df8056740 con 0x7f1e040ce840 2023-10-06T04:43:41.792 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:43:41.792 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":21,"fsid":"780777c4-2b25-4d35-9058-c9f2d62e3ad9","created":"2023-10-06T04:43:10.578520+0000","modified":"2023-10-06T04:43:30.789916+0000","last_up_change":"2023-10-06T04:43:20.682958+0000","last_in_change":"2023-10-06T04:43:12.978917+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:43:21.795733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:43:22.389592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:43:26.914728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:43:28.173678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"84737b08-575c-46dd-9488-073ae8504494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6809","nonce":90656},{"type":"v1","addr":"172.21.15.17:6811","nonce":90656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":90656},{"type":"v1","addr":"172.21.15.17:6814","nonce":90656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":90656},{"type":"v1","addr":"172.21.15.17:6822","nonce":90656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":90656},{"type":"v1","addr":"172.21.15.17:6818","nonce":90656}]},"public_addr":"172.21.15.17:6811/90656","cluster_addr":"172.21.15.17:6814/90656","heartbeat_back_addr":"172.21.15.17:6822/90656","heartbeat_front_addr":"172.21.15.17:6818/90656","state":["exists","up"]},{"osd":1,"uuid":"dffeb740-58a2-4fd6-8ff1-a0a11a2cc709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":90655},{"type":"v1","addr":"172.21.15.17:6801","nonce":90655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":90655},{"type":"v1","addr":"172.21.15.17:6803","nonce":90655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":90655},{"type":"v1","addr":"172.21.15.17:6807","nonce":90655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":90655},{"type":"v1","addr":"172.21.15.17:6805","nonce":90655}]},"public_addr":"172.21.15.17:6801/90655","cluster_addr":"172.21.15.17:6803/90655","heartbeat_back_addr":"172.21.15.17:6807/90655","heartbeat_front_addr":"172.21.15.17:6805/90655","state":["exists","up"]},{"osd":2,"uuid":"48bd6831-763d-48c2-b515-e02c216d608b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":90657},{"type":"v1","addr":"172.21.15.17:6810","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":90657},{"type":"v1","addr":"172.21.15.17:6815","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":90657},{"type":"v1","addr":"172.21.15.17:6823","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":90657},{"type":"v1","addr":"172.21.15.17:6819","nonce":90657}]},"public_addr":"172.21.15.17:6810/90657","cluster_addr":"172.21.15.17:6815/90657","heartbeat_back_addr":"172.21.15.17:6823/90657","heartbeat_front_addr":"172.21.15.17:6819/90657","state":["exists","up"]},{"osd":3,"uuid":"ae7dbb23-abe7-4bd3-a4df-6f5963d6804c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":90688},{"type":"v1","addr":"172.21.15.17:6825","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":90688},{"type":"v1","addr":"172.21.15.17:6827","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":90688},{"type":"v1","addr":"172.21.15.17:6831","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":90688},{"type":"v1","addr":"172.21.15.17:6829","nonce":90688}]},"public_addr":"172.21.15.17:6825/90688","cluster_addr":"172.21.15.17:6827/90688","heartbeat_back_addr":"172.21.15.17:6831/90688","heartbeat_front_addr":"172.21.15.17:6829/90688","state":["exists","up"]},{"osd":4,"uuid":"29991fb4-1667-4ea3-aca0-d55db27f3bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":90902},{"type":"v1","addr":"172.21.15.136:6801","nonce":90902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":90902},{"type":"v1","addr":"172.21.15.136:6803","nonce":90902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":90902},{"type":"v1","addr":"172.21.15.136:6807","nonce":90902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":90902},{"type":"v1","addr":"172.21.15.136:6805","nonce":90902}]},"public_addr":"172.21.15.136:6801/90902","cluster_addr":"172.21.15.136:6803/90902","heartbeat_back_addr":"172.21.15.136:6807/90902","heartbeat_front_addr":"172.21.15.136:6805/90902","state":["exists","up"]},{"osd":5,"uuid":"398b4ff9-03fc-421f-882c-ba12aa088eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":90901},{"type":"v1","addr":"172.21.15.136:6809","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":90901},{"type":"v1","addr":"172.21.15.136:6811","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":90901},{"type":"v1","addr":"172.21.15.136:6815","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":90901},{"type":"v1","addr":"172.21.15.136:6813","nonce":90901}]},"public_addr":"172.21.15.136:6809/90901","cluster_addr":"172.21.15.136:6811/90901","heartbeat_back_addr":"172.21.15.136:6815/90901","heartbeat_front_addr":"172.21.15.136:6813/90901","state":["exists","up"]},{"osd":6,"uuid":"1bb91a72-4dab-4cdb-aa1d-2b8a9edf1ad0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":90927},{"type":"v1","addr":"172.21.15.136:6825","nonce":90927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":90927},{"type":"v1","addr":"172.21.15.136:6827","nonce":90927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":90927},{"type":"v1","addr":"172.21.15.136:6831","nonce":90927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":90927},{"type":"v1","addr":"172.21.15.136:6829","nonce":90927}]},"public_addr":"172.21.15.136:6825/90927","cluster_addr":"172.21.15.136:6827/90927","heartbeat_back_addr":"172.21.15.136:6831/90927","heartbeat_front_addr":"172.21.15.136:6829/90927","state":["exists","up"]},{"osd":7,"uuid":"719b654e-010d-4aa4-8c13-83fdde242b47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":90934},{"type":"v1","addr":"172.21.15.136:6817","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":90934},{"type":"v1","addr":"172.21.15.136:6819","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":90934},{"type":"v1","addr":"172.21.15.136:6824","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":90934},{"type":"v1","addr":"172.21.15.136:6821","nonce":90934}]},"public_addr":"172.21.15.136:6817/90934","cluster_addr":"172.21.15.136:6819/90934","heartbeat_back_addr":"172.21.15.136:6824/90934","heartbeat_front_addr":"172.21.15.136:6821/90934","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.157479+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.140520+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.190743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.231396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.156510+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.145822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.202888+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.139532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:43:41.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.792+0000 7f1e0b528700 1 -- 172.21.15.17:0/2744751700 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1df0066f30 msgr2=0x7f1df00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:41.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.792+0000 7f1e0b528700 1 --2- 172.21.15.17:0/2744751700 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1df0066f30 0x7f1df00693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc005c50 tx=0x7f1dfc009040 comp rx=0 tx=0).stop 2023-10-06T04:43:41.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.792+0000 7f1e0b528700 1 -- 172.21.15.17:0/2744751700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e040ce840 msgr2=0x7f1e040b50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:41.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.792+0000 7f1e0b528700 1 --2- 172.21.15.17:0/2744751700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e040ce840 0x7f1e040b50c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1df80091e0 tx=0x7f1df8017000 comp rx=0 tx=0).stop 2023-10-06T04:43:41.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.792+0000 7f1e0b528700 1 -- 172.21.15.17:0/2744751700 shutdown_connections 2023-10-06T04:43:41.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.792+0000 7f1e0b528700 1 --2- 172.21.15.17:0/2744751700 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1df0066f30 0x7f1df00693e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:41.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.792+0000 7f1e0b528700 1 --2- 172.21.15.17:0/2744751700 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1e04159630 0x7f1e0414f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:41.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.792+0000 7f1e0b528700 1 --2- 172.21.15.17:0/2744751700 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1e040cd760 0x7f1e040b4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:41.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.792+0000 7f1e0b528700 1 --2- 172.21.15.17:0/2744751700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e040ce840 0x7f1e040b50c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:41.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.792+0000 7f1e0b528700 1 -- 172.21.15.17:0/2744751700 >> 172.21.15.17:0/2744751700 conn(0x7f1e0406cff0 msgr2=0x7f1e040b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:41.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.792+0000 7f1e0b528700 1 -- 172.21.15.17:0/2744751700 shutdown_connections 2023-10-06T04:43:41.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.792+0000 7f1e0b528700 1 -- 172.21.15.17:0/2744751700 wait complete. 2023-10-06T04:43:41.806 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:43:21.795733+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:43:22.389592+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:43:26.914728+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:43:28.173678+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:43:41.806 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:43:41.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.926+0000 7f6d15204700 1 Processor -- start 2023-10-06T04:43:41.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.926+0000 7f6d15204700 1 -- start start 2023-10-06T04:43:41.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.927+0000 7f6d15204700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6d100cd5e0 0x7f6d100af910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:41.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.927+0000 7f6d15204700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6d1015a650 0x7f6d1015d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:41.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.927+0000 7f6d15204700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d1015d660 con 0x7f6d100af540 2023-10-06T04:43:41.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.927+0000 7f6d15204700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d100ce890 con 0x7f6d1015a650 2023-10-06T04:43:41.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.927+0000 7f6d15204700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1015aad0 con 0x7f6d100cd5e0 2023-10-06T04:43:41.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.927+0000 7f6d0ffff700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f6d100af540 0x7f6d100cced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55368/0 (socket says 172.21.15.17:55368) 2023-10-06T04:43:41.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.927+0000 7f6d0ffff700 1 -- 172.21.15.17:0/373451763 learned_addr learned my addr 172.21.15.17:0/373451763 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:41.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.927+0000 7f6d14a03700 1 --2- 172.21.15.17:0/373451763 >> v2:172.21.15.17:3300/0 conn(0x7f6d1015a650 0x7f6d1015d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:41.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.928+0000 7f6d07fff700 1 --2- 172.21.15.17:0/373451763 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6d100cd5e0 0x7f6d100af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:41.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.928+0000 7f6d0f7fe700 1 -- 172.21.15.17:0/373451763 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2429004037 0 0) 0x7f6d1015d660 con 0x7f6d100af540 2023-10-06T04:43:41.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.928+0000 7f6d0f7fe700 1 -- 172.21.15.17:0/373451763 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cfc003570 con 0x7f6d100af540 2023-10-06T04:43:41.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.928+0000 7f6d14a03700 1 -- 172.21.15.17:0/373451763 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6d100cd5e0 msgr2=0x7f6d100af910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:41.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.928+0000 7f6d14a03700 1 --2- 172.21.15.17:0/373451763 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6d100cd5e0 0x7f6d100af910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:41.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.928+0000 7f6d14a03700 1 -- 172.21.15.17:0/373451763 >> v1:172.21.15.17:6789/0 conn(0x7f6d100af540 legacy=0x7f6d100cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:41.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.928+0000 7f6d14a03700 1 -- 172.21.15.17:0/373451763 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d1015d890 con 0x7f6d1015a650 2023-10-06T04:43:41.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.928+0000 7f6d14a03700 1 --2- 172.21.15.17:0/373451763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d1015a650 0x7f6d1015d120 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6d08009e60 tx=0x7f6d08009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=656448d0a0416e04 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:41.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.928+0000 7f6d0f7fe700 1 -- 172.21.15.17:0/373451763 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0800e070 con 0x7f6d1015a650 2023-10-06T04:43:41.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.928+0000 7f6d0f7fe700 1 -- 172.21.15.17:0/373451763 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d0800bab0 con 0x7f6d1015a650 2023-10-06T04:43:41.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.928+0000 7f6d0f7fe700 1 -- 172.21.15.17:0/373451763 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0800be70 con 0x7f6d1015a650 2023-10-06T04:43:41.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.929+0000 7f6d15204700 1 -- 172.21.15.17:0/373451763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d1015a650 msgr2=0x7f6d1015d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:41.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.929+0000 7f6d15204700 1 --2- 172.21.15.17:0/373451763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d1015a650 0x7f6d1015d120 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6d08009e60 tx=0x7f6d08009780 comp rx=0 tx=0).stop 2023-10-06T04:43:41.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.929+0000 7f6d15204700 1 -- 172.21.15.17:0/373451763 shutdown_connections 2023-10-06T04:43:41.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.929+0000 7f6d15204700 1 --2- 172.21.15.17:0/373451763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d1015a650 0x7f6d1015d120 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:41.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.929+0000 7f6d15204700 1 --2- 172.21.15.17:0/373451763 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6d100cd5e0 0x7f6d100af910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:41.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.929+0000 7f6d15204700 1 -- 172.21.15.17:0/373451763 >> 172.21.15.17:0/373451763 conn(0x7f6d1006d9b0 msgr2=0x7f6d1006ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:41.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.929+0000 7f6d15204700 1 -- 172.21.15.17:0/373451763 shutdown_connections 2023-10-06T04:43:41.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.929+0000 7f6d15204700 1 -- 172.21.15.17:0/373451763 wait complete. 2023-10-06T04:43:41.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.930+0000 7f6d15204700 1 Processor -- start 2023-10-06T04:43:41.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.930+0000 7f6d15204700 1 -- start start 2023-10-06T04:43:41.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.931+0000 7f6d15204700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d100af540 0x7f6d1014de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:41.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.931+0000 7f6d15204700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d100cd5e0 0x7f6d100c7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:41.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.931+0000 7f6d15204700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6d1015a650 0x7f6d100c7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:41.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.931+0000 7f6d15204700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d10159370 con 0x7f6d100af540 2023-10-06T04:43:41.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.931+0000 7f6d15204700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d100c82b0 con 0x7f6d100cd5e0 2023-10-06T04:43:41.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.931+0000 7f6d15204700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d100c8590 con 0x7f6d1015a650 2023-10-06T04:43:41.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.931+0000 7f6d0ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d100af540 0x7f6d1014de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:41.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.931+0000 7f6d0ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d100af540 0x7f6d1014de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42676/0 (socket says 172.21.15.17:42676) 2023-10-06T04:43:41.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.931+0000 7f6d0ffff700 1 -- 172.21.15.17:0/1944482644 learned_addr learned my addr 172.21.15.17:0/1944482644 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:41.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.931+0000 7f6d07fff700 1 --2- 172.21.15.17:0/1944482644 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d100cd5e0 0x7f6d100c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:41.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.931+0000 7f6d14a03700 1 --2- 172.21.15.17:0/1944482644 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6d1015a650 0x7f6d100c7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:41.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.931+0000 7f6d0ffff700 1 -- 172.21.15.17:0/1944482644 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6d1015a650 msgr2=0x7f6d100c7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:41.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.931+0000 7f6d0ffff700 1 --2- 172.21.15.17:0/1944482644 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6d1015a650 0x7f6d100c7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:41.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.931+0000 7f6d0ffff700 1 -- 172.21.15.17:0/1944482644 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d100cd5e0 msgr2=0x7f6d100c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:41.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.931+0000 7f6d0ffff700 1 --2- 172.21.15.17:0/1944482644 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d100cd5e0 0x7f6d100c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:41.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.931+0000 7f6d0ffff700 1 -- 172.21.15.17:0/1944482644 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d08009a20 con 0x7f6d100af540 2023-10-06T04:43:41.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.931+0000 7f6d0ffff700 1 --2- 172.21.15.17:0/1944482644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d100af540 0x7f6d1014de10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6d0000c590 tx=0x7f6d00007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:41.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.931+0000 7f6d0cff9700 1 -- 172.21.15.17:0/1944482644 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d00005b30 con 0x7f6d100af540 2023-10-06T04:43:41.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.931+0000 7f6d0cff9700 1 -- 172.21.15.17:0/1944482644 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d00005cb0 con 0x7f6d100af540 2023-10-06T04:43:41.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.931+0000 7f6d15204700 1 -- 172.21.15.17:0/1944482644 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d100c8870 con 0x7f6d100af540 2023-10-06T04:43:41.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.932+0000 7f6d0cff9700 1 -- 172.21.15.17:0/1944482644 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d00007320 con 0x7f6d100af540 2023-10-06T04:43:41.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.932+0000 7f6d15204700 1 -- 172.21.15.17:0/1944482644 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d100c8e30 con 0x7f6d100af540 2023-10-06T04:43:41.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.932+0000 7f6d15204700 1 -- 172.21.15.17:0/1944482644 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d1004c380 con 0x7f6d100af540 2023-10-06T04:43:41.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.933+0000 7f6d0cff9700 1 -- 172.21.15.17:0/1944482644 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6d0001b3b0 con 0x7f6d100af540 2023-10-06T04:43:41.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.933+0000 7f6d0cff9700 1 --2- 172.21.15.17:0/1944482644 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6cf0066f30 0x7f6cf00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:41.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.933+0000 7f6d0cff9700 1 -- 172.21.15.17:0/1944482644 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6d00083b60 con 0x7f6d100af540 2023-10-06T04:43:41.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.933+0000 7f6d07fff700 1 --2- 172.21.15.17:0/1944482644 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6cf0066f30 0x7f6cf00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:41.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.934+0000 7f6d07fff700 1 --2- 172.21.15.17:0/1944482644 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6cf0066f30 0x7f6cf00693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8009db0 tx=0x7f6cf80091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:41.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:41.938+0000 7f6d0cff9700 1 -- 172.21.15.17:0/1944482644 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6d00050bd0 con 0x7f6d100af540 2023-10-06T04:43:42.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.128+0000 7f6d15204700 1 -- 172.21.15.17:0/1944482644 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6d1015db70 con 0x7f6d100af540 2023-10-06T04:43:42.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.128+0000 7f6d0cff9700 1 -- 172.21.15.17:0/1944482644 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6d00017020 con 0x7f6d100af540 2023-10-06T04:43:42.130 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-10-06T04:43:42.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.130+0000 7f6d15204700 1 -- 172.21.15.17:0/1944482644 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6cf0066f30 msgr2=0x7f6cf00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:42.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.130+0000 7f6d15204700 1 --2- 172.21.15.17:0/1944482644 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6cf0066f30 0x7f6cf00693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8009db0 tx=0x7f6cf80091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:42.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.130+0000 7f6d15204700 1 -- 172.21.15.17:0/1944482644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d100af540 msgr2=0x7f6d1014de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:42.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.130+0000 7f6d15204700 1 --2- 172.21.15.17:0/1944482644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d100af540 0x7f6d1014de10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6d0000c590 tx=0x7f6d00007e00 comp rx=0 tx=0).stop 2023-10-06T04:43:42.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.130+0000 7f6d15204700 1 -- 172.21.15.17:0/1944482644 shutdown_connections 2023-10-06T04:43:42.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.130+0000 7f6d15204700 1 --2- 172.21.15.17:0/1944482644 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6cf0066f30 0x7f6cf00693e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:42.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.130+0000 7f6d15204700 1 --2- 172.21.15.17:0/1944482644 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6d1015a650 0x7f6d100c7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:42.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.130+0000 7f6d15204700 1 --2- 172.21.15.17:0/1944482644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d100af540 0x7f6d1014de10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:42.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.130+0000 7f6d15204700 1 --2- 172.21.15.17:0/1944482644 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d100cd5e0 0x7f6d100c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:42.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.130+0000 7f6d15204700 1 -- 172.21.15.17:0/1944482644 >> 172.21.15.17:0/1944482644 conn(0x7f6d1006d9b0 msgr2=0x7f6d100cced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:42.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.130+0000 7f6d15204700 1 -- 172.21.15.17:0/1944482644 shutdown_connections 2023-10-06T04:43:42.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.130+0000 7f6d15204700 1 -- 172.21.15.17:0/1944482644 wait complete. 2023-10-06T04:43:42.144 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:43:42.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.264+0000 7f062f59e700 1 Processor -- start 2023-10-06T04:43:42.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.264+0000 7f062f59e700 1 -- start start 2023-10-06T04:43:42.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.265+0000 7f062f59e700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f06300cd5e0 0x7f06300af910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:42.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.265+0000 7f062f59e700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f063015a650 0x7f063015d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:42.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.265+0000 7f062f59e700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f063015d660 con 0x7f06300af540 2023-10-06T04:43:42.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.265+0000 7f062f59e700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06300ce890 con 0x7f063015a650 2023-10-06T04:43:42.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.265+0000 7f062f59e700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f063015aa60 con 0x7f06300cd5e0 2023-10-06T04:43:42.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.265+0000 7f062e59c700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f06300af540 0x7f06300cced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55372/0 (socket says 172.21.15.17:55372) 2023-10-06T04:43:42.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.265+0000 7f062e59c700 1 -- 172.21.15.17:0/4179426139 learned_addr learned my addr 172.21.15.17:0/4179426139 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:42.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.265+0000 7f062ed9d700 1 --2- 172.21.15.17:0/4179426139 >> v2:172.21.15.17:3300/0 conn(0x7f063015a650 0x7f063015d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:42.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.265+0000 7f062dd9b700 1 --2- 172.21.15.17:0/4179426139 >> v2:172.21.15.136:3300/0 conn(0x7f06300cd5e0 0x7f06300af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:42.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.265+0000 7f062d59a700 1 -- 172.21.15.17:0/4179426139 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3761567041 0 0) 0x7f063015d660 con 0x7f06300af540 2023-10-06T04:43:42.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.265+0000 7f062d59a700 1 -- 172.21.15.17:0/4179426139 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f061c003570 con 0x7f06300af540 2023-10-06T04:43:42.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.265+0000 7f062ed9d700 1 -- 172.21.15.17:0/4179426139 >> v2:172.21.15.136:3300/0 conn(0x7f06300cd5e0 msgr2=0x7f06300af910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:42.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.265+0000 7f062ed9d700 1 --2- 172.21.15.17:0/4179426139 >> v2:172.21.15.136:3300/0 conn(0x7f06300cd5e0 0x7f06300af910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:42.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.265+0000 7f062ed9d700 1 -- 172.21.15.17:0/4179426139 >> v1:172.21.15.17:6789/0 conn(0x7f06300af540 legacy=0x7f06300cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:42.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.265+0000 7f062ed9d700 1 -- 172.21.15.17:0/4179426139 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063015d890 con 0x7f063015a650 2023-10-06T04:43:42.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.266+0000 7f062ed9d700 1 --2- 172.21.15.17:0/4179426139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f063015a650 0x7f063015d120 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f06300893f0 tx=0x7f0620009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=327dde550129815 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:42.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.266+0000 7f062d59a700 1 -- 172.21.15.17:0/4179426139 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062000e070 con 0x7f063015a650 2023-10-06T04:43:42.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.266+0000 7f062d59a700 1 -- 172.21.15.17:0/4179426139 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062000bab0 con 0x7f063015a650 2023-10-06T04:43:42.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.266+0000 7f062d59a700 1 -- 172.21.15.17:0/4179426139 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062000be70 con 0x7f063015a650 2023-10-06T04:43:42.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.266+0000 7f062f59e700 1 -- 172.21.15.17:0/4179426139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f063015a650 msgr2=0x7f063015d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:42.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.266+0000 7f062f59e700 1 --2- 172.21.15.17:0/4179426139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f063015a650 0x7f063015d120 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f06300893f0 tx=0x7f0620009780 comp rx=0 tx=0).stop 2023-10-06T04:43:42.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.266+0000 7f062f59e700 1 -- 172.21.15.17:0/4179426139 shutdown_connections 2023-10-06T04:43:42.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.266+0000 7f062f59e700 1 --2- 172.21.15.17:0/4179426139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f063015a650 0x7f063015d120 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:42.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.266+0000 7f062f59e700 1 --2- 172.21.15.17:0/4179426139 >> v2:172.21.15.136:3300/0 conn(0x7f06300cd5e0 0x7f06300af910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:42.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.266+0000 7f062f59e700 1 -- 172.21.15.17:0/4179426139 >> 172.21.15.17:0/4179426139 conn(0x7f063006d9b0 msgr2=0x7f063006ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:42.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.266+0000 7f062f59e700 1 -- 172.21.15.17:0/4179426139 shutdown_connections 2023-10-06T04:43:42.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.266+0000 7f062f59e700 1 -- 172.21.15.17:0/4179426139 wait complete. 2023-10-06T04:43:42.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.267+0000 7f062f59e700 1 Processor -- start 2023-10-06T04:43:42.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.267+0000 7f062f59e700 1 -- start start 2023-10-06T04:43:42.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.268+0000 7f062f59e700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f06300af540 0x7f0630157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:42.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.268+0000 7f062f59e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06300cd5e0 0x7f06300b43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:42.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.268+0000 7f062f59e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f063015a650 0x7f06300ca060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:42.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.268+0000 7f062f59e700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063016a8a0 con 0x7f06300cd5e0 2023-10-06T04:43:42.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.268+0000 7f062f59e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06301699f0 con 0x7f063015a650 2023-10-06T04:43:42.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.268+0000 7f062f59e700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06300c78e0 con 0x7f06300af540 2023-10-06T04:43:42.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.268+0000 7f062dd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06300cd5e0 0x7f06300b43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:42.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.268+0000 7f062dd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06300cd5e0 0x7f06300b43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42692/0 (socket says 172.21.15.17:42692) 2023-10-06T04:43:42.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.268+0000 7f062dd9b700 1 -- 172.21.15.17:0/32982984 learned_addr learned my addr 172.21.15.17:0/32982984 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:42.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.268+0000 7f062ed9d700 1 --2- 172.21.15.17:0/32982984 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f063015a650 0x7f06300ca060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:42.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.268+0000 7f062e59c700 1 --2- 172.21.15.17:0/32982984 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f06300af540 0x7f0630157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:42.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.269+0000 7f062dd9b700 1 -- 172.21.15.17:0/32982984 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f06300af540 msgr2=0x7f0630157240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:42.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.269+0000 7f062dd9b700 1 --2- 172.21.15.17:0/32982984 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f06300af540 0x7f0630157240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:42.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.269+0000 7f062dd9b700 1 -- 172.21.15.17:0/32982984 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f063015a650 msgr2=0x7f06300ca060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:42.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.269+0000 7f062dd9b700 1 --2- 172.21.15.17:0/32982984 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f063015a650 0x7f06300ca060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:42.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.269+0000 7f062dd9b700 1 -- 172.21.15.17:0/32982984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0620009a20 con 0x7f06300cd5e0 2023-10-06T04:43:42.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.269+0000 7f062e59c700 1 --2- 172.21.15.17:0/32982984 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f06300af540 0x7f0630157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:43:42.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.269+0000 7f062ed9d700 1 --2- 172.21.15.17:0/32982984 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f063015a650 0x7f06300ca060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:43:42.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.269+0000 7f062dd9b700 1 --2- 172.21.15.17:0/32982984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06300cd5e0 0x7f06300b43a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f061800e930 tx=0x7f06180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:42.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.269+0000 7f06267fc700 1 -- 172.21.15.17:0/32982984 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061800eed0 con 0x7f06300cd5e0 2023-10-06T04:43:42.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.269+0000 7f06267fc700 1 -- 172.21.15.17:0/32982984 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061800c850 con 0x7f06300cd5e0 2023-10-06T04:43:42.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.269+0000 7f062f59e700 1 -- 172.21.15.17:0/32982984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0630169c20 con 0x7f06300cd5e0 2023-10-06T04:43:42.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.269+0000 7f06267fc700 1 -- 172.21.15.17:0/32982984 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061800cbf0 con 0x7f06300cd5e0 2023-10-06T04:43:42.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.269+0000 7f062f59e700 1 -- 172.21.15.17:0/32982984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f063016a1e0 con 0x7f06300cd5e0 2023-10-06T04:43:42.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.270+0000 7f062f59e700 1 -- 172.21.15.17:0/32982984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06300d02a0 con 0x7f06300cd5e0 2023-10-06T04:43:42.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.270+0000 7f06267fc700 1 -- 172.21.15.17:0/32982984 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0618013470 con 0x7f06300cd5e0 2023-10-06T04:43:42.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.271+0000 7f06267fc700 1 --2- 172.21.15.17:0/32982984 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0610066f30 0x7f06100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:42.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.271+0000 7f06267fc700 1 -- 172.21.15.17:0/32982984 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0618084900 con 0x7f06300cd5e0 2023-10-06T04:43:42.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.271+0000 7f062e59c700 1 --2- 172.21.15.17:0/32982984 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0610066f30 0x7f06100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:42.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.271+0000 7f062e59c700 1 --2- 172.21.15.17:0/32982984 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0610066f30 0x7f06100693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f06280058d0 tx=0x7f0628009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:42.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.275+0000 7f06267fc700 1 -- 172.21.15.17:0/32982984 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0618051a10 con 0x7f06300cd5e0 2023-10-06T04:43:42.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.468+0000 7f062f59e700 1 -- 172.21.15.17:0/32982984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f063004c380 con 0x7f06300cd5e0 2023-10-06T04:43:42.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.468+0000 7f06267fc700 1 -- 172.21.15.17:0/32982984 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0618055030 con 0x7f06300cd5e0 2023-10-06T04:43:42.470 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-10-06T04:43:42.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.470+0000 7f062f59e700 1 -- 172.21.15.17:0/32982984 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0610066f30 msgr2=0x7f06100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:42.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.470+0000 7f062f59e700 1 --2- 172.21.15.17:0/32982984 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0610066f30 0x7f06100693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f06280058d0 tx=0x7f0628009040 comp rx=0 tx=0).stop 2023-10-06T04:43:42.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.470+0000 7f062f59e700 1 -- 172.21.15.17:0/32982984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06300cd5e0 msgr2=0x7f06300b43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:42.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.470+0000 7f062f59e700 1 --2- 172.21.15.17:0/32982984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06300cd5e0 0x7f06300b43a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f061800e930 tx=0x7f06180091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:42.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.470+0000 7f062f59e700 1 -- 172.21.15.17:0/32982984 shutdown_connections 2023-10-06T04:43:42.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.470+0000 7f062f59e700 1 --2- 172.21.15.17:0/32982984 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0610066f30 0x7f06100693e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:42.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.470+0000 7f062f59e700 1 --2- 172.21.15.17:0/32982984 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f063015a650 0x7f06300ca060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:42.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.470+0000 7f062f59e700 1 --2- 172.21.15.17:0/32982984 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f06300af540 0x7f0630157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:42.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.470+0000 7f062f59e700 1 --2- 172.21.15.17:0/32982984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06300cd5e0 0x7f06300b43a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:42.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.470+0000 7f062f59e700 1 -- 172.21.15.17:0/32982984 >> 172.21.15.17:0/32982984 conn(0x7f063006d9b0 msgr2=0x7f06301580c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:42.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.470+0000 7f062f59e700 1 -- 172.21.15.17:0/32982984 shutdown_connections 2023-10-06T04:43:42.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.470+0000 7f062f59e700 1 -- 172.21.15.17:0/32982984 wait complete. 2023-10-06T04:43:42.485 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:43:42.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.606+0000 7ff85dc99700 1 Processor -- start 2023-10-06T04:43:42.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.606+0000 7ff85dc99700 1 -- start start 2023-10-06T04:43:42.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.607+0000 7ff85dc99700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff8580af910 0x7ff85815a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:42.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.607+0000 7ff85dc99700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8580ce890 con 0x7ff8580af540 2023-10-06T04:43:42.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.607+0000 7ff85dc99700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff85815d890 con 0x7ff8580cd5e0 2023-10-06T04:43:42.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.607+0000 7ff85dc99700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8580afd50 con 0x7ff8580af910 2023-10-06T04:43:42.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.607+0000 7ff85d498700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff8580af910 0x7ff85815a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:42.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.607+0000 7ff85cc97700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7ff8580af540 0x7ff8580cced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55376/0 (socket says 172.21.15.17:55376) 2023-10-06T04:43:42.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.607+0000 7ff85cc97700 1 -- 172.21.15.17:0/702891450 learned_addr learned my addr 172.21.15.17:0/702891450 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:42.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.607+0000 7ff85d498700 1 -- 172.21.15.17:0/702891450 >> v1:172.21.15.136:6789/0 conn(0x7ff8580cd5e0 legacy=0x7ff8580ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:42.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.607+0000 7ff85d498700 1 -- 172.21.15.17:0/702891450 >> v1:172.21.15.17:6789/0 conn(0x7ff8580af540 legacy=0x7ff8580cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:42.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.607+0000 7ff85d498700 1 -- 172.21.15.17:0/702891450 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff85815db70 con 0x7ff8580af910 2023-10-06T04:43:42.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.607+0000 7ff8577fe700 1 -- 172.21.15.17:0/702891450 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 659593050 0 0) 0x7ff8580ce890 con 0x7ff8580af540 2023-10-06T04:43:42.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.608+0000 7ff85d498700 1 --2- 172.21.15.17:0/702891450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8580af910 0x7ff85815a650 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff8400098e0 tx=0x7ff8400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf05995bb51b8bca server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:42.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.608+0000 7ff8577fe700 1 -- 172.21.15.17:0/702891450 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff840009e80 con 0x7ff8580af910 2023-10-06T04:43:42.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.608+0000 7ff8577fe700 1 -- 172.21.15.17:0/702891450 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff84000b860 con 0x7ff8580af910 2023-10-06T04:43:42.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.608+0000 7ff8577fe700 1 -- 172.21.15.17:0/702891450 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84000bbe0 con 0x7ff8580af910 2023-10-06T04:43:42.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.608+0000 7ff85dc99700 1 -- 172.21.15.17:0/702891450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8580af910 msgr2=0x7ff85815a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:42.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.608+0000 7ff85dc99700 1 --2- 172.21.15.17:0/702891450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8580af910 0x7ff85815a650 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff8400098e0 tx=0x7ff8400091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:42.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.608+0000 7ff85dc99700 1 -- 172.21.15.17:0/702891450 shutdown_connections 2023-10-06T04:43:42.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.608+0000 7ff85dc99700 1 --2- 172.21.15.17:0/702891450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8580af910 0x7ff85815a650 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:42.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.608+0000 7ff85dc99700 1 -- 172.21.15.17:0/702891450 >> 172.21.15.17:0/702891450 conn(0x7ff85806d9b0 msgr2=0x7ff85806ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:42.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.608+0000 7ff85dc99700 1 -- 172.21.15.17:0/702891450 shutdown_connections 2023-10-06T04:43:42.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.608+0000 7ff85dc99700 1 -- 172.21.15.17:0/702891450 wait complete. 2023-10-06T04:43:42.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.609+0000 7ff85dc99700 1 Processor -- start 2023-10-06T04:43:42.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.609+0000 7ff85dc99700 1 -- start start 2023-10-06T04:43:42.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.610+0000 7ff85dc99700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff8580af540 0x7ff8580c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:42.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.610+0000 7ff85dc99700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff8580af910 0x7ff8580c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:42.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.610+0000 7ff85dc99700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8580cd5e0 0x7ff8580b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:42.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.610+0000 7ff85dc99700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8580c98f0 con 0x7ff8580cd5e0 2023-10-06T04:43:42.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.610+0000 7ff85dc99700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8580c7880 con 0x7ff8580af540 2023-10-06T04:43:42.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.610+0000 7ff85dc99700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8580c9ae0 con 0x7ff8580af910 2023-10-06T04:43:42.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.610+0000 7ff85d498700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8580cd5e0 0x7ff8580b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:42.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.610+0000 7ff85d498700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8580cd5e0 0x7ff8580b00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42720/0 (socket says 172.21.15.17:42720) 2023-10-06T04:43:42.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.610+0000 7ff85d498700 1 -- 172.21.15.17:0/2076422516 learned_addr learned my addr 172.21.15.17:0/2076422516 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:42.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.610+0000 7ff85cc97700 1 --2- 172.21.15.17:0/2076422516 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff8580af540 0x7ff8580c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:42.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.611+0000 7ff857fff700 1 --2- 172.21.15.17:0/2076422516 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff8580af910 0x7ff8580c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:42.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.611+0000 7ff85d498700 1 -- 172.21.15.17:0/2076422516 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff8580af910 msgr2=0x7ff8580c93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:42.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.611+0000 7ff85d498700 1 --2- 172.21.15.17:0/2076422516 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff8580af910 0x7ff8580c93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:42.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.611+0000 7ff85d498700 1 -- 172.21.15.17:0/2076422516 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff8580af540 msgr2=0x7ff8580c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:42.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.611+0000 7ff85d498700 1 --2- 172.21.15.17:0/2076422516 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff8580af540 0x7ff8580c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:42.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.611+0000 7ff85d498700 1 -- 172.21.15.17:0/2076422516 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff840009420 con 0x7ff8580cd5e0 2023-10-06T04:43:42.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.611+0000 7ff85cc97700 1 --2- 172.21.15.17:0/2076422516 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff8580af540 0x7ff8580c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:43:42.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.611+0000 7ff85d498700 1 --2- 172.21.15.17:0/2076422516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8580cd5e0 0x7ff8580b00a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff8580c7320 tx=0x7ff840017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:42.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.611+0000 7ff854ff9700 1 -- 172.21.15.17:0/2076422516 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84001f070 con 0x7ff8580cd5e0 2023-10-06T04:43:42.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.611+0000 7ff854ff9700 1 -- 172.21.15.17:0/2076422516 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff840011420 con 0x7ff8580cd5e0 2023-10-06T04:43:42.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.611+0000 7ff85dc99700 1 -- 172.21.15.17:0/2076422516 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8580c9dc0 con 0x7ff8580cd5e0 2023-10-06T04:43:42.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.611+0000 7ff854ff9700 1 -- 172.21.15.17:0/2076422516 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84000bbe0 con 0x7ff8580cd5e0 2023-10-06T04:43:42.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.611+0000 7ff85dc99700 1 -- 172.21.15.17:0/2076422516 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8580ca380 con 0x7ff8580cd5e0 2023-10-06T04:43:42.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.612+0000 7ff85dc99700 1 -- 172.21.15.17:0/2076422516 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff85804c380 con 0x7ff8580cd5e0 2023-10-06T04:43:42.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.612+0000 7ff854ff9700 1 -- 172.21.15.17:0/2076422516 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff8400119d0 con 0x7ff8580cd5e0 2023-10-06T04:43:42.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.613+0000 7ff854ff9700 1 --2- 172.21.15.17:0/2076422516 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff838066f30 0x7ff8380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:42.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.613+0000 7ff854ff9700 1 -- 172.21.15.17:0/2076422516 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff840085f10 con 0x7ff8580cd5e0 2023-10-06T04:43:42.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.613+0000 7ff85cc97700 1 --2- 172.21.15.17:0/2076422516 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff838066f30 0x7ff8380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:42.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.613+0000 7ff85cc97700 1 --2- 172.21.15.17:0/2076422516 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff838066f30 0x7ff8380693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff850000c00 tx=0x7ff850009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:42.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.617+0000 7ff854ff9700 1 -- 172.21.15.17:0/2076422516 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff840053020 con 0x7ff8580cd5e0 2023-10-06T04:43:42.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.812+0000 7ff85dc99700 1 -- 172.21.15.17:0/2076422516 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff85815de50 con 0x7ff8580cd5e0 2023-10-06T04:43:42.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.812+0000 7ff854ff9700 1 -- 172.21.15.17:0/2076422516 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff840056640 con 0x7ff8580cd5e0 2023-10-06T04:43:42.815 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-10-06T04:43:42.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.814+0000 7ff85dc99700 1 -- 172.21.15.17:0/2076422516 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff838066f30 msgr2=0x7ff8380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:42.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.814+0000 7ff85dc99700 1 --2- 172.21.15.17:0/2076422516 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff838066f30 0x7ff8380693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff850000c00 tx=0x7ff850009040 comp rx=0 tx=0).stop 2023-10-06T04:43:42.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.814+0000 7ff85dc99700 1 -- 172.21.15.17:0/2076422516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8580cd5e0 msgr2=0x7ff8580b00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:42.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.814+0000 7ff85dc99700 1 --2- 172.21.15.17:0/2076422516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8580cd5e0 0x7ff8580b00a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff8580c7320 tx=0x7ff840017000 comp rx=0 tx=0).stop 2023-10-06T04:43:42.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.814+0000 7ff85dc99700 1 -- 172.21.15.17:0/2076422516 shutdown_connections 2023-10-06T04:43:42.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.814+0000 7ff85dc99700 1 --2- 172.21.15.17:0/2076422516 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff838066f30 0x7ff8380693e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:42.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.814+0000 7ff85dc99700 1 --2- 172.21.15.17:0/2076422516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8580cd5e0 0x7ff8580b00a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:42.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.814+0000 7ff85dc99700 1 --2- 172.21.15.17:0/2076422516 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff8580af540 0x7ff8580c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:42.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.814+0000 7ff85dc99700 1 --2- 172.21.15.17:0/2076422516 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff8580af910 0x7ff8580c93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:42.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.814+0000 7ff85dc99700 1 -- 172.21.15.17:0/2076422516 >> 172.21.15.17:0/2076422516 conn(0x7ff85806d9b0 msgr2=0x7ff85806c560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:42.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.814+0000 7ff85dc99700 1 -- 172.21.15.17:0/2076422516 shutdown_connections 2023-10-06T04:43:42.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.814+0000 7ff85dc99700 1 -- 172.21.15.17:0/2076422516 wait complete. 2023-10-06T04:43:42.829 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:43:42.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.948+0000 7f3b0058f700 1 Processor -- start 2023-10-06T04:43:42.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.949+0000 7f3b0058f700 1 -- start start 2023-10-06T04:43:42.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.949+0000 7f3b0058f700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3af81567d0 0x7f3af80aefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:42.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.949+0000 7f3b0058f700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3af80b1660 0x7f3af806c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:42.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.949+0000 7f3b0058f700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3af80af920 con 0x7f3af815a450 2023-10-06T04:43:42.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.949+0000 7f3b0058f700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3af806dab0 con 0x7f3af81567d0 2023-10-06T04:43:42.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.949+0000 7f3b0058f700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af80b01c0 con 0x7f3af80b1660 2023-10-06T04:43:42.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.950+0000 7f3afdb2a700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3af81567d0 0x7f3af80aefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:42.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.950+0000 7f3afeb2c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3af80b1660 0x7f3af806c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:42.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.950+0000 7f3afe32b700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f3af815a450 0x7f3af81560c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.17:51520/0 (socket says 172.21.15.17:51520) 2023-10-06T04:43:42.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.950+0000 7f3afe32b700 1 -- 172.21.15.17:0/100283563 learned_addr learned my addr 172.21.15.17:0/100283563 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:42.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.950+0000 7f3afd329700 1 -- 172.21.15.17:0/100283563 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3563748670 0 0) 0x7f3af80af920 con 0x7f3af815a450 2023-10-06T04:43:42.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.950+0000 7f3afd329700 1 -- 172.21.15.17:0/100283563 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ae4003570 con 0x7f3af815a450 2023-10-06T04:43:42.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.950+0000 7f3afdb2a700 1 -- 172.21.15.17:0/100283563 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3af80b1660 msgr2=0x7f3af806c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:42.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.950+0000 7f3afdb2a700 1 --2- 172.21.15.17:0/100283563 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3af80b1660 0x7f3af806c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:42.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.950+0000 7f3afdb2a700 1 -- 172.21.15.17:0/100283563 >> v1:172.21.15.136:6789/0 conn(0x7f3af815a450 legacy=0x7f3af81560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:42.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.950+0000 7f3afdb2a700 1 -- 172.21.15.17:0/100283563 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af806dce0 con 0x7f3af81567d0 2023-10-06T04:43:42.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.950+0000 7f3afeb2c700 1 --2- 172.21.15.17:0/100283563 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3af80b1660 0x7f3af806c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:43:42.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.950+0000 7f3afdb2a700 1 --2- 172.21.15.17:0/100283563 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3af81567d0 0x7f3af80aefb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3ae80098e0 tx=0x7f3ae80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b1552641d55571d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:42.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.951+0000 7f3afd329700 1 -- 172.21.15.17:0/100283563 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae8011630 con 0x7f3af81567d0 2023-10-06T04:43:42.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.951+0000 7f3afd329700 1 -- 172.21.15.17:0/100283563 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae8011790 con 0x7f3af81567d0 2023-10-06T04:43:42.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.951+0000 7f3afd329700 1 -- 172.21.15.17:0/100283563 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae8011b30 con 0x7f3af81567d0 2023-10-06T04:43:42.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.951+0000 7f3b0058f700 1 -- 172.21.15.17:0/100283563 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3af81567d0 msgr2=0x7f3af80aefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:42.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.951+0000 7f3b0058f700 1 --2- 172.21.15.17:0/100283563 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3af81567d0 0x7f3af80aefb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3ae80098e0 tx=0x7f3ae80091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:42.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.951+0000 7f3b0058f700 1 -- 172.21.15.17:0/100283563 shutdown_connections 2023-10-06T04:43:42.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.951+0000 7f3b0058f700 1 --2- 172.21.15.17:0/100283563 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3af80b1660 0x7f3af806c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:42.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.951+0000 7f3b0058f700 1 --2- 172.21.15.17:0/100283563 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3af81567d0 0x7f3af80aefb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:42.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.951+0000 7f3b0058f700 1 -- 172.21.15.17:0/100283563 >> 172.21.15.17:0/100283563 conn(0x7f3af806f7b0 msgr2=0x7f3af80ae590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:42.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.951+0000 7f3b0058f700 1 -- 172.21.15.17:0/100283563 shutdown_connections 2023-10-06T04:43:42.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.951+0000 7f3b0058f700 1 -- 172.21.15.17:0/100283563 wait complete. 2023-10-06T04:43:42.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.952+0000 7f3b0058f700 1 Processor -- start 2023-10-06T04:43:42.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.952+0000 7f3b0058f700 1 -- start start 2023-10-06T04:43:42.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.953+0000 7f3b0058f700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3af80b1660 0x7f3af80c18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:42.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.953+0000 7f3b0058f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3af81567d0 0x7f3af8150ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:42.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.953+0000 7f3b0058f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3af815a450 0x7f3af8154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:42.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.953+0000 7f3b0058f700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af816b7b0 con 0x7f3af815a450 2023-10-06T04:43:42.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.953+0000 7f3b0058f700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af816abe0 con 0x7f3af81567d0 2023-10-06T04:43:42.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.953+0000 7f3b0058f700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af816ae80 con 0x7f3af80b1660 2023-10-06T04:43:42.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.953+0000 7f3afeb2c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3af815a450 0x7f3af8154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:42.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.953+0000 7f3afe32b700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3af80b1660 0x7f3af80c18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:42.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.953+0000 7f3afeb2c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3af815a450 0x7f3af8154ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42722/0 (socket says 172.21.15.17:42722) 2023-10-06T04:43:42.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.953+0000 7f3afeb2c700 1 -- 172.21.15.17:0/1914235020 learned_addr learned my addr 172.21.15.17:0/1914235020 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:42.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.953+0000 7f3afdb2a700 1 --2- 172.21.15.17:0/1914235020 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3af81567d0 0x7f3af8150ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:42.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.954+0000 7f3afe32b700 1 -- 172.21.15.17:0/1914235020 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3af81567d0 msgr2=0x7f3af8150ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:42.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.954+0000 7f3afe32b700 1 --2- 172.21.15.17:0/1914235020 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3af81567d0 0x7f3af8150ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:42.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.954+0000 7f3afe32b700 1 -- 172.21.15.17:0/1914235020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3af815a450 msgr2=0x7f3af8154ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:42.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.954+0000 7f3afe32b700 1 --2- 172.21.15.17:0/1914235020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3af815a450 0x7f3af8154ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:42.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.954+0000 7f3afe32b700 1 -- 172.21.15.17:0/1914235020 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af4009420 con 0x7f3af80b1660 2023-10-06T04:43:42.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.954+0000 7f3afeb2c700 1 --2- 172.21.15.17:0/1914235020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3af815a450 0x7f3af8154ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:43:42.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.954+0000 7f3afe32b700 1 --2- 172.21.15.17:0/1914235020 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3af80b1660 0x7f3af80c18a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3af000cb90 tx=0x7f3af00019c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:42.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.954+0000 7f3aee7fc700 1 -- 172.21.15.17:0/1914235020 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af000a7e0 con 0x7f3af80b1660 2023-10-06T04:43:42.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.954+0000 7f3aee7fc700 1 -- 172.21.15.17:0/1914235020 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af000a960 con 0x7f3af80b1660 2023-10-06T04:43:42.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.954+0000 7f3aee7fc700 1 -- 172.21.15.17:0/1914235020 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af000ad20 con 0x7f3af80b1660 2023-10-06T04:43:42.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.954+0000 7f3b0058f700 1 -- 172.21.15.17:0/1914235020 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ae8009420 con 0x7f3af80b1660 2023-10-06T04:43:42.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.954+0000 7f3b0058f700 1 -- 172.21.15.17:0/1914235020 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3af816b440 con 0x7f3af80b1660 2023-10-06T04:43:42.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.955+0000 7f3b0058f700 1 -- 172.21.15.17:0/1914235020 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3af804c380 con 0x7f3af80b1660 2023-10-06T04:43:42.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.955+0000 7f3aee7fc700 1 -- 172.21.15.17:0/1914235020 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3af0007300 con 0x7f3af80b1660 2023-10-06T04:43:42.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.956+0000 7f3aee7fc700 1 --2- 172.21.15.17:0/1914235020 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3adc066f30 0x7f3adc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:42.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.956+0000 7f3aee7fc700 1 -- 172.21.15.17:0/1914235020 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3af0084990 con 0x7f3af80b1660 2023-10-06T04:43:42.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.956+0000 7f3afdb2a700 1 --2- 172.21.15.17:0/1914235020 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3adc066f30 0x7f3adc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:42.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.956+0000 7f3afdb2a700 1 --2- 172.21.15.17:0/1914235020 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3adc066f30 0x7f3adc0693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3ae80091e0 tx=0x7f3ae8017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:42.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:42.961+0000 7f3aee7fc700 1 -- 172.21.15.17:0/1914235020 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3af0051aa0 con 0x7f3af80b1660 2023-10-06T04:43:43.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.154+0000 7f3b0058f700 1 -- 172.21.15.17:0/1914235020 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3af80afb70 con 0x7f3af80b1660 2023-10-06T04:43:43.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.155+0000 7f3aee7fc700 1 -- 172.21.15.17:0/1914235020 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3af0084030 con 0x7f3af80b1660 2023-10-06T04:43:43.156 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-10-06T04:43:43.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.156+0000 7f3b0058f700 1 -- 172.21.15.17:0/1914235020 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3adc066f30 msgr2=0x7f3adc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:43.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.156+0000 7f3b0058f700 1 --2- 172.21.15.17:0/1914235020 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3adc066f30 0x7f3adc0693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3ae80091e0 tx=0x7f3ae8017000 comp rx=0 tx=0).stop 2023-10-06T04:43:43.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.157+0000 7f3b0058f700 1 -- 172.21.15.17:0/1914235020 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3af80b1660 msgr2=0x7f3af80c18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:43.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.157+0000 7f3b0058f700 1 --2- 172.21.15.17:0/1914235020 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3af80b1660 0x7f3af80c18a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3af000cb90 tx=0x7f3af00019c0 comp rx=0 tx=0).stop 2023-10-06T04:43:43.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.157+0000 7f3b0058f700 1 -- 172.21.15.17:0/1914235020 shutdown_connections 2023-10-06T04:43:43.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.157+0000 7f3b0058f700 1 --2- 172.21.15.17:0/1914235020 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3adc066f30 0x7f3adc0693e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:43.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.157+0000 7f3b0058f700 1 --2- 172.21.15.17:0/1914235020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3af815a450 0x7f3af8154ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:43.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.157+0000 7f3b0058f700 1 --2- 172.21.15.17:0/1914235020 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3af80b1660 0x7f3af80c18a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:43.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.157+0000 7f3b0058f700 1 --2- 172.21.15.17:0/1914235020 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3af81567d0 0x7f3af8150ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:43.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.157+0000 7f3b0058f700 1 -- 172.21.15.17:0/1914235020 >> 172.21.15.17:0/1914235020 conn(0x7f3af806f7b0 msgr2=0x7f3af80cb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:43.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.157+0000 7f3b0058f700 1 -- 172.21.15.17:0/1914235020 shutdown_connections 2023-10-06T04:43:43.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.157+0000 7f3b0058f700 1 -- 172.21.15.17:0/1914235020 wait complete. 2023-10-06T04:43:43.171 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:43:43.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.288+0000 7f232359e700 1 Processor -- start 2023-10-06T04:43:43.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.288+0000 7f232359e700 1 -- start start 2023-10-06T04:43:43.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.289+0000 7f232359e700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2324159bb0 0x7f23240b0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:43.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.289+0000 7f232359e700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23240cbd80 con 0x7f23240ccfc0 2023-10-06T04:43:43.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.289+0000 7f232359e700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23240af5f0 con 0x7f23240cf3b0 2023-10-06T04:43:43.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.289+0000 7f232359e700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23240af8d0 con 0x7f2324159bb0 2023-10-06T04:43:43.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.289+0000 7f232259c700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f23240ccfc0 0x7f23240cc210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55378/0 (socket says 172.21.15.17:55378) 2023-10-06T04:43:43.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.289+0000 7f232259c700 1 -- 172.21.15.17:0/1752352679 learned_addr learned my addr 172.21.15.17:0/1752352679 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:43.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.289+0000 7f232159a700 1 -- 172.21.15.17:0/1752352679 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2464163349 0 0) 0x7f23240cbd80 con 0x7f23240ccfc0 2023-10-06T04:43:43.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.289+0000 7f232159a700 1 -- 172.21.15.17:0/1752352679 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2310003570 con 0x7f23240ccfc0 2023-10-06T04:43:43.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.289+0000 7f2322d9d700 1 --2- 172.21.15.17:0/1752352679 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2324159bb0 0x7f23240b0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:43.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.289+0000 7f232159a700 1 -- 172.21.15.17:0/1752352679 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4019752964 0 0) 0x7f2310003570 con 0x7f23240ccfc0 2023-10-06T04:43:43.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.289+0000 7f232159a700 1 -- 172.21.15.17:0/1752352679 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2324159bb0 msgr2=0x7f23240b0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:43.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.289+0000 7f232159a700 1 --2- 172.21.15.17:0/1752352679 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2324159bb0 0x7f23240b0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:43.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.289+0000 7f232159a700 1 -- 172.21.15.17:0/1752352679 >> v1:172.21.15.136:6789/0 conn(0x7f23240cf3b0 legacy=0x7f23241594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:43.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.289+0000 7f232159a700 1 -- 172.21.15.17:0/1752352679 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23240afbb0 con 0x7f23240ccfc0 2023-10-06T04:43:43.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.289+0000 7f232159a700 1 -- 172.21.15.17:0/1752352679 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4268781140 0 0) 0x7f231c0017f0 con 0x7f23240ccfc0 2023-10-06T04:43:43.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.289+0000 7f232159a700 1 -- 172.21.15.17:0/1752352679 >> v1:172.21.15.17:6789/0 conn(0x7f23240ccfc0 legacy=0x7f23240cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:43.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.289+0000 7f232159a700 1 --2- 172.21.15.17:0/1752352679 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2324159bb0 0x7f2310003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:43.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.289+0000 7f232159a700 1 --2- 172.21.15.17:0/1752352679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2310004010 0x7f2310004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:43.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.290+0000 7f232159a700 1 --2- 172.21.15.17:0/1752352679 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2310004d50 0x7f23100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:43.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.290+0000 7f232159a700 1 -- 172.21.15.17:0/1752352679 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23240af8d0 con 0x7f2310004010 2023-10-06T04:43:43.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.290+0000 7f232159a700 1 -- 172.21.15.17:0/1752352679 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231000bbf0 con 0x7f2310004d50 2023-10-06T04:43:43.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.290+0000 7f232159a700 1 -- 172.21.15.17:0/1752352679 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f231000bdb0 con 0x7f2324159bb0 2023-10-06T04:43:43.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.290+0000 7f2321d9b700 1 --2- 172.21.15.17:0/1752352679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2310004010 0x7f2310004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:43.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.290+0000 7f232259c700 1 --2- 172.21.15.17:0/1752352679 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2324159bb0 0x7f2310003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:43.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.290+0000 7f2322d9d700 1 --2- 172.21.15.17:0/1752352679 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2310004d50 0x7f23100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:43.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.290+0000 7f2321d9b700 1 -- 172.21.15.17:0/1752352679 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2324159bb0 msgr2=0x7f2310003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:43.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.290+0000 7f2321d9b700 1 --2- 172.21.15.17:0/1752352679 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2324159bb0 0x7f2310003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:43.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.290+0000 7f2321d9b700 1 -- 172.21.15.17:0/1752352679 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2310004d50 msgr2=0x7f23100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:43.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.290+0000 7f2321d9b700 1 --2- 172.21.15.17:0/1752352679 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2310004d50 0x7f23100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:43.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.290+0000 7f2321d9b700 1 -- 172.21.15.17:0/1752352679 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2310003570 con 0x7f2310004010 2023-10-06T04:43:43.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.290+0000 7f2321d9b700 1 --2- 172.21.15.17:0/1752352679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2310004010 0x7f2310004810 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f232406bdf0 tx=0x7f230c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c999c86d7807576f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:43.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.290+0000 7f232159a700 1 -- 172.21.15.17:0/1752352679 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c012420 con 0x7f2310004010 2023-10-06T04:43:43.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.290+0000 7f232159a700 1 -- 172.21.15.17:0/1752352679 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230c012580 con 0x7f2310004010 2023-10-06T04:43:43.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.290+0000 7f232159a700 1 -- 172.21.15.17:0/1752352679 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c012920 con 0x7f2310004010 2023-10-06T04:43:43.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.291+0000 7f232359e700 1 -- 172.21.15.17:0/1752352679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2310004010 msgr2=0x7f2310004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:43.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.291+0000 7f232359e700 1 --2- 172.21.15.17:0/1752352679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2310004010 0x7f2310004810 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f232406bdf0 tx=0x7f230c007d30 comp rx=0 tx=0).stop 2023-10-06T04:43:43.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.291+0000 7f2322d9d700 1 -- 172.21.15.17:0/1752352679 reap_dead start 2023-10-06T04:43:43.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.291+0000 7f232359e700 1 -- 172.21.15.17:0/1752352679 shutdown_connections 2023-10-06T04:43:43.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.291+0000 7f232359e700 1 -- 172.21.15.17:0/1752352679 >> 172.21.15.17:0/1752352679 conn(0x7f232406cff0 msgr2=0x7f232406da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:43.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.291+0000 7f232359e700 1 -- 172.21.15.17:0/1752352679 shutdown_connections 2023-10-06T04:43:43.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.291+0000 7f232359e700 1 -- 172.21.15.17:0/1752352679 wait complete. 2023-10-06T04:43:43.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.292+0000 7f232359e700 1 Processor -- start 2023-10-06T04:43:43.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.292+0000 7f232359e700 1 -- start start 2023-10-06T04:43:43.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.293+0000 7f232359e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2310004010 0x7f232414e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:43.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.293+0000 7f232359e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23240c8cb0 0x7f2324150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:43.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.293+0000 7f232359e700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f23241511a0 0x7f23240c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:43.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.293+0000 7f232359e700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2324151620 con 0x7f23240c8cb0 2023-10-06T04:43:43.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.293+0000 7f232359e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2324151900 con 0x7f2310004010 2023-10-06T04:43:43.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.293+0000 7f232359e700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2324151be0 con 0x7f23241511a0 2023-10-06T04:43:43.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.293+0000 7f2321d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23240c8cb0 0x7f2324150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:43.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.293+0000 7f2321d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23240c8cb0 0x7f2324150c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42736/0 (socket says 172.21.15.17:42736) 2023-10-06T04:43:43.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.293+0000 7f2321d9b700 1 -- 172.21.15.17:0/78705550 learned_addr learned my addr 172.21.15.17:0/78705550 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:43.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.293+0000 7f2322d9d700 1 --2- 172.21.15.17:0/78705550 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f23241511a0 0x7f23240c95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:43.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.293+0000 7f232259c700 1 --2- 172.21.15.17:0/78705550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2310004010 0x7f232414e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:43.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.293+0000 7f2321d9b700 1 -- 172.21.15.17:0/78705550 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f23241511a0 msgr2=0x7f23240c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:43.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.293+0000 7f2321d9b700 1 --2- 172.21.15.17:0/78705550 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f23241511a0 0x7f23240c95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:43.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.293+0000 7f2321d9b700 1 -- 172.21.15.17:0/78705550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2310004010 msgr2=0x7f232414e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:43.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.293+0000 7f2321d9b700 1 --2- 172.21.15.17:0/78705550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2310004010 0x7f232414e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:43.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.293+0000 7f2321d9b700 1 -- 172.21.15.17:0/78705550 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2324151ec0 con 0x7f23240c8cb0 2023-10-06T04:43:43.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.293+0000 7f2321d9b700 1 --2- 172.21.15.17:0/78705550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23240c8cb0 0x7f2324150c60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f23240b0250 tx=0x7f230c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:43.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.293+0000 7f231a7fc700 1 -- 172.21.15.17:0/78705550 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c006a30 con 0x7f23240c8cb0 2023-10-06T04:43:43.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.293+0000 7f231a7fc700 1 -- 172.21.15.17:0/78705550 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230c006bb0 con 0x7f23240c8cb0 2023-10-06T04:43:43.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.293+0000 7f232359e700 1 -- 172.21.15.17:0/78705550 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23241521a0 con 0x7f23240c8cb0 2023-10-06T04:43:43.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.293+0000 7f231a7fc700 1 -- 172.21.15.17:0/78705550 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c007030 con 0x7f23240c8cb0 2023-10-06T04:43:43.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.293+0000 7f232359e700 1 -- 172.21.15.17:0/78705550 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23240c9ae0 con 0x7f23240c8cb0 2023-10-06T04:43:43.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.294+0000 7f232359e700 1 -- 172.21.15.17:0/78705550 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2324152510 con 0x7f23240c8cb0 2023-10-06T04:43:43.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.295+0000 7f231a7fc700 1 -- 172.21.15.17:0/78705550 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f230c019070 con 0x7f23240c8cb0 2023-10-06T04:43:43.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.295+0000 7f231a7fc700 1 --2- 172.21.15.17:0/78705550 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2304066f30 0x7f23040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:43.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.295+0000 7f232259c700 1 --2- 172.21.15.17:0/78705550 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2304066f30 0x7f23040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:43.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.295+0000 7f231a7fc700 1 -- 172.21.15.17:0/78705550 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f230c085460 con 0x7f23240c8cb0 2023-10-06T04:43:43.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.296+0000 7f232259c700 1 --2- 172.21.15.17:0/78705550 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2304066f30 0x7f23040693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f231c004ea0 tx=0x7f231c006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:43.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.300+0000 7f231a7fc700 1 -- 172.21.15.17:0/78705550 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f230c052570 con 0x7f23240c8cb0 2023-10-06T04:43:43.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.541+0000 7f232359e700 1 -- 172.21.15.17:0/78705550 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2324151620 con 0x7f23240c8cb0 2023-10-06T04:43:43.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.541+0000 7f231a7fc700 1 -- 172.21.15.17:0/78705550 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f230c055b90 con 0x7f23240c8cb0 2023-10-06T04:43:43.543 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:43:43.543 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/3001699743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3001699743},{"type":"v1","addr":"172.21.15.136:6833","nonce":3001699743}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/1891609455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1891609455},{"type":"v1","addr":"172.21.15.17:6835","nonce":1891609455}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/2697752124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":2697752124},{"type":"v1","addr":"172.21.15.17:6837","nonce":2697752124}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:43:29.199801+0000","modified":"2023-10-06T04:43:32.817081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6835/1496795591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":1496795591},{"type":"v1","addr":"172.21.15.136:6835","nonce":1496795591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:43:43.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.543+0000 7f232359e700 1 -- 172.21.15.17:0/78705550 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2304066f30 msgr2=0x7f23040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:43.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.543+0000 7f232359e700 1 --2- 172.21.15.17:0/78705550 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2304066f30 0x7f23040693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f231c004ea0 tx=0x7f231c006040 comp rx=0 tx=0).stop 2023-10-06T04:43:43.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.543+0000 7f232359e700 1 -- 172.21.15.17:0/78705550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23240c8cb0 msgr2=0x7f2324150c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:43.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.543+0000 7f232359e700 1 --2- 172.21.15.17:0/78705550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23240c8cb0 0x7f2324150c60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f23240b0250 tx=0x7f230c015000 comp rx=0 tx=0).stop 2023-10-06T04:43:43.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.543+0000 7f232359e700 1 -- 172.21.15.17:0/78705550 shutdown_connections 2023-10-06T04:43:43.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.543+0000 7f232359e700 1 --2- 172.21.15.17:0/78705550 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2304066f30 0x7f23040693e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:43.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.543+0000 7f232359e700 1 --2- 172.21.15.17:0/78705550 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f23241511a0 0x7f23240c95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:43.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.543+0000 7f232359e700 1 --2- 172.21.15.17:0/78705550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2310004010 0x7f232414e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:43.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.543+0000 7f232359e700 1 --2- 172.21.15.17:0/78705550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23240c8cb0 0x7f2324150c60 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:43.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.543+0000 7f232359e700 1 -- 172.21.15.17:0/78705550 >> 172.21.15.17:0/78705550 conn(0x7f232406cff0 msgr2=0x7f232414ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:43.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.544+0000 7f232359e700 1 -- 172.21.15.17:0/78705550 shutdown_connections 2023-10-06T04:43:43.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.544+0000 7f232359e700 1 -- 172.21.15.17:0/78705550 wait complete. 2023-10-06T04:43:43.547 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 7 2023-10-06T04:43:43.557 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:43:43.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.674+0000 7fb39f59e700 1 Processor -- start 2023-10-06T04:43:43.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.674+0000 7fb39f59e700 1 -- start start 2023-10-06T04:43:43.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.675+0000 7fb39f59e700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb3a00b04e0 0x7fb3a00ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:43.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.675+0000 7fb39f59e700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb3a01575c0 0x7fb3a00cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:43.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.675+0000 7fb39f59e700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3a00b1ae0 con 0x7fb3a01571f0 2023-10-06T04:43:43.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.675+0000 7fb39f59e700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3a00ad8c0 con 0x7fb3a00b04e0 2023-10-06T04:43:43.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.675+0000 7fb39f59e700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a00b17b0 con 0x7fb3a01575c0 2023-10-06T04:43:43.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.675+0000 7fb39dd9b700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb3a00b04e0 0x7fb3a00ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:43.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.675+0000 7fb39dd9b700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb3a00b04e0 0x7fb3a00ccda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42740/0 (socket says 172.21.15.17:42740) 2023-10-06T04:43:43.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.675+0000 7fb39dd9b700 1 -- 172.21.15.17:0/2971202689 learned_addr learned my addr 172.21.15.17:0/2971202689 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:43.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.675+0000 7fb39ed9d700 1 --2- 172.21.15.17:0/2971202689 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb3a01575c0 0x7fb3a00cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:43.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.675+0000 7fb39dd9b700 1 -- 172.21.15.17:0/2971202689 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb3a01575c0 msgr2=0x7fb3a00cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:43.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.675+0000 7fb39dd9b700 1 --2- 172.21.15.17:0/2971202689 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb3a01575c0 0x7fb3a00cd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:43.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.676+0000 7fb39dd9b700 1 -- 172.21.15.17:0/2971202689 >> v1:172.21.15.136:6789/0 conn(0x7fb3a01571f0 legacy=0x7fb3a00afdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:43.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.676+0000 7fb39dd9b700 1 -- 172.21.15.17:0/2971202689 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a00cd9f0 con 0x7fb3a00b04e0 2023-10-06T04:43:43.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.676+0000 7fb39dd9b700 1 --2- 172.21.15.17:0/2971202689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3a00b04e0 0x7fb3a00ccda0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb3880099b0 tx=0x7fb388009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53fc47efdfbdf81f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:43.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.676+0000 7fb39d59a700 1 -- 172.21.15.17:0/2971202689 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38800b860 con 0x7fb3a00b04e0 2023-10-06T04:43:43.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.676+0000 7fb39d59a700 1 -- 172.21.15.17:0/2971202689 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38800b9c0 con 0x7fb3a00b04e0 2023-10-06T04:43:43.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.676+0000 7fb39d59a700 1 -- 172.21.15.17:0/2971202689 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38800bd60 con 0x7fb3a00b04e0 2023-10-06T04:43:43.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.676+0000 7fb39f59e700 1 -- 172.21.15.17:0/2971202689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3a00b04e0 msgr2=0x7fb3a00ccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:43.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.676+0000 7fb39f59e700 1 --2- 172.21.15.17:0/2971202689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3a00b04e0 0x7fb3a00ccda0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb3880099b0 tx=0x7fb388009250 comp rx=0 tx=0).stop 2023-10-06T04:43:43.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.676+0000 7fb39f59e700 1 -- 172.21.15.17:0/2971202689 shutdown_connections 2023-10-06T04:43:43.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.676+0000 7fb39f59e700 1 --2- 172.21.15.17:0/2971202689 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb3a01575c0 0x7fb3a00cd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:43.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.676+0000 7fb39f59e700 1 --2- 172.21.15.17:0/2971202689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3a00b04e0 0x7fb3a00ccda0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:43.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.676+0000 7fb39f59e700 1 -- 172.21.15.17:0/2971202689 >> 172.21.15.17:0/2971202689 conn(0x7fb3a006c560 msgr2=0x7fb3a006c960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:43.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.677+0000 7fb39f59e700 1 -- 172.21.15.17:0/2971202689 shutdown_connections 2023-10-06T04:43:43.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.677+0000 7fb39f59e700 1 -- 172.21.15.17:0/2971202689 wait complete. 2023-10-06T04:43:43.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.678+0000 7fb39f59e700 1 Processor -- start 2023-10-06T04:43:43.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.678+0000 7fb39f59e700 1 -- start start 2023-10-06T04:43:43.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.678+0000 7fb39f59e700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb3a00b04e0 0x7fb3a006e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:43.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.678+0000 7fb39f59e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3a01571f0 0x7fb3a01510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:43.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.678+0000 7fb39f59e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3a01575c0 0x7fb3a01515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:43.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.678+0000 7fb39f59e700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a006dcf0 con 0x7fb3a01571f0 2023-10-06T04:43:43.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.678+0000 7fb39f59e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a006e650 con 0x7fb3a01575c0 2023-10-06T04:43:43.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.678+0000 7fb39f59e700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a006d670 con 0x7fb3a00b04e0 2023-10-06T04:43:43.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.678+0000 7fb39dd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3a01571f0 0x7fb3a01510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:43.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.679+0000 7fb39dd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3a01571f0 0x7fb3a01510b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42748/0 (socket says 172.21.15.17:42748) 2023-10-06T04:43:43.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.679+0000 7fb39dd9b700 1 -- 172.21.15.17:0/3901839420 learned_addr learned my addr 172.21.15.17:0/3901839420 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:43.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.679+0000 7fb39e59c700 1 --2- 172.21.15.17:0/3901839420 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb3a00b04e0 0x7fb3a006e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:43.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.679+0000 7fb39dd9b700 1 -- 172.21.15.17:0/3901839420 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb3a00b04e0 msgr2=0x7fb3a006e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:43.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.679+0000 7fb39dd9b700 1 --2- 172.21.15.17:0/3901839420 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb3a00b04e0 0x7fb3a006e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:43.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.679+0000 7fb39dd9b700 1 -- 172.21.15.17:0/3901839420 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3a01575c0 msgr2=0x7fb3a01515f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:43.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.679+0000 7fb39ed9d700 1 --2- 172.21.15.17:0/3901839420 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3a01575c0 0x7fb3a01515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:43.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.679+0000 7fb39dd9b700 1 --2- 172.21.15.17:0/3901839420 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3a01575c0 0x7fb3a01515f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:43.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.679+0000 7fb39dd9b700 1 -- 172.21.15.17:0/3901839420 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3880094f0 con 0x7fb3a01571f0 2023-10-06T04:43:43.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.679+0000 7fb39dd9b700 1 --2- 172.21.15.17:0/3901839420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3a01571f0 0x7fb3a01510b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb388006fd0 tx=0x7fb388017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:43.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.679+0000 7fb3967fc700 1 -- 172.21.15.17:0/3901839420 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb388024440 con 0x7fb3a01571f0 2023-10-06T04:43:43.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.679+0000 7fb3967fc700 1 -- 172.21.15.17:0/3901839420 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3880245c0 con 0x7fb3a01571f0 2023-10-06T04:43:43.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.679+0000 7fb39f59e700 1 -- 172.21.15.17:0/3901839420 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3a00c7900 con 0x7fb3a01571f0 2023-10-06T04:43:43.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.679+0000 7fb3967fc700 1 -- 172.21.15.17:0/3901839420 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb388024980 con 0x7fb3a01571f0 2023-10-06T04:43:43.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.679+0000 7fb39f59e700 1 -- 172.21.15.17:0/3901839420 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3a006d910 con 0x7fb3a01571f0 2023-10-06T04:43:43.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.680+0000 7fb39f59e700 1 -- 172.21.15.17:0/3901839420 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3a006de30 con 0x7fb3a01571f0 2023-10-06T04:43:43.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.681+0000 7fb3967fc700 1 -- 172.21.15.17:0/3901839420 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb38801a420 con 0x7fb3a01571f0 2023-10-06T04:43:43.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.681+0000 7fb3967fc700 1 --2- 172.21.15.17:0/3901839420 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fb380066f30 0x7fb3800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:43.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.681+0000 7fb3967fc700 1 -- 172.21.15.17:0/3901839420 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb388086510 con 0x7fb3a01571f0 2023-10-06T04:43:43.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.681+0000 7fb39e59c700 1 --2- 172.21.15.17:0/3901839420 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fb380066f30 0x7fb3800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:43.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.682+0000 7fb39e59c700 1 --2- 172.21.15.17:0/3901839420 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fb380066f30 0x7fb3800693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb398001760 tx=0x7fb398009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:43.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.686+0000 7fb3967fc700 1 -- 172.21.15.17:0/3901839420 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb3a006de30 con 0x7fb3a01571f0 2023-10-06T04:43:43.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.881+0000 7fb39f59e700 1 -- 172.21.15.17:0/3901839420 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3a006de30 con 0x7fb3a01571f0 2023-10-06T04:43:43.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.881+0000 7fb3967fc700 1 -- 172.21.15.17:0/3901839420 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16866 (secure 0 0 0) 0x7fb3a006de30 con 0x7fb3a01571f0 2023-10-06T04:43:43.884 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:43:43.884 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":21,"fsid":"780777c4-2b25-4d35-9058-c9f2d62e3ad9","created":"2023-10-06T04:43:10.578520+0000","modified":"2023-10-06T04:43:30.789916+0000","last_up_change":"2023-10-06T04:43:20.682958+0000","last_in_change":"2023-10-06T04:43:12.978917+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:43:21.795733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:43:22.389592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:43:26.914728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:43:28.173678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"84737b08-575c-46dd-9488-073ae8504494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6809","nonce":90656},{"type":"v1","addr":"172.21.15.17:6811","nonce":90656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":90656},{"type":"v1","addr":"172.21.15.17:6814","nonce":90656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":90656},{"type":"v1","addr":"172.21.15.17:6822","nonce":90656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":90656},{"type":"v1","addr":"172.21.15.17:6818","nonce":90656}]},"public_addr":"172.21.15.17:6811/90656","cluster_addr":"172.21.15.17:6814/90656","heartbeat_back_addr":"172.21.15.17:6822/90656","heartbeat_front_addr":"172.21.15.17:6818/90656","state":["exists","up"]},{"osd":1,"uuid":"dffeb740-58a2-4fd6-8ff1-a0a11a2cc709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":90655},{"type":"v1","addr":"172.21.15.17:6801","nonce":90655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":90655},{"type":"v1","addr":"172.21.15.17:6803","nonce":90655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":90655},{"type":"v1","addr":"172.21.15.17:6807","nonce":90655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":90655},{"type":"v1","addr":"172.21.15.17:6805","nonce":90655}]},"public_addr":"172.21.15.17:6801/90655","cluster_addr":"172.21.15.17:6803/90655","heartbeat_back_addr":"172.21.15.17:6807/90655","heartbeat_front_addr":"172.21.15.17:6805/90655","state":["exists","up"]},{"osd":2,"uuid":"48bd6831-763d-48c2-b515-e02c216d608b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":90657},{"type":"v1","addr":"172.21.15.17:6810","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":90657},{"type":"v1","addr":"172.21.15.17:6815","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":90657},{"type":"v1","addr":"172.21.15.17:6823","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":90657},{"type":"v1","addr":"172.21.15.17:6819","nonce":90657}]},"public_addr":"172.21.15.17:6810/90657","cluster_addr":"172.21.15.17:6815/90657","heartbeat_back_addr":"172.21.15.17:6823/90657","heartbeat_front_addr":"172.21.15.17:6819/90657","state":["exists","up"]},{"osd":3,"uuid":"ae7dbb23-abe7-4bd3-a4df-6f5963d6804c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":90688},{"type":"v1","addr":"172.21.15.17:6825","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":90688},{"type":"v1","addr":"172.21.15.17:6827","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":90688},{"type":"v1","addr":"172.21.15.17:6831","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":90688},{"type":"v1","addr":"172.21.15.17:6829","nonce":90688}]},"public_addr":"172.21.15.17:6825/90688","cluster_addr":"172.21.15.17:6827/90688","heartbeat_back_addr":"172.21.15.17:6831/90688","heartbeat_front_addr":"172.21.15.17:6829/90688","state":["exists","up"]},{"osd":4,"uuid":"29991fb4-1667-4ea3-aca0-d55db27f3bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":90902},{"type":"v1","addr":"172.21.15.136:6801","nonce":90902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":90902},{"type":"v1","addr":"172.21.15.136:6803","nonce":90902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":90902},{"type":"v1","addr":"172.21.15.136:6807","nonce":90902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":90902},{"type":"v1","addr":"172.21.15.136:6805","nonce":90902}]},"public_addr":"172.21.15.136:6801/90902","cluster_addr":"172.21.15.136:6803/90902","heartbeat_back_addr":"172.21.15.136:6807/90902","heartbeat_front_addr":"172.21.15.136:6805/90902","state":["exists","up"]},{"osd":5,"uuid":"398b4ff9-03fc-421f-882c-ba12aa088eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":90901},{"type":"v1","addr":"172.21.15.136:6809","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":90901},{"type":"v1","addr":"172.21.15.136:6811","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":90901},{"type":"v1","addr":"172.21.15.136:6815","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":90901},{"type":"v1","addr":"172.21.15.136:6813","nonce":90901}]},"public_addr":"172.21.15.136:6809/90901","cluster_addr":"172.21.15.136:6811/90901","heartbeat_back_addr":"172.21.15.136:6815/90901","heartbeat_front_addr":"172.21.15.136:6813/90901","state":["exists","up"]},{"osd":6,"uuid":"1bb91a72-4dab-4cdb-aa1d-2b8a9edf1ad0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":90927},{"type":"v1","addr":"172.21.15.136:6825","nonce":90927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":90927},{"type":"v1","addr":"172.21.15.136:6827","nonce":90927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":90927},{"type":"v1","addr":"172.21.15.136:6831","nonce":90927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":90927},{"type":"v1","addr":"172.21.15.136:6829","nonce":90927}]},"public_addr":"172.21.15.136:6825/90927","cluster_addr":"172.21.15.136:6827/90927","heartbeat_back_addr":"172.21.15.136:6831/90927","heartbeat_front_addr":"172.21.15.136:6829/90927","state":["exists","up"]},{"osd":7,"uuid":"719b654e-010d-4aa4-8c13-83fdde242b47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":90934},{"type":"v1","addr":"172.21.15.136:6817","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":90934},{"type":"v1","addr":"172.21.15.136:6819","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":90934},{"type":"v1","addr":"172.21.15.136:6824","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":90934},{"type":"v1","addr":"172.21.15.136:6821","nonce":90934}]},"public_addr":"172.21.15.136:6817/90934","cluster_addr":"172.21.15.136:6819/90934","heartbeat_back_addr":"172.21.15.136:6824/90934","heartbeat_front_addr":"172.21.15.136:6821/90934","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.157479+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.140520+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.190743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.231396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.156510+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.145822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.202888+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.139532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:43:43.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.884+0000 7fb39f59e700 1 -- 172.21.15.17:0/3901839420 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fb380066f30 msgr2=0x7fb3800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:43.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.884+0000 7fb39f59e700 1 --2- 172.21.15.17:0/3901839420 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fb380066f30 0x7fb3800693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb398001760 tx=0x7fb398009040 comp rx=0 tx=0).stop 2023-10-06T04:43:43.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.884+0000 7fb39f59e700 1 -- 172.21.15.17:0/3901839420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3a01571f0 msgr2=0x7fb3a01510b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:43.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.884+0000 7fb39f59e700 1 --2- 172.21.15.17:0/3901839420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3a01571f0 0x7fb3a01510b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb388006fd0 tx=0x7fb388017000 comp rx=0 tx=0).stop 2023-10-06T04:43:43.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.884+0000 7fb39f59e700 1 -- 172.21.15.17:0/3901839420 shutdown_connections 2023-10-06T04:43:43.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.884+0000 7fb39f59e700 1 --2- 172.21.15.17:0/3901839420 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fb380066f30 0x7fb3800693e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:43.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.884+0000 7fb39f59e700 1 --2- 172.21.15.17:0/3901839420 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3a01575c0 0x7fb3a01515f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:43.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.884+0000 7fb39f59e700 1 --2- 172.21.15.17:0/3901839420 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb3a00b04e0 0x7fb3a006e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:43.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.884+0000 7fb39f59e700 1 --2- 172.21.15.17:0/3901839420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3a01571f0 0x7fb3a01510b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:43.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.884+0000 7fb39f59e700 1 -- 172.21.15.17:0/3901839420 >> 172.21.15.17:0/3901839420 conn(0x7fb3a006c560 msgr2=0x7fb3a0153d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:43.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.884+0000 7fb39f59e700 1 -- 172.21.15.17:0/3901839420 shutdown_connections 2023-10-06T04:43:43.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:43.884+0000 7fb39f59e700 1 -- 172.21.15.17:0/3901839420 wait complete. 2023-10-06T04:43:43.898 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:43:44.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.014+0000 7f179b250700 1 Processor -- start 2023-10-06T04:43:44.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.015+0000 7f179b250700 1 -- start start 2023-10-06T04:43:44.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.015+0000 7f179b250700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f17940caf00 0x7f17941569d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:44.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.015+0000 7f179b250700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f17940c20d0 0x7f17940c35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:44.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.015+0000 7f179b250700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17940c3f40 con 0x7f17940c3b00 2023-10-06T04:43:44.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.015+0000 7f179b250700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1794156fb0 con 0x7f17940c20d0 2023-10-06T04:43:44.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.015+0000 7f179b250700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1794157290 con 0x7f17940caf00 2023-10-06T04:43:44.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.016+0000 7f1798fec700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f17940caf00 0x7f17941569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:44.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.016+0000 7f1793fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f17940c20d0 0x7f17940c35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:44.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.016+0000 7f1798fec700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f17940caf00 0x7f17941569d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.17:59372/0 (socket says 172.21.15.17:59372) 2023-10-06T04:43:44.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.016+0000 7f1798fec700 1 -- 172.21.15.17:0/622158664 learned_addr learned my addr 172.21.15.17:0/622158664 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:44.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.016+0000 7f1798fec700 1 -- 172.21.15.17:0/622158664 >> v2:172.21.15.136:3300/0 conn(0x7f17940c20d0 msgr2=0x7f17940c35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:44.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.016+0000 7f1798fec700 1 --2- 172.21.15.17:0/622158664 >> v2:172.21.15.136:3300/0 conn(0x7f17940c20d0 0x7f17940c35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.016+0000 7f1798fec700 1 -- 172.21.15.17:0/622158664 >> v1:172.21.15.136:6789/0 conn(0x7f17940c3b00 legacy=0x7f179406ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:44.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.016+0000 7f1798fec700 1 -- 172.21.15.17:0/622158664 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1794157570 con 0x7f17940caf00 2023-10-06T04:43:44.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.016+0000 7f1793fff700 1 --2- 172.21.15.17:0/622158664 >> v2:172.21.15.136:3300/0 conn(0x7f17940c20d0 0x7f17940c35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:43:44.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.016+0000 7f1798fec700 1 --2- 172.21.15.17:0/622158664 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f17940caf00 0x7f17941569d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f178c00bc50 tx=0x7f178c00b4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ad7b9fa068803a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:44.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.017+0000 7f17937fe700 1 -- 172.21.15.17:0/622158664 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c00dbf0 con 0x7f17940caf00 2023-10-06T04:43:44.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.017+0000 7f17937fe700 1 -- 172.21.15.17:0/622158664 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f178c00dd50 con 0x7f17940caf00 2023-10-06T04:43:44.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.017+0000 7f17937fe700 1 -- 172.21.15.17:0/622158664 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c0196b0 con 0x7f17940caf00 2023-10-06T04:43:44.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.017+0000 7f179b250700 1 -- 172.21.15.17:0/622158664 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f17940caf00 msgr2=0x7f17941569d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:44.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.017+0000 7f179b250700 1 --2- 172.21.15.17:0/622158664 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f17940caf00 0x7f17941569d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f178c00bc50 tx=0x7f178c00b4f0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.017+0000 7f179b250700 1 -- 172.21.15.17:0/622158664 shutdown_connections 2023-10-06T04:43:44.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.017+0000 7f179b250700 1 --2- 172.21.15.17:0/622158664 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f17940caf00 0x7f17941569d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.017+0000 7f179b250700 1 --2- 172.21.15.17:0/622158664 >> v2:172.21.15.136:3300/0 conn(0x7f17940c20d0 0x7f17940c35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.017+0000 7f179b250700 1 -- 172.21.15.17:0/622158664 >> 172.21.15.17:0/622158664 conn(0x7f179406e140 msgr2=0x7f17940cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:44.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.017+0000 7f179b250700 1 -- 172.21.15.17:0/622158664 shutdown_connections 2023-10-06T04:43:44.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.017+0000 7f179b250700 1 -- 172.21.15.17:0/622158664 wait complete. 2023-10-06T04:43:44.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.018+0000 7f179b250700 1 Processor -- start 2023-10-06T04:43:44.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.018+0000 7f179b250700 1 -- start start 2023-10-06T04:43:44.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.019+0000 7f179b250700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17940c20d0 0x7f1794166cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:44.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.019+0000 7f179b250700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f17940c3b00 0x7f17940b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:44.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.019+0000 7f179b250700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17940caf00 0x7f17941690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:44.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.019+0000 7f179b250700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17940b2840 con 0x7f17940c20d0 2023-10-06T04:43:44.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.019+0000 7f179b250700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179414e4a0 con 0x7f17940caf00 2023-10-06T04:43:44.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.019+0000 7f179b250700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f179414db70 con 0x7f17940c3b00 2023-10-06T04:43:44.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.019+0000 7f1798fec700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17940c20d0 0x7f1794166cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:44.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.019+0000 7f1798fec700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17940c20d0 0x7f1794166cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42756/0 (socket says 172.21.15.17:42756) 2023-10-06T04:43:44.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.019+0000 7f1798fec700 1 -- 172.21.15.17:0/455477422 learned_addr learned my addr 172.21.15.17:0/455477422 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:44.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.019+0000 7f1793fff700 1 --2- 172.21.15.17:0/455477422 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f17940c3b00 0x7f17940b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:44.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.019+0000 7f17997ed700 1 --2- 172.21.15.17:0/455477422 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17940caf00 0x7f17941690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:44.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.019+0000 7f1798fec700 1 -- 172.21.15.17:0/455477422 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f17940c3b00 msgr2=0x7f17940b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:44.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.019+0000 7f1798fec700 1 --2- 172.21.15.17:0/455477422 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f17940c3b00 0x7f17940b1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.019+0000 7f1798fec700 1 -- 172.21.15.17:0/455477422 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17940caf00 msgr2=0x7f17941690f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:44.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.019+0000 7f1798fec700 1 --2- 172.21.15.17:0/455477422 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17940caf00 0x7f17941690f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.020+0000 7f1798fec700 1 -- 172.21.15.17:0/455477422 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1784009a20 con 0x7f17940c20d0 2023-10-06T04:43:44.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.020+0000 7f1798fec700 1 --2- 172.21.15.17:0/455477422 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17940c20d0 0x7f1794166cc0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f17941573d0 tx=0x7f178c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:44.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.020+0000 7f1790ff9700 1 -- 172.21.15.17:0/455477422 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c010540 con 0x7f17940c20d0 2023-10-06T04:43:44.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.020+0000 7f1790ff9700 1 -- 172.21.15.17:0/455477422 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f178c0106c0 con 0x7f17940c20d0 2023-10-06T04:43:44.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.020+0000 7f179b250700 1 -- 172.21.15.17:0/455477422 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f178c00b790 con 0x7f17940c20d0 2023-10-06T04:43:44.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.020+0000 7f1790ff9700 1 -- 172.21.15.17:0/455477422 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c010a80 con 0x7f17940c20d0 2023-10-06T04:43:44.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.020+0000 7f179b250700 1 -- 172.21.15.17:0/455477422 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f179414e130 con 0x7f17940c20d0 2023-10-06T04:43:44.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.021+0000 7f179b250700 1 -- 172.21.15.17:0/455477422 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1794063ff0 con 0x7f17940c20d0 2023-10-06T04:43:44.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.021+0000 7f1790ff9700 1 -- 172.21.15.17:0/455477422 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f178c022070 con 0x7f17940c20d0 2023-10-06T04:43:44.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.022+0000 7f1790ff9700 1 --2- 172.21.15.17:0/455477422 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1774066f30 0x7f17740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:44.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.022+0000 7f1790ff9700 1 -- 172.21.15.17:0/455477422 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f178c014070 con 0x7f17940c20d0 2023-10-06T04:43:44.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.022+0000 7f1793fff700 1 --2- 172.21.15.17:0/455477422 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1774066f30 0x7f17740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:44.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.022+0000 7f1793fff700 1 --2- 172.21.15.17:0/455477422 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1774066f30 0x7f17740693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f17840099f0 tx=0x7f178400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:44.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.026+0000 7f1790ff9700 1 -- 172.21.15.17:0/455477422 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f178c0b95a0 con 0x7f17940c20d0 2023-10-06T04:43:44.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.263+0000 7f179b250700 1 -- 172.21.15.17:0/455477422 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1794157850 con 0x7f17940c20d0 2023-10-06T04:43:44.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.263+0000 7f1790ff9700 1 -- 172.21.15.17:0/455477422 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f178c0552a0 con 0x7f17940c20d0 2023-10-06T04:43:44.265 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:43:44.265 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/3001699743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3001699743},{"type":"v1","addr":"172.21.15.136:6833","nonce":3001699743}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/1891609455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1891609455},{"type":"v1","addr":"172.21.15.17:6835","nonce":1891609455}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/2697752124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":2697752124},{"type":"v1","addr":"172.21.15.17:6837","nonce":2697752124}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:43:29.199801+0000","modified":"2023-10-06T04:43:32.817081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6835/1496795591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":1496795591},{"type":"v1","addr":"172.21.15.136:6835","nonce":1496795591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:43:44.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.266+0000 7f179b250700 1 -- 172.21.15.17:0/455477422 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1774066f30 msgr2=0x7f17740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:44.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.266+0000 7f179b250700 1 --2- 172.21.15.17:0/455477422 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1774066f30 0x7f17740693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f17840099f0 tx=0x7f178400b040 comp rx=0 tx=0).stop 2023-10-06T04:43:44.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.266+0000 7f179b250700 1 -- 172.21.15.17:0/455477422 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17940c20d0 msgr2=0x7f1794166cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:44.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.266+0000 7f179b250700 1 --2- 172.21.15.17:0/455477422 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17940c20d0 0x7f1794166cc0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f17941573d0 tx=0x7f178c01b000 comp rx=0 tx=0).stop 2023-10-06T04:43:44.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.266+0000 7f179b250700 1 -- 172.21.15.17:0/455477422 shutdown_connections 2023-10-06T04:43:44.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.266+0000 7f179b250700 1 --2- 172.21.15.17:0/455477422 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1774066f30 0x7f17740693e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.266+0000 7f179b250700 1 --2- 172.21.15.17:0/455477422 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17940caf00 0x7f17941690f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.266+0000 7f179b250700 1 --2- 172.21.15.17:0/455477422 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17940c20d0 0x7f1794166cc0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.266+0000 7f179b250700 1 --2- 172.21.15.17:0/455477422 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f17940c3b00 0x7f17940b1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.266+0000 7f179b250700 1 -- 172.21.15.17:0/455477422 >> 172.21.15.17:0/455477422 conn(0x7f179406e140 msgr2=0x7f17940cd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:44.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.266+0000 7f179b250700 1 -- 172.21.15.17:0/455477422 shutdown_connections 2023-10-06T04:43:44.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.266+0000 7f179b250700 1 -- 172.21.15.17:0/455477422 wait complete. 2023-10-06T04:43:44.270 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 7 2023-10-06T04:43:44.682 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T04:43:29.199801+0000', 'modified': '2023-10-06T04:43:32.817081+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4291}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4291': {'gid': 4291, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.136:6835/1496795591', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6834', 'nonce': 1496795591}, {'type': 'v1', 'addr': '172.21.15.136:6835', 'nonce': 1496795591}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T04:43:44.682 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T04:43:44.682 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-06T04:43:44.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.803+0000 7f98f3030700 1 Processor -- start 2023-10-06T04:43:44.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.803+0000 7f98f3030700 1 -- start start 2023-10-06T04:43:44.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.804+0000 7f98f3030700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f98ec15ace0 0x7f98ec0b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:44.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.804+0000 7f98f3030700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f98ec0682a0 0x7f98ec0675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:44.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.804+0000 7f98f3030700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98ec06c560 con 0x7f98ec068710 2023-10-06T04:43:44.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.804+0000 7f98f3030700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98ec0b1f40 con 0x7f98ec15ace0 2023-10-06T04:43:44.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.804+0000 7f98f3030700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec0afd00 con 0x7f98ec0682a0 2023-10-06T04:43:44.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.804+0000 7f98ebfff700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f98ec0682a0 0x7f98ec0675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:44.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.804+0000 7f98ebfff700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f98ec0682a0 0x7f98ec0675f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.17:59386/0 (socket says 172.21.15.17:59386) 2023-10-06T04:43:44.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.804+0000 7f98ebfff700 1 -- 172.21.15.17:0/3362271721 learned_addr learned my addr 172.21.15.17:0/3362271721 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:44.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.804+0000 7f98f15cd700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f98ec068710 0x7f98ec15b680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.17:51556/0 (socket says 172.21.15.17:51556) 2023-10-06T04:43:44.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.804+0000 7f98f0dcc700 1 --2- 172.21.15.17:0/3362271721 >> v2:172.21.15.136:3300/0 conn(0x7f98ec15ace0 0x7f98ec0b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:44.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.804+0000 7f98eb7fe700 1 -- 172.21.15.17:0/3362271721 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 57452051 0 0) 0x7f98ec06c560 con 0x7f98ec068710 2023-10-06T04:43:44.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.804+0000 7f98eb7fe700 1 -- 172.21.15.17:0/3362271721 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98dc003570 con 0x7f98ec068710 2023-10-06T04:43:44.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.804+0000 7f98ebfff700 1 -- 172.21.15.17:0/3362271721 >> v2:172.21.15.136:3300/0 conn(0x7f98ec15ace0 msgr2=0x7f98ec0b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:44.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.804+0000 7f98ebfff700 1 --2- 172.21.15.17:0/3362271721 >> v2:172.21.15.136:3300/0 conn(0x7f98ec15ace0 0x7f98ec0b1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.804+0000 7f98ebfff700 1 -- 172.21.15.17:0/3362271721 >> v1:172.21.15.136:6789/0 conn(0x7f98ec068710 legacy=0x7f98ec15b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:44.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.804+0000 7f98ebfff700 1 -- 172.21.15.17:0/3362271721 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ec06d3c0 con 0x7f98ec0682a0 2023-10-06T04:43:44.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.804+0000 7f98f0dcc700 1 --2- 172.21.15.17:0/3362271721 >> v2:172.21.15.136:3300/0 conn(0x7f98ec15ace0 0x7f98ec0b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:43:44.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.805+0000 7f98ebfff700 1 --2- 172.21.15.17:0/3362271721 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f98ec0682a0 0x7f98ec0675f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f98d80099b0 tx=0x7f98d8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d31fe48e5932b4a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:44.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.805+0000 7f98eb7fe700 1 -- 172.21.15.17:0/3362271721 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d800b680 con 0x7f98ec0682a0 2023-10-06T04:43:44.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.805+0000 7f98eb7fe700 1 -- 172.21.15.17:0/3362271721 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d800b7e0 con 0x7f98ec0682a0 2023-10-06T04:43:44.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.805+0000 7f98eb7fe700 1 -- 172.21.15.17:0/3362271721 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d800bb60 con 0x7f98ec0682a0 2023-10-06T04:43:44.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.805+0000 7f98f3030700 1 -- 172.21.15.17:0/3362271721 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f98ec0682a0 msgr2=0x7f98ec0675f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:44.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.805+0000 7f98f3030700 1 --2- 172.21.15.17:0/3362271721 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f98ec0682a0 0x7f98ec0675f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f98d80099b0 tx=0x7f98d8009250 comp rx=0 tx=0).stop 2023-10-06T04:43:44.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.806+0000 7f98f3030700 1 -- 172.21.15.17:0/3362271721 shutdown_connections 2023-10-06T04:43:44.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.806+0000 7f98f3030700 1 --2- 172.21.15.17:0/3362271721 >> v2:172.21.15.136:3300/0 conn(0x7f98ec15ace0 0x7f98ec0b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.806+0000 7f98f3030700 1 --2- 172.21.15.17:0/3362271721 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f98ec0682a0 0x7f98ec0675f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.806+0000 7f98f3030700 1 -- 172.21.15.17:0/3362271721 >> 172.21.15.17:0/3362271721 conn(0x7f98ec0cd420 msgr2=0x7f98ec0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:44.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.806+0000 7f98f3030700 1 -- 172.21.15.17:0/3362271721 shutdown_connections 2023-10-06T04:43:44.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.806+0000 7f98f3030700 1 -- 172.21.15.17:0/3362271721 wait complete. 2023-10-06T04:43:44.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.807+0000 7f98f3030700 1 Processor -- start 2023-10-06T04:43:44.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.807+0000 7f98f3030700 1 -- start start 2023-10-06T04:43:44.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.808+0000 7f98f3030700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98ec0682a0 0x7f98ec0c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:44.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.808+0000 7f98f3030700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f98ec068710 0x7f98ec0ace20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:44.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.808+0000 7f98f3030700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98ec15ace0 0x7f98ec159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:44.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.808+0000 7f98f3030700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec0c91b0 con 0x7f98ec15ace0 2023-10-06T04:43:44.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.808+0000 7f98f3030700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec16d200 con 0x7f98ec0682a0 2023-10-06T04:43:44.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.808+0000 7f98f3030700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec16d4e0 con 0x7f98ec068710 2023-10-06T04:43:44.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.808+0000 7f98f15cd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98ec15ace0 0x7f98ec159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:44.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.808+0000 7f98f0dcc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98ec0682a0 0x7f98ec0c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:44.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.808+0000 7f98f15cd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98ec15ace0 0x7f98ec159a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42772/0 (socket says 172.21.15.17:42772) 2023-10-06T04:43:44.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.808+0000 7f98f15cd700 1 -- 172.21.15.17:0/542923836 learned_addr learned my addr 172.21.15.17:0/542923836 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:44.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.808+0000 7f98ebfff700 1 --2- 172.21.15.17:0/542923836 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f98ec068710 0x7f98ec0ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:44.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.808+0000 7f98f15cd700 1 -- 172.21.15.17:0/542923836 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f98ec068710 msgr2=0x7f98ec0ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:44.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.808+0000 7f98f15cd700 1 --2- 172.21.15.17:0/542923836 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f98ec068710 0x7f98ec0ace20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.808+0000 7f98f15cd700 1 -- 172.21.15.17:0/542923836 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98ec0682a0 msgr2=0x7f98ec0c8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:44.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.808+0000 7f98f15cd700 1 --2- 172.21.15.17:0/542923836 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98ec0682a0 0x7f98ec0c8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.808+0000 7f98f15cd700 1 -- 172.21.15.17:0/542923836 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e0009420 con 0x7f98ec15ace0 2023-10-06T04:43:44.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.808+0000 7f98f0dcc700 1 --2- 172.21.15.17:0/542923836 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98ec0682a0 0x7f98ec0c8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:43:44.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.809+0000 7f98f15cd700 1 --2- 172.21.15.17:0/542923836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98ec15ace0 0x7f98ec159a70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f98e400cd30 tx=0x7f98e4001b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:44.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.809+0000 7f98e8ff9700 1 -- 172.21.15.17:0/542923836 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e400ce90 con 0x7f98ec15ace0 2023-10-06T04:43:44.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.809+0000 7f98e8ff9700 1 -- 172.21.15.17:0/542923836 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e4005df0 con 0x7f98ec15ace0 2023-10-06T04:43:44.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.809+0000 7f98f3030700 1 -- 172.21.15.17:0/542923836 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98d80094f0 con 0x7f98ec15ace0 2023-10-06T04:43:44.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.809+0000 7f98e8ff9700 1 -- 172.21.15.17:0/542923836 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e400aac0 con 0x7f98ec15ace0 2023-10-06T04:43:44.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.809+0000 7f98f3030700 1 -- 172.21.15.17:0/542923836 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98ec15c6f0 con 0x7f98ec15ace0 2023-10-06T04:43:44.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.810+0000 7f98e8ff9700 1 -- 172.21.15.17:0/542923836 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f98e40070f0 con 0x7f98ec15ace0 2023-10-06T04:43:44.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.811+0000 7f98e8ff9700 1 --2- 172.21.15.17:0/542923836 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f98d0066f60 0x7f98d0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:44.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.811+0000 7f98e8ff9700 1 -- 172.21.15.17:0/542923836 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f98e4084700 con 0x7f98ec15ace0 2023-10-06T04:43:44.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.811+0000 7f98f0dcc700 1 --2- 172.21.15.17:0/542923836 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f98d0066f60 0x7f98d0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:44.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.811+0000 7f98f0dcc700 1 --2- 172.21.15.17:0/542923836 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f98d0066f60 0x7f98d0069410 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f98e0011560 tx=0x7f98e00091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:44.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.813+0000 7f98fc328b80 1 Processor -- start 2023-10-06T04:43:44.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.813+0000 7f98fc328b80 1 -- start start 2023-10-06T04:43:44.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.813+0000 7f98fc328b80 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55dedd59ea90 0x55dedd59ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:44.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.813+0000 7f98fc328b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dedd55a9a0 0x55dedd557580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:44.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.813+0000 7f98fc328b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dedd558bd0 0x55dedd557ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:44.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.813+0000 7f98fc328b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dedd4d7c80 con 0x55dedd558bd0 2023-10-06T04:43:44.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.813+0000 7f98fc328b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dedd4aea70 con 0x55dedd55a9a0 2023-10-06T04:43:44.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.813+0000 7f98fc328b80 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dedd4ac270 con 0x55dedd59ea90 2023-10-06T04:43:44.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.814+0000 7f98f15cd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dedd558bd0 0x55dedd557ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:44.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.814+0000 7f98f15cd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dedd558bd0 0x55dedd557ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42788/0 (socket says 172.21.15.17:42788) 2023-10-06T04:43:44.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.814+0000 7f98f15cd700 1 -- 172.21.15.17:0/2564774732 learned_addr learned my addr 172.21.15.17:0/2564774732 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:44.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.814+0000 7f98f0dcc700 1 --2- 172.21.15.17:0/2564774732 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55dedd59ea90 0x55dedd59ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:44.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.814+0000 7f98ebfff700 1 --2- 172.21.15.17:0/2564774732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dedd55a9a0 0x55dedd557580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:44.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.814+0000 7f98f15cd700 1 -- 172.21.15.17:0/2564774732 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55dedd59ea90 msgr2=0x55dedd59ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:44.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.814+0000 7f98f15cd700 1 --2- 172.21.15.17:0/2564774732 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55dedd59ea90 0x55dedd59ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.814+0000 7f98f15cd700 1 -- 172.21.15.17:0/2564774732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dedd55a9a0 msgr2=0x55dedd557580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:44.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.814+0000 7f98f15cd700 1 --2- 172.21.15.17:0/2564774732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dedd55a9a0 0x55dedd557580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.814+0000 7f98f15cd700 1 -- 172.21.15.17:0/2564774732 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dedd342270 con 0x55dedd558bd0 2023-10-06T04:43:44.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.814+0000 7f98f15cd700 1 --2- 172.21.15.17:0/2564774732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dedd558bd0 0x55dedd557ac0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f98e4051a50 tx=0x7f98e4082a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3dd1a7f027b5afc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:44.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.814+0000 7f98d5ffb700 1 -- 172.21.15.17:0/2564774732 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e4055550 con 0x55dedd558bd0 2023-10-06T04:43:44.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.814+0000 7f98d5ffb700 1 -- 172.21.15.17:0/2564774732 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e40587a0 con 0x55dedd558bd0 2023-10-06T04:43:44.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.814+0000 7f98d5ffb700 1 -- 172.21.15.17:0/2564774732 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e405c4f0 con 0x55dedd558bd0 2023-10-06T04:43:44.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.815+0000 7f98fc328b80 1 -- 172.21.15.17:0/2564774732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dedd558bd0 msgr2=0x55dedd557ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:44.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.815+0000 7f98fc328b80 1 --2- 172.21.15.17:0/2564774732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dedd558bd0 0x55dedd557ac0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f98e4051a50 tx=0x7f98e4082a20 comp rx=0 tx=0).stop 2023-10-06T04:43:44.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.815+0000 7f98fc328b80 1 -- 172.21.15.17:0/2564774732 shutdown_connections 2023-10-06T04:43:44.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.815+0000 7f98fc328b80 1 --2- 172.21.15.17:0/2564774732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dedd558bd0 0x55dedd557ac0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.815+0000 7f98fc328b80 1 --2- 172.21.15.17:0/2564774732 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55dedd59ea90 0x55dedd59ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.815+0000 7f98fc328b80 1 --2- 172.21.15.17:0/2564774732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dedd55a9a0 0x55dedd557580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.815+0000 7f98fc328b80 1 -- 172.21.15.17:0/2564774732 >> 172.21.15.17:0/2564774732 conn(0x55dedd559070 msgr2=0x55dedd559440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:44.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.815+0000 7f98fc328b80 1 -- 172.21.15.17:0/2564774732 shutdown_connections 2023-10-06T04:43:44.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.815+0000 7f98fc328b80 1 -- 172.21.15.17:0/2564774732 wait complete. 2023-10-06T04:43:44.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.815+0000 7f98fc328b80 1 -- start start 2023-10-06T04:43:44.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.816+0000 7f98fc328b80 1 Processor -- start 2023-10-06T04:43:44.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.816+0000 7f98fc328b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dedd558bd0 0x55dedd583780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:44.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.816+0000 7f98fc328b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dedd55a9a0 0x55dedd57fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:44.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.816+0000 7f98fc328b80 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55dedd59ea90 0x55dedd57ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:44.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.816+0000 7f98fc328b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dedd4a8060 con 0x55dedd55a9a0 2023-10-06T04:43:44.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.816+0000 7f98fc328b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dedd453890 con 0x55dedd558bd0 2023-10-06T04:43:44.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.816+0000 7f98fc328b80 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dedd46eea0 con 0x55dedd59ea90 2023-10-06T04:43:44.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.816+0000 7f98fc328b80 10 client.0 _ll_register_callbacks cb 0x55dedd344f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:43:44.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.816+0000 7f98ebfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dedd55a9a0 0x55dedd57fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:44.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.817+0000 7f98ebfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dedd55a9a0 0x55dedd57fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42800/0 (socket says 172.21.15.17:42800) 2023-10-06T04:43:44.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.817+0000 7f98ebfff700 1 -- 172.21.15.17:0/3047024728 learned_addr learned my addr 172.21.15.17:0/3047024728 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:44.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.817+0000 7f98f0dcc700 1 --2- 172.21.15.17:0/3047024728 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dedd558bd0 0x55dedd583780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:44.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.817+0000 7f98f15cd700 1 --2- 172.21.15.17:0/3047024728 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55dedd59ea90 0x55dedd57ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:44.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.817+0000 7f98ebfff700 1 -- 172.21.15.17:0/3047024728 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55dedd59ea90 msgr2=0x55dedd57ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:44.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.817+0000 7f98ebfff700 1 --2- 172.21.15.17:0/3047024728 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55dedd59ea90 0x55dedd57ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.817+0000 7f98ebfff700 1 -- 172.21.15.17:0/3047024728 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dedd558bd0 msgr2=0x55dedd583780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:44.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.817+0000 7f98ebfff700 1 --2- 172.21.15.17:0/3047024728 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dedd558bd0 0x55dedd583780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.817+0000 7f98ebfff700 1 -- 172.21.15.17:0/3047024728 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98ec15c6f0 con 0x55dedd55a9a0 2023-10-06T04:43:44.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.817+0000 7f98ebfff700 1 --2- 172.21.15.17:0/3047024728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dedd55a9a0 0x55dedd57fa70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f98d8009290 tx=0x7f98d8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5822262bf368edb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:44.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.817+0000 7f98caffd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-06T04:43:44.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.817+0000 7f98caffd700 1 -- 172.21.15.17:0/3047024728 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d8021070 con 0x55dedd55a9a0 2023-10-06T04:43:44.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.817+0000 7f98caffd700 1 -- 172.21.15.17:0/3047024728 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f98d801b430 con 0x55dedd55a9a0 2023-10-06T04:43:44.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.817+0000 7f98fc328b80 1 -- 172.21.15.17:0/3047024728 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dedd54c690 con 0x55dedd55a9a0 2023-10-06T04:43:44.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.817+0000 7f98caffd700 1 -- 172.21.15.17:0/3047024728 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98d801b800 con 0x55dedd55a9a0 2023-10-06T04:43:44.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.817+0000 7f98fc328b80 10 client.4662 fetch_fsmap learned FSMap version 7 2023-10-06T04:43:44.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.817+0000 7f98fc328b80 1 -- 172.21.15.17:0/3047024728 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55dedd2e4fe0 con 0x55dedd55a9a0 2023-10-06T04:43:44.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.817+0000 7f98caffd700 1 -- 172.21.15.17:0/3047024728 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55dedd54c690 con 0x55dedd55a9a0 2023-10-06T04:43:44.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.817+0000 7f98caffd700 1 -- 172.21.15.17:0/3047024728 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 7) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f98d801b960 con 0x55dedd55a9a0 2023-10-06T04:43:44.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.818+0000 7f98fc328b80 10 client.4662 fetch_fsmap finished waiting for FSMap version 7 2023-10-06T04:43:44.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.818+0000 7f98fc328b80 10 client.4662 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T04:43:44.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.818+0000 7f98fc328b80 20 client.4662 populate_metadata read hostname 'smithi017' 2023-10-06T04:43:44.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.818+0000 7f98fc328b80 1 --2- 172.21.15.17:0/3047024728 >> [v2:172.21.15.136:6834/1496795591,v1:172.21.15.136:6835/1496795591] conn(0x55dedd5ae0a0 0x55dedd581670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:44.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.818+0000 7f98fc328b80 4 client.4662 mds_command: new command op to 4291 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T04:43:44.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.818+0000 7f98fc328b80 1 -- 172.21.15.17:0/3047024728 --> [v2:172.21.15.136:6834/1496795591,v1:172.21.15.136:6835/1496795591] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dedd5295c0 con 0x55dedd5ae0a0 2023-10-06T04:43:44.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.818+0000 7f98f0dcc700 1 --2- 172.21.15.17:0/3047024728 >> [v2:172.21.15.136:6834/1496795591,v1:172.21.15.136:6835/1496795591] conn(0x55dedd5ae0a0 0x55dedd581670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:44.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.818+0000 7f98f0dcc700 1 --2- 172.21.15.17:0/3047024728 >> [v2:172.21.15.136:6834/1496795591,v1:172.21.15.136:6835/1496795591] conn(0x55dedd5ae0a0 0x55dedd581670 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=872b66b2c81b5d4a server_cookie=4663bea96369773 in_seq=0 out_seq=0 2023-10-06T04:43:44.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.818+0000 7f98caffd700 10 client.4662 ms_handle_connect on v2:172.21.15.136:6834/1496795591 2023-10-06T04:43:44.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.819+0000 7f98caffd700 1 -- 172.21.15.17:0/3047024728 <== mds.0 v2:172.21.15.136:6834/1496795591 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55dedd5295c0 con 0x55dedd5ae0a0 2023-10-06T04:43:44.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.819+0000 7f98caffd700 10 client.4662 handle_command_reply: tid=0 2023-10-06T04:43:44.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.819+0000 7f98fc328b80 1 client.4662 shutdown 2023-10-06T04:43:44.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.819+0000 7f98fc328b80 1 -- 172.21.15.17:0/3047024728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dedd55a9a0 msgr2=0x55dedd57fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:44.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.819+0000 7f98fc328b80 1 --2- 172.21.15.17:0/3047024728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dedd55a9a0 0x55dedd57fa70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f98d8009290 tx=0x7f98d8017000 comp rx=0 tx=0).stop 2023-10-06T04:43:44.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.819+0000 7f98fc328b80 1 -- 172.21.15.17:0/3047024728 shutdown_connections 2023-10-06T04:43:44.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.819+0000 7f98fc328b80 1 --2- 172.21.15.17:0/3047024728 >> [v2:172.21.15.136:6834/1496795591,v1:172.21.15.136:6835/1496795591] conn(0x55dedd5ae0a0 0x55dedd581670 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.819+0000 7f98fc328b80 1 --2- 172.21.15.17:0/3047024728 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55dedd59ea90 0x55dedd57ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.819+0000 7f98fc328b80 1 --2- 172.21.15.17:0/3047024728 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dedd558bd0 0x55dedd583780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.819+0000 7f98caffd700 0 client.4662 ms_handle_reset on v2:172.21.15.136:6834/1496795591 2023-10-06T04:43:44.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.819+0000 7f98fc328b80 1 --2- 172.21.15.17:0/3047024728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dedd55a9a0 0x55dedd57fa70 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.819+0000 7f98fc328b80 1 -- 172.21.15.17:0/3047024728 >> 172.21.15.17:0/3047024728 conn(0x55dedd559070 msgr2=0x55dedd554760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:44.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.819+0000 7f98fc328b80 1 -- 172.21.15.17:0/3047024728 shutdown_connections 2023-10-06T04:43:44.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.819+0000 7f98fc328b80 1 -- 172.21.15.17:0/3047024728 wait complete. 2023-10-06T04:43:44.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.819+0000 7f98fc328b80 20 client.4662 trim_cache size 0 max 16384 2023-10-06T04:43:44.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.836+0000 7f98fc328b80 1 Processor -- start 2023-10-06T04:43:44.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.836+0000 7f98fc328b80 1 -- start start 2023-10-06T04:43:44.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.837+0000 7f98fc328b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dedd558bd0 0x55dedd5ad000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:44.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.837+0000 7f98fc328b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dedd55a9a0 0x55dedd554a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:44.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.837+0000 7f98fc328b80 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55dedd59ea90 0x55dedd57fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:44.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.837+0000 7f98fc328b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dedd32ae30 con 0x55dedd55a9a0 2023-10-06T04:43:44.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.837+0000 7f98fc328b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dedd59d9c0 con 0x55dedd558bd0 2023-10-06T04:43:44.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.837+0000 7f98fc328b80 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dedd595480 con 0x55dedd59ea90 2023-10-06T04:43:44.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.837+0000 7f98ebfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dedd55a9a0 0x55dedd554a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:44.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.837+0000 7f98ebfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dedd55a9a0 0x55dedd554a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42802/0 (socket says 172.21.15.17:42802) 2023-10-06T04:43:44.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.837+0000 7f98ebfff700 1 -- 172.21.15.17:0/3022192823 learned_addr learned my addr 172.21.15.17:0/3022192823 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:44.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.837+0000 7f98f15cd700 1 --2- 172.21.15.17:0/3022192823 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55dedd59ea90 0x55dedd57fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:44.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.837+0000 7f98f0dcc700 1 --2- 172.21.15.17:0/3022192823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dedd558bd0 0x55dedd5ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:44.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.837+0000 7f98ebfff700 1 -- 172.21.15.17:0/3022192823 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55dedd59ea90 msgr2=0x55dedd57fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:44.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.837+0000 7f98ebfff700 1 --2- 172.21.15.17:0/3022192823 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55dedd59ea90 0x55dedd57fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.837+0000 7f98ebfff700 1 -- 172.21.15.17:0/3022192823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dedd558bd0 msgr2=0x55dedd5ad000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:44.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.837+0000 7f98ebfff700 1 --2- 172.21.15.17:0/3022192823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dedd558bd0 0x55dedd5ad000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.837+0000 7f98ebfff700 1 -- 172.21.15.17:0/3022192823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dedd476780 con 0x55dedd55a9a0 2023-10-06T04:43:44.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.837+0000 7f98f0dcc700 1 --2- 172.21.15.17:0/3022192823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dedd558bd0 0x55dedd5ad000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:43:44.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.838+0000 7f98ebfff700 1 --2- 172.21.15.17:0/3022192823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dedd55a9a0 0x55dedd554a40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f98d800b2c0 tx=0x7f98d8024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af9130828bcd8e80 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:44.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.838+0000 7f98d67fc700 1 -- 172.21.15.17:0/3022192823 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d8021070 con 0x55dedd55a9a0 2023-10-06T04:43:44.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.838+0000 7f98d67fc700 1 -- 172.21.15.17:0/3022192823 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d8022040 con 0x55dedd55a9a0 2023-10-06T04:43:44.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.838+0000 7f98d67fc700 1 -- 172.21.15.17:0/3022192823 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d8006d00 con 0x55dedd55a9a0 2023-10-06T04:43:44.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.838+0000 7f98fc328b80 1 -- 172.21.15.17:0/3022192823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dedd55a9a0 msgr2=0x55dedd554a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:44.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.838+0000 7f98fc328b80 1 --2- 172.21.15.17:0/3022192823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dedd55a9a0 0x55dedd554a40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f98d800b2c0 tx=0x7f98d8024000 comp rx=0 tx=0).stop 2023-10-06T04:43:44.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.838+0000 7f98fc328b80 1 -- 172.21.15.17:0/3022192823 shutdown_connections 2023-10-06T04:43:44.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.838+0000 7f98fc328b80 1 --2- 172.21.15.17:0/3022192823 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55dedd59ea90 0x55dedd57fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.838+0000 7f98fc328b80 1 --2- 172.21.15.17:0/3022192823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dedd558bd0 0x55dedd5ad000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.838+0000 7f98fc328b80 1 --2- 172.21.15.17:0/3022192823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dedd55a9a0 0x55dedd554a40 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.838+0000 7f98fc328b80 1 -- 172.21.15.17:0/3022192823 >> 172.21.15.17:0/3022192823 conn(0x55dedd559070 msgr2=0x55dedd57d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:44.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.838+0000 7f98fc328b80 1 -- 172.21.15.17:0/3022192823 shutdown_connections 2023-10-06T04:43:44.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.838+0000 7f98fc328b80 1 -- 172.21.15.17:0/3022192823 wait complete. 2023-10-06T04:43:44.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.839+0000 7f98fc328b80 1 -- start start 2023-10-06T04:43:44.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.839+0000 7f98fc328b80 1 Processor -- start 2023-10-06T04:43:44.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.840+0000 7f98fc328b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dedd558bd0 0x55dedd6034a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:44.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.840+0000 7f98fc328b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dedd55a9a0 0x55dedd582f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:44.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.840+0000 7f98fc328b80 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55dedd59ea90 0x55dedd581c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:44.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.840+0000 7f98fc328b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dedd603cf0 con 0x55dedd558bd0 2023-10-06T04:43:44.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.840+0000 7f98fc328b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dedd5817a0 con 0x55dedd55a9a0 2023-10-06T04:43:44.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.840+0000 7f98fc328b80 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dedd583480 con 0x55dedd59ea90 2023-10-06T04:43:44.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.840+0000 7f98fc328b80 10 client.0 _ll_register_callbacks cb 0x55dedd344f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:43:44.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.840+0000 7f98f0dcc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dedd558bd0 0x55dedd6034a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:44.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.840+0000 7f98f0dcc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dedd558bd0 0x55dedd6034a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42808/0 (socket says 172.21.15.17:42808) 2023-10-06T04:43:44.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.840+0000 7f98f0dcc700 1 -- 172.21.15.17:0/1580571027 learned_addr learned my addr 172.21.15.17:0/1580571027 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:44.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.840+0000 7f98ebfff700 1 --2- 172.21.15.17:0/1580571027 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dedd55a9a0 0x55dedd582f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:44.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.840+0000 7f98f15cd700 1 --2- 172.21.15.17:0/1580571027 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55dedd59ea90 0x55dedd581c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:44.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.840+0000 7f98f0dcc700 1 -- 172.21.15.17:0/1580571027 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55dedd59ea90 msgr2=0x55dedd581c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:44.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.840+0000 7f98f0dcc700 1 --2- 172.21.15.17:0/1580571027 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55dedd59ea90 0x55dedd581c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.840+0000 7f98f0dcc700 1 -- 172.21.15.17:0/1580571027 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dedd55a9a0 msgr2=0x55dedd582f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:44.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.840+0000 7f98f0dcc700 1 --2- 172.21.15.17:0/1580571027 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dedd55a9a0 0x55dedd582f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.840+0000 7f98f0dcc700 1 -- 172.21.15.17:0/1580571027 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dedd2e4fe0 con 0x55dedd558bd0 2023-10-06T04:43:44.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.840+0000 7f98ebfff700 1 --2- 172.21.15.17:0/1580571027 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dedd55a9a0 0x55dedd582f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:43:44.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.840+0000 7f98f0dcc700 1 --2- 172.21.15.17:0/1580571027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dedd558bd0 0x55dedd6034a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x55dedd583fd0 tx=0x7f98e0025040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c43d55c39ca12ecb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:44.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.840+0000 7f98caffd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-06T04:43:44.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.840+0000 7f98caffd700 1 -- 172.21.15.17:0/1580571027 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e0028050 con 0x55dedd558bd0 2023-10-06T04:43:44.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.840+0000 7f98caffd700 1 -- 172.21.15.17:0/1580571027 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f98e001a040 con 0x55dedd558bd0 2023-10-06T04:43:44.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.840+0000 7f98fc328b80 1 -- 172.21.15.17:0/1580571027 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f98e40587a0 con 0x55dedd558bd0 2023-10-06T04:43:44.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.841+0000 7f98caffd700 1 -- 172.21.15.17:0/1580571027 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98e0005a00 con 0x55dedd558bd0 2023-10-06T04:43:44.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.841+0000 7f98fc328b80 10 client.4668 fetch_fsmap learned FSMap version 7 2023-10-06T04:43:44.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.841+0000 7f98fc328b80 1 -- 172.21.15.17:0/1580571027 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55dedd45d470 con 0x55dedd558bd0 2023-10-06T04:43:44.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.841+0000 7f98caffd700 1 -- 172.21.15.17:0/1580571027 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e40587a0 con 0x55dedd558bd0 2023-10-06T04:43:44.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.841+0000 7f98caffd700 1 -- 172.21.15.17:0/1580571027 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 7) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f98e0005b60 con 0x55dedd558bd0 2023-10-06T04:43:44.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.841+0000 7f98fc328b80 10 client.4668 fetch_fsmap finished waiting for FSMap version 7 2023-10-06T04:43:44.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.841+0000 7f98fc328b80 10 client.4668 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T04:43:44.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.841+0000 7f98fc328b80 20 client.4668 populate_metadata read hostname 'smithi017' 2023-10-06T04:43:44.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.841+0000 7f98fc328b80 1 --2- 172.21.15.17:0/1580571027 >> [v2:172.21.15.136:6834/1496795591,v1:172.21.15.136:6835/1496795591] conn(0x55dedd57d4b0 0x55dedd57d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:44.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.841+0000 7f98fc328b80 4 client.4668 mds_command: new command op to 4291 tid=0[{"prefix": "status"}] 2023-10-06T04:43:44.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.841+0000 7f98fc328b80 1 -- 172.21.15.17:0/1580571027 --> [v2:172.21.15.136:6834/1496795591,v1:172.21.15.136:6835/1496795591] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55dedd44ae00 con 0x55dedd57d4b0 2023-10-06T04:43:44.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.841+0000 7f98ebfff700 1 --2- 172.21.15.17:0/1580571027 >> [v2:172.21.15.136:6834/1496795591,v1:172.21.15.136:6835/1496795591] conn(0x55dedd57d4b0 0x55dedd57d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:44.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.841+0000 7f98caffd700 10 client.4668 ms_handle_connect on v2:172.21.15.136:6834/1496795591 2023-10-06T04:43:44.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.841+0000 7f98ebfff700 1 --2- 172.21.15.17:0/1580571027 >> [v2:172.21.15.136:6834/1496795591,v1:172.21.15.136:6835/1496795591] conn(0x55dedd57d4b0 0x55dedd57d880 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4e7a5b014c3e9b server_cookie=633aab3ab4961c70 in_seq=0 out_seq=0 2023-10-06T04:43:44.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.842+0000 7f98caffd700 1 -- 172.21.15.17:0/1580571027 <== mds.0 v2:172.21.15.136:6834/1496795591 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55dedd44ae00 con 0x55dedd57d4b0 2023-10-06T04:43:44.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.842+0000 7f98caffd700 10 client.4668 handle_command_reply: tid=0 2023-10-06T04:43:44.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.842+0000 7f98fc328b80 1 client.4668 shutdown 2023-10-06T04:43:44.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.842+0000 7f98fc328b80 1 -- 172.21.15.17:0/1580571027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dedd558bd0 msgr2=0x55dedd6034a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:44.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.842+0000 7f98fc328b80 1 --2- 172.21.15.17:0/1580571027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dedd558bd0 0x55dedd6034a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x55dedd583fd0 tx=0x7f98e0025040 comp rx=0 tx=0).stop 2023-10-06T04:43:44.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.842+0000 7f98fc328b80 1 -- 172.21.15.17:0/1580571027 shutdown_connections 2023-10-06T04:43:44.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.842+0000 7f98fc328b80 1 --2- 172.21.15.17:0/1580571027 >> [v2:172.21.15.136:6834/1496795591,v1:172.21.15.136:6835/1496795591] conn(0x55dedd57d4b0 0x55dedd57d880 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.842+0000 7f98fc328b80 1 --2- 172.21.15.17:0/1580571027 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55dedd59ea90 0x55dedd581c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.842+0000 7f98fc328b80 1 --2- 172.21.15.17:0/1580571027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dedd558bd0 0x55dedd6034a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.842+0000 7f98fc328b80 1 --2- 172.21.15.17:0/1580571027 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dedd55a9a0 0x55dedd582f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.842+0000 7f98caffd700 0 client.4668 ms_handle_reset on v2:172.21.15.136:6834/1496795591 2023-10-06T04:43:44.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.842+0000 7f98fc328b80 1 -- 172.21.15.17:0/1580571027 >> 172.21.15.17:0/1580571027 conn(0x55dedd559070 msgr2=0x55dedd5ad000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:44.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.842+0000 7f98fc328b80 1 -- 172.21.15.17:0/1580571027 shutdown_connections 2023-10-06T04:43:44.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.842+0000 7f98fc328b80 1 -- 172.21.15.17:0/1580571027 wait complete. 2023-10-06T04:43:44.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.842+0000 7f98fc328b80 20 client.4668 trim_cache size 0 max 16384 2023-10-06T04:43:44.857 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-06T04:43:44.857 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "780777c4-2b25-4d35-9058-c9f2d62e3ad9", 2023-10-06T04:43:44.857 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2023-10-06T04:43:44.858 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4291, 2023-10-06T04:43:44.858 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2023-10-06T04:43:44.858 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2023-10-06T04:43:44.858 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2023-10-06T04:43:44.858 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 15.051823256, 2023-10-06T04:43:44.858 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 7, 2023-10-06T04:43:44.858 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 21, 2023-10-06T04:43:44.859 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 21, 2023-10-06T04:43:44.859 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 21.024181479999999 2023-10-06T04:43:44.859 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-06T04:43:44.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.842+0000 7f98f3030700 1 -- 172.21.15.17:0/542923836 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f98d0066f60 msgr2=0x7f98d0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:44.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.842+0000 7f98f3030700 1 --2- 172.21.15.17:0/542923836 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f98d0066f60 0x7f98d0069410 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f98e0011560 tx=0x7f98e00091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.842+0000 7f98f3030700 1 -- 172.21.15.17:0/542923836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98ec15ace0 msgr2=0x7f98ec159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:44.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.842+0000 7f98f3030700 1 --2- 172.21.15.17:0/542923836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98ec15ace0 0x7f98ec159a70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f98e400cd30 tx=0x7f98e4001b60 comp rx=0 tx=0).stop 2023-10-06T04:43:44.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.843+0000 7f98f3030700 1 -- 172.21.15.17:0/542923836 shutdown_connections 2023-10-06T04:43:44.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.843+0000 7f98f3030700 1 --2- 172.21.15.17:0/542923836 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f98d0066f60 0x7f98d0069410 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.843+0000 7f98f3030700 1 --2- 172.21.15.17:0/542923836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98ec15ace0 0x7f98ec159a70 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.843+0000 7f98f3030700 1 --2- 172.21.15.17:0/542923836 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98ec0682a0 0x7f98ec0c8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.843+0000 7f98f3030700 1 --2- 172.21.15.17:0/542923836 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f98ec068710 0x7f98ec0ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:44.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.843+0000 7f98f3030700 1 -- 172.21.15.17:0/542923836 >> 172.21.15.17:0/542923836 conn(0x7f98ec0cd420 msgr2=0x7f98ec156d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:44.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.843+0000 7f98f3030700 1 -- 172.21.15.17:0/542923836 shutdown_connections 2023-10-06T04:43:44.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:44.843+0000 7f98f3030700 1 -- 172.21.15.17:0/542923836 wait complete. 2023-10-06T04:43:44.866 INFO:teuthology.run_tasks:Running task kclient... 2023-10-06T04:43:44.889 INFO:tasks.kclient:Mounting kernel clients... 2023-10-06T04:43:44.890 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-06T04:43:44.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:44.890 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2023-10-06T04:43:44.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:44.907 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link delete ceph-brx 2023-10-06T04:43:44.973 INFO:teuthology.orchestra.run.smithi017.stderr:Cannot find device "ceph-brx" 2023-10-06T04:43:44.974 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:43:44.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:44.975 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2023-10-06T04:43:45.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:45.032 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link delete ceph-brx 2023-10-06T04:43:45.099 INFO:teuthology.orchestra.run.smithi017.stderr:Cannot find device "ceph-brx" 2023-10-06T04:43:45.100 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:43:45.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:45.101 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2023-10-06T04:43:45.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:45.121 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link delete ceph-brx 2023-10-06T04:43:45.193 INFO:teuthology.orchestra.run.smithi136.stderr:Cannot find device "ceph-brx" 2023-10-06T04:43:45.193 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:43:45.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:45.195 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2023-10-06T04:43:45.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:45.253 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link delete ceph-brx 2023-10-06T04:43:45.323 INFO:teuthology.orchestra.run.smithi136.stderr:Cannot find device "ceph-brx" 2023-10-06T04:43:45.325 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:43:45.325 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-10-06T04:43:45.326 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:43:45.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.443+0000 7fa285de3700 1 Processor -- start 2023-10-06T04:43:45.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.443+0000 7fa285de3700 1 -- start start 2023-10-06T04:43:45.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.444+0000 7fa285de3700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa280159630 0x7fa2800cd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:45.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.444+0000 7fa285de3700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa2800cd590 0x7fa2800ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:45.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.444+0000 7fa285de3700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2800cda00 con 0x7fa2800ce840 2023-10-06T04:43:45.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.444+0000 7fa285de3700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2800cfc80 con 0x7fa2800cd590 2023-10-06T04:43:45.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.444+0000 7fa285de3700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2800cf070 con 0x7fa280159630 2023-10-06T04:43:45.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.444+0000 7fa27ffff700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fa2800ce840 0x7fa28015d2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55384/0 (socket says 172.21.15.17:55384) 2023-10-06T04:43:45.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.444+0000 7fa27ffff700 1 -- 172.21.15.17:0/2506290705 learned_addr learned my addr 172.21.15.17:0/2506290705 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:45.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.445+0000 7fa27effd700 1 --2- 172.21.15.17:0/2506290705 >> v2:172.21.15.136:3300/0 conn(0x7fa2800cd590 0x7fa2800ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:45.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.445+0000 7fa27f7fe700 1 --2- 172.21.15.17:0/2506290705 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa280159630 0x7fa2800cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:45.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.445+0000 7fa27e7fc700 1 -- 172.21.15.17:0/2506290705 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4190993495 0 0) 0x7fa2800cda00 con 0x7fa2800ce840 2023-10-06T04:43:45.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.445+0000 7fa27e7fc700 1 -- 172.21.15.17:0/2506290705 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa268003570 con 0x7fa2800ce840 2023-10-06T04:43:45.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.445+0000 7fa27e7fc700 1 -- 172.21.15.17:0/2506290705 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 396790842 0 0) 0x7fa268003570 con 0x7fa2800ce840 2023-10-06T04:43:45.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.445+0000 7fa27e7fc700 1 -- 172.21.15.17:0/2506290705 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa280159630 msgr2=0x7fa2800cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:45.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.445+0000 7fa27e7fc700 1 --2- 172.21.15.17:0/2506290705 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa280159630 0x7fa2800cd050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:45.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.445+0000 7fa27e7fc700 1 -- 172.21.15.17:0/2506290705 >> v2:172.21.15.136:3300/0 conn(0x7fa2800cd590 msgr2=0x7fa2800ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:45.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.445+0000 7fa27e7fc700 1 --2- 172.21.15.17:0/2506290705 >> v2:172.21.15.136:3300/0 conn(0x7fa2800cd590 0x7fa2800ce300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:45.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.445+0000 7fa27e7fc700 1 -- 172.21.15.17:0/2506290705 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2800cf350 con 0x7fa2800ce840 2023-10-06T04:43:45.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.445+0000 7fa27e7fc700 1 -- 172.21.15.17:0/2506290705 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4268781140 0 0) 0x7fa2780017f0 con 0x7fa2800ce840 2023-10-06T04:43:45.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.445+0000 7fa27e7fc700 1 -- 172.21.15.17:0/2506290705 >> v1:172.21.15.17:6789/0 conn(0x7fa2800ce840 legacy=0x7fa28015d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:45.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.445+0000 7fa27e7fc700 1 --2- 172.21.15.17:0/2506290705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa268003a60 0x7fa268003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:45.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.445+0000 7fa27e7fc700 1 --2- 172.21.15.17:0/2506290705 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa268004810 0x7fa268004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:45.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.445+0000 7fa27e7fc700 1 --2- 172.21.15.17:0/2506290705 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa280159630 0x7fa2680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:45.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.445+0000 7fa27e7fc700 1 -- 172.21.15.17:0/2506290705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2800cfc80 con 0x7fa268003a60 2023-10-06T04:43:45.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.445+0000 7fa27e7fc700 1 -- 172.21.15.17:0/2506290705 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2800cf070 con 0x7fa268004810 2023-10-06T04:43:45.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.445+0000 7fa27e7fc700 1 -- 172.21.15.17:0/2506290705 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26800ba60 con 0x7fa280159630 2023-10-06T04:43:45.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.445+0000 7fa27f7fe700 1 --2- 172.21.15.17:0/2506290705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa268003a60 0x7fa268003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:45.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.445+0000 7fa27effd700 1 --2- 172.21.15.17:0/2506290705 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa268004810 0x7fa268004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:45.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.445+0000 7fa27ffff700 1 --2- 172.21.15.17:0/2506290705 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa280159630 0x7fa2680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:45.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.445+0000 7fa27f7fe700 1 -- 172.21.15.17:0/2506290705 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa280159630 msgr2=0x7fa2680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:45.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.445+0000 7fa27f7fe700 1 --2- 172.21.15.17:0/2506290705 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa280159630 0x7fa2680051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:45.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.445+0000 7fa27f7fe700 1 -- 172.21.15.17:0/2506290705 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa268004810 msgr2=0x7fa268004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:45.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.445+0000 7fa27f7fe700 1 --2- 172.21.15.17:0/2506290705 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa268004810 0x7fa268004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:45.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.445+0000 7fa27f7fe700 1 -- 172.21.15.17:0/2506290705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa268003570 con 0x7fa268003a60 2023-10-06T04:43:45.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.446+0000 7fa27f7fe700 1 --2- 172.21.15.17:0/2506290705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa268003a60 0x7fa268003e70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa270009c30 tx=0x7fa2700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40e03de5807fdfb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:45.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.446+0000 7fa27e7fc700 1 -- 172.21.15.17:0/2506290705 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27000e710 con 0x7fa268003a60 2023-10-06T04:43:45.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.446+0000 7fa27e7fc700 1 -- 172.21.15.17:0/2506290705 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27000e870 con 0x7fa268003a60 2023-10-06T04:43:45.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.446+0000 7fa27e7fc700 1 -- 172.21.15.17:0/2506290705 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27000ec30 con 0x7fa268003a60 2023-10-06T04:43:45.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.446+0000 7fa285de3700 1 -- 172.21.15.17:0/2506290705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa268003a60 msgr2=0x7fa268003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:45.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.446+0000 7fa285de3700 1 --2- 172.21.15.17:0/2506290705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa268003a60 0x7fa268003e70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa270009c30 tx=0x7fa2700091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:45.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.446+0000 7fa27ffff700 1 -- 172.21.15.17:0/2506290705 reap_dead start 2023-10-06T04:43:45.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.446+0000 7fa285de3700 1 -- 172.21.15.17:0/2506290705 shutdown_connections 2023-10-06T04:43:45.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.446+0000 7fa285de3700 1 -- 172.21.15.17:0/2506290705 >> 172.21.15.17:0/2506290705 conn(0x7fa28006cff0 msgr2=0x7fa28006d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:45.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.446+0000 7fa285de3700 1 -- 172.21.15.17:0/2506290705 shutdown_connections 2023-10-06T04:43:45.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.446+0000 7fa285de3700 1 -- 172.21.15.17:0/2506290705 wait complete. 2023-10-06T04:43:45.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.448+0000 7fa285de3700 1 Processor -- start 2023-10-06T04:43:45.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.448+0000 7fa285de3700 1 -- start start 2023-10-06T04:43:45.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.448+0000 7fa285de3700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa268003a60 0x7fa2800c7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:45.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.448+0000 7fa285de3700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa2800ca7c0 0x7fa2800b3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:45.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.448+0000 7fa285de3700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2800b3bd0 0x7fa2800b4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:45.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.448+0000 7fa285de3700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28015b930 con 0x7fa2800b3bd0 2023-10-06T04:43:45.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.448+0000 7fa285de3700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2800ca330 con 0x7fa2800ca7c0 2023-10-06T04:43:45.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.448+0000 7fa285de3700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa280153e40 con 0x7fa268003a60 2023-10-06T04:43:45.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.448+0000 7fa27ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2800b3bd0 0x7fa2800b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:45.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.448+0000 7fa27ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2800b3bd0 0x7fa2800b4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42814/0 (socket says 172.21.15.17:42814) 2023-10-06T04:43:45.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.448+0000 7fa27ffff700 1 -- 172.21.15.17:0/712668525 learned_addr learned my addr 172.21.15.17:0/712668525 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:45.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.448+0000 7fa27f7fe700 1 --2- 172.21.15.17:0/712668525 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa268003a60 0x7fa2800c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:45.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.449+0000 7fa27effd700 1 --2- 172.21.15.17:0/712668525 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa2800ca7c0 0x7fa2800b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:45.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.449+0000 7fa27ffff700 1 -- 172.21.15.17:0/712668525 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa268003a60 msgr2=0x7fa2800c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:45.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.449+0000 7fa27ffff700 1 --2- 172.21.15.17:0/712668525 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa268003a60 0x7fa2800c7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:45.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.449+0000 7fa27ffff700 1 -- 172.21.15.17:0/712668525 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa2800ca7c0 msgr2=0x7fa2800b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:45.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.449+0000 7fa27ffff700 1 --2- 172.21.15.17:0/712668525 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa2800ca7c0 0x7fa2800b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:45.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.449+0000 7fa27ffff700 1 -- 172.21.15.17:0/712668525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2800b4560 con 0x7fa2800b3bd0 2023-10-06T04:43:45.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.449+0000 7fa27ffff700 1 --2- 172.21.15.17:0/712668525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2800b3bd0 0x7fa2800b4020 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa280076990 tx=0x7fa278002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:45.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.449+0000 7fa2677fe700 1 -- 172.21.15.17:0/712668525 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27800ad40 con 0x7fa2800b3bd0 2023-10-06T04:43:45.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.449+0000 7fa2677fe700 1 -- 172.21.15.17:0/712668525 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2780133f0 con 0x7fa2800b3bd0 2023-10-06T04:43:45.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.449+0000 7fa285de3700 1 -- 172.21.15.17:0/712668525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2800b5f70 con 0x7fa2800b3bd0 2023-10-06T04:43:45.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.449+0000 7fa2677fe700 1 -- 172.21.15.17:0/712668525 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2780137b0 con 0x7fa2800b3bd0 2023-10-06T04:43:45.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.449+0000 7fa285de3700 1 -- 172.21.15.17:0/712668525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2800c9fc0 con 0x7fa2800b3bd0 2023-10-06T04:43:45.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.450+0000 7fa285de3700 1 -- 172.21.15.17:0/712668525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2800ca4a0 con 0x7fa2800b3bd0 2023-10-06T04:43:45.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.450+0000 7fa2677fe700 1 -- 172.21.15.17:0/712668525 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa278013b60 con 0x7fa2800b3bd0 2023-10-06T04:43:45.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.451+0000 7fa2677fe700 1 --2- 172.21.15.17:0/712668525 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa26c066f30 0x7fa26c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:45.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.451+0000 7fa2677fe700 1 -- 172.21.15.17:0/712668525 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa278084f90 con 0x7fa2800b3bd0 2023-10-06T04:43:45.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.451+0000 7fa27f7fe700 1 --2- 172.21.15.17:0/712668525 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa26c066f30 0x7fa26c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:45.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.451+0000 7fa27f7fe700 1 --2- 172.21.15.17:0/712668525 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa26c066f30 0x7fa26c0693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa270009ad0 tx=0x7fa27001a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:45.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.455+0000 7fa2677fe700 1 -- 172.21.15.17:0/712668525 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa2780520a0 con 0x7fa2800b3bd0 2023-10-06T04:43:45.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.692+0000 7fa285de3700 1 -- 172.21.15.17:0/712668525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa280063ff0 con 0x7fa2800b3bd0 2023-10-06T04:43:45.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.692+0000 7fa2677fe700 1 -- 172.21.15.17:0/712668525 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa2780556c0 con 0x7fa2800b3bd0 2023-10-06T04:43:45.694 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T04:43:45.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.694+0000 7fa285de3700 1 -- 172.21.15.17:0/712668525 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa26c066f30 msgr2=0x7fa26c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:45.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.694+0000 7fa285de3700 1 --2- 172.21.15.17:0/712668525 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa26c066f30 0x7fa26c0693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa270009ad0 tx=0x7fa27001a000 comp rx=0 tx=0).stop 2023-10-06T04:43:45.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.694+0000 7fa285de3700 1 -- 172.21.15.17:0/712668525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2800b3bd0 msgr2=0x7fa2800b4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:45.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.694+0000 7fa285de3700 1 --2- 172.21.15.17:0/712668525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2800b3bd0 0x7fa2800b4020 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa280076990 tx=0x7fa278002210 comp rx=0 tx=0).stop 2023-10-06T04:43:45.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.694+0000 7fa285de3700 1 -- 172.21.15.17:0/712668525 shutdown_connections 2023-10-06T04:43:45.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.694+0000 7fa285de3700 1 --2- 172.21.15.17:0/712668525 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa26c066f30 0x7fa26c0693e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:45.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.694+0000 7fa285de3700 1 --2- 172.21.15.17:0/712668525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2800b3bd0 0x7fa2800b4020 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:45.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.694+0000 7fa285de3700 1 --2- 172.21.15.17:0/712668525 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa268003a60 0x7fa2800c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:45.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.694+0000 7fa285de3700 1 --2- 172.21.15.17:0/712668525 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa2800ca7c0 0x7fa2800b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:45.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.694+0000 7fa285de3700 1 -- 172.21.15.17:0/712668525 >> 172.21.15.17:0/712668525 conn(0x7fa28006cff0 msgr2=0x7fa2800b0320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:45.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.695+0000 7fa285de3700 1 -- 172.21.15.17:0/712668525 shutdown_connections 2023-10-06T04:43:45.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:45.695+0000 7fa285de3700 1 -- 172.21.15.17:0/712668525 wait complete. 2023-10-06T04:43:45.708 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T04:43:45.708 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:43:45.708 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2023-10-06T04:43:45.708 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T04:43:45.708 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T04:43:45.709 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T04:43:45.709 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T04:43:45.709 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:43:45.709 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:43:45.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:45.709 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2023-10-06T04:43:45.724 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:43:45.724 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:43:45.724 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:43:45.724 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:43:45.725 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2023-10-06T04:43:45.725 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:43:45.725 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:43:45.725 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:43:45.725 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2023-10-06T04:43:45.725 INFO:teuthology.orchestra.run.smithi017.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:43:45.725 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:43:45.725 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2023-10-06T04:43:45.725 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T04:43:45.725 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 42471sec preferred_lft 42471sec 2023-10-06T04:43:45.726 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link noprefixroute 2023-10-06T04:43:45.726 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:43:45.726 INFO:teuthology.orchestra.run.smithi017.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:43:45.726 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:43:45.726 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2023-10-06T04:43:45.726 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:43:45.726 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:43:45.727 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2023-10-06T04:43:45.727 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T04:43:45.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:45.728 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-10-06T04:43:45.728 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-10-06T04:43:45.729 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add name ceph-brx type bridge 2023-10-06T04:43:45.729 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr flush dev ceph-brx 2023-10-06T04:43:45.729 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set ceph-brx up 2023-10-06T04:43:45.729 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T04:43:45.730 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-10-06T04:43:45.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:45.891 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:43:45.934 INFO:teuthology.orchestra.run.smithi017.stdout:1 2023-10-06T04:43:45.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:45.936 DEBUG:teuthology.orchestra.run.smithi017:> route 2023-10-06T04:43:46.002 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2023-10-06T04:43:46.002 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:43:46.002 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T04:43:46.003 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T04:43:46.003 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:43:46.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:46.003 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-10-06T04:43:46.003 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-10-06T04:43:46.004 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T04:43:46.004 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T04:43:46.004 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T04:43:46.004 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-10-06T04:43:46.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:46.275 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2023-10-06T04:43:46.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:46.290 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list-id 2023-10-06T04:43:46.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:46.345 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-10-06T04:43:46.345 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-10-06T04:43:46.345 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T04:43:46.346 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-06T04:43:46.346 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-10-06T04:43:46.437 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-06T04:43:46.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:46.438 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-10-06T04:43:46.438 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-10-06T04:43:46.438 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-06T04:43:46.438 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T04:43:46.438 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-06T04:43:46.438 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-06T04:43:46.438 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-06T04:43:46.438 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-10-06T04:43:46.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:46.637 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-10-06T04:43:46.637 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-10-06T04:43:46.638 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2023-10-06T04:43:46.638 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T04:43:46.638 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-10-06T04:43:46.731 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:43:46.731 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T04:43:46.746 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:43:46.746 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:43:46.746 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T04:43:46.801 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T04:43:46.801 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:43:46.801 DEBUG:teuthology.orchestra.run.smithi017:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T04:43:46.904 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T04:43:46.904 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T04:43:46.904 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-10-06T04:43:46.979 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T04:43:46.979 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T04:43:46.979 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-10-06T04:43:46.979 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.136:3300,172.21.15.136:3301" 2023-10-06T04:43:46.979 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:43:47.002 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T04:43:47.002 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T04:43:47.002 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-10-06T04:43:47.002 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.136:3300,172.21.15.136:3301" 2023-10-06T04:43:47.002 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:43:47.002 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:6789,172.21.15.136:6789,172.21.15.136:6790" 2023-10-06T04:43:47.002 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.17:6789,172.21.15.136:6789,172.21.15.136:6790:/ 2023-10-06T04:43:47.002 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=780777c4-2b25-4d35-9058-c9f2d62e3ad9" will pass to kernel 2023-10-06T04:43:47.004 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T04:43:47.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:47.005 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T04:43:47.030 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-10-06T04:43:47.030 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:43:47.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.187+0000 7f1f7232e700 1 Processor -- start 2023-10-06T04:43:47.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.187+0000 7f1f7232e700 1 -- start start 2023-10-06T04:43:47.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.188+0000 7f1f7232e700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f6c0cd760 0x7f1f6c0ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:47.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.188+0000 7f1f7232e700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1f6c0ce840 0x7f1f6c0b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:47.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.188+0000 7f1f7232e700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f6c0cfc80 con 0x7f1f6c159630 2023-10-06T04:43:47.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.188+0000 7f1f7232e700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f6c0cf070 con 0x7f1f6c0ce840 2023-10-06T04:43:47.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.188+0000 7f1f7232e700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c0cf350 con 0x7f1f6c0cd760 2023-10-06T04:43:47.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.188+0000 7f1f708cb700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1f6c0ce840 0x7f1f6c0b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:47.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.188+0000 7f1f708cb700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1f6c0ce840 0x7f1f6c0b02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42830/0 (socket says 172.21.15.17:42830) 2023-10-06T04:43:47.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.188+0000 7f1f708cb700 1 -- 172.21.15.17:0/2678379751 learned_addr learned my addr 172.21.15.17:0/2678379751 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:47.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.188+0000 7f1f6b7fe700 1 --2- 172.21.15.17:0/2678379751 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f6c0cd760 0x7f1f6c0ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:47.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.188+0000 7f1f708cb700 1 -- 172.21.15.17:0/2678379751 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f6c0cd760 msgr2=0x7f1f6c0ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:47.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.189+0000 7f1f708cb700 1 --2- 172.21.15.17:0/2678379751 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f6c0cd760 0x7f1f6c0ce300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:47.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.189+0000 7f1f708cb700 1 -- 172.21.15.17:0/2678379751 >> v1:172.21.15.136:6789/0 conn(0x7f1f6c159630 legacy=0x7f1f6c0cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:47.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.189+0000 7f1f708cb700 1 -- 172.21.15.17:0/2678379751 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f6c0cf630 con 0x7f1f6c0ce840 2023-10-06T04:43:47.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.189+0000 7f1f708cb700 1 --2- 172.21.15.17:0/2678379751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f6c0ce840 0x7f1f6c0b02d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1f64009f20 tx=0x7f1f64009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e52c49b46888273d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:47.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.189+0000 7f1f6affd700 1 -- 172.21.15.17:0/2678379751 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6400e070 con 0x7f1f6c0ce840 2023-10-06T04:43:47.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.189+0000 7f1f6affd700 1 -- 172.21.15.17:0/2678379751 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f6400b9d0 con 0x7f1f6c0ce840 2023-10-06T04:43:47.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.189+0000 7f1f6affd700 1 -- 172.21.15.17:0/2678379751 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f640092e0 con 0x7f1f6c0ce840 2023-10-06T04:43:47.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.189+0000 7f1f7232e700 1 -- 172.21.15.17:0/2678379751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f6c0ce840 msgr2=0x7f1f6c0b02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:47.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.189+0000 7f1f7232e700 1 --2- 172.21.15.17:0/2678379751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f6c0ce840 0x7f1f6c0b02d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1f64009f20 tx=0x7f1f64009840 comp rx=0 tx=0).stop 2023-10-06T04:43:47.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.189+0000 7f1f7232e700 1 -- 172.21.15.17:0/2678379751 shutdown_connections 2023-10-06T04:43:47.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.189+0000 7f1f7232e700 1 --2- 172.21.15.17:0/2678379751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f6c0ce840 0x7f1f6c0b02d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:47.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.189+0000 7f1f7232e700 1 --2- 172.21.15.17:0/2678379751 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f6c0cd760 0x7f1f6c0ce300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:47.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.189+0000 7f1f7232e700 1 -- 172.21.15.17:0/2678379751 >> 172.21.15.17:0/2678379751 conn(0x7f1f6c06cff0 msgr2=0x7f1f6c06d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:47.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.189+0000 7f1f7232e700 1 -- 172.21.15.17:0/2678379751 shutdown_connections 2023-10-06T04:43:47.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.189+0000 7f1f7232e700 1 -- 172.21.15.17:0/2678379751 wait complete. 2023-10-06T04:43:47.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.191+0000 7f1f7232e700 1 Processor -- start 2023-10-06T04:43:47.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.191+0000 7f1f7232e700 1 -- start start 2023-10-06T04:43:47.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.191+0000 7f1f7232e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f6c0cd760 0x7f1f6c149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:47.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.191+0000 7f1f7232e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f6c0ce840 0x7f1f6c15c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:47.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.191+0000 7f1f7232e700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f6c159630 0x7f1f6c0b0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:47.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.191+0000 7f1f7232e700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c1496d0 con 0x7f1f6c0ce840 2023-10-06T04:43:47.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.191+0000 7f1f7232e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c15bb80 con 0x7f1f6c0cd760 2023-10-06T04:43:47.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.191+0000 7f1f7232e700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c15af70 con 0x7f1f6c159630 2023-10-06T04:43:47.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.192+0000 7f1f6b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f6c0ce840 0x7f1f6c15c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:47.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.192+0000 7f1f6b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f6c0ce840 0x7f1f6c15c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42840/0 (socket says 172.21.15.17:42840) 2023-10-06T04:43:47.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.192+0000 7f1f6b7fe700 1 -- 172.21.15.17:0/3187639388 learned_addr learned my addr 172.21.15.17:0/3187639388 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:47.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.192+0000 7f1f708cb700 1 --2- 172.21.15.17:0/3187639388 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f6c159630 0x7f1f6c0b0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:47.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.192+0000 7f1f6bfff700 1 --2- 172.21.15.17:0/3187639388 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f6c0cd760 0x7f1f6c149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:47.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.192+0000 7f1f6b7fe700 1 -- 172.21.15.17:0/3187639388 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f6c159630 msgr2=0x7f1f6c0b0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:47.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.192+0000 7f1f6b7fe700 1 --2- 172.21.15.17:0/3187639388 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f6c159630 0x7f1f6c0b0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:47.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.192+0000 7f1f6b7fe700 1 -- 172.21.15.17:0/3187639388 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f6c0cd760 msgr2=0x7f1f6c149190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:47.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.192+0000 7f1f6b7fe700 1 --2- 172.21.15.17:0/3187639388 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f6c0cd760 0x7f1f6c149190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:47.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.192+0000 7f1f6b7fe700 1 -- 172.21.15.17:0/3187639388 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f64009ae0 con 0x7f1f6c0ce840 2023-10-06T04:43:47.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.192+0000 7f1f6bfff700 1 --2- 172.21.15.17:0/3187639388 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f6c0cd760 0x7f1f6c149190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:43:47.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.192+0000 7f1f6b7fe700 1 --2- 172.21.15.17:0/3187639388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f6c0ce840 0x7f1f6c15c2c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1f5400ec80 tx=0x7f1f540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:47.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.192+0000 7f1f63fff700 1 -- 172.21.15.17:0/3187639388 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5400c9d0 con 0x7f1f6c0ce840 2023-10-06T04:43:47.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.192+0000 7f1f63fff700 1 -- 172.21.15.17:0/3187639388 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f5400cb30 con 0x7f1f6c0ce840 2023-10-06T04:43:47.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.192+0000 7f1f7232e700 1 -- 172.21.15.17:0/3187639388 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f6c15b250 con 0x7f1f6c0ce840 2023-10-06T04:43:47.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.192+0000 7f1f63fff700 1 -- 172.21.15.17:0/3187639388 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f54013470 con 0x7f1f6c0ce840 2023-10-06T04:43:47.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.192+0000 7f1f7232e700 1 -- 172.21.15.17:0/3187639388 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f6c15b810 con 0x7f1f6c0ce840 2023-10-06T04:43:47.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.193+0000 7f1f7232e700 1 -- 172.21.15.17:0/3187639388 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f6c0c76e0 con 0x7f1f6c0ce840 2023-10-06T04:43:47.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.194+0000 7f1f63fff700 1 -- 172.21.15.17:0/3187639388 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1f540137e0 con 0x7f1f6c0ce840 2023-10-06T04:43:47.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.194+0000 7f1f63fff700 1 --2- 172.21.15.17:0/3187639388 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1f4c066f30 0x7f1f4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:47.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.194+0000 7f1f63fff700 1 -- 172.21.15.17:0/3187639388 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1f54084a60 con 0x7f1f6c0ce840 2023-10-06T04:43:47.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.194+0000 7f1f6bfff700 1 --2- 172.21.15.17:0/3187639388 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1f4c066f30 0x7f1f4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:47.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.194+0000 7f1f6bfff700 1 --2- 172.21.15.17:0/3187639388 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1f4c066f30 0x7f1f4c0693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c0c67d0 tx=0x7f1f5c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:47.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.198+0000 7f1f63fff700 1 -- 172.21.15.17:0/3187639388 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1f54051b70 con 0x7f1f6c0ce840 2023-10-06T04:43:47.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.441+0000 7f1f7232e700 1 -- 172.21.15.17:0/3187639388 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1f6c063ff0 con 0x7f1f6c0ce840 2023-10-06T04:43:47.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.441+0000 7f1f63fff700 1 -- 172.21.15.17:0/3187639388 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1f54055190 con 0x7f1f6c0ce840 2023-10-06T04:43:47.443 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T04:43:47.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.443+0000 7f1f7232e700 1 -- 172.21.15.17:0/3187639388 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1f4c066f30 msgr2=0x7f1f4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:47.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.443+0000 7f1f7232e700 1 --2- 172.21.15.17:0/3187639388 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1f4c066f30 0x7f1f4c0693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c0c67d0 tx=0x7f1f5c009040 comp rx=0 tx=0).stop 2023-10-06T04:43:47.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.443+0000 7f1f7232e700 1 -- 172.21.15.17:0/3187639388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f6c0ce840 msgr2=0x7f1f6c15c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:47.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.443+0000 7f1f7232e700 1 --2- 172.21.15.17:0/3187639388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f6c0ce840 0x7f1f6c15c2c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1f5400ec80 tx=0x7f1f540091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:47.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.443+0000 7f1f7232e700 1 -- 172.21.15.17:0/3187639388 shutdown_connections 2023-10-06T04:43:47.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.443+0000 7f1f7232e700 1 --2- 172.21.15.17:0/3187639388 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1f4c066f30 0x7f1f4c0693e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:47.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.443+0000 7f1f7232e700 1 --2- 172.21.15.17:0/3187639388 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f6c159630 0x7f1f6c0b0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:47.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.443+0000 7f1f7232e700 1 --2- 172.21.15.17:0/3187639388 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f6c0cd760 0x7f1f6c149190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:47.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.443+0000 7f1f7232e700 1 --2- 172.21.15.17:0/3187639388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f6c0ce840 0x7f1f6c15c2c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:47.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.443+0000 7f1f7232e700 1 -- 172.21.15.17:0/3187639388 >> 172.21.15.17:0/3187639388 conn(0x7f1f6c06cff0 msgr2=0x7f1f6c153c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:47.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.444+0000 7f1f7232e700 1 -- 172.21.15.17:0/3187639388 shutdown_connections 2023-10-06T04:43:47.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:47.444+0000 7f1f7232e700 1 -- 172.21.15.17:0/3187639388 wait complete. 2023-10-06T04:43:47.457 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T04:43:47.457 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:43:47.457 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2023-10-06T04:43:47.457 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-06T04:43:47.457 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-06T04:43:47.458 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T04:43:47.458 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T04:43:47.458 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:43:47.458 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-06T04:43:47.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:47.458 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2023-10-06T04:43:47.473 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:43:47.474 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:43:47.474 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:43:47.474 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:43:47.474 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2023-10-06T04:43:47.474 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:43:47.474 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:43:47.474 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:43:47.474 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2023-10-06T04:43:47.474 INFO:teuthology.orchestra.run.smithi017.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:43:47.474 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:43:47.475 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2023-10-06T04:43:47.475 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T04:43:47.475 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 42470sec preferred_lft 42470sec 2023-10-06T04:43:47.475 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link noprefixroute 2023-10-06T04:43:47.475 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:43:47.475 INFO:teuthology.orchestra.run.smithi017.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:43:47.475 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:43:47.475 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2023-10-06T04:43:47.475 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:43:47.475 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:43:47.475 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2023-10-06T04:43:47.476 INFO:teuthology.orchestra.run.smithi017.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:43:47.476 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 76:58:b8:0a:23:ad brd ff:ff:ff:ff:ff:ff 2023-10-06T04:43:47.476 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T04:43:47.476 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:43:47.476 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::dc99:b6ff:fe76:4553/64 scope link tentative 2023-10-06T04:43:47.476 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:43:47.476 INFO:teuthology.orchestra.run.smithi017.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T04:43:47.476 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 76:58:b8:0a:23:ad brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T04:43:47.476 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::7458:b8ff:fe0a:23ad/64 scope link tentative 2023-10-06T04:43:47.476 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:43:47.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:47.477 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:43:47.537 INFO:teuthology.orchestra.run.smithi017.stdout:1 2023-10-06T04:43:47.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:47.539 DEBUG:teuthology.orchestra.run.smithi017:> route 2023-10-06T04:43:47.596 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2023-10-06T04:43:47.596 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:43:47.596 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T04:43:47.597 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T04:43:47.597 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:43:47.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:47.597 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-10-06T04:43:47.597 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-10-06T04:43:47.597 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T04:43:47.597 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T04:43:47.597 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T04:43:47.598 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-10-06T04:43:47.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:47.699 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2023-10-06T04:43:47.714 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T04:43:47.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:47.714 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list-id 2023-10-06T04:43:47.770 INFO:teuthology.orchestra.run.smithi017.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-06T04:43:47.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:47.771 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-10-06T04:43:47.771 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-10-06T04:43:47.771 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T04:43:47.771 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-06T04:43:47.771 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-10-06T04:43:47.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:47.861 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T04:43:47.897 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:43:47.897 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:43:47.897 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:43:47.898 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:43:47.898 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2023-10-06T04:43:47.898 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:43:47.898 INFO:teuthology.orchestra.run.smithi017.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:43:47.898 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether b6:a9:07:af:90:b0 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T04:43:47.898 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T04:43:47.898 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:43:47.899 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::b4a9:7ff:feaf:90b0/64 scope link tentative 2023-10-06T04:43:47.899 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:43:47.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:47.910 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T04:43:47.991 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:43:47.991 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:43:47.991 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:43:47.991 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:43:47.992 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2023-10-06T04:43:47.992 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:43:47.992 INFO:teuthology.orchestra.run.smithi017.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:43:47.992 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether b6:a9:07:af:90:b0 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T04:43:47.992 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T04:43:47.993 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:43:47.993 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::b4a9:7ff:feaf:90b0/64 scope link 2023-10-06T04:43:47.993 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:43:48.007 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-06T04:43:48.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:48.007 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-10-06T04:43:48.007 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-10-06T04:43:48.008 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-06T04:43:48.008 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T04:43:48.008 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-06T04:43:48.008 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-06T04:43:48.008 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-06T04:43:48.009 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-10-06T04:43:48.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:48.224 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-10-06T04:43:48.225 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-10-06T04:43:48.225 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.1 up 2023-10-06T04:43:48.225 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T04:43:48.225 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-10-06T04:43:48.306 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:43:48.306 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-06T04:43:48.321 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-06T04:43:48.322 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:43:48.322 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-06T04:43:48.376 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T04:43:48.376 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:43:48.376 DEBUG:teuthology.orchestra.run.smithi017:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-06T04:43:48.457 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-06T04:43:48.457 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-06T04:43:48.458 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-10-06T04:43:48.466 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-06T04:43:48.466 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-06T04:43:48.466 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-10-06T04:43:48.466 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.136:3300,172.21.15.136:3301" 2023-10-06T04:43:48.466 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:43:48.489 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-06T04:43:48.489 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-06T04:43:48.489 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-10-06T04:43:48.489 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.136:3300,172.21.15.136:3301" 2023-10-06T04:43:48.489 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:43:48.489 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:6789,172.21.15.136:6789,172.21.15.136:6790" 2023-10-06T04:43:48.490 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.17:6789,172.21.15.136:6789,172.21.15.136:6790:/ 2023-10-06T04:43:48.490 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=780777c4-2b25-4d35-9058-c9f2d62e3ad9" will pass to kernel 2023-10-06T04:43:48.491 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T04:43:48.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:48.492 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-06T04:43:48.556 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-10-06T04:43:48.557 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:43:48.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.713+0000 7ff22736a700 1 Processor -- start 2023-10-06T04:43:48.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.714+0000 7ff22736a700 1 -- start start 2023-10-06T04:43:48.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.714+0000 7ff22736a700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff2201575d0 0x7ff220067ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:48.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.714+0000 7ff22736a700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff22015bcb0 con 0x7ff22006cd50 2023-10-06T04:43:48.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.714+0000 7ff22736a700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2200ae460 con 0x7ff2201579a0 2023-10-06T04:43:48.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.714+0000 7ff22736a700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff22006d190 con 0x7ff2201575d0 2023-10-06T04:43:48.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.714+0000 7ff225907700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7ff22006cd50 0x7ff2200abfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55386/0 (socket says 172.21.15.17:55386) 2023-10-06T04:43:48.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.714+0000 7ff225907700 1 -- 172.21.15.17:0/1266449793 learned_addr learned my addr 172.21.15.17:0/1266449793 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:48.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.715+0000 7ff225106700 1 --2- 172.21.15.17:0/1266449793 >> v2:172.21.15.136:3300/0 conn(0x7ff2201575d0 0x7ff220067ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:48.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.715+0000 7ff213fff700 1 -- 172.21.15.17:0/1266449793 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3091349424 0 0) 0x7ff22015bcb0 con 0x7ff22006cd50 2023-10-06T04:43:48.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.715+0000 7ff213fff700 1 -- 172.21.15.17:0/1266449793 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff20c003570 con 0x7ff22006cd50 2023-10-06T04:43:48.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.715+0000 7ff213fff700 1 -- 172.21.15.17:0/1266449793 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3720167935 0 0) 0x7ff2200ae460 con 0x7ff2201579a0 2023-10-06T04:43:48.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.715+0000 7ff213fff700 1 -- 172.21.15.17:0/1266449793 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff22015bcb0 con 0x7ff2201579a0 2023-10-06T04:43:48.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.715+0000 7ff225106700 1 -- 172.21.15.17:0/1266449793 >> v1:172.21.15.136:6789/0 conn(0x7ff2201579a0 legacy=0x7ff22006c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:48.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.715+0000 7ff225106700 1 -- 172.21.15.17:0/1266449793 >> v1:172.21.15.17:6789/0 conn(0x7ff22006cd50 legacy=0x7ff2200abfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:48.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.715+0000 7ff213fff700 1 -- 172.21.15.17:0/1266449793 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3768648973 0 0) 0x7ff20c003570 con 0x7ff22006cd50 2023-10-06T04:43:48.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.715+0000 7ff225106700 1 -- 172.21.15.17:0/1266449793 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff22006d390 con 0x7ff2201575d0 2023-10-06T04:43:48.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.715+0000 7ff225106700 1 --2- 172.21.15.17:0/1266449793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff2201575d0 0x7ff220067ce0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff2140098e0 tx=0x7ff2140091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f3a48a93a09da4f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:48.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.715+0000 7ff213fff700 1 -- 172.21.15.17:0/1266449793 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2180017f0 con 0x7ff2201575d0 2023-10-06T04:43:48.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.715+0000 7ff213fff700 1 -- 172.21.15.17:0/1266449793 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff214011420 con 0x7ff2201575d0 2023-10-06T04:43:48.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.715+0000 7ff213fff700 1 -- 172.21.15.17:0/1266449793 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2140117c0 con 0x7ff2201575d0 2023-10-06T04:43:48.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.716+0000 7ff22736a700 1 -- 172.21.15.17:0/1266449793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff2201575d0 msgr2=0x7ff220067ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:48.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.716+0000 7ff22736a700 1 --2- 172.21.15.17:0/1266449793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff2201575d0 0x7ff220067ce0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff2140098e0 tx=0x7ff2140091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:48.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.716+0000 7ff22736a700 1 -- 172.21.15.17:0/1266449793 shutdown_connections 2023-10-06T04:43:48.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.716+0000 7ff22736a700 1 --2- 172.21.15.17:0/1266449793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff2201575d0 0x7ff220067ce0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:48.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.716+0000 7ff22736a700 1 -- 172.21.15.17:0/1266449793 >> 172.21.15.17:0/1266449793 conn(0x7ff2200ccae0 msgr2=0x7ff2200ccee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:48.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.716+0000 7ff22736a700 1 -- 172.21.15.17:0/1266449793 shutdown_connections 2023-10-06T04:43:48.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.716+0000 7ff22736a700 1 -- 172.21.15.17:0/1266449793 wait complete. 2023-10-06T04:43:48.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.717+0000 7ff22736a700 1 Processor -- start 2023-10-06T04:43:48.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.717+0000 7ff22736a700 1 -- start start 2023-10-06T04:43:48.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.718+0000 7ff22736a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff22006cd50 0x7ff220152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:48.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.718+0000 7ff22736a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff2201575d0 0x7ff220155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:48.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.718+0000 7ff22736a700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff2201579a0 0x7ff220155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:48.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.718+0000 7ff22736a700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2200c4a20 con 0x7ff22006cd50 2023-10-06T04:43:48.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.718+0000 7ff22736a700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff220153cc0 con 0x7ff2201575d0 2023-10-06T04:43:48.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.718+0000 7ff22736a700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2200c4fa0 con 0x7ff2201579a0 2023-10-06T04:43:48.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.718+0000 7ff225106700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff22006cd50 0x7ff220152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:48.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.718+0000 7ff225106700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff22006cd50 0x7ff220152270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42852/0 (socket says 172.21.15.17:42852) 2023-10-06T04:43:48.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.718+0000 7ff225106700 1 -- 172.21.15.17:0/2326047426 learned_addr learned my addr 172.21.15.17:0/2326047426 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:48.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.718+0000 7ff224905700 1 --2- 172.21.15.17:0/2326047426 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff2201575d0 0x7ff220155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:48.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.718+0000 7ff225907700 1 --2- 172.21.15.17:0/2326047426 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff2201579a0 0x7ff220155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:48.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.718+0000 7ff225106700 1 -- 172.21.15.17:0/2326047426 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff2201579a0 msgr2=0x7ff220155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:48.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.718+0000 7ff225106700 1 --2- 172.21.15.17:0/2326047426 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff2201579a0 0x7ff220155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:48.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.719+0000 7ff225106700 1 -- 172.21.15.17:0/2326047426 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff2201575d0 msgr2=0x7ff220155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:48.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.719+0000 7ff225106700 1 --2- 172.21.15.17:0/2326047426 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff2201575d0 0x7ff220155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:48.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.719+0000 7ff225106700 1 -- 172.21.15.17:0/2326047426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff214009420 con 0x7ff22006cd50 2023-10-06T04:43:48.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.719+0000 7ff224905700 1 --2- 172.21.15.17:0/2326047426 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff2201575d0 0x7ff220155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:43:48.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.719+0000 7ff225106700 1 --2- 172.21.15.17:0/2326047426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff22006cd50 0x7ff220152270 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff2200cc710 tx=0x7ff214016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:48.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.719+0000 7ff2117fa700 1 -- 172.21.15.17:0/2326047426 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21401cc90 con 0x7ff22006cd50 2023-10-06T04:43:48.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.719+0000 7ff2117fa700 1 -- 172.21.15.17:0/2326047426 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21401cdf0 con 0x7ff22006cd50 2023-10-06T04:43:48.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.719+0000 7ff22736a700 1 -- 172.21.15.17:0/2326047426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2201527b0 con 0x7ff22006cd50 2023-10-06T04:43:48.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.719+0000 7ff2117fa700 1 -- 172.21.15.17:0/2326047426 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21401a6a0 con 0x7ff22006cd50 2023-10-06T04:43:48.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.719+0000 7ff22736a700 1 -- 172.21.15.17:0/2326047426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff22015ae20 con 0x7ff22006cd50 2023-10-06T04:43:48.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.720+0000 7ff22736a700 1 -- 172.21.15.17:0/2326047426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff220063ff0 con 0x7ff22006cd50 2023-10-06T04:43:48.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.720+0000 7ff2117fa700 1 -- 172.21.15.17:0/2326047426 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff21401aa90 con 0x7ff22006cd50 2023-10-06T04:43:48.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.721+0000 7ff2117fa700 1 --2- 172.21.15.17:0/2326047426 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff204066f30 0x7ff2040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:48.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.721+0000 7ff2117fa700 1 -- 172.21.15.17:0/2326047426 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff2140860a0 con 0x7ff22006cd50 2023-10-06T04:43:48.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.721+0000 7ff224905700 1 --2- 172.21.15.17:0/2326047426 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff204066f30 0x7ff2040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:48.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.721+0000 7ff224905700 1 --2- 172.21.15.17:0/2326047426 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff204066f30 0x7ff2040693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff2200abf20 tx=0x7ff21c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:48.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.725+0000 7ff2117fa700 1 -- 172.21.15.17:0/2326047426 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff2140531b0 con 0x7ff22006cd50 2023-10-06T04:43:48.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.963+0000 7ff22736a700 1 -- 172.21.15.17:0/2326047426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff22015b380 con 0x7ff22006cd50 2023-10-06T04:43:48.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.963+0000 7ff2117fa700 1 -- 172.21.15.17:0/2326047426 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff2140567d0 con 0x7ff22006cd50 2023-10-06T04:43:48.965 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T04:43:48.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.965+0000 7ff22736a700 1 -- 172.21.15.17:0/2326047426 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff204066f30 msgr2=0x7ff2040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:48.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.965+0000 7ff22736a700 1 --2- 172.21.15.17:0/2326047426 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff204066f30 0x7ff2040693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff2200abf20 tx=0x7ff21c009040 comp rx=0 tx=0).stop 2023-10-06T04:43:48.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.965+0000 7ff22736a700 1 -- 172.21.15.17:0/2326047426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff22006cd50 msgr2=0x7ff220152270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:48.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.965+0000 7ff22736a700 1 --2- 172.21.15.17:0/2326047426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff22006cd50 0x7ff220152270 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff2200cc710 tx=0x7ff214016000 comp rx=0 tx=0).stop 2023-10-06T04:43:48.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.966+0000 7ff22736a700 1 -- 172.21.15.17:0/2326047426 shutdown_connections 2023-10-06T04:43:48.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.966+0000 7ff22736a700 1 --2- 172.21.15.17:0/2326047426 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff204066f30 0x7ff2040693e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:48.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.966+0000 7ff22736a700 1 --2- 172.21.15.17:0/2326047426 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff2201579a0 0x7ff220155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:48.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.966+0000 7ff22736a700 1 --2- 172.21.15.17:0/2326047426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff22006cd50 0x7ff220152270 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:48.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.966+0000 7ff22736a700 1 --2- 172.21.15.17:0/2326047426 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff2201575d0 0x7ff220155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:48.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.966+0000 7ff22736a700 1 -- 172.21.15.17:0/2326047426 >> 172.21.15.17:0/2326047426 conn(0x7ff2200ccae0 msgr2=0x7ff2201564a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:48.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.966+0000 7ff22736a700 1 -- 172.21.15.17:0/2326047426 shutdown_connections 2023-10-06T04:43:48.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:48.966+0000 7ff22736a700 1 -- 172.21.15.17:0/2326047426 wait complete. 2023-10-06T04:43:48.979 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T04:43:48.979 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:43:48.979 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi136.front.sepia.ceph.com 2023-10-06T04:43:48.979 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T04:43:48.979 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T04:43:48.980 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T04:43:48.980 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T04:43:48.980 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:43:48.980 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T04:43:48.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:48.980 DEBUG:teuthology.orchestra.run.smithi136:> ip addr 2023-10-06T04:43:48.998 INFO:teuthology.orchestra.run.smithi136.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:43:48.999 INFO:teuthology.orchestra.run.smithi136.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:43:48.999 INFO:teuthology.orchestra.run.smithi136.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:43:48.999 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:43:48.999 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 ::1/128 scope host 2023-10-06T04:43:48.999 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:43:48.999 INFO:teuthology.orchestra.run.smithi136.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:43:48.999 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:d9:3b:1a brd ff:ff:ff:ff:ff:ff 2023-10-06T04:43:48.999 INFO:teuthology.orchestra.run.smithi136.stdout: altname enp7s0f0 2023-10-06T04:43:48.999 INFO:teuthology.orchestra.run.smithi136.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:43:48.999 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:d9:3b:1b brd ff:ff:ff:ff:ff:ff 2023-10-06T04:43:49.000 INFO:teuthology.orchestra.run.smithi136.stdout: altname enp7s0f1 2023-10-06T04:43:49.000 INFO:teuthology.orchestra.run.smithi136.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:43:49.000 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:88:6e:42 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:43:49.000 INFO:teuthology.orchestra.run.smithi136.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:43:49.000 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:88:6e:43 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:43:49.000 INFO:teuthology.orchestra.run.smithi136.stdout: inet 172.21.15.136/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T04:43:49.000 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft 42466sec preferred_lft 42466sec 2023-10-06T04:43:49.000 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::ec4:7aff:fe88:6e43/64 scope link 2023-10-06T04:43:49.000 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:43:49.000 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T04:43:49.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:49.001 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2023-10-06T04:43:49.001 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2023-10-06T04:43:49.001 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link add name ceph-brx type bridge 2023-10-06T04:43:49.001 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip addr flush dev ceph-brx 2023-10-06T04:43:49.001 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set ceph-brx up 2023-10-06T04:43:49.001 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T04:43:49.001 DEBUG:teuthology.orchestra.run.smithi136:> ') 2023-10-06T04:43:49.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:49.164 DEBUG:teuthology.orchestra.run.smithi136:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:43:49.206 INFO:teuthology.orchestra.run.smithi136.stdout:1 2023-10-06T04:43:49.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:49.208 DEBUG:teuthology.orchestra.run.smithi136:> route 2023-10-06T04:43:49.278 INFO:teuthology.orchestra.run.smithi136.stdout:Kernel IP routing table 2023-10-06T04:43:49.278 INFO:teuthology.orchestra.run.smithi136.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:43:49.278 INFO:teuthology.orchestra.run.smithi136.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T04:43:49.278 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T04:43:49.278 INFO:teuthology.orchestra.run.smithi136.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:43:49.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:49.279 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2023-10-06T04:43:49.279 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2023-10-06T04:43:49.279 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T04:43:49.279 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T04:43:49.279 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T04:43:49.279 DEBUG:teuthology.orchestra.run.smithi136:> ') 2023-10-06T04:43:49.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:49.571 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2023-10-06T04:43:49.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:49.586 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list-id 2023-10-06T04:43:49.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:49.640 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2023-10-06T04:43:49.641 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2023-10-06T04:43:49.641 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T04:43:49.641 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-06T04:43:49.641 DEBUG:teuthology.orchestra.run.smithi136:> ') 2023-10-06T04:43:49.731 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-06T04:43:49.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:49.732 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2023-10-06T04:43:49.732 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2023-10-06T04:43:49.732 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-06T04:43:49.732 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T04:43:49.732 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-06T04:43:49.732 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-06T04:43:49.732 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-06T04:43:49.732 DEBUG:teuthology.orchestra.run.smithi136:> ') 2023-10-06T04:43:49.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:49.928 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2023-10-06T04:43:49.929 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2023-10-06T04:43:49.929 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set brx.0 up 2023-10-06T04:43:49.929 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T04:43:49.929 DEBUG:teuthology.orchestra.run.smithi136:> ') 2023-10-06T04:43:50.020 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:43:50.020 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T04:43:50.035 INFO:teuthology.orchestra.run.smithi136.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T04:43:50.035 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:43:50.035 DEBUG:teuthology.orchestra.run.smithi136:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T04:43:50.091 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T04:43:50.091 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:43:50.091 DEBUG:teuthology.orchestra.run.smithi136:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T04:43:50.187 INFO:teuthology.orchestra.run.smithi136.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T04:43:50.188 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-06T04:43:50.188 INFO:teuthology.orchestra.run.smithi136.stdout:invalid new device string format 2023-10-06T04:43:50.263 INFO:teuthology.orchestra.run.smithi136.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T04:43:50.263 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-06T04:43:50.264 INFO:teuthology.orchestra.run.smithi136.stdout:invalid new device string format 2023-10-06T04:43:50.264 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.136:3300,172.21.15.136:3301" 2023-10-06T04:43:50.264 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:43:50.285 INFO:teuthology.orchestra.run.smithi136.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T04:43:50.285 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-06T04:43:50.285 INFO:teuthology.orchestra.run.smithi136.stdout:invalid new device string format 2023-10-06T04:43:50.285 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.136:3300,172.21.15.136:3301" 2023-10-06T04:43:50.285 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:43:50.285 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: resolved to: "172.21.15.17:6789,172.21.15.136:6789,172.21.15.136:6790" 2023-10-06T04:43:50.285 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.17:6789,172.21.15.136:6789,172.21.15.136:6790:/ 2023-10-06T04:43:50.285 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=780777c4-2b25-4d35-9058-c9f2d62e3ad9" will pass to kernel 2023-10-06T04:43:50.288 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T04:43:50.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:50.288 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T04:43:50.314 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-10-06T04:43:50.314 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:43:50.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.446+0000 7fd996f7f700 1 Processor -- start 2023-10-06T04:43:50.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.446+0000 7fd996f7f700 1 -- start start 2023-10-06T04:43:50.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.447+0000 7fd996f7f700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd99015ca80 0x7fd99006e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:50.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.447+0000 7fd996f7f700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd99015ce50 0x7fd99015d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:50.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.447+0000 7fd996f7f700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9900ab250 con 0x7fd99015d910 2023-10-06T04:43:50.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.447+0000 7fd996f7f700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd99006e660 con 0x7fd99015ca80 2023-10-06T04:43:50.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.447+0000 7fd996f7f700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd99006e940 con 0x7fd99015ce50 2023-10-06T04:43:50.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.447+0000 7fd99551c700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fd99015d910 0x7fd9900aefa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55388/0 (socket says 172.21.15.17:55388) 2023-10-06T04:43:50.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.447+0000 7fd99551c700 1 -- 172.21.15.17:0/4176936225 learned_addr learned my addr 172.21.15.17:0/4176936225 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:50.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.447+0000 7fd994d1b700 1 --2- 172.21.15.17:0/4176936225 >> v2:172.21.15.136:3300/0 conn(0x7fd99015ca80 0x7fd99006e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:50.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.447+0000 7fd98ffff700 1 --2- 172.21.15.17:0/4176936225 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd99015ce50 0x7fd99015d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:50.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.447+0000 7fd98f7fe700 1 -- 172.21.15.17:0/4176936225 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3363229520 0 0) 0x7fd9900ab250 con 0x7fd99015d910 2023-10-06T04:43:50.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.447+0000 7fd98f7fe700 1 -- 172.21.15.17:0/4176936225 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd97c003570 con 0x7fd99015d910 2023-10-06T04:43:50.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.447+0000 7fd994d1b700 1 -- 172.21.15.17:0/4176936225 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd99015ce50 msgr2=0x7fd99015d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:50.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.447+0000 7fd994d1b700 1 --2- 172.21.15.17:0/4176936225 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd99015ce50 0x7fd99015d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:50.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.447+0000 7fd994d1b700 1 -- 172.21.15.17:0/4176936225 >> v1:172.21.15.17:6789/0 conn(0x7fd99015d910 legacy=0x7fd9900aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:50.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.447+0000 7fd994d1b700 1 -- 172.21.15.17:0/4176936225 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd99006ec20 con 0x7fd99015ca80 2023-10-06T04:43:50.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.447+0000 7fd98ffff700 1 --2- 172.21.15.17:0/4176936225 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd99015ce50 0x7fd99015d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:43:50.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.448+0000 7fd994d1b700 1 --2- 172.21.15.17:0/4176936225 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd99015ca80 0x7fd99006e050 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd9880098e0 tx=0x7fd9880091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7be336b294ad3011 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:50.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.448+0000 7fd98f7fe700 1 -- 172.21.15.17:0/4176936225 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd988011630 con 0x7fd99015ca80 2023-10-06T04:43:50.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.448+0000 7fd98f7fe700 1 -- 172.21.15.17:0/4176936225 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd988011790 con 0x7fd99015ca80 2023-10-06T04:43:50.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.448+0000 7fd98f7fe700 1 -- 172.21.15.17:0/4176936225 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd988011b30 con 0x7fd99015ca80 2023-10-06T04:43:50.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.448+0000 7fd996f7f700 1 -- 172.21.15.17:0/4176936225 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd99015ca80 msgr2=0x7fd99006e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:50.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.448+0000 7fd996f7f700 1 --2- 172.21.15.17:0/4176936225 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd99015ca80 0x7fd99006e050 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd9880098e0 tx=0x7fd9880091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:50.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.448+0000 7fd996f7f700 1 -- 172.21.15.17:0/4176936225 shutdown_connections 2023-10-06T04:43:50.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.448+0000 7fd996f7f700 1 --2- 172.21.15.17:0/4176936225 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd99015ca80 0x7fd99006e050 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:50.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.448+0000 7fd996f7f700 1 --2- 172.21.15.17:0/4176936225 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd99015ce50 0x7fd99015d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:50.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.448+0000 7fd996f7f700 1 -- 172.21.15.17:0/4176936225 >> 172.21.15.17:0/4176936225 conn(0x7fd99006cd40 msgr2=0x7fd990087fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:50.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.448+0000 7fd996f7f700 1 -- 172.21.15.17:0/4176936225 shutdown_connections 2023-10-06T04:43:50.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.448+0000 7fd996f7f700 1 -- 172.21.15.17:0/4176936225 wait complete. 2023-10-06T04:43:50.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.449+0000 7fd996f7f700 1 Processor -- start 2023-10-06T04:43:50.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.450+0000 7fd996f7f700 1 -- start start 2023-10-06T04:43:50.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.450+0000 7fd996f7f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd99015ca80 0x7fd9900cdc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:50.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.450+0000 7fd996f7f700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd99015ce50 0x7fd99016ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:50.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.450+0000 7fd996f7f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd99015d910 0x7fd9900690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:50.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.450+0000 7fd996f7f700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9900cb010 con 0x7fd99015ca80 2023-10-06T04:43:50.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.450+0000 7fd996f7f700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd99016ab50 con 0x7fd99015d910 2023-10-06T04:43:50.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.450+0000 7fd996f7f700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9900cbc40 con 0x7fd99015ce50 2023-10-06T04:43:50.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.450+0000 7fd994d1b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd99015ca80 0x7fd9900cdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:50.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.451+0000 7fd994d1b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd99015ca80 0x7fd9900cdc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42868/0 (socket says 172.21.15.17:42868) 2023-10-06T04:43:50.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.451+0000 7fd994d1b700 1 -- 172.21.15.17:0/2173182455 learned_addr learned my addr 172.21.15.17:0/2173182455 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:50.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.451+0000 7fd98ffff700 1 --2- 172.21.15.17:0/2173182455 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd99015ce50 0x7fd99016ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:50.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.451+0000 7fd99551c700 1 --2- 172.21.15.17:0/2173182455 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd99015d910 0x7fd9900690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:50.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.451+0000 7fd994d1b700 1 -- 172.21.15.17:0/2173182455 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd99015ce50 msgr2=0x7fd99016ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:50.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.451+0000 7fd994d1b700 1 --2- 172.21.15.17:0/2173182455 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd99015ce50 0x7fd99016ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:50.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.451+0000 7fd994d1b700 1 -- 172.21.15.17:0/2173182455 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd99015d910 msgr2=0x7fd9900690a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:50.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.451+0000 7fd994d1b700 1 --2- 172.21.15.17:0/2173182455 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd99015d910 0x7fd9900690a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:50.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.451+0000 7fd994d1b700 1 -- 172.21.15.17:0/2173182455 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd980009a20 con 0x7fd99015ca80 2023-10-06T04:43:50.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.451+0000 7fd98ffff700 1 --2- 172.21.15.17:0/2173182455 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd99015ce50 0x7fd99016ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:43:50.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.451+0000 7fd99551c700 1 --2- 172.21.15.17:0/2173182455 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd99015d910 0x7fd9900690a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:43:50.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.451+0000 7fd994d1b700 1 --2- 172.21.15.17:0/2173182455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd99015ca80 0x7fd9900cdc70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd99006b110 tx=0x7fd988017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:50.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.451+0000 7fd98cff9700 1 -- 172.21.15.17:0/2173182455 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd988011b10 con 0x7fd99015ca80 2023-10-06T04:43:50.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.451+0000 7fd98cff9700 1 -- 172.21.15.17:0/2173182455 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9880253f0 con 0x7fd99015ca80 2023-10-06T04:43:50.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.451+0000 7fd996f7f700 1 -- 172.21.15.17:0/2173182455 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd988009420 con 0x7fd99015ca80 2023-10-06T04:43:50.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.451+0000 7fd98cff9700 1 -- 172.21.15.17:0/2173182455 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd988025790 con 0x7fd99015ca80 2023-10-06T04:43:50.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.451+0000 7fd996f7f700 1 -- 172.21.15.17:0/2173182455 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9900cb5f0 con 0x7fd99015ca80 2023-10-06T04:43:50.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.452+0000 7fd996f7f700 1 -- 172.21.15.17:0/2173182455 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd990063ff0 con 0x7fd99015ca80 2023-10-06T04:43:50.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.453+0000 7fd98cff9700 1 -- 172.21.15.17:0/2173182455 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd988025b40 con 0x7fd99015ca80 2023-10-06T04:43:50.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.453+0000 7fd98cff9700 1 --2- 172.21.15.17:0/2173182455 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd970066f30 0x7fd9700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:50.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.453+0000 7fd98cff9700 1 -- 172.21.15.17:0/2173182455 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd988085ee0 con 0x7fd99015ca80 2023-10-06T04:43:50.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.453+0000 7fd98ffff700 1 --2- 172.21.15.17:0/2173182455 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd970066f30 0x7fd9700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:50.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.454+0000 7fd98ffff700 1 --2- 172.21.15.17:0/2173182455 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd970066f30 0x7fd9700693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd9900c9d80 tx=0x7fd98000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:50.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.458+0000 7fd98cff9700 1 -- 172.21.15.17:0/2173182455 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd988052ff0 con 0x7fd99015ca80 2023-10-06T04:43:50.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.697+0000 7fd996f7f700 1 -- 172.21.15.17:0/2173182455 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd9900cb3e0 con 0x7fd99015ca80 2023-10-06T04:43:50.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.697+0000 7fd98cff9700 1 -- 172.21.15.17:0/2173182455 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd988056610 con 0x7fd99015ca80 2023-10-06T04:43:50.701 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T04:43:50.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.699+0000 7fd996f7f700 1 -- 172.21.15.17:0/2173182455 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd970066f30 msgr2=0x7fd9700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:50.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.699+0000 7fd996f7f700 1 --2- 172.21.15.17:0/2173182455 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd970066f30 0x7fd9700693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd9900c9d80 tx=0x7fd98000b040 comp rx=0 tx=0).stop 2023-10-06T04:43:50.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.699+0000 7fd996f7f700 1 -- 172.21.15.17:0/2173182455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd99015ca80 msgr2=0x7fd9900cdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:50.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.699+0000 7fd996f7f700 1 --2- 172.21.15.17:0/2173182455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd99015ca80 0x7fd9900cdc70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd99006b110 tx=0x7fd988017000 comp rx=0 tx=0).stop 2023-10-06T04:43:50.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.699+0000 7fd996f7f700 1 -- 172.21.15.17:0/2173182455 shutdown_connections 2023-10-06T04:43:50.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.699+0000 7fd996f7f700 1 --2- 172.21.15.17:0/2173182455 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd970066f30 0x7fd9700693e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:50.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.699+0000 7fd996f7f700 1 --2- 172.21.15.17:0/2173182455 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd99015d910 0x7fd9900690a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:50.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.699+0000 7fd996f7f700 1 --2- 172.21.15.17:0/2173182455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd99015ca80 0x7fd9900cdc70 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:50.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.699+0000 7fd996f7f700 1 --2- 172.21.15.17:0/2173182455 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd99015ce50 0x7fd99016ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:50.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.699+0000 7fd996f7f700 1 -- 172.21.15.17:0/2173182455 >> 172.21.15.17:0/2173182455 conn(0x7fd99006cd40 msgr2=0x7fd9900aefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:50.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.699+0000 7fd996f7f700 1 -- 172.21.15.17:0/2173182455 shutdown_connections 2023-10-06T04:43:50.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:50.699+0000 7fd996f7f700 1 -- 172.21.15.17:0/2173182455 wait complete. 2023-10-06T04:43:50.713 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T04:43:50.714 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:43:50.714 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi136.front.sepia.ceph.com 2023-10-06T04:43:50.714 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-06T04:43:50.714 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-06T04:43:50.714 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T04:43:50.714 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T04:43:50.714 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:43:50.714 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-06T04:43:50.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:50.715 DEBUG:teuthology.orchestra.run.smithi136:> ip addr 2023-10-06T04:43:50.732 INFO:teuthology.orchestra.run.smithi136.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:43:50.732 INFO:teuthology.orchestra.run.smithi136.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:43:50.733 INFO:teuthology.orchestra.run.smithi136.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:43:50.733 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:43:50.733 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 ::1/128 scope host 2023-10-06T04:43:50.733 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:43:50.733 INFO:teuthology.orchestra.run.smithi136.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:43:50.733 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:d9:3b:1a brd ff:ff:ff:ff:ff:ff 2023-10-06T04:43:50.733 INFO:teuthology.orchestra.run.smithi136.stdout: altname enp7s0f0 2023-10-06T04:43:50.733 INFO:teuthology.orchestra.run.smithi136.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:43:50.733 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:d9:3b:1b brd ff:ff:ff:ff:ff:ff 2023-10-06T04:43:50.733 INFO:teuthology.orchestra.run.smithi136.stdout: altname enp7s0f1 2023-10-06T04:43:50.734 INFO:teuthology.orchestra.run.smithi136.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:43:50.734 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:88:6e:42 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:43:50.734 INFO:teuthology.orchestra.run.smithi136.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:43:50.734 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:88:6e:43 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:43:50.734 INFO:teuthology.orchestra.run.smithi136.stdout: inet 172.21.15.136/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T04:43:50.734 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft 42464sec preferred_lft 42464sec 2023-10-06T04:43:50.734 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::ec4:7aff:fe88:6e43/64 scope link 2023-10-06T04:43:50.734 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:43:50.735 INFO:teuthology.orchestra.run.smithi136.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:43:50.735 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 5e:ab:92:84:8d:0a brd ff:ff:ff:ff:ff:ff 2023-10-06T04:43:50.735 INFO:teuthology.orchestra.run.smithi136.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T04:43:50.735 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:43:50.735 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::e003:d7ff:fe9a:ea8c/64 scope link 2023-10-06T04:43:50.735 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:43:50.735 INFO:teuthology.orchestra.run.smithi136.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T04:43:50.736 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 5e:ab:92:84:8d:0a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T04:43:50.736 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::5cab:92ff:fe84:8d0a/64 scope link tentative 2023-10-06T04:43:50.736 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:43:50.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:50.736 DEBUG:teuthology.orchestra.run.smithi136:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:43:50.804 INFO:teuthology.orchestra.run.smithi136.stdout:1 2023-10-06T04:43:50.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:50.805 DEBUG:teuthology.orchestra.run.smithi136:> route 2023-10-06T04:43:50.870 INFO:teuthology.orchestra.run.smithi136.stdout:Kernel IP routing table 2023-10-06T04:43:50.870 INFO:teuthology.orchestra.run.smithi136.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:43:50.870 INFO:teuthology.orchestra.run.smithi136.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T04:43:50.871 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T04:43:50.871 INFO:teuthology.orchestra.run.smithi136.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:43:50.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:50.871 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2023-10-06T04:43:50.871 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2023-10-06T04:43:50.871 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T04:43:50.871 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T04:43:50.871 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T04:43:50.872 DEBUG:teuthology.orchestra.run.smithi136:> ') 2023-10-06T04:43:50.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:50.977 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2023-10-06T04:43:51.000 INFO:teuthology.orchestra.run.smithi136.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T04:43:51.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:51.001 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list-id 2023-10-06T04:43:51.072 INFO:teuthology.orchestra.run.smithi136.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-06T04:43:51.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:51.073 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2023-10-06T04:43:51.073 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2023-10-06T04:43:51.073 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T04:43:51.073 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-06T04:43:51.073 DEBUG:teuthology.orchestra.run.smithi136:> ') 2023-10-06T04:43:51.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:51.167 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T04:43:51.222 INFO:teuthology.orchestra.run.smithi136.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:43:51.222 INFO:teuthology.orchestra.run.smithi136.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:43:51.222 INFO:teuthology.orchestra.run.smithi136.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:43:51.222 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:43:51.222 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 ::1/128 scope host 2023-10-06T04:43:51.222 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:43:51.222 INFO:teuthology.orchestra.run.smithi136.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:43:51.222 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether ee:60:2b:72:97:c0 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T04:43:51.223 INFO:teuthology.orchestra.run.smithi136.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T04:43:51.223 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:43:51.223 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::ec60:2bff:fe72:97c0/64 scope link tentative 2023-10-06T04:43:51.223 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:43:51.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:51.234 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T04:43:51.319 INFO:teuthology.orchestra.run.smithi136.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:43:51.320 INFO:teuthology.orchestra.run.smithi136.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:43:51.320 INFO:teuthology.orchestra.run.smithi136.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:43:51.320 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:43:51.320 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 ::1/128 scope host 2023-10-06T04:43:51.320 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:43:51.320 INFO:teuthology.orchestra.run.smithi136.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:43:51.320 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether ee:60:2b:72:97:c0 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T04:43:51.320 INFO:teuthology.orchestra.run.smithi136.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T04:43:51.321 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:43:51.321 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::ec60:2bff:fe72:97c0/64 scope link tentative 2023-10-06T04:43:51.321 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:43:51.331 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-06T04:43:51.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:51.331 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2023-10-06T04:43:51.331 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2023-10-06T04:43:51.332 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-06T04:43:51.332 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T04:43:51.332 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-06T04:43:51.332 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-06T04:43:51.332 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-06T04:43:51.332 DEBUG:teuthology.orchestra.run.smithi136:> ') 2023-10-06T04:43:51.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:51.567 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec bash -c ' 2023-10-06T04:43:51.567 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2023-10-06T04:43:51.567 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set brx.1 up 2023-10-06T04:43:51.568 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T04:43:51.568 DEBUG:teuthology.orchestra.run.smithi136:> ') 2023-10-06T04:43:51.652 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:43:51.652 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-06T04:43:51.669 INFO:teuthology.orchestra.run.smithi136.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-06T04:43:51.670 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:43:51.670 DEBUG:teuthology.orchestra.run.smithi136:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-06T04:43:51.727 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T04:43:51.727 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:43:51.727 DEBUG:teuthology.orchestra.run.smithi136:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-06T04:43:51.811 INFO:teuthology.orchestra.run.smithi136.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-06T04:43:51.812 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-06T04:43:51.812 INFO:teuthology.orchestra.run.smithi136.stdout:invalid new device string format 2023-10-06T04:43:51.818 INFO:teuthology.orchestra.run.smithi136.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-06T04:43:51.818 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-06T04:43:51.819 INFO:teuthology.orchestra.run.smithi136.stdout:invalid new device string format 2023-10-06T04:43:51.819 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.136:3300,172.21.15.136:3301" 2023-10-06T04:43:51.820 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:43:51.844 INFO:teuthology.orchestra.run.smithi136.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-06T04:43:51.844 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-06T04:43:51.844 INFO:teuthology.orchestra.run.smithi136.stdout:invalid new device string format 2023-10-06T04:43:51.844 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.136:3300,172.21.15.136:3301" 2023-10-06T04:43:51.844 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:43:51.844 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: resolved to: "172.21.15.17:6789,172.21.15.136:6789,172.21.15.136:6790" 2023-10-06T04:43:51.845 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.17:6789,172.21.15.136:6789,172.21.15.136:6790:/ 2023-10-06T04:43:51.845 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=780777c4-2b25-4d35-9058-c9f2d62e3ad9" will pass to kernel 2023-10-06T04:43:51.845 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T04:43:51.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:51.845 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-06T04:43:51.908 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-06T04:43:51.931 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:43:52.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.062+0000 7f18bf278700 1 Processor -- start 2023-10-06T04:43:52.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.063+0000 7f18bf278700 1 -- start start 2023-10-06T04:43:52.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.063+0000 7f18bf278700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f18b8160ed0 0x7f18b80cd790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:52.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.063+0000 7f18bf278700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18b81612a0 0x7f18b80b2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:52.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.063+0000 7f18bf278700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18b80ce220 con 0x7f18b80cac90 2023-10-06T04:43:52.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.063+0000 7f18bf278700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18b80ceac0 con 0x7f18b8160ed0 2023-10-06T04:43:52.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.063+0000 7f18bf278700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b80afde0 con 0x7f18b81612a0 2023-10-06T04:43:52.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.064+0000 7f18bd815700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f18b80cac90 0x7f18b8161740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:43904/0 (socket says 172.21.15.17:43904) 2023-10-06T04:43:52.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.064+0000 7f18bd815700 1 -- 172.21.15.17:0/3832483745 learned_addr learned my addr 172.21.15.17:0/3832483745 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:52.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.064+0000 7f18bd014700 1 --2- 172.21.15.17:0/3832483745 >> v2:172.21.15.136:3300/0 conn(0x7f18b8160ed0 0x7f18b80cd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:52.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.064+0000 7f18bc813700 1 --2- 172.21.15.17:0/3832483745 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18b81612a0 0x7f18b80b2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:52.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.064+0000 7f18b7fff700 1 -- 172.21.15.17:0/3832483745 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2482794224 0 0) 0x7f18b80ce220 con 0x7f18b80cac90 2023-10-06T04:43:52.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.064+0000 7f18b7fff700 1 -- 172.21.15.17:0/3832483745 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18a0003570 con 0x7f18b80cac90 2023-10-06T04:43:52.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.064+0000 7f18bc813700 1 -- 172.21.15.17:0/3832483745 >> v2:172.21.15.136:3300/0 conn(0x7f18b8160ed0 msgr2=0x7f18b80cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:52.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.064+0000 7f18bc813700 1 --2- 172.21.15.17:0/3832483745 >> v2:172.21.15.136:3300/0 conn(0x7f18b8160ed0 0x7f18b80cd790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:52.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.064+0000 7f18bc813700 1 -- 172.21.15.17:0/3832483745 >> v1:172.21.15.17:6789/0 conn(0x7f18b80cac90 legacy=0x7f18b8161740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:52.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.064+0000 7f18bc813700 1 -- 172.21.15.17:0/3832483745 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b80b2bd0 con 0x7f18b81612a0 2023-10-06T04:43:52.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.064+0000 7f18bd014700 1 --2- 172.21.15.17:0/3832483745 >> v2:172.21.15.136:3300/0 conn(0x7f18b8160ed0 0x7f18b80cd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:43:52.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.064+0000 7f18bc813700 1 --2- 172.21.15.17:0/3832483745 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18b81612a0 0x7f18b80b2690 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f18ac0098e0 tx=0x7f18ac0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4454cced2598b10 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:52.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.065+0000 7f18b7fff700 1 -- 172.21.15.17:0/3832483745 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ac011630 con 0x7f18b81612a0 2023-10-06T04:43:52.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.065+0000 7f18b7fff700 1 -- 172.21.15.17:0/3832483745 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18ac011790 con 0x7f18b81612a0 2023-10-06T04:43:52.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.065+0000 7f18b7fff700 1 -- 172.21.15.17:0/3832483745 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ac011b30 con 0x7f18b81612a0 2023-10-06T04:43:52.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.065+0000 7f18bf278700 1 -- 172.21.15.17:0/3832483745 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18b81612a0 msgr2=0x7f18b80b2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:52.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.065+0000 7f18bf278700 1 --2- 172.21.15.17:0/3832483745 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18b81612a0 0x7f18b80b2690 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f18ac0098e0 tx=0x7f18ac0091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:52.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.065+0000 7f18bf278700 1 -- 172.21.15.17:0/3832483745 shutdown_connections 2023-10-06T04:43:52.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.065+0000 7f18bf278700 1 --2- 172.21.15.17:0/3832483745 >> v2:172.21.15.136:3300/0 conn(0x7f18b8160ed0 0x7f18b80cd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:52.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.065+0000 7f18bf278700 1 --2- 172.21.15.17:0/3832483745 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18b81612a0 0x7f18b80b2690 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:52.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.065+0000 7f18bf278700 1 -- 172.21.15.17:0/3832483745 >> 172.21.15.17:0/3832483745 conn(0x7f18b806cff0 msgr2=0x7f18b806d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:52.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.065+0000 7f18bf278700 1 -- 172.21.15.17:0/3832483745 shutdown_connections 2023-10-06T04:43:52.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.065+0000 7f18bf278700 1 -- 172.21.15.17:0/3832483745 wait complete. 2023-10-06T04:43:52.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.066+0000 7f18bf278700 1 Processor -- start 2023-10-06T04:43:52.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.066+0000 7f18bf278700 1 -- start start 2023-10-06T04:43:52.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.067+0000 7f18bf278700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f18b80cac90 0x7f18b80aff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:52.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.067+0000 7f18bf278700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18b8160ed0 0x7f18b814a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:52.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.067+0000 7f18bf278700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18b81612a0 0x7f18b80c7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:52.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.067+0000 7f18bf278700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b815e800 con 0x7f18b8160ed0 2023-10-06T04:43:52.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.067+0000 7f18bf278700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b815ed80 con 0x7f18b80cac90 2023-10-06T04:43:52.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.067+0000 7f18bf278700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b80b0490 con 0x7f18b81612a0 2023-10-06T04:43:52.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.067+0000 7f18bc813700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18b8160ed0 0x7f18b814a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:52.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.068+0000 7f18bc813700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18b8160ed0 0x7f18b814a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34952/0 (socket says 172.21.15.17:34952) 2023-10-06T04:43:52.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.068+0000 7f18bc813700 1 -- 172.21.15.17:0/3610213353 learned_addr learned my addr 172.21.15.17:0/3610213353 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:52.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.068+0000 7f18bd014700 1 --2- 172.21.15.17:0/3610213353 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f18b80cac90 0x7f18b80aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:52.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.068+0000 7f18bd815700 1 --2- 172.21.15.17:0/3610213353 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18b81612a0 0x7f18b80c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:52.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.068+0000 7f18bc813700 1 -- 172.21.15.17:0/3610213353 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18b81612a0 msgr2=0x7f18b80c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:52.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.068+0000 7f18bc813700 1 --2- 172.21.15.17:0/3610213353 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18b81612a0 0x7f18b80c7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:52.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.068+0000 7f18bc813700 1 -- 172.21.15.17:0/3610213353 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f18b80cac90 msgr2=0x7f18b80aff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:52.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.068+0000 7f18bc813700 1 --2- 172.21.15.17:0/3610213353 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f18b80cac90 0x7f18b80aff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:52.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.068+0000 7f18bc813700 1 -- 172.21.15.17:0/3610213353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b0009420 con 0x7f18b8160ed0 2023-10-06T04:43:52.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.068+0000 7f18bc813700 1 --2- 172.21.15.17:0/3610213353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18b8160ed0 0x7f18b814a220 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f18b806ea60 tx=0x7f18ac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:52.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.068+0000 7f18b57fa700 1 -- 172.21.15.17:0/3610213353 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ac000d10 con 0x7f18b8160ed0 2023-10-06T04:43:52.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.068+0000 7f18b57fa700 1 -- 172.21.15.17:0/3610213353 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18ac011b10 con 0x7f18b8160ed0 2023-10-06T04:43:52.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.068+0000 7f18bf278700 1 -- 172.21.15.17:0/3610213353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18ac009420 con 0x7f18b8160ed0 2023-10-06T04:43:52.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.068+0000 7f18b57fa700 1 -- 172.21.15.17:0/3610213353 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ac025660 con 0x7f18b8160ed0 2023-10-06T04:43:52.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.068+0000 7f18bf278700 1 -- 172.21.15.17:0/3610213353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b80b1f10 con 0x7f18b8160ed0 2023-10-06T04:43:52.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.069+0000 7f18bf278700 1 -- 172.21.15.17:0/3610213353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18b8063ff0 con 0x7f18b8160ed0 2023-10-06T04:43:52.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.070+0000 7f18b57fa700 1 -- 172.21.15.17:0/3610213353 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f18ac025a50 con 0x7f18b8160ed0 2023-10-06T04:43:52.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.070+0000 7f18b57fa700 1 --2- 172.21.15.17:0/3610213353 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f18a4066f60 0x7f18a4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:52.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.070+0000 7f18b57fa700 1 -- 172.21.15.17:0/3610213353 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f18ac085d50 con 0x7f18b8160ed0 2023-10-06T04:43:52.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.070+0000 7f18bd014700 1 --2- 172.21.15.17:0/3610213353 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f18a4066f60 0x7f18a4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:52.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.070+0000 7f18bd014700 1 --2- 172.21.15.17:0/3610213353 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f18a4066f60 0x7f18a4069410 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f18b0009f40 tx=0x7f18b00091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:52.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.074+0000 7f18b57fa700 1 -- 172.21.15.17:0/3610213353 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f18ac089030 con 0x7f18b8160ed0 2023-10-06T04:43:52.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.268+0000 7f18bf278700 1 -- 172.21.15.17:0/3610213353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18b80c53f0 con 0x7f18b8160ed0 2023-10-06T04:43:52.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.269+0000 7f18b57fa700 1 -- 172.21.15.17:0/3610213353 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f18ac052e60 con 0x7f18b8160ed0 2023-10-06T04:43:52.271 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:43:52.271 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":21,"fsid":"780777c4-2b25-4d35-9058-c9f2d62e3ad9","created":"2023-10-06T04:43:10.578520+0000","modified":"2023-10-06T04:43:30.789916+0000","last_up_change":"2023-10-06T04:43:20.682958+0000","last_in_change":"2023-10-06T04:43:12.978917+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:43:21.795733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:43:22.389592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:43:26.914728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:43:28.173678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"84737b08-575c-46dd-9488-073ae8504494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6809","nonce":90656},{"type":"v1","addr":"172.21.15.17:6811","nonce":90656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":90656},{"type":"v1","addr":"172.21.15.17:6814","nonce":90656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":90656},{"type":"v1","addr":"172.21.15.17:6822","nonce":90656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":90656},{"type":"v1","addr":"172.21.15.17:6818","nonce":90656}]},"public_addr":"172.21.15.17:6811/90656","cluster_addr":"172.21.15.17:6814/90656","heartbeat_back_addr":"172.21.15.17:6822/90656","heartbeat_front_addr":"172.21.15.17:6818/90656","state":["exists","up"]},{"osd":1,"uuid":"dffeb740-58a2-4fd6-8ff1-a0a11a2cc709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":90655},{"type":"v1","addr":"172.21.15.17:6801","nonce":90655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":90655},{"type":"v1","addr":"172.21.15.17:6803","nonce":90655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":90655},{"type":"v1","addr":"172.21.15.17:6807","nonce":90655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":90655},{"type":"v1","addr":"172.21.15.17:6805","nonce":90655}]},"public_addr":"172.21.15.17:6801/90655","cluster_addr":"172.21.15.17:6803/90655","heartbeat_back_addr":"172.21.15.17:6807/90655","heartbeat_front_addr":"172.21.15.17:6805/90655","state":["exists","up"]},{"osd":2,"uuid":"48bd6831-763d-48c2-b515-e02c216d608b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":90657},{"type":"v1","addr":"172.21.15.17:6810","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":90657},{"type":"v1","addr":"172.21.15.17:6815","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":90657},{"type":"v1","addr":"172.21.15.17:6823","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":90657},{"type":"v1","addr":"172.21.15.17:6819","nonce":90657}]},"public_addr":"172.21.15.17:6810/90657","cluster_addr":"172.21.15.17:6815/90657","heartbeat_back_addr":"172.21.15.17:6823/90657","heartbeat_front_addr":"172.21.15.17:6819/90657","state":["exists","up"]},{"osd":3,"uuid":"ae7dbb23-abe7-4bd3-a4df-6f5963d6804c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":90688},{"type":"v1","addr":"172.21.15.17:6825","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":90688},{"type":"v1","addr":"172.21.15.17:6827","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":90688},{"type":"v1","addr":"172.21.15.17:6831","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":90688},{"type":"v1","addr":"172.21.15.17:6829","nonce":90688}]},"public_addr":"172.21.15.17:6825/90688","cluster_addr":"172.21.15.17:6827/90688","heartbeat_back_addr":"172.21.15.17:6831/90688","heartbeat_front_addr":"172.21.15.17:6829/90688","state":["exists","up"]},{"osd":4,"uuid":"29991fb4-1667-4ea3-aca0-d55db27f3bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":90902},{"type":"v1","addr":"172.21.15.136:6801","nonce":90902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":90902},{"type":"v1","addr":"172.21.15.136:6803","nonce":90902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":90902},{"type":"v1","addr":"172.21.15.136:6807","nonce":90902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":90902},{"type":"v1","addr":"172.21.15.136:6805","nonce":90902}]},"public_addr":"172.21.15.136:6801/90902","cluster_addr":"172.21.15.136:6803/90902","heartbeat_back_addr":"172.21.15.136:6807/90902","heartbeat_front_addr":"172.21.15.136:6805/90902","state":["exists","up"]},{"osd":5,"uuid":"398b4ff9-03fc-421f-882c-ba12aa088eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":90901},{"type":"v1","addr":"172.21.15.136:6809","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":90901},{"type":"v1","addr":"172.21.15.136:6811","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":90901},{"type":"v1","addr":"172.21.15.136:6815","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":90901},{"type":"v1","addr":"172.21.15.136:6813","nonce":90901}]},"public_addr":"172.21.15.136:6809/90901","cluster_addr":"172.21.15.136:6811/90901","heartbeat_back_addr":"172.21.15.136:6815/90901","heartbeat_front_addr":"172.21.15.136:6813/90901","state":["exists","up"]},{"osd":6,"uuid":"1bb91a72-4dab-4cdb-aa1d-2b8a9edf1ad0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":90927},{"type":"v1","addr":"172.21.15.136:6825","nonce":90927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":90927},{"type":"v1","addr":"172.21.15.136:6827","nonce":90927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":90927},{"type":"v1","addr":"172.21.15.136:6831","nonce":90927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":90927},{"type":"v1","addr":"172.21.15.136:6829","nonce":90927}]},"public_addr":"172.21.15.136:6825/90927","cluster_addr":"172.21.15.136:6827/90927","heartbeat_back_addr":"172.21.15.136:6831/90927","heartbeat_front_addr":"172.21.15.136:6829/90927","state":["exists","up"]},{"osd":7,"uuid":"719b654e-010d-4aa4-8c13-83fdde242b47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":90934},{"type":"v1","addr":"172.21.15.136:6817","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":90934},{"type":"v1","addr":"172.21.15.136:6819","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":90934},{"type":"v1","addr":"172.21.15.136:6824","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":90934},{"type":"v1","addr":"172.21.15.136:6821","nonce":90934}]},"public_addr":"172.21.15.136:6817/90934","cluster_addr":"172.21.15.136:6819/90934","heartbeat_back_addr":"172.21.15.136:6824/90934","heartbeat_front_addr":"172.21.15.136:6821/90934","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.157479+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.140520+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.190743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.231396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.156510+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.145822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.202888+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.139532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:43:52.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.271+0000 7f18bf278700 1 -- 172.21.15.17:0/3610213353 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f18a4066f60 msgr2=0x7f18a4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:52.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.271+0000 7f18bf278700 1 --2- 172.21.15.17:0/3610213353 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f18a4066f60 0x7f18a4069410 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f18b0009f40 tx=0x7f18b00091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:52.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.271+0000 7f18bf278700 1 -- 172.21.15.17:0/3610213353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18b8160ed0 msgr2=0x7f18b814a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:52.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.271+0000 7f18bf278700 1 --2- 172.21.15.17:0/3610213353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18b8160ed0 0x7f18b814a220 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f18b806ea60 tx=0x7f18ac017000 comp rx=0 tx=0).stop 2023-10-06T04:43:52.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.271+0000 7f18bf278700 1 -- 172.21.15.17:0/3610213353 shutdown_connections 2023-10-06T04:43:52.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.271+0000 7f18bf278700 1 --2- 172.21.15.17:0/3610213353 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f18a4066f60 0x7f18a4069410 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:52.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.271+0000 7f18bf278700 1 --2- 172.21.15.17:0/3610213353 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18b81612a0 0x7f18b80c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:52.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.271+0000 7f18bf278700 1 --2- 172.21.15.17:0/3610213353 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f18b80cac90 0x7f18b80aff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:52.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.271+0000 7f18bf278700 1 --2- 172.21.15.17:0/3610213353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18b8160ed0 0x7f18b814a220 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:52.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.272+0000 7f18bf278700 1 -- 172.21.15.17:0/3610213353 >> 172.21.15.17:0/3610213353 conn(0x7f18b806cff0 msgr2=0x7f18b806e310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:52.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.272+0000 7f18bf278700 1 -- 172.21.15.17:0/3610213353 shutdown_connections 2023-10-06T04:43:52.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.272+0000 7f18bf278700 1 -- 172.21.15.17:0/3610213353 wait complete. 2023-10-06T04:43:52.285 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:43:21.795733+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:43:22.389592+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:43:26.914728+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:43:28.173678+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:43:52.286 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:43:52.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.405+0000 7fad9cf07700 1 Processor -- start 2023-10-06T04:43:52.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.405+0000 7fad9cf07700 1 -- start start 2023-10-06T04:43:52.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.406+0000 7fad9cf07700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fad980cabf0 0x7fad980c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:52.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.406+0000 7fad9cf07700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fad98159b10 0x7fad9806f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:52.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.406+0000 7fad9cf07700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad980d1120 con 0x7fad9806d140 2023-10-06T04:43:52.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.406+0000 7fad9cf07700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad980d1400 con 0x7fad98159b10 2023-10-06T04:43:52.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.406+0000 7fad9cf07700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad9806e920 con 0x7fad980cabf0 2023-10-06T04:43:52.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.406+0000 7fad95d9b700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fad98159b10 0x7fad9806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:52.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.406+0000 7fad95d9b700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fad98159b10 0x7fad9806f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34958/0 (socket says 172.21.15.17:34958) 2023-10-06T04:43:52.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.406+0000 7fad95d9b700 1 -- 172.21.15.17:0/4262265725 learned_addr learned my addr 172.21.15.17:0/4262265725 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:52.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.406+0000 7fad9659c700 1 --2- 172.21.15.17:0/4262265725 >> v2:172.21.15.136:3300/0 conn(0x7fad980cabf0 0x7fad980c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:52.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.407+0000 7fad95d9b700 1 -- 172.21.15.17:0/4262265725 >> v2:172.21.15.136:3300/0 conn(0x7fad980cabf0 msgr2=0x7fad980c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:52.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.407+0000 7fad95d9b700 1 --2- 172.21.15.17:0/4262265725 >> v2:172.21.15.136:3300/0 conn(0x7fad980cabf0 0x7fad980c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:52.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.407+0000 7fad95d9b700 1 -- 172.21.15.17:0/4262265725 >> v1:172.21.15.136:6789/0 conn(0x7fad9806d140 legacy=0x7fad9806f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:52.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.407+0000 7fad95d9b700 1 -- 172.21.15.17:0/4262265725 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad9806ec00 con 0x7fad98159b10 2023-10-06T04:43:52.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.407+0000 7fad9659c700 1 --2- 172.21.15.17:0/4262265725 >> v2:172.21.15.136:3300/0 conn(0x7fad980cabf0 0x7fad980c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:43:52.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.407+0000 7fad95d9b700 1 --2- 172.21.15.17:0/4262265725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad98159b10 0x7fad9806f120 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fad980ce130 tx=0x7fad80009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=842483e2e20d5a0f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:52.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.407+0000 7fad9559a700 1 -- 172.21.15.17:0/4262265725 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8000b820 con 0x7fad98159b10 2023-10-06T04:43:52.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.407+0000 7fad9559a700 1 -- 172.21.15.17:0/4262265725 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8000b980 con 0x7fad98159b10 2023-10-06T04:43:52.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.407+0000 7fad9559a700 1 -- 172.21.15.17:0/4262265725 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8000bd20 con 0x7fad98159b10 2023-10-06T04:43:52.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.407+0000 7fad9cf07700 1 -- 172.21.15.17:0/4262265725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad98159b10 msgr2=0x7fad9806f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:52.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.407+0000 7fad9cf07700 1 --2- 172.21.15.17:0/4262265725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad98159b10 0x7fad9806f120 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fad980ce130 tx=0x7fad80009250 comp rx=0 tx=0).stop 2023-10-06T04:43:52.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.408+0000 7fad9cf07700 1 -- 172.21.15.17:0/4262265725 shutdown_connections 2023-10-06T04:43:52.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.408+0000 7fad9cf07700 1 --2- 172.21.15.17:0/4262265725 >> v2:172.21.15.136:3300/0 conn(0x7fad980cabf0 0x7fad980c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:52.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.408+0000 7fad9cf07700 1 --2- 172.21.15.17:0/4262265725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad98159b10 0x7fad9806f120 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:52.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.408+0000 7fad9cf07700 1 -- 172.21.15.17:0/4262265725 >> 172.21.15.17:0/4262265725 conn(0x7fad9806cd40 msgr2=0x7fad980d0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:52.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.408+0000 7fad9cf07700 1 -- 172.21.15.17:0/4262265725 shutdown_connections 2023-10-06T04:43:52.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.408+0000 7fad9cf07700 1 -- 172.21.15.17:0/4262265725 wait complete. 2023-10-06T04:43:52.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.409+0000 7fad9cf07700 1 Processor -- start 2023-10-06T04:43:52.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.409+0000 7fad9cf07700 1 -- start start 2023-10-06T04:43:52.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.409+0000 7fad9cf07700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fad9806d140 0x7fad9815e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:52.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.409+0000 7fad9cf07700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad980cabf0 0x7fad98156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:52.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.409+0000 7fad9cf07700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fad98159b10 0x7fad980b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:52.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.409+0000 7fad9cf07700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad980c4900 con 0x7fad980cabf0 2023-10-06T04:43:52.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.409+0000 7fad9cf07700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9815e830 con 0x7fad98159b10 2023-10-06T04:43:52.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.409+0000 7fad9cf07700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad9815c3c0 con 0x7fad9806d140 2023-10-06T04:43:52.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.409+0000 7fad95d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad980cabf0 0x7fad98156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:52.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.410+0000 7fad95d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad980cabf0 0x7fad98156df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34972/0 (socket says 172.21.15.17:34972) 2023-10-06T04:43:52.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.410+0000 7fad95d9b700 1 -- 172.21.15.17:0/804510331 learned_addr learned my addr 172.21.15.17:0/804510331 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:52.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.410+0000 7fad96d9d700 1 --2- 172.21.15.17:0/804510331 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fad98159b10 0x7fad980b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:52.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.410+0000 7fad9659c700 1 --2- 172.21.15.17:0/804510331 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fad9806d140 0x7fad9815e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:52.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.410+0000 7fad95d9b700 1 -- 172.21.15.17:0/804510331 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fad9806d140 msgr2=0x7fad9815e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:52.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.410+0000 7fad95d9b700 1 --2- 172.21.15.17:0/804510331 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fad9806d140 0x7fad9815e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:52.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.410+0000 7fad95d9b700 1 -- 172.21.15.17:0/804510331 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fad98159b10 msgr2=0x7fad980b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:52.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.410+0000 7fad95d9b700 1 --2- 172.21.15.17:0/804510331 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fad98159b10 0x7fad980b43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:52.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.410+0000 7fad95d9b700 1 -- 172.21.15.17:0/804510331 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad800094f0 con 0x7fad980cabf0 2023-10-06T04:43:52.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.410+0000 7fad96d9d700 1 --2- 172.21.15.17:0/804510331 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fad98159b10 0x7fad980b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:43:52.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.410+0000 7fad95d9b700 1 --2- 172.21.15.17:0/804510331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad980cabf0 0x7fad98156df0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fad80009290 tx=0x7fad80016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:52.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.410+0000 7fad8e7fc700 1 -- 172.21.15.17:0/804510331 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad80011e20 con 0x7fad980cabf0 2023-10-06T04:43:52.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.410+0000 7fad8e7fc700 1 -- 172.21.15.17:0/804510331 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8001b680 con 0x7fad980cabf0 2023-10-06T04:43:52.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.410+0000 7fad9cf07700 1 -- 172.21.15.17:0/804510331 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad9815eab0 con 0x7fad980cabf0 2023-10-06T04:43:52.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.410+0000 7fad8e7fc700 1 -- 172.21.15.17:0/804510331 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8001ba40 con 0x7fad980cabf0 2023-10-06T04:43:52.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.410+0000 7fad9cf07700 1 -- 172.21.15.17:0/804510331 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad980c42b0 con 0x7fad980cabf0 2023-10-06T04:43:52.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.411+0000 7fad9cf07700 1 -- 172.21.15.17:0/804510331 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad980c4a70 con 0x7fad980cabf0 2023-10-06T04:43:52.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.412+0000 7fad8e7fc700 1 -- 172.21.15.17:0/804510331 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fad8001c450 con 0x7fad980cabf0 2023-10-06T04:43:52.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.412+0000 7fad8e7fc700 1 --2- 172.21.15.17:0/804510331 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fad78066f30 0x7fad780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:52.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.412+0000 7fad8e7fc700 1 -- 172.21.15.17:0/804510331 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fad80086350 con 0x7fad980cabf0 2023-10-06T04:43:52.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.412+0000 7fad9659c700 1 --2- 172.21.15.17:0/804510331 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fad78066f30 0x7fad780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:52.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.412+0000 7fad9659c700 1 --2- 172.21.15.17:0/804510331 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fad78066f30 0x7fad780693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fad9000b530 tx=0x7fad900075f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:52.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.416+0000 7fad8e7fc700 1 -- 172.21.15.17:0/804510331 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad80053460 con 0x7fad980cabf0 2023-10-06T04:43:52.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.607+0000 7fad9cf07700 1 -- 172.21.15.17:0/804510331 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fad9804c380 con 0x7fad980cabf0 2023-10-06T04:43:52.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.608+0000 7fad8e7fc700 1 -- 172.21.15.17:0/804510331 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fad8002a0a0 con 0x7fad980cabf0 2023-10-06T04:43:52.610 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-10-06T04:43:52.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.610+0000 7fad9cf07700 1 -- 172.21.15.17:0/804510331 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fad78066f30 msgr2=0x7fad780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:52.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.610+0000 7fad9cf07700 1 --2- 172.21.15.17:0/804510331 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fad78066f30 0x7fad780693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fad9000b530 tx=0x7fad900075f0 comp rx=0 tx=0).stop 2023-10-06T04:43:52.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.610+0000 7fad9cf07700 1 -- 172.21.15.17:0/804510331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad980cabf0 msgr2=0x7fad98156df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:52.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.610+0000 7fad9cf07700 1 --2- 172.21.15.17:0/804510331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad980cabf0 0x7fad98156df0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fad80009290 tx=0x7fad80016000 comp rx=0 tx=0).stop 2023-10-06T04:43:52.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.610+0000 7fad9cf07700 1 -- 172.21.15.17:0/804510331 shutdown_connections 2023-10-06T04:43:52.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.610+0000 7fad9cf07700 1 --2- 172.21.15.17:0/804510331 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fad78066f30 0x7fad780693e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:52.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.610+0000 7fad9cf07700 1 --2- 172.21.15.17:0/804510331 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fad98159b10 0x7fad980b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:52.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.610+0000 7fad9cf07700 1 --2- 172.21.15.17:0/804510331 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fad9806d140 0x7fad9815e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:52.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.610+0000 7fad9cf07700 1 --2- 172.21.15.17:0/804510331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad980cabf0 0x7fad98156df0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:52.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.610+0000 7fad9cf07700 1 -- 172.21.15.17:0/804510331 >> 172.21.15.17:0/804510331 conn(0x7fad9806cd40 msgr2=0x7fad980c9730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:52.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.610+0000 7fad9cf07700 1 -- 172.21.15.17:0/804510331 shutdown_connections 2023-10-06T04:43:52.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.610+0000 7fad9cf07700 1 -- 172.21.15.17:0/804510331 wait complete. 2023-10-06T04:43:52.623 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:43:52.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.743+0000 7f2dc0b45700 1 Processor -- start 2023-10-06T04:43:52.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.743+0000 7f2dc0b45700 1 -- start start 2023-10-06T04:43:52.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.744+0000 7f2dc0b45700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2dbc159b10 0x7f2dbc06f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:52.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.744+0000 7f2dc0b45700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2dbc06d140 0x7f2dbc06f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:52.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.744+0000 7f2dc0b45700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dbc0d1120 con 0x7f2dbc0cabf0 2023-10-06T04:43:52.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.744+0000 7f2dc0b45700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dbc0d1400 con 0x7f2dbc06d140 2023-10-06T04:43:52.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.744+0000 7f2dc0b45700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dbc06e920 con 0x7f2dbc159b10 2023-10-06T04:43:52.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.744+0000 7f2dbad9d700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2dbc06d140 0x7f2dbc06f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:52.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.744+0000 7f2dbad9d700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2dbc06d140 0x7f2dbc06f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34984/0 (socket says 172.21.15.17:34984) 2023-10-06T04:43:52.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.744+0000 7f2dbad9d700 1 -- 172.21.15.17:0/2271435822 learned_addr learned my addr 172.21.15.17:0/2271435822 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:52.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.744+0000 7f2db9d9b700 1 --2- 172.21.15.17:0/2271435822 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2dbc159b10 0x7f2dbc06f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:52.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.745+0000 7f2dbad9d700 1 -- 172.21.15.17:0/2271435822 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2dbc159b10 msgr2=0x7f2dbc06f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:52.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.745+0000 7f2dbad9d700 1 --2- 172.21.15.17:0/2271435822 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2dbc159b10 0x7f2dbc06f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:52.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.745+0000 7f2dbad9d700 1 -- 172.21.15.17:0/2271435822 >> v1:172.21.15.136:6789/0 conn(0x7f2dbc0cabf0 legacy=0x7f2dbc0c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:52.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.745+0000 7f2dbad9d700 1 -- 172.21.15.17:0/2271435822 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dbc06ec00 con 0x7f2dbc06d140 2023-10-06T04:43:52.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.745+0000 7f2dbad9d700 1 --2- 172.21.15.17:0/2271435822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dbc06d140 0x7f2dbc06f660 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2dac009f20 tx=0x7f2dac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7420df0d63a621c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:52.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.745+0000 7f2db959a700 1 -- 172.21.15.17:0/2271435822 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac00e070 con 0x7f2dbc06d140 2023-10-06T04:43:52.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.745+0000 7f2db959a700 1 -- 172.21.15.17:0/2271435822 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dac00ba80 con 0x7f2dbc06d140 2023-10-06T04:43:52.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.745+0000 7f2db959a700 1 -- 172.21.15.17:0/2271435822 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac0092e0 con 0x7f2dbc06d140 2023-10-06T04:43:52.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.745+0000 7f2dc0b45700 1 -- 172.21.15.17:0/2271435822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dbc06d140 msgr2=0x7f2dbc06f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:52.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.745+0000 7f2dc0b45700 1 --2- 172.21.15.17:0/2271435822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dbc06d140 0x7f2dbc06f660 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2dac009f20 tx=0x7f2dac009840 comp rx=0 tx=0).stop 2023-10-06T04:43:52.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.746+0000 7f2dc0b45700 1 -- 172.21.15.17:0/2271435822 shutdown_connections 2023-10-06T04:43:52.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.746+0000 7f2dc0b45700 1 --2- 172.21.15.17:0/2271435822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dbc06d140 0x7f2dbc06f660 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:52.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.746+0000 7f2dc0b45700 1 --2- 172.21.15.17:0/2271435822 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2dbc159b10 0x7f2dbc06f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:52.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.746+0000 7f2dc0b45700 1 -- 172.21.15.17:0/2271435822 >> 172.21.15.17:0/2271435822 conn(0x7f2dbc06cd40 msgr2=0x7f2dbc0d0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:52.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.746+0000 7f2dc0b45700 1 -- 172.21.15.17:0/2271435822 shutdown_connections 2023-10-06T04:43:52.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.746+0000 7f2dc0b45700 1 -- 172.21.15.17:0/2271435822 wait complete. 2023-10-06T04:43:52.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.747+0000 7f2dc0b45700 1 Processor -- start 2023-10-06T04:43:52.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.747+0000 7f2dc0b45700 1 -- start start 2023-10-06T04:43:52.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.747+0000 7f2dc0b45700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2dbc06d140 0x7f2dbc156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:52.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.747+0000 7f2dc0b45700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2dbc0cabf0 0x7f2dbc0c5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:52.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.747+0000 7f2dc0b45700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dbc159b10 0x7f2dbc0c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:52.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.747+0000 7f2dc0b45700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dbc0b3670 con 0x7f2dbc159b10 2023-10-06T04:43:52.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.747+0000 7f2dc0b45700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dbc0b5720 con 0x7f2dbc06d140 2023-10-06T04:43:52.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.747+0000 7f2dc0b45700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dbc0b59c0 con 0x7f2dbc0cabf0 2023-10-06T04:43:52.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.747+0000 7f2dbad9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dbc159b10 0x7f2dbc0c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:52.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.748+0000 7f2dbad9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dbc159b10 0x7f2dbc0c6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34996/0 (socket says 172.21.15.17:34996) 2023-10-06T04:43:52.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.748+0000 7f2dbad9d700 1 -- 172.21.15.17:0/1275644405 learned_addr learned my addr 172.21.15.17:0/1275644405 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:52.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.748+0000 7f2dba59c700 1 --2- 172.21.15.17:0/1275644405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2dbc06d140 0x7f2dbc156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:52.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.748+0000 7f2db9d9b700 1 --2- 172.21.15.17:0/1275644405 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2dbc0cabf0 0x7f2dbc0c5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:52.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.748+0000 7f2dbad9d700 1 -- 172.21.15.17:0/1275644405 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2dbc0cabf0 msgr2=0x7f2dbc0c5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:52.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.748+0000 7f2dbad9d700 1 --2- 172.21.15.17:0/1275644405 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2dbc0cabf0 0x7f2dbc0c5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:52.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.748+0000 7f2dbad9d700 1 -- 172.21.15.17:0/1275644405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2dbc06d140 msgr2=0x7f2dbc156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:52.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.748+0000 7f2dbad9d700 1 --2- 172.21.15.17:0/1275644405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2dbc06d140 0x7f2dbc156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:52.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.748+0000 7f2dbad9d700 1 -- 172.21.15.17:0/1275644405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dac009ae0 con 0x7f2dbc159b10 2023-10-06T04:43:52.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.748+0000 7f2dbad9d700 1 --2- 172.21.15.17:0/1275644405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dbc159b10 0x7f2dbc0c6100 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc064590 tx=0x7f2dac018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:52.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.748+0000 7f2db27fc700 1 -- 172.21.15.17:0/1275644405 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac0032f0 con 0x7f2dbc159b10 2023-10-06T04:43:52.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.748+0000 7f2db27fc700 1 -- 172.21.15.17:0/1275644405 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dac008d20 con 0x7f2dbc159b10 2023-10-06T04:43:52.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.748+0000 7f2dc0b45700 1 -- 172.21.15.17:0/1275644405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dbc0b5ca0 con 0x7f2dbc159b10 2023-10-06T04:43:52.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.748+0000 7f2db27fc700 1 -- 172.21.15.17:0/1275644405 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac026690 con 0x7f2dbc159b10 2023-10-06T04:43:52.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.748+0000 7f2dc0b45700 1 -- 172.21.15.17:0/1275644405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dbc0c6e00 con 0x7f2dbc159b10 2023-10-06T04:43:52.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.749+0000 7f2dc0b45700 1 -- 172.21.15.17:0/1275644405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dbc04c380 con 0x7f2dbc159b10 2023-10-06T04:43:52.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.750+0000 7f2db27fc700 1 -- 172.21.15.17:0/1275644405 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2dac003040 con 0x7f2dbc159b10 2023-10-06T04:43:52.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.750+0000 7f2db27fc700 1 --2- 172.21.15.17:0/1275644405 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2d9c066f30 0x7f2d9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:52.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.750+0000 7f2db27fc700 1 -- 172.21.15.17:0/1275644405 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2dac086580 con 0x7f2dbc159b10 2023-10-06T04:43:52.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.750+0000 7f2dba59c700 1 --2- 172.21.15.17:0/1275644405 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2d9c066f30 0x7f2d9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:52.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.750+0000 7f2dba59c700 1 --2- 172.21.15.17:0/1275644405 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2d9c066f30 0x7f2d9c0693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2db4007fd0 tx=0x7f2db4007eb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:52.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.754+0000 7f2db27fc700 1 -- 172.21.15.17:0/1275644405 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2dac053690 con 0x7f2dbc159b10 2023-10-06T04:43:52.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.950+0000 7f2dc0b45700 1 -- 172.21.15.17:0/1275644405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2dbc0b6140 con 0x7f2dbc159b10 2023-10-06T04:43:52.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.950+0000 7f2db27fc700 1 -- 172.21.15.17:0/1275644405 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2dac056cb0 con 0x7f2dbc159b10 2023-10-06T04:43:52.952 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-10-06T04:43:52.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.952+0000 7f2dc0b45700 1 -- 172.21.15.17:0/1275644405 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2d9c066f30 msgr2=0x7f2d9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:52.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.952+0000 7f2dc0b45700 1 --2- 172.21.15.17:0/1275644405 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2d9c066f30 0x7f2d9c0693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2db4007fd0 tx=0x7f2db4007eb0 comp rx=0 tx=0).stop 2023-10-06T04:43:52.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.952+0000 7f2dc0b45700 1 -- 172.21.15.17:0/1275644405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dbc159b10 msgr2=0x7f2dbc0c6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:52.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.952+0000 7f2dc0b45700 1 --2- 172.21.15.17:0/1275644405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dbc159b10 0x7f2dbc0c6100 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc064590 tx=0x7f2dac018000 comp rx=0 tx=0).stop 2023-10-06T04:43:52.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.952+0000 7f2dc0b45700 1 -- 172.21.15.17:0/1275644405 shutdown_connections 2023-10-06T04:43:52.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.952+0000 7f2dc0b45700 1 --2- 172.21.15.17:0/1275644405 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2d9c066f30 0x7f2d9c0693e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:52.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.952+0000 7f2dc0b45700 1 --2- 172.21.15.17:0/1275644405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dbc159b10 0x7f2dbc0c6100 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:52.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.952+0000 7f2dc0b45700 1 --2- 172.21.15.17:0/1275644405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2dbc06d140 0x7f2dbc156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:52.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.952+0000 7f2dc0b45700 1 --2- 172.21.15.17:0/1275644405 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2dbc0cabf0 0x7f2dbc0c5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:52.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.952+0000 7f2dc0b45700 1 -- 172.21.15.17:0/1275644405 >> 172.21.15.17:0/1275644405 conn(0x7f2dbc06cd40 msgr2=0x7f2dbc158a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:52.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.952+0000 7f2dc0b45700 1 -- 172.21.15.17:0/1275644405 shutdown_connections 2023-10-06T04:43:52.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:52.952+0000 7f2dc0b45700 1 -- 172.21.15.17:0/1275644405 wait complete. 2023-10-06T04:43:52.966 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:43:53.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.086+0000 7f148653b700 1 Processor -- start 2023-10-06T04:43:53.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.087+0000 7f148653b700 1 -- start start 2023-10-06T04:43:53.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.087+0000 7f148653b700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f14800cabf0 0x7f14800c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:53.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.087+0000 7f148653b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1480159b10 0x7f148006f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:53.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.087+0000 7f148653b700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14800d1120 con 0x7f148006d140 2023-10-06T04:43:53.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.087+0000 7f148653b700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14800d1400 con 0x7f14800cabf0 2023-10-06T04:43:53.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.087+0000 7f148653b700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f148006e920 con 0x7f1480159b10 2023-10-06T04:43:53.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.087+0000 7f147ffff700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f14800cabf0 0x7f14800c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:53.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.088+0000 7f147ffff700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f14800cabf0 0x7f14800c7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35012/0 (socket says 172.21.15.17:35012) 2023-10-06T04:43:53.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.088+0000 7f147ffff700 1 -- 172.21.15.17:0/2562866138 learned_addr learned my addr 172.21.15.17:0/2562866138 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:53.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.088+0000 7f147f7fe700 1 --2- 172.21.15.17:0/2562866138 >> v2:172.21.15.136:3300/0 conn(0x7f1480159b10 0x7f148006f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:53.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.088+0000 7f147ffff700 1 -- 172.21.15.17:0/2562866138 >> v2:172.21.15.136:3300/0 conn(0x7f1480159b10 msgr2=0x7f148006f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:53.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.088+0000 7f147ffff700 1 --2- 172.21.15.17:0/2562866138 >> v2:172.21.15.136:3300/0 conn(0x7f1480159b10 0x7f148006f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:53.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.088+0000 7f147ffff700 1 -- 172.21.15.17:0/2562866138 >> v1:172.21.15.136:6789/0 conn(0x7f148006d140 legacy=0x7f148006f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:53.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.088+0000 7f147ffff700 1 -- 172.21.15.17:0/2562866138 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148006ec00 con 0x7f14800cabf0 2023-10-06T04:43:53.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.088+0000 7f147ffff700 1 --2- 172.21.15.17:0/2562866138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14800cabf0 0x7f14800c7660 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f14800cc490 tx=0x7f1470009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=218ad22b3bad6722 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:53.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.088+0000 7f147effd700 1 -- 172.21.15.17:0/2562866138 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1470005c10 con 0x7f14800cabf0 2023-10-06T04:43:53.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.088+0000 7f147effd700 1 -- 172.21.15.17:0/2562866138 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1470005d70 con 0x7f14800cabf0 2023-10-06T04:43:53.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.088+0000 7f147effd700 1 -- 172.21.15.17:0/2562866138 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147000b880 con 0x7f14800cabf0 2023-10-06T04:43:53.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.089+0000 7f148653b700 1 -- 172.21.15.17:0/2562866138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14800cabf0 msgr2=0x7f14800c7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:53.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.089+0000 7f148653b700 1 --2- 172.21.15.17:0/2562866138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14800cabf0 0x7f14800c7660 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f14800cc490 tx=0x7f1470009220 comp rx=0 tx=0).stop 2023-10-06T04:43:53.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.089+0000 7f148653b700 1 -- 172.21.15.17:0/2562866138 shutdown_connections 2023-10-06T04:43:53.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.089+0000 7f148653b700 1 --2- 172.21.15.17:0/2562866138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14800cabf0 0x7f14800c7660 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:53.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.089+0000 7f148653b700 1 --2- 172.21.15.17:0/2562866138 >> v2:172.21.15.136:3300/0 conn(0x7f1480159b10 0x7f148006f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:53.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.089+0000 7f148653b700 1 -- 172.21.15.17:0/2562866138 >> 172.21.15.17:0/2562866138 conn(0x7f148006cd40 msgr2=0x7f14800d0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:53.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.089+0000 7f148653b700 1 -- 172.21.15.17:0/2562866138 shutdown_connections 2023-10-06T04:43:53.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.089+0000 7f148653b700 1 -- 172.21.15.17:0/2562866138 wait complete. 2023-10-06T04:43:53.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.090+0000 7f148653b700 1 Processor -- start 2023-10-06T04:43:53.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.090+0000 7f148653b700 1 -- start start 2023-10-06T04:43:53.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.091+0000 7f148653b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f148006d140 0x7f1480155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:53.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.091+0000 7f148653b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f14800cabf0 0x7f14800c5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:53.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.091+0000 7f148653b700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1480159b10 0x7f148016abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:53.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.091+0000 7f148653b700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14800c4080 con 0x7f148006d140 2023-10-06T04:43:53.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.091+0000 7f148653b700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14800c4ee0 con 0x7f14800cabf0 2023-10-06T04:43:53.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.091+0000 7f148653b700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14801561b0 con 0x7f1480159b10 2023-10-06T04:43:53.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.091+0000 7f147ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f148006d140 0x7f1480155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:53.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.091+0000 7f147ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f148006d140 0x7f1480155c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35026/0 (socket says 172.21.15.17:35026) 2023-10-06T04:43:53.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.091+0000 7f147ffff700 1 -- 172.21.15.17:0/1459031584 learned_addr learned my addr 172.21.15.17:0/1459031584 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:53.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.091+0000 7f147f7fe700 1 --2- 172.21.15.17:0/1459031584 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f14800cabf0 0x7f14800c5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:53.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.091+0000 7f1484ad8700 1 --2- 172.21.15.17:0/1459031584 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1480159b10 0x7f148016abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:53.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.091+0000 7f147ffff700 1 -- 172.21.15.17:0/1459031584 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1480159b10 msgr2=0x7f148016abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:53.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.091+0000 7f147ffff700 1 --2- 172.21.15.17:0/1459031584 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1480159b10 0x7f148016abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:53.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.091+0000 7f147ffff700 1 -- 172.21.15.17:0/1459031584 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f14800cabf0 msgr2=0x7f14800c5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:53.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.091+0000 7f147ffff700 1 --2- 172.21.15.17:0/1459031584 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f14800cabf0 0x7f14800c5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:53.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.091+0000 7f147ffff700 1 -- 172.21.15.17:0/1459031584 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1470009480 con 0x7f148006d140 2023-10-06T04:43:53.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.091+0000 7f1484ad8700 1 --2- 172.21.15.17:0/1459031584 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1480159b10 0x7f148016abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:43:53.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.091+0000 7f147ffff700 1 --2- 172.21.15.17:0/1459031584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f148006d140 0x7f1480155c70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f147000b3c0 tx=0x7f1470016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:53.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.092+0000 7f1467fff700 1 -- 172.21.15.17:0/1459031584 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14700119e0 con 0x7f148006d140 2023-10-06T04:43:53.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.092+0000 7f1467fff700 1 -- 172.21.15.17:0/1459031584 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1470011b60 con 0x7f148006d140 2023-10-06T04:43:53.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.092+0000 7f148653b700 1 -- 172.21.15.17:0/1459031584 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14800c42d0 con 0x7f148006d140 2023-10-06T04:43:53.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.092+0000 7f1467fff700 1 -- 172.21.15.17:0/1459031584 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147001b430 con 0x7f148006d140 2023-10-06T04:43:53.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.092+0000 7f148653b700 1 -- 172.21.15.17:0/1459031584 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14800c4890 con 0x7f148006d140 2023-10-06T04:43:53.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.093+0000 7f148653b700 1 -- 172.21.15.17:0/1459031584 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1480071310 con 0x7f148006d140 2023-10-06T04:43:53.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.093+0000 7f1467fff700 1 -- 172.21.15.17:0/1459031584 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f147001b7e0 con 0x7f148006d140 2023-10-06T04:43:53.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.093+0000 7f1467fff700 1 --2- 172.21.15.17:0/1459031584 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f146c066f60 0x7f146c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:53.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.093+0000 7f1467fff700 1 -- 172.21.15.17:0/1459031584 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1470085ff0 con 0x7f148006d140 2023-10-06T04:43:53.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.094+0000 7f147f7fe700 1 --2- 172.21.15.17:0/1459031584 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f146c066f60 0x7f146c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:53.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.094+0000 7f147f7fe700 1 --2- 172.21.15.17:0/1459031584 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f146c066f60 0x7f146c069410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f148015f500 tx=0x7f1474008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:53.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.098+0000 7f1467fff700 1 -- 172.21.15.17:0/1459031584 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1470053100 con 0x7f148006d140 2023-10-06T04:43:53.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.289+0000 7f148653b700 1 -- 172.21.15.17:0/1459031584 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f14800c9a80 con 0x7f148006d140 2023-10-06T04:43:53.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.289+0000 7f1467fff700 1 -- 172.21.15.17:0/1459031584 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1470056720 con 0x7f148006d140 2023-10-06T04:43:53.291 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-10-06T04:43:53.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.291+0000 7f148653b700 1 -- 172.21.15.17:0/1459031584 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f146c066f60 msgr2=0x7f146c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:53.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.291+0000 7f148653b700 1 --2- 172.21.15.17:0/1459031584 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f146c066f60 0x7f146c069410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f148015f500 tx=0x7f1474008040 comp rx=0 tx=0).stop 2023-10-06T04:43:53.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.291+0000 7f148653b700 1 -- 172.21.15.17:0/1459031584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f148006d140 msgr2=0x7f1480155c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:53.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.291+0000 7f148653b700 1 --2- 172.21.15.17:0/1459031584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f148006d140 0x7f1480155c70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f147000b3c0 tx=0x7f1470016000 comp rx=0 tx=0).stop 2023-10-06T04:43:53.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.291+0000 7f148653b700 1 -- 172.21.15.17:0/1459031584 shutdown_connections 2023-10-06T04:43:53.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.291+0000 7f148653b700 1 --2- 172.21.15.17:0/1459031584 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f146c066f60 0x7f146c069410 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:53.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.291+0000 7f148653b700 1 --2- 172.21.15.17:0/1459031584 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1480159b10 0x7f148016abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:53.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.291+0000 7f148653b700 1 --2- 172.21.15.17:0/1459031584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f148006d140 0x7f1480155c70 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:53.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.291+0000 7f148653b700 1 --2- 172.21.15.17:0/1459031584 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f14800cabf0 0x7f14800c5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:53.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.291+0000 7f148653b700 1 -- 172.21.15.17:0/1459031584 >> 172.21.15.17:0/1459031584 conn(0x7f148006cd40 msgr2=0x7f1480158a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:53.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.291+0000 7f148653b700 1 -- 172.21.15.17:0/1459031584 shutdown_connections 2023-10-06T04:43:53.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.291+0000 7f148653b700 1 -- 172.21.15.17:0/1459031584 wait complete. 2023-10-06T04:43:53.305 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:43:53.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.426+0000 7f1ba239d700 1 Processor -- start 2023-10-06T04:43:53.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.426+0000 7f1ba239d700 1 -- start start 2023-10-06T04:43:53.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.427+0000 7f1ba239d700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1b9c159800 0x7f1b9c0af520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:53.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.427+0000 7f1ba239d700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b9c06bb60 0x7f1b9c159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:53.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.427+0000 7f1ba239d700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b9c0aec30 con 0x7f1b9c0af0c0 2023-10-06T04:43:53.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.427+0000 7f1ba239d700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b9c0ae300 con 0x7f1b9c159800 2023-10-06T04:43:53.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.427+0000 7f1ba239d700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c0ae5e0 con 0x7f1b9c06bb60 2023-10-06T04:43:53.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.427+0000 7f1b9bfff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1b9c159800 0x7f1b9c0af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:53.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.427+0000 7f1ba093a700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b9c06bb60 0x7f1b9c159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:53.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.427+0000 7f1b9bfff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1b9c159800 0x7f1b9c0af520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.17:40772/0 (socket says 172.21.15.17:40772) 2023-10-06T04:43:53.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.427+0000 7f1b9bfff700 1 -- 172.21.15.17:0/1471520068 learned_addr learned my addr 172.21.15.17:0/1471520068 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:53.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.427+0000 7f1b9b7fe700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f1b9c0af0c0 0x7f1b9c06b450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.17:55482/0 (socket says 172.21.15.17:55482) 2023-10-06T04:43:53.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.428+0000 7f1b9bfff700 1 -- 172.21.15.17:0/1471520068 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b9c06bb60 msgr2=0x7f1b9c159bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:53.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.428+0000 7f1b9bfff700 1 --2- 172.21.15.17:0/1471520068 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b9c06bb60 0x7f1b9c159bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:53.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.428+0000 7f1b9bfff700 1 -- 172.21.15.17:0/1471520068 >> v1:172.21.15.136:6789/0 conn(0x7f1b9c0af0c0 legacy=0x7f1b9c06b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:53.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.428+0000 7f1b9bfff700 1 -- 172.21.15.17:0/1471520068 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b9c0ae8c0 con 0x7f1b9c159800 2023-10-06T04:43:53.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.428+0000 7f1ba093a700 1 --2- 172.21.15.17:0/1471520068 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b9c06bb60 0x7f1b9c159bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:43:53.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.428+0000 7f1b9bfff700 1 --2- 172.21.15.17:0/1471520068 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1b9c159800 0x7f1b9c0af520 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c0099b0 tx=0x7f1b8c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb88736d288585c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:53.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.428+0000 7f1b9affd700 1 -- 172.21.15.17:0/1471520068 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c009ea0 con 0x7f1b9c159800 2023-10-06T04:43:53.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.428+0000 7f1b9affd700 1 -- 172.21.15.17:0/1471520068 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b8c00b860 con 0x7f1b9c159800 2023-10-06T04:43:53.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.428+0000 7f1b9affd700 1 -- 172.21.15.17:0/1471520068 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c00bc00 con 0x7f1b9c159800 2023-10-06T04:43:53.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.429+0000 7f1ba239d700 1 -- 172.21.15.17:0/1471520068 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1b9c159800 msgr2=0x7f1b9c0af520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:53.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.429+0000 7f1ba239d700 1 --2- 172.21.15.17:0/1471520068 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1b9c159800 0x7f1b9c0af520 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c0099b0 tx=0x7f1b8c009250 comp rx=0 tx=0).stop 2023-10-06T04:43:53.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.429+0000 7f1ba239d700 1 -- 172.21.15.17:0/1471520068 shutdown_connections 2023-10-06T04:43:53.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.429+0000 7f1ba239d700 1 --2- 172.21.15.17:0/1471520068 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1b9c159800 0x7f1b9c0af520 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:53.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.429+0000 7f1ba239d700 1 --2- 172.21.15.17:0/1471520068 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b9c06bb60 0x7f1b9c159bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:53.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.429+0000 7f1ba239d700 1 -- 172.21.15.17:0/1471520068 >> 172.21.15.17:0/1471520068 conn(0x7f1b9c0cde20 msgr2=0x7f1b9c06ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:53.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.429+0000 7f1ba239d700 1 -- 172.21.15.17:0/1471520068 shutdown_connections 2023-10-06T04:43:53.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.429+0000 7f1ba239d700 1 -- 172.21.15.17:0/1471520068 wait complete. 2023-10-06T04:43:53.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.430+0000 7f1ba239d700 1 Processor -- start 2023-10-06T04:43:53.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.430+0000 7f1ba239d700 1 -- start start 2023-10-06T04:43:53.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.431+0000 7f1ba239d700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b9c06bb60 0x7f1b9c15ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:53.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.431+0000 7f1ba239d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b9c0af0c0 0x7f1b9c152b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:53.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.431+0000 7f1ba239d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1b9c159800 0x7f1b9c0aa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:53.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.431+0000 7f1ba239d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c159bd0 con 0x7f1b9c0af0c0 2023-10-06T04:43:53.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.431+0000 7f1ba239d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c159eb0 con 0x7f1b9c159800 2023-10-06T04:43:53.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.431+0000 7f1ba239d700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c15a190 con 0x7f1b9c06bb60 2023-10-06T04:43:53.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.431+0000 7f1b9b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b9c0af0c0 0x7f1b9c152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:53.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.431+0000 7f1b9b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b9c0af0c0 0x7f1b9c152b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35030/0 (socket says 172.21.15.17:35030) 2023-10-06T04:43:53.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.431+0000 7f1b9b7fe700 1 -- 172.21.15.17:0/1211106202 learned_addr learned my addr 172.21.15.17:0/1211106202 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:53.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.431+0000 7f1ba093a700 1 --2- 172.21.15.17:0/1211106202 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1b9c159800 0x7f1b9c0aa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:53.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.431+0000 7f1b9bfff700 1 --2- 172.21.15.17:0/1211106202 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b9c06bb60 0x7f1b9c15ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:53.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.431+0000 7f1b9b7fe700 1 -- 172.21.15.17:0/1211106202 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b9c06bb60 msgr2=0x7f1b9c15ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:53.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.431+0000 7f1b9b7fe700 1 --2- 172.21.15.17:0/1211106202 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b9c06bb60 0x7f1b9c15ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:53.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.431+0000 7f1b9b7fe700 1 -- 172.21.15.17:0/1211106202 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1b9c159800 msgr2=0x7f1b9c0aa2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:53.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.431+0000 7f1b9b7fe700 1 --2- 172.21.15.17:0/1211106202 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1b9c159800 0x7f1b9c0aa2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:53.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.431+0000 7f1b9b7fe700 1 -- 172.21.15.17:0/1211106202 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b94009a20 con 0x7f1b9c0af0c0 2023-10-06T04:43:53.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.431+0000 7f1b9b7fe700 1 --2- 172.21.15.17:0/1211106202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b9c0af0c0 0x7f1b9c152b60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1b9000c7c0 tx=0x7f1b90007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:53.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.431+0000 7f1b83fff700 1 -- 172.21.15.17:0/1211106202 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b90005a70 con 0x7f1b9c0af0c0 2023-10-06T04:43:53.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.432+0000 7f1b83fff700 1 -- 172.21.15.17:0/1211106202 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b90005bd0 con 0x7f1b9c0af0c0 2023-10-06T04:43:53.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.432+0000 7f1ba239d700 1 -- 172.21.15.17:0/1211106202 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b8c0094f0 con 0x7f1b9c0af0c0 2023-10-06T04:43:53.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.432+0000 7f1b83fff700 1 -- 172.21.15.17:0/1211106202 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b900070d0 con 0x7f1b9c0af0c0 2023-10-06T04:43:53.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.432+0000 7f1ba239d700 1 -- 172.21.15.17:0/1211106202 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b9c15a750 con 0x7f1b9c0af0c0 2023-10-06T04:43:53.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.432+0000 7f1ba239d700 1 -- 172.21.15.17:0/1211106202 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b9c15a970 con 0x7f1b9c0af0c0 2023-10-06T04:43:53.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.433+0000 7f1b83fff700 1 -- 172.21.15.17:0/1211106202 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1b90007480 con 0x7f1b9c0af0c0 2023-10-06T04:43:53.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.433+0000 7f1b83fff700 1 --2- 172.21.15.17:0/1211106202 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1b88066f30 0x7f1b880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:53.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.433+0000 7f1b83fff700 1 -- 172.21.15.17:0/1211106202 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1b90083b50 con 0x7f1b9c0af0c0 2023-10-06T04:43:53.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.433+0000 7f1b9bfff700 1 --2- 172.21.15.17:0/1211106202 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1b88066f30 0x7f1b880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:53.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.434+0000 7f1b9bfff700 1 --2- 172.21.15.17:0/1211106202 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1b88066f30 0x7f1b880693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c0099b0 tx=0x7f1b8c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:53.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.438+0000 7f1b83fff700 1 -- 172.21.15.17:0/1211106202 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1b90050d20 con 0x7f1b9c0af0c0 2023-10-06T04:43:53.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.630+0000 7f1ba239d700 1 -- 172.21.15.17:0/1211106202 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1b9c04c380 con 0x7f1b9c0af0c0 2023-10-06T04:43:53.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.630+0000 7f1b83fff700 1 -- 172.21.15.17:0/1211106202 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1b90017070 con 0x7f1b9c0af0c0 2023-10-06T04:43:53.632 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-10-06T04:43:53.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.632+0000 7f1ba239d700 1 -- 172.21.15.17:0/1211106202 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1b88066f30 msgr2=0x7f1b880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:53.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.632+0000 7f1ba239d700 1 --2- 172.21.15.17:0/1211106202 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1b88066f30 0x7f1b880693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c0099b0 tx=0x7f1b8c017000 comp rx=0 tx=0).stop 2023-10-06T04:43:53.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.632+0000 7f1ba239d700 1 -- 172.21.15.17:0/1211106202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b9c0af0c0 msgr2=0x7f1b9c152b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:53.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.632+0000 7f1ba239d700 1 --2- 172.21.15.17:0/1211106202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b9c0af0c0 0x7f1b9c152b60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1b9000c7c0 tx=0x7f1b90007f70 comp rx=0 tx=0).stop 2023-10-06T04:43:53.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.633+0000 7f1ba239d700 1 -- 172.21.15.17:0/1211106202 shutdown_connections 2023-10-06T04:43:53.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.633+0000 7f1ba239d700 1 --2- 172.21.15.17:0/1211106202 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1b88066f30 0x7f1b880693e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:53.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.633+0000 7f1ba239d700 1 --2- 172.21.15.17:0/1211106202 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1b9c159800 0x7f1b9c0aa2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:53.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.633+0000 7f1ba239d700 1 --2- 172.21.15.17:0/1211106202 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b9c06bb60 0x7f1b9c15ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:53.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.633+0000 7f1ba239d700 1 --2- 172.21.15.17:0/1211106202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b9c0af0c0 0x7f1b9c152b60 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:53.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.633+0000 7f1ba239d700 1 -- 172.21.15.17:0/1211106202 >> 172.21.15.17:0/1211106202 conn(0x7f1b9c0cde20 msgr2=0x7f1b9c0b1120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:53.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.633+0000 7f1ba239d700 1 -- 172.21.15.17:0/1211106202 shutdown_connections 2023-10-06T04:43:53.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.633+0000 7f1ba239d700 1 -- 172.21.15.17:0/1211106202 wait complete. 2023-10-06T04:43:53.647 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:43:53.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.763+0000 7f48c0729700 1 Processor -- start 2023-10-06T04:43:53.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.764+0000 7f48c0729700 1 -- start start 2023-10-06T04:43:53.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.764+0000 7f48c0729700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f48b8159630 0x7f48b80cd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:53.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.764+0000 7f48c0729700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f48b80cd590 0x7f48b80ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:53.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.764+0000 7f48c0729700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b80cda00 con 0x7f48b80ce840 2023-10-06T04:43:53.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.764+0000 7f48c0729700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b80cfc80 con 0x7f48b8159630 2023-10-06T04:43:53.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.764+0000 7f48c0729700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b80cf070 con 0x7f48b80cd590 2023-10-06T04:43:53.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.765+0000 7f48be4c5700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f48b8159630 0x7f48b80cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:53.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.765+0000 7f48be4c5700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f48b8159630 0x7f48b80cd050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35034/0 (socket says 172.21.15.17:35034) 2023-10-06T04:43:53.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.765+0000 7f48be4c5700 1 -- 172.21.15.17:0/1157137458 learned_addr learned my addr 172.21.15.17:0/1157137458 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:53.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.765+0000 7f48bdcc4700 1 --2- 172.21.15.17:0/1157137458 >> v2:172.21.15.136:3300/0 conn(0x7f48b80cd590 0x7f48b80ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:53.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.765+0000 7f48be4c5700 1 -- 172.21.15.17:0/1157137458 >> v2:172.21.15.136:3300/0 conn(0x7f48b80cd590 msgr2=0x7f48b80ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:53.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.765+0000 7f48be4c5700 1 --2- 172.21.15.17:0/1157137458 >> v2:172.21.15.136:3300/0 conn(0x7f48b80cd590 0x7f48b80ce300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:53.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.765+0000 7f48be4c5700 1 -- 172.21.15.17:0/1157137458 >> v1:172.21.15.136:6789/0 conn(0x7f48b80ce840 legacy=0x7f48b815d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:53.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.765+0000 7f48be4c5700 1 -- 172.21.15.17:0/1157137458 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b80cf350 con 0x7f48b8159630 2023-10-06T04:43:53.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.765+0000 7f48be4c5700 1 --2- 172.21.15.17:0/1157137458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48b8159630 0x7f48b80cd050 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f48b804bc70 tx=0x7f48b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3216cad6248f796 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:53.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.765+0000 7f48bd4c3700 1 -- 172.21.15.17:0/1157137458 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b000b860 con 0x7f48b8159630 2023-10-06T04:43:53.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.765+0000 7f48bd4c3700 1 -- 172.21.15.17:0/1157137458 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b000b9c0 con 0x7f48b8159630 2023-10-06T04:43:53.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.765+0000 7f48bd4c3700 1 -- 172.21.15.17:0/1157137458 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b000bd60 con 0x7f48b8159630 2023-10-06T04:43:53.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.766+0000 7f48c0729700 1 -- 172.21.15.17:0/1157137458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48b8159630 msgr2=0x7f48b80cd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:53.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.766+0000 7f48c0729700 1 --2- 172.21.15.17:0/1157137458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48b8159630 0x7f48b80cd050 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f48b804bc70 tx=0x7f48b0009250 comp rx=0 tx=0).stop 2023-10-06T04:43:53.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.766+0000 7f48c0729700 1 -- 172.21.15.17:0/1157137458 shutdown_connections 2023-10-06T04:43:53.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.766+0000 7f48c0729700 1 --2- 172.21.15.17:0/1157137458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48b8159630 0x7f48b80cd050 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:53.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.766+0000 7f48c0729700 1 --2- 172.21.15.17:0/1157137458 >> v2:172.21.15.136:3300/0 conn(0x7f48b80cd590 0x7f48b80ce300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:53.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.766+0000 7f48c0729700 1 -- 172.21.15.17:0/1157137458 >> 172.21.15.17:0/1157137458 conn(0x7f48b806cff0 msgr2=0x7f48b806d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:53.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.766+0000 7f48c0729700 1 -- 172.21.15.17:0/1157137458 shutdown_connections 2023-10-06T04:43:53.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.766+0000 7f48c0729700 1 -- 172.21.15.17:0/1157137458 wait complete. 2023-10-06T04:43:53.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.767+0000 7f48c0729700 1 Processor -- start 2023-10-06T04:43:53.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.767+0000 7f48c0729700 1 -- start start 2023-10-06T04:43:53.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.768+0000 7f48c0729700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48b80cd590 0x7f48b815d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:53.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.768+0000 7f48c0729700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48b80ce840 0x7f48b80c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:53.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.768+0000 7f48c0729700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48b8159630 0x7f48b80c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:53.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.768+0000 7f48c0729700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b80b4060 con 0x7f48b80ce840 2023-10-06T04:43:53.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.768+0000 7f48c0729700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b815e1e0 con 0x7f48b8159630 2023-10-06T04:43:53.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.768+0000 7f48c0729700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b815e4c0 con 0x7f48b80cd590 2023-10-06T04:43:53.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.768+0000 7f48bdcc4700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48b80ce840 0x7f48b80c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:53.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.768+0000 7f48bdcc4700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48b80ce840 0x7f48b80c7ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35046/0 (socket says 172.21.15.17:35046) 2023-10-06T04:43:53.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.768+0000 7f48bdcc4700 1 -- 172.21.15.17:0/2191349032 learned_addr learned my addr 172.21.15.17:0/2191349032 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:53.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.768+0000 7f48be4c5700 1 --2- 172.21.15.17:0/2191349032 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48b80cd590 0x7f48b815d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:53.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.768+0000 7f48becc6700 1 --2- 172.21.15.17:0/2191349032 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48b8159630 0x7f48b80c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:53.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.768+0000 7f48bdcc4700 1 -- 172.21.15.17:0/2191349032 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48b80cd590 msgr2=0x7f48b815d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:53.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.768+0000 7f48bdcc4700 1 --2- 172.21.15.17:0/2191349032 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48b80cd590 0x7f48b815d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:53.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.768+0000 7f48bdcc4700 1 -- 172.21.15.17:0/2191349032 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48b8159630 msgr2=0x7f48b80c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:53.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.768+0000 7f48bdcc4700 1 --2- 172.21.15.17:0/2191349032 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48b8159630 0x7f48b80c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:53.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.768+0000 7f48bdcc4700 1 -- 172.21.15.17:0/2191349032 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b00094f0 con 0x7f48b80ce840 2023-10-06T04:43:53.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.768+0000 7f48bdcc4700 1 --2- 172.21.15.17:0/2191349032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48b80ce840 0x7f48b80c7ab0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f48ac00d860 tx=0x7f48ac008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:53.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.768+0000 7f48b67fc700 1 -- 172.21.15.17:0/2191349032 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac0125f0 con 0x7f48b80ce840 2023-10-06T04:43:53.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.769+0000 7f48b67fc700 1 -- 172.21.15.17:0/2191349032 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ac012750 con 0x7f48b80ce840 2023-10-06T04:43:53.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.769+0000 7f48c0729700 1 -- 172.21.15.17:0/2191349032 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b815e7a0 con 0x7f48b80ce840 2023-10-06T04:43:53.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.769+0000 7f48b67fc700 1 -- 172.21.15.17:0/2191349032 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac012b10 con 0x7f48b80ce840 2023-10-06T04:43:53.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.769+0000 7f48c0729700 1 -- 172.21.15.17:0/2191349032 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b815de60 con 0x7f48b80ce840 2023-10-06T04:43:53.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.770+0000 7f48c0729700 1 -- 172.21.15.17:0/2191349032 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b8063ff0 con 0x7f48b80ce840 2023-10-06T04:43:53.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.770+0000 7f48b67fc700 1 -- 172.21.15.17:0/2191349032 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f48ac01e460 con 0x7f48b80ce840 2023-10-06T04:43:53.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.770+0000 7f48b67fc700 1 --2- 172.21.15.17:0/2191349032 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f48a4066f30 0x7f48a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:53.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.770+0000 7f48b67fc700 1 -- 172.21.15.17:0/2191349032 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f48ac084bc0 con 0x7f48b80ce840 2023-10-06T04:43:53.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.770+0000 7f48be4c5700 1 --2- 172.21.15.17:0/2191349032 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f48a4066f30 0x7f48a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:53.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.771+0000 7f48be4c5700 1 --2- 172.21.15.17:0/2191349032 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f48a4066f30 0x7f48a40693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f48b804bc70 tx=0x7f48b0017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:53.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.775+0000 7f48b67fc700 1 -- 172.21.15.17:0/2191349032 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f48ac051cd0 con 0x7f48b80ce840 2023-10-06T04:43:53.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.970+0000 7f48c0729700 1 -- 172.21.15.17:0/2191349032 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48b80cdea0 con 0x7f48b80ce840 2023-10-06T04:43:53.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.971+0000 7f48b67fc700 1 -- 172.21.15.17:0/2191349032 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f48ac0552f0 con 0x7f48b80ce840 2023-10-06T04:43:53.973 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:43:53.973 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":21,"fsid":"780777c4-2b25-4d35-9058-c9f2d62e3ad9","created":"2023-10-06T04:43:10.578520+0000","modified":"2023-10-06T04:43:30.789916+0000","last_up_change":"2023-10-06T04:43:20.682958+0000","last_in_change":"2023-10-06T04:43:12.978917+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:43:21.795733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:43:22.389592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:43:26.914728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:43:28.173678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"84737b08-575c-46dd-9488-073ae8504494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6809","nonce":90656},{"type":"v1","addr":"172.21.15.17:6811","nonce":90656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":90656},{"type":"v1","addr":"172.21.15.17:6814","nonce":90656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":90656},{"type":"v1","addr":"172.21.15.17:6822","nonce":90656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":90656},{"type":"v1","addr":"172.21.15.17:6818","nonce":90656}]},"public_addr":"172.21.15.17:6811/90656","cluster_addr":"172.21.15.17:6814/90656","heartbeat_back_addr":"172.21.15.17:6822/90656","heartbeat_front_addr":"172.21.15.17:6818/90656","state":["exists","up"]},{"osd":1,"uuid":"dffeb740-58a2-4fd6-8ff1-a0a11a2cc709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":90655},{"type":"v1","addr":"172.21.15.17:6801","nonce":90655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":90655},{"type":"v1","addr":"172.21.15.17:6803","nonce":90655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":90655},{"type":"v1","addr":"172.21.15.17:6807","nonce":90655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":90655},{"type":"v1","addr":"172.21.15.17:6805","nonce":90655}]},"public_addr":"172.21.15.17:6801/90655","cluster_addr":"172.21.15.17:6803/90655","heartbeat_back_addr":"172.21.15.17:6807/90655","heartbeat_front_addr":"172.21.15.17:6805/90655","state":["exists","up"]},{"osd":2,"uuid":"48bd6831-763d-48c2-b515-e02c216d608b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":90657},{"type":"v1","addr":"172.21.15.17:6810","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":90657},{"type":"v1","addr":"172.21.15.17:6815","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":90657},{"type":"v1","addr":"172.21.15.17:6823","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":90657},{"type":"v1","addr":"172.21.15.17:6819","nonce":90657}]},"public_addr":"172.21.15.17:6810/90657","cluster_addr":"172.21.15.17:6815/90657","heartbeat_back_addr":"172.21.15.17:6823/90657","heartbeat_front_addr":"172.21.15.17:6819/90657","state":["exists","up"]},{"osd":3,"uuid":"ae7dbb23-abe7-4bd3-a4df-6f5963d6804c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":90688},{"type":"v1","addr":"172.21.15.17:6825","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":90688},{"type":"v1","addr":"172.21.15.17:6827","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":90688},{"type":"v1","addr":"172.21.15.17:6831","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":90688},{"type":"v1","addr":"172.21.15.17:6829","nonce":90688}]},"public_addr":"172.21.15.17:6825/90688","cluster_addr":"172.21.15.17:6827/90688","heartbeat_back_addr":"172.21.15.17:6831/90688","heartbeat_front_addr":"172.21.15.17:6829/90688","state":["exists","up"]},{"osd":4,"uuid":"29991fb4-1667-4ea3-aca0-d55db27f3bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":90902},{"type":"v1","addr":"172.21.15.136:6801","nonce":90902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":90902},{"type":"v1","addr":"172.21.15.136:6803","nonce":90902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":90902},{"type":"v1","addr":"172.21.15.136:6807","nonce":90902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":90902},{"type":"v1","addr":"172.21.15.136:6805","nonce":90902}]},"public_addr":"172.21.15.136:6801/90902","cluster_addr":"172.21.15.136:6803/90902","heartbeat_back_addr":"172.21.15.136:6807/90902","heartbeat_front_addr":"172.21.15.136:6805/90902","state":["exists","up"]},{"osd":5,"uuid":"398b4ff9-03fc-421f-882c-ba12aa088eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":90901},{"type":"v1","addr":"172.21.15.136:6809","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":90901},{"type":"v1","addr":"172.21.15.136:6811","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":90901},{"type":"v1","addr":"172.21.15.136:6815","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":90901},{"type":"v1","addr":"172.21.15.136:6813","nonce":90901}]},"public_addr":"172.21.15.136:6809/90901","cluster_addr":"172.21.15.136:6811/90901","heartbeat_back_addr":"172.21.15.136:6815/90901","heartbeat_front_addr":"172.21.15.136:6813/90901","state":["exists","up"]},{"osd":6,"uuid":"1bb91a72-4dab-4cdb-aa1d-2b8a9edf1ad0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":90927},{"type":"v1","addr":"172.21.15.136:6825","nonce":90927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":90927},{"type":"v1","addr":"172.21.15.136:6827","nonce":90927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":90927},{"type":"v1","addr":"172.21.15.136:6831","nonce":90927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":90927},{"type":"v1","addr":"172.21.15.136:6829","nonce":90927}]},"public_addr":"172.21.15.136:6825/90927","cluster_addr":"172.21.15.136:6827/90927","heartbeat_back_addr":"172.21.15.136:6831/90927","heartbeat_front_addr":"172.21.15.136:6829/90927","state":["exists","up"]},{"osd":7,"uuid":"719b654e-010d-4aa4-8c13-83fdde242b47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":90934},{"type":"v1","addr":"172.21.15.136:6817","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":90934},{"type":"v1","addr":"172.21.15.136:6819","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":90934},{"type":"v1","addr":"172.21.15.136:6824","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":90934},{"type":"v1","addr":"172.21.15.136:6821","nonce":90934}]},"public_addr":"172.21.15.136:6817/90934","cluster_addr":"172.21.15.136:6819/90934","heartbeat_back_addr":"172.21.15.136:6824/90934","heartbeat_front_addr":"172.21.15.136:6821/90934","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.157479+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.140520+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.190743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.231396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.156510+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.145822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.202888+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.139532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:43:53.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.973+0000 7f48c0729700 1 -- 172.21.15.17:0/2191349032 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f48a4066f30 msgr2=0x7f48a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:53.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.973+0000 7f48c0729700 1 --2- 172.21.15.17:0/2191349032 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f48a4066f30 0x7f48a40693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f48b804bc70 tx=0x7f48b0017000 comp rx=0 tx=0).stop 2023-10-06T04:43:53.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.973+0000 7f48c0729700 1 -- 172.21.15.17:0/2191349032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48b80ce840 msgr2=0x7f48b80c7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:53.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.973+0000 7f48c0729700 1 --2- 172.21.15.17:0/2191349032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48b80ce840 0x7f48b80c7ab0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f48ac00d860 tx=0x7f48ac008040 comp rx=0 tx=0).stop 2023-10-06T04:43:53.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.973+0000 7f48c0729700 1 -- 172.21.15.17:0/2191349032 shutdown_connections 2023-10-06T04:43:53.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.973+0000 7f48c0729700 1 --2- 172.21.15.17:0/2191349032 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f48a4066f30 0x7f48a40693e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:53.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.973+0000 7f48c0729700 1 --2- 172.21.15.17:0/2191349032 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48b8159630 0x7f48b80c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:53.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.973+0000 7f48c0729700 1 --2- 172.21.15.17:0/2191349032 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48b80cd590 0x7f48b815d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:53.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.973+0000 7f48c0729700 1 --2- 172.21.15.17:0/2191349032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48b80ce840 0x7f48b80c7ab0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:53.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.973+0000 7f48c0729700 1 -- 172.21.15.17:0/2191349032 >> 172.21.15.17:0/2191349032 conn(0x7f48b806cff0 msgr2=0x7f48b80b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:53.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.973+0000 7f48c0729700 1 -- 172.21.15.17:0/2191349032 shutdown_connections 2023-10-06T04:43:53.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:53.973+0000 7f48c0729700 1 -- 172.21.15.17:0/2191349032 wait complete. 2023-10-06T04:43:53.987 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:43:21.795733+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:43:22.389592+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:43:26.914728+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:43:28.173678+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:43:53.988 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:43:54.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.107+0000 7f514c766700 1 Processor -- start 2023-10-06T04:43:54.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.107+0000 7f514c766700 1 -- start start 2023-10-06T04:43:54.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.108+0000 7f514c766700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f51441595c0 0x7f514406eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:54.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.108+0000 7f514c766700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f51440afe60 0x7f51440b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:54.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.108+0000 7f514c766700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51440b23c0 con 0x7f514406f240 2023-10-06T04:43:54.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.108+0000 7f514c766700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51440b21d0 con 0x7f51441595c0 2023-10-06T04:43:54.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.108+0000 7f514c766700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f514406efe0 con 0x7f51440afe60 2023-10-06T04:43:54.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.109+0000 7f514a502700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f51441595c0 0x7f514406eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:54.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.109+0000 7f514ad03700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f51440afe60 0x7f51440b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:54.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.109+0000 7f514a502700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f51441595c0 0x7f514406eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.17:40808/0 (socket says 172.21.15.17:40808) 2023-10-06T04:43:54.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.109+0000 7f5149d01700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f514406f240 0x7f51440b1ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.17:55508/0 (socket says 172.21.15.17:55508) 2023-10-06T04:43:54.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.109+0000 7f514a502700 1 -- 172.21.15.17:0/666748784 learned_addr learned my addr 172.21.15.17:0/666748784 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:54.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.109+0000 7f514a502700 1 -- 172.21.15.17:0/666748784 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f51440afe60 msgr2=0x7f51440b02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:54.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.109+0000 7f514a502700 1 --2- 172.21.15.17:0/666748784 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f51440afe60 0x7f51440b02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:54.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.109+0000 7f514a502700 1 -- 172.21.15.17:0/666748784 >> v1:172.21.15.136:6789/0 conn(0x7f514406f240 legacy=0x7f51440b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:54.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.109+0000 7f514a502700 1 -- 172.21.15.17:0/666748784 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514406e610 con 0x7f51441595c0 2023-10-06T04:43:54.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.109+0000 7f514a502700 1 --2- 172.21.15.17:0/666748784 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51441595c0 0x7f514406eaa0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f513c0099e0 tx=0x7f513c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41834a969f1fdccd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:54.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.109+0000 7f5149500700 1 -- 172.21.15.17:0/666748784 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c00b820 con 0x7f51441595c0 2023-10-06T04:43:54.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.109+0000 7f5149500700 1 -- 172.21.15.17:0/666748784 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513c00b980 con 0x7f51441595c0 2023-10-06T04:43:54.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.109+0000 7f5149500700 1 -- 172.21.15.17:0/666748784 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c00bd20 con 0x7f51441595c0 2023-10-06T04:43:54.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.110+0000 7f514c766700 1 -- 172.21.15.17:0/666748784 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51441595c0 msgr2=0x7f514406eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:54.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.110+0000 7f514c766700 1 --2- 172.21.15.17:0/666748784 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51441595c0 0x7f514406eaa0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f513c0099e0 tx=0x7f513c009250 comp rx=0 tx=0).stop 2023-10-06T04:43:54.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.110+0000 7f514c766700 1 -- 172.21.15.17:0/666748784 shutdown_connections 2023-10-06T04:43:54.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.110+0000 7f514c766700 1 --2- 172.21.15.17:0/666748784 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51441595c0 0x7f514406eaa0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:54.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.110+0000 7f514c766700 1 --2- 172.21.15.17:0/666748784 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f51440afe60 0x7f51440b02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:54.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.110+0000 7f514c766700 1 -- 172.21.15.17:0/666748784 >> 172.21.15.17:0/666748784 conn(0x7f514406c560 msgr2=0x7f514406c960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:54.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.110+0000 7f514c766700 1 -- 172.21.15.17:0/666748784 shutdown_connections 2023-10-06T04:43:54.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.110+0000 7f514c766700 1 -- 172.21.15.17:0/666748784 wait complete. 2023-10-06T04:43:54.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.111+0000 7f514c766700 1 Processor -- start 2023-10-06T04:43:54.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.111+0000 7f514c766700 1 -- start start 2023-10-06T04:43:54.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.112+0000 7f514c766700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f514406f240 0x7f514416da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:54.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.112+0000 7f514c766700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51440afe60 0x7f5144157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:54.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.112+0000 7f514c766700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51441595c0 0x7f514413ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:54.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.112+0000 7f514c766700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5144157ea0 con 0x7f51440afe60 2023-10-06T04:43:54.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.112+0000 7f514c766700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5144158cc0 con 0x7f51441595c0 2023-10-06T04:43:54.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.112+0000 7f514c766700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51441580b0 con 0x7f514406f240 2023-10-06T04:43:54.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.112+0000 7f5149d01700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51440afe60 0x7f5144157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:54.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.112+0000 7f514a502700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f514406f240 0x7f514416da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:54.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.112+0000 7f5149d01700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51440afe60 0x7f5144157960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35052/0 (socket says 172.21.15.17:35052) 2023-10-06T04:43:54.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.112+0000 7f5149d01700 1 -- 172.21.15.17:0/957365552 learned_addr learned my addr 172.21.15.17:0/957365552 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:54.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.112+0000 7f514ad03700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51441595c0 0x7f514413ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:54.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.112+0000 7f514a502700 1 -- 172.21.15.17:0/957365552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51441595c0 msgr2=0x7f514413ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:54.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.112+0000 7f514a502700 1 --2- 172.21.15.17:0/957365552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51441595c0 0x7f514413ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:54.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.112+0000 7f514a502700 1 -- 172.21.15.17:0/957365552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51440afe60 msgr2=0x7f5144157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:54.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.112+0000 7f514a502700 1 --2- 172.21.15.17:0/957365552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51440afe60 0x7f5144157960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:54.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.112+0000 7f514a502700 1 -- 172.21.15.17:0/957365552 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f513c0094f0 con 0x7f514406f240 2023-10-06T04:43:54.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.112+0000 7f5149d01700 1 --2- 172.21.15.17:0/957365552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51440afe60 0x7f5144157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:43:54.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.113+0000 7f514a502700 1 --2- 172.21.15.17:0/957365552 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f514406f240 0x7f514416da70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f514406b530 tx=0x7f513c017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:54.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.113+0000 7f51427fc700 1 -- 172.21.15.17:0/957365552 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c011d30 con 0x7f514406f240 2023-10-06T04:43:54.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.113+0000 7f51427fc700 1 -- 172.21.15.17:0/957365552 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513c024440 con 0x7f514406f240 2023-10-06T04:43:54.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.113+0000 7f514c766700 1 -- 172.21.15.17:0/957365552 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5144158390 con 0x7f514406f240 2023-10-06T04:43:54.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.113+0000 7f51427fc700 1 -- 172.21.15.17:0/957365552 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c024800 con 0x7f514406f240 2023-10-06T04:43:54.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.113+0000 7f514c766700 1 -- 172.21.15.17:0/957365552 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5144158950 con 0x7f514406f240 2023-10-06T04:43:54.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.114+0000 7f514c766700 1 -- 172.21.15.17:0/957365552 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f514404c380 con 0x7f514406f240 2023-10-06T04:43:54.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.114+0000 7f51427fc700 1 -- 172.21.15.17:0/957365552 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f513c01a420 con 0x7f514406f240 2023-10-06T04:43:54.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.115+0000 7f51427fc700 1 --2- 172.21.15.17:0/957365552 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5130066f30 0x7f51300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:54.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.115+0000 7f51427fc700 1 -- 172.21.15.17:0/957365552 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f513c086770 con 0x7f514406f240 2023-10-06T04:43:54.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.115+0000 7f5149d01700 1 --2- 172.21.15.17:0/957365552 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5130066f30 0x7f51300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:54.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.115+0000 7f5149d01700 1 --2- 172.21.15.17:0/957365552 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5130066f30 0x7f51300693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5144153e70 tx=0x7f5138007f40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:54.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.119+0000 7f51427fc700 1 -- 172.21.15.17:0/957365552 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f513c053860 con 0x7f514406f240 2023-10-06T04:43:54.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.314+0000 7f514c766700 1 -- 172.21.15.17:0/957365552 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f51440ae060 con 0x7f514406f240 2023-10-06T04:43:54.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.315+0000 7f51427fc700 1 -- 172.21.15.17:0/957365552 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f513c0150a0 con 0x7f514406f240 2023-10-06T04:43:54.317 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-10-06T04:43:54.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.317+0000 7f514c766700 1 -- 172.21.15.17:0/957365552 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5130066f30 msgr2=0x7f51300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:54.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.317+0000 7f514c766700 1 --2- 172.21.15.17:0/957365552 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5130066f30 0x7f51300693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5144153e70 tx=0x7f5138007f40 comp rx=0 tx=0).stop 2023-10-06T04:43:54.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.317+0000 7f514c766700 1 -- 172.21.15.17:0/957365552 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f514406f240 msgr2=0x7f514416da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:54.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.317+0000 7f514c766700 1 --2- 172.21.15.17:0/957365552 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f514406f240 0x7f514416da70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f514406b530 tx=0x7f513c017000 comp rx=0 tx=0).stop 2023-10-06T04:43:54.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.317+0000 7f514c766700 1 -- 172.21.15.17:0/957365552 shutdown_connections 2023-10-06T04:43:54.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.317+0000 7f514c766700 1 --2- 172.21.15.17:0/957365552 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5130066f30 0x7f51300693e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:54.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.317+0000 7f514c766700 1 --2- 172.21.15.17:0/957365552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51441595c0 0x7f514413ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:54.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.317+0000 7f514c766700 1 --2- 172.21.15.17:0/957365552 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f514406f240 0x7f514416da70 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:54.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.317+0000 7f514c766700 1 --2- 172.21.15.17:0/957365552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51440afe60 0x7f5144157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:54.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.317+0000 7f514c766700 1 -- 172.21.15.17:0/957365552 >> 172.21.15.17:0/957365552 conn(0x7f514406c560 msgr2=0x7f51440cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:54.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.317+0000 7f514c766700 1 -- 172.21.15.17:0/957365552 shutdown_connections 2023-10-06T04:43:54.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.317+0000 7f514c766700 1 -- 172.21.15.17:0/957365552 wait complete. 2023-10-06T04:43:54.331 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:43:54.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.451+0000 7f752bb39700 1 Processor -- start 2023-10-06T04:43:54.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.452+0000 7f752bb39700 1 -- start start 2023-10-06T04:43:54.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.452+0000 7f752bb39700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f752406d140 0x7f752406f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:54.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.452+0000 7f752bb39700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75240d1120 con 0x7f7524159b10 2023-10-06T04:43:54.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.452+0000 7f752bb39700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75240d1400 con 0x7f75240cabf0 2023-10-06T04:43:54.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.452+0000 7f752bb39700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f752406e920 con 0x7f752406d140 2023-10-06T04:43:54.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.453+0000 7f75290d4700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f7524159b10 0x7f752406f120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:43916/0 (socket says 172.21.15.17:43916) 2023-10-06T04:43:54.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.453+0000 7f752a0d6700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f752406d140 0x7f752406f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:54.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.453+0000 7f75290d4700 1 -- 172.21.15.17:0/420378310 learned_addr learned my addr 172.21.15.17:0/420378310 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:54.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.453+0000 7f752a0d6700 1 -- 172.21.15.17:0/420378310 >> v1:172.21.15.136:6789/0 conn(0x7f75240cabf0 legacy=0x7f75240c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:54.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.453+0000 7f752a0d6700 1 -- 172.21.15.17:0/420378310 >> v1:172.21.15.17:6789/0 conn(0x7f7524159b10 legacy=0x7f752406f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:54.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.453+0000 7f752a0d6700 1 -- 172.21.15.17:0/420378310 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752406ec00 con 0x7f752406d140 2023-10-06T04:43:54.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.453+0000 7f75288d3700 1 -- 172.21.15.17:0/420378310 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 390916140 0 0) 0x7f75240d1120 con 0x7f7524159b10 2023-10-06T04:43:54.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.453+0000 7f752a0d6700 1 --2- 172.21.15.17:0/420378310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f752406d140 0x7f752406f830 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7514009e60 tx=0x7f7514009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0891e239211929f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:54.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.453+0000 7f75288d3700 1 -- 172.21.15.17:0/420378310 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751400e070 con 0x7f752406d140 2023-10-06T04:43:54.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.453+0000 7f75288d3700 1 -- 172.21.15.17:0/420378310 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751400bbf0 con 0x7f752406d140 2023-10-06T04:43:54.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.453+0000 7f75288d3700 1 -- 172.21.15.17:0/420378310 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7514012430 con 0x7f752406d140 2023-10-06T04:43:54.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.454+0000 7f752bb39700 1 -- 172.21.15.17:0/420378310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f752406d140 msgr2=0x7f752406f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:54.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.454+0000 7f752bb39700 1 --2- 172.21.15.17:0/420378310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f752406d140 0x7f752406f830 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7514009e60 tx=0x7f7514009780 comp rx=0 tx=0).stop 2023-10-06T04:43:54.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.454+0000 7f752bb39700 1 -- 172.21.15.17:0/420378310 shutdown_connections 2023-10-06T04:43:54.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.454+0000 7f752bb39700 1 --2- 172.21.15.17:0/420378310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f752406d140 0x7f752406f830 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:54.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.454+0000 7f752bb39700 1 -- 172.21.15.17:0/420378310 >> 172.21.15.17:0/420378310 conn(0x7f752406cd40 msgr2=0x7f75240d0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:54.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.454+0000 7f752bb39700 1 -- 172.21.15.17:0/420378310 shutdown_connections 2023-10-06T04:43:54.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.454+0000 7f752bb39700 1 -- 172.21.15.17:0/420378310 wait complete. 2023-10-06T04:43:54.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.455+0000 7f752bb39700 1 Processor -- start 2023-10-06T04:43:54.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.455+0000 7f752bb39700 1 -- start start 2023-10-06T04:43:54.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.456+0000 7f752bb39700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f752406d140 0x7f7524169880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:54.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.456+0000 7f752bb39700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f75240cabf0 0x7f752409d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:54.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.456+0000 7f752bb39700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7524159b10 0x7f752409b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:54.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.456+0000 7f752bb39700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75240c4120 con 0x7f752406d140 2023-10-06T04:43:54.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.456+0000 7f752bb39700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75240c4400 con 0x7f7524159b10 2023-10-06T04:43:54.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.456+0000 7f752bb39700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75240c46e0 con 0x7f75240cabf0 2023-10-06T04:43:54.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.456+0000 7f75298d5700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f752406d140 0x7f7524169880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:54.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.456+0000 7f75298d5700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f752406d140 0x7f7524169880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35076/0 (socket says 172.21.15.17:35076) 2023-10-06T04:43:54.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.456+0000 7f75298d5700 1 -- 172.21.15.17:0/1847142843 learned_addr learned my addr 172.21.15.17:0/1847142843 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:54.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.456+0000 7f752a0d6700 1 --2- 172.21.15.17:0/1847142843 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7524159b10 0x7f752409b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:54.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.456+0000 7f75290d4700 1 --2- 172.21.15.17:0/1847142843 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f75240cabf0 0x7f752409d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:54.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.456+0000 7f75298d5700 1 -- 172.21.15.17:0/1847142843 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f75240cabf0 msgr2=0x7f752409d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:54.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.456+0000 7f75298d5700 1 --2- 172.21.15.17:0/1847142843 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f75240cabf0 0x7f752409d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:54.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.456+0000 7f75298d5700 1 -- 172.21.15.17:0/1847142843 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7524159b10 msgr2=0x7f752409b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:54.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.456+0000 7f75298d5700 1 --2- 172.21.15.17:0/1847142843 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7524159b10 0x7f752409b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:54.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.456+0000 7f75298d5700 1 -- 172.21.15.17:0/1847142843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7514009a20 con 0x7f752406d140 2023-10-06T04:43:54.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.456+0000 7f752a0d6700 1 --2- 172.21.15.17:0/1847142843 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7524159b10 0x7f752409b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:43:54.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.456+0000 7f75298d5700 1 --2- 172.21.15.17:0/1847142843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f752406d140 0x7f7524169880 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f751c00c5b0 tx=0x7f751c0020e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:54.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.456+0000 7f7521ffb700 1 -- 172.21.15.17:0/1847142843 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c011590 con 0x7f752406d140 2023-10-06T04:43:54.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.456+0000 7f7521ffb700 1 -- 172.21.15.17:0/1847142843 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751c0116f0 con 0x7f752406d140 2023-10-06T04:43:54.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.456+0000 7f752bb39700 1 -- 172.21.15.17:0/1847142843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75240c49c0 con 0x7f752406d140 2023-10-06T04:43:54.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.456+0000 7f7521ffb700 1 -- 172.21.15.17:0/1847142843 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c011a90 con 0x7f752406d140 2023-10-06T04:43:54.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.457+0000 7f752bb39700 1 -- 172.21.15.17:0/1847142843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7524169dc0 con 0x7f752406d140 2023-10-06T04:43:54.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.457+0000 7f752bb39700 1 -- 172.21.15.17:0/1847142843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75240c4ee0 con 0x7f752406d140 2023-10-06T04:43:54.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.458+0000 7f7521ffb700 1 -- 172.21.15.17:0/1847142843 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f751c01c460 con 0x7f752406d140 2023-10-06T04:43:54.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.458+0000 7f7521ffb700 1 --2- 172.21.15.17:0/1847142843 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7510066f30 0x7f75100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:54.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.458+0000 7f7521ffb700 1 -- 172.21.15.17:0/1847142843 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f751c0843b0 con 0x7f752406d140 2023-10-06T04:43:54.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.458+0000 7f75290d4700 1 --2- 172.21.15.17:0/1847142843 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7510066f30 0x7f75100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:54.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.459+0000 7f75290d4700 1 --2- 172.21.15.17:0/1847142843 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7510066f30 0x7f75100693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f75240d01f0 tx=0x7f7518009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:54.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.462+0000 7f7521ffb700 1 -- 172.21.15.17:0/1847142843 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f751c0514c0 con 0x7f752406d140 2023-10-06T04:43:54.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.655+0000 7f752bb39700 1 -- 172.21.15.17:0/1847142843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7524071310 con 0x7f752406d140 2023-10-06T04:43:54.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.656+0000 7f7521ffb700 1 -- 172.21.15.17:0/1847142843 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f751c054ae0 con 0x7f752406d140 2023-10-06T04:43:54.658 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-10-06T04:43:54.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.658+0000 7f752bb39700 1 -- 172.21.15.17:0/1847142843 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7510066f30 msgr2=0x7f75100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:54.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.658+0000 7f752bb39700 1 --2- 172.21.15.17:0/1847142843 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7510066f30 0x7f75100693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f75240d01f0 tx=0x7f7518009040 comp rx=0 tx=0).stop 2023-10-06T04:43:54.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.658+0000 7f752bb39700 1 -- 172.21.15.17:0/1847142843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f752406d140 msgr2=0x7f7524169880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:54.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.658+0000 7f752bb39700 1 --2- 172.21.15.17:0/1847142843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f752406d140 0x7f7524169880 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f751c00c5b0 tx=0x7f751c0020e0 comp rx=0 tx=0).stop 2023-10-06T04:43:54.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.658+0000 7f752bb39700 1 -- 172.21.15.17:0/1847142843 shutdown_connections 2023-10-06T04:43:54.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.658+0000 7f752bb39700 1 --2- 172.21.15.17:0/1847142843 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7510066f30 0x7f75100693e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:54.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.658+0000 7f752bb39700 1 --2- 172.21.15.17:0/1847142843 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7524159b10 0x7f752409b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:54.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.658+0000 7f752bb39700 1 --2- 172.21.15.17:0/1847142843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f752406d140 0x7f7524169880 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:54.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.658+0000 7f752bb39700 1 --2- 172.21.15.17:0/1847142843 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f75240cabf0 0x7f752409d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:54.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.658+0000 7f752bb39700 1 -- 172.21.15.17:0/1847142843 >> 172.21.15.17:0/1847142843 conn(0x7f752406cd40 msgr2=0x7f7524158cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:54.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.658+0000 7f752bb39700 1 -- 172.21.15.17:0/1847142843 shutdown_connections 2023-10-06T04:43:54.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.658+0000 7f752bb39700 1 -- 172.21.15.17:0/1847142843 wait complete. 2023-10-06T04:43:54.672 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:43:54.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.792+0000 7f4bc29f3700 1 Processor -- start 2023-10-06T04:43:54.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.792+0000 7f4bc29f3700 1 -- start start 2023-10-06T04:43:54.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.793+0000 7f4bc29f3700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4bbc06a420 0x7f4bbc15a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:54.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.793+0000 7f4bc29f3700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f4bbc0aa2a0 0x7f4bbc163520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:54.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.793+0000 7f4bc29f3700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bbc06d780 con 0x7f4bbc0aeeb0 2023-10-06T04:43:54.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.793+0000 7f4bc29f3700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bbc0ac1c0 con 0x7f4bbc06a420 2023-10-06T04:43:54.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.793+0000 7f4bc29f3700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bbc06d9d0 con 0x7f4bbc0aa2a0 2023-10-06T04:43:54.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.793+0000 7f4bbbfff700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4bbc06a420 0x7f4bbc15a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:54.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.793+0000 7f4bbb7fe700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f4bbc0aeeb0 0x7f4bbc06a7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:43918/0 (socket says 172.21.15.17:43918) 2023-10-06T04:43:54.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.794+0000 7f4bbb7fe700 1 -- 172.21.15.17:0/1634392524 learned_addr learned my addr 172.21.15.17:0/1634392524 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:54.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.794+0000 7f4bbbfff700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4bbc06a420 0x7f4bbc15a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35086/0 (socket says 172.21.15.17:35086) 2023-10-06T04:43:54.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.794+0000 7f4bc0f90700 1 --2- 172.21.15.17:0/1634392524 >> v2:172.21.15.136:3300/0 conn(0x7f4bbc0aa2a0 0x7f4bbc163520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:54.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.794+0000 7f4bbbfff700 1 -- 172.21.15.17:0/1634392524 >> v2:172.21.15.136:3300/0 conn(0x7f4bbc0aa2a0 msgr2=0x7f4bbc163520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:54.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.794+0000 7f4bbbfff700 1 --2- 172.21.15.17:0/1634392524 >> v2:172.21.15.136:3300/0 conn(0x7f4bbc0aa2a0 0x7f4bbc163520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:54.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.794+0000 7f4bbbfff700 1 -- 172.21.15.17:0/1634392524 >> v1:172.21.15.17:6789/0 conn(0x7f4bbc0aeeb0 legacy=0x7f4bbc06a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:54.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.794+0000 7f4bbbfff700 1 -- 172.21.15.17:0/1634392524 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bbc06dcb0 con 0x7f4bbc06a420 2023-10-06T04:43:54.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.794+0000 7f4bbaffd700 1 -- 172.21.15.17:0/1634392524 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3777718604 0 0) 0x7f4bbc06d780 con 0x7f4bbc0aeeb0 2023-10-06T04:43:54.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.794+0000 7f4bbbfff700 1 --2- 172.21.15.17:0/1634392524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bbc06a420 0x7f4bbc15a920 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc067830 tx=0x7f4bac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f406a0d7ee3f21c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:54.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.794+0000 7f4bbaffd700 1 -- 172.21.15.17:0/1634392524 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac011630 con 0x7f4bbc06a420 2023-10-06T04:43:54.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.794+0000 7f4bbaffd700 1 -- 172.21.15.17:0/1634392524 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bac011790 con 0x7f4bbc06a420 2023-10-06T04:43:54.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.794+0000 7f4bbaffd700 1 -- 172.21.15.17:0/1634392524 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac011b30 con 0x7f4bbc06a420 2023-10-06T04:43:54.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.795+0000 7f4bc29f3700 1 -- 172.21.15.17:0/1634392524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bbc06a420 msgr2=0x7f4bbc15a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:54.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.795+0000 7f4bc29f3700 1 --2- 172.21.15.17:0/1634392524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bbc06a420 0x7f4bbc15a920 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc067830 tx=0x7f4bac0091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:54.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.795+0000 7f4bc29f3700 1 -- 172.21.15.17:0/1634392524 shutdown_connections 2023-10-06T04:43:54.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.795+0000 7f4bc29f3700 1 --2- 172.21.15.17:0/1634392524 >> v2:172.21.15.136:3300/0 conn(0x7f4bbc0aa2a0 0x7f4bbc163520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:54.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.795+0000 7f4bc29f3700 1 --2- 172.21.15.17:0/1634392524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bbc06a420 0x7f4bbc15a920 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:54.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.795+0000 7f4bc29f3700 1 -- 172.21.15.17:0/1634392524 >> 172.21.15.17:0/1634392524 conn(0x7f4bbc06f7b0 msgr2=0x7f4bbc0ae590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:54.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.795+0000 7f4bc29f3700 1 -- 172.21.15.17:0/1634392524 shutdown_connections 2023-10-06T04:43:54.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.795+0000 7f4bc29f3700 1 -- 172.21.15.17:0/1634392524 wait complete. 2023-10-06T04:43:54.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.796+0000 7f4bc29f3700 1 Processor -- start 2023-10-06T04:43:54.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.796+0000 7f4bc29f3700 1 -- start start 2023-10-06T04:43:54.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.797+0000 7f4bc29f3700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4bbc06a420 0x7f4bbc1432b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:54.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.797+0000 7f4bc29f3700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4bbc0aa2a0 0x7f4bbc14cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:54.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.797+0000 7f4bc29f3700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bbc0aeeb0 0x7f4bbc0b1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:54.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.797+0000 7f4bc29f3700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc14c910 con 0x7f4bbc0aeeb0 2023-10-06T04:43:54.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.797+0000 7f4bc29f3700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc143c10 con 0x7f4bbc06a420 2023-10-06T04:43:54.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.797+0000 7f4bc29f3700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc0ac940 con 0x7f4bbc0aa2a0 2023-10-06T04:43:54.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.797+0000 7f4bc0f90700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bbc0aeeb0 0x7f4bbc0b1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:54.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.797+0000 7f4bc0f90700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bbc0aeeb0 0x7f4bbc0b1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35096/0 (socket says 172.21.15.17:35096) 2023-10-06T04:43:54.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.797+0000 7f4bc0f90700 1 -- 172.21.15.17:0/3287604434 learned_addr learned my addr 172.21.15.17:0/3287604434 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:54.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.797+0000 7f4bbbfff700 1 --2- 172.21.15.17:0/3287604434 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4bbc06a420 0x7f4bbc1432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:54.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.797+0000 7f4bbb7fe700 1 --2- 172.21.15.17:0/3287604434 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4bbc0aa2a0 0x7f4bbc14cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:54.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.797+0000 7f4bc0f90700 1 -- 172.21.15.17:0/3287604434 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4bbc0aa2a0 msgr2=0x7f4bbc14cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:54.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.797+0000 7f4bc0f90700 1 --2- 172.21.15.17:0/3287604434 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4bbc0aa2a0 0x7f4bbc14cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:54.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.797+0000 7f4bc0f90700 1 -- 172.21.15.17:0/3287604434 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4bbc06a420 msgr2=0x7f4bbc1432b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:54.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.797+0000 7f4bc0f90700 1 --2- 172.21.15.17:0/3287604434 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4bbc06a420 0x7f4bbc1432b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:54.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.797+0000 7f4bc0f90700 1 -- 172.21.15.17:0/3287604434 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bac009420 con 0x7f4bbc0aeeb0 2023-10-06T04:43:54.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.797+0000 7f4bbbfff700 1 --2- 172.21.15.17:0/3287604434 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4bbc06a420 0x7f4bbc1432b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:43:54.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.797+0000 7f4bbb7fe700 1 --2- 172.21.15.17:0/3287604434 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4bbc0aa2a0 0x7f4bbc14cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:43:54.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.797+0000 7f4bc0f90700 1 --2- 172.21.15.17:0/3287604434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bbc0aeeb0 0x7f4bbc0b1d00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4009df0 tx=0x7f4bb400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:54.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.798+0000 7f4bb3fff700 1 -- 172.21.15.17:0/3287604434 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb400cb50 con 0x7f4bbc0aeeb0 2023-10-06T04:43:54.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.798+0000 7f4bb3fff700 1 -- 172.21.15.17:0/3287604434 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb400f040 con 0x7f4bbc0aeeb0 2023-10-06T04:43:54.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.798+0000 7f4bc29f3700 1 -- 172.21.15.17:0/3287604434 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bbc14adb0 con 0x7f4bbc0aeeb0 2023-10-06T04:43:54.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.798+0000 7f4bb3fff700 1 -- 172.21.15.17:0/3287604434 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb4014480 con 0x7f4bbc0aeeb0 2023-10-06T04:43:54.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.798+0000 7f4bc29f3700 1 -- 172.21.15.17:0/3287604434 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bbc0b0750 con 0x7f4bbc0aeeb0 2023-10-06T04:43:54.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.799+0000 7f4bc29f3700 1 -- 172.21.15.17:0/3287604434 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bbc04c380 con 0x7f4bbc0aeeb0 2023-10-06T04:43:54.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.799+0000 7f4bb3fff700 1 -- 172.21.15.17:0/3287604434 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4bb40147f0 con 0x7f4bbc0aeeb0 2023-10-06T04:43:54.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.799+0000 7f4bb3fff700 1 --2- 172.21.15.17:0/3287604434 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f4b9c066f30 0x7f4b9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:54.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.800+0000 7f4bbbfff700 1 --2- 172.21.15.17:0/3287604434 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f4b9c066f30 0x7f4b9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:54.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.800+0000 7f4bb3fff700 1 -- 172.21.15.17:0/3287604434 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4bb40852f0 con 0x7f4bbc0aeeb0 2023-10-06T04:43:54.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.800+0000 7f4bbbfff700 1 --2- 172.21.15.17:0/3287604434 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f4b9c066f30 0x7f4b9c0693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4bac003080 tx=0x7f4bac017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:54.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.804+0000 7f4bb3fff700 1 -- 172.21.15.17:0/3287604434 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4bb4052400 con 0x7f4bbc0aeeb0 2023-10-06T04:43:54.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.996+0000 7f4bc29f3700 1 -- 172.21.15.17:0/3287604434 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4bbc06b190 con 0x7f4bbc0aeeb0 2023-10-06T04:43:54.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.996+0000 7f4bb3fff700 1 -- 172.21.15.17:0/3287604434 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4bb4055a20 con 0x7f4bbc0aeeb0 2023-10-06T04:43:54.998 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-10-06T04:43:55.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.998+0000 7f4bc29f3700 1 -- 172.21.15.17:0/3287604434 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f4b9c066f30 msgr2=0x7f4b9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:55.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.998+0000 7f4bc29f3700 1 --2- 172.21.15.17:0/3287604434 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f4b9c066f30 0x7f4b9c0693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4bac003080 tx=0x7f4bac017000 comp rx=0 tx=0).stop 2023-10-06T04:43:55.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.998+0000 7f4bc29f3700 1 -- 172.21.15.17:0/3287604434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bbc0aeeb0 msgr2=0x7f4bbc0b1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:55.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.998+0000 7f4bc29f3700 1 --2- 172.21.15.17:0/3287604434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bbc0aeeb0 0x7f4bbc0b1d00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4009df0 tx=0x7f4bb400b040 comp rx=0 tx=0).stop 2023-10-06T04:43:55.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.998+0000 7f4bc29f3700 1 -- 172.21.15.17:0/3287604434 shutdown_connections 2023-10-06T04:43:55.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.998+0000 7f4bc29f3700 1 --2- 172.21.15.17:0/3287604434 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f4b9c066f30 0x7f4b9c0693e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:55.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.998+0000 7f4bc29f3700 1 --2- 172.21.15.17:0/3287604434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bbc0aeeb0 0x7f4bbc0b1d00 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:55.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.998+0000 7f4bc29f3700 1 --2- 172.21.15.17:0/3287604434 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4bbc06a420 0x7f4bbc1432b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:55.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.998+0000 7f4bc29f3700 1 --2- 172.21.15.17:0/3287604434 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4bbc0aa2a0 0x7f4bbc14cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:55.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.998+0000 7f4bc29f3700 1 -- 172.21.15.17:0/3287604434 >> 172.21.15.17:0/3287604434 conn(0x7f4bbc06f7b0 msgr2=0x7f4bbc156990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:55.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.999+0000 7f4bc29f3700 1 -- 172.21.15.17:0/3287604434 shutdown_connections 2023-10-06T04:43:55.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:54.999+0000 7f4bc29f3700 1 -- 172.21.15.17:0/3287604434 wait complete. 2023-10-06T04:43:55.012 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:43:55.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.131+0000 7fd5c9a0f700 1 Processor -- start 2023-10-06T04:43:55.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.131+0000 7fd5c9a0f700 1 -- start start 2023-10-06T04:43:55.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.132+0000 7fd5c9a0f700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd5c40cabf0 0x7fd5c40c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:55.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.132+0000 7fd5c9a0f700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5c4159b10 0x7fd5c406f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:55.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.132+0000 7fd5c9a0f700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c40d1120 con 0x7fd5c406d140 2023-10-06T04:43:55.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.132+0000 7fd5c9a0f700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5c40d1400 con 0x7fd5c40cabf0 2023-10-06T04:43:55.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.132+0000 7fd5c9a0f700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c406e920 con 0x7fd5c4159b10 2023-10-06T04:43:55.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.132+0000 7fd5c37fe700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fd5c406d140 0x7fd5c406f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:43922/0 (socket says 172.21.15.17:43922) 2023-10-06T04:43:55.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.132+0000 7fd5c37fe700 1 -- 172.21.15.17:0/2685505178 learned_addr learned my addr 172.21.15.17:0/2685505178 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:55.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.133+0000 7fd5c2ffd700 1 --2- 172.21.15.17:0/2685505178 >> v2:172.21.15.136:3300/0 conn(0x7fd5c40cabf0 0x7fd5c40c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:55.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.133+0000 7fd5c27fc700 1 --2- 172.21.15.17:0/2685505178 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5c4159b10 0x7fd5c406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:55.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.133+0000 7fd5c1ffb700 1 -- 172.21.15.17:0/2685505178 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3539690997 0 0) 0x7fd5c40d1120 con 0x7fd5c406d140 2023-10-06T04:43:55.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.133+0000 7fd5c1ffb700 1 -- 172.21.15.17:0/2685505178 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5b0003570 con 0x7fd5c406d140 2023-10-06T04:43:55.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.133+0000 7fd5c1ffb700 1 -- 172.21.15.17:0/2685505178 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2970139808 0 0) 0x7fd5b0003570 con 0x7fd5c406d140 2023-10-06T04:43:55.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.133+0000 7fd5c2ffd700 1 -- 172.21.15.17:0/2685505178 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5c4159b10 msgr2=0x7fd5c406f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:55.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.133+0000 7fd5c2ffd700 1 --2- 172.21.15.17:0/2685505178 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5c4159b10 0x7fd5c406f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:55.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.133+0000 7fd5c2ffd700 1 -- 172.21.15.17:0/2685505178 >> v1:172.21.15.17:6789/0 conn(0x7fd5c406d140 legacy=0x7fd5c406f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:55.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.133+0000 7fd5c2ffd700 1 -- 172.21.15.17:0/2685505178 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c406ec00 con 0x7fd5c40cabf0 2023-10-06T04:43:55.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.133+0000 7fd5c2ffd700 1 --2- 172.21.15.17:0/2685505178 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5c40cabf0 0x7fd5c40c7660 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc009eb0 tx=0x7fd5bc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61ee3ffb399d9c40 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:55.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.133+0000 7fd5c1ffb700 1 -- 172.21.15.17:0/2685505178 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc00e070 con 0x7fd5c40cabf0 2023-10-06T04:43:55.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.133+0000 7fd5c1ffb700 1 -- 172.21.15.17:0/2685505178 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5bc00b870 con 0x7fd5c40cabf0 2023-10-06T04:43:55.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.133+0000 7fd5c1ffb700 1 -- 172.21.15.17:0/2685505178 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b4001470 con 0x7fd5c40cabf0 2023-10-06T04:43:55.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.134+0000 7fd5c9a0f700 1 -- 172.21.15.17:0/2685505178 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5c40cabf0 msgr2=0x7fd5c40c7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:55.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.134+0000 7fd5c9a0f700 1 --2- 172.21.15.17:0/2685505178 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5c40cabf0 0x7fd5c40c7660 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc009eb0 tx=0x7fd5bc009780 comp rx=0 tx=0).stop 2023-10-06T04:43:55.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.134+0000 7fd5c9a0f700 1 -- 172.21.15.17:0/2685505178 shutdown_connections 2023-10-06T04:43:55.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.134+0000 7fd5c9a0f700 1 --2- 172.21.15.17:0/2685505178 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5c40cabf0 0x7fd5c40c7660 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:55.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.134+0000 7fd5c9a0f700 1 --2- 172.21.15.17:0/2685505178 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5c4159b10 0x7fd5c406f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:55.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.134+0000 7fd5c9a0f700 1 -- 172.21.15.17:0/2685505178 >> 172.21.15.17:0/2685505178 conn(0x7fd5c406cd40 msgr2=0x7fd5c40d0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:55.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.134+0000 7fd5c9a0f700 1 -- 172.21.15.17:0/2685505178 shutdown_connections 2023-10-06T04:43:55.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.134+0000 7fd5c9a0f700 1 -- 172.21.15.17:0/2685505178 wait complete. 2023-10-06T04:43:55.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.135+0000 7fd5c9a0f700 1 Processor -- start 2023-10-06T04:43:55.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.135+0000 7fd5c9a0f700 1 -- start start 2023-10-06T04:43:55.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.136+0000 7fd5c9a0f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5c406d140 0x7fd5c416de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:55.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.136+0000 7fd5c9a0f700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5c40cabf0 0x7fd5c415e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:55.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.136+0000 7fd5c9a0f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5c4159b10 0x7fd5c415e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:55.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.136+0000 7fd5c9a0f700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c415c840 con 0x7fd5c406d140 2023-10-06T04:43:55.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.136+0000 7fd5c9a0f700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c415cb20 con 0x7fd5c4159b10 2023-10-06T04:43:55.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.136+0000 7fd5c9a0f700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c415ce00 con 0x7fd5c40cabf0 2023-10-06T04:43:55.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.136+0000 7fd5c2ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5c406d140 0x7fd5c416de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:55.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.136+0000 7fd5c2ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5c406d140 0x7fd5c416de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35098/0 (socket says 172.21.15.17:35098) 2023-10-06T04:43:55.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.136+0000 7fd5c2ffd700 1 -- 172.21.15.17:0/26422844 learned_addr learned my addr 172.21.15.17:0/26422844 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:55.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.136+0000 7fd5c37fe700 1 --2- 172.21.15.17:0/26422844 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5c4159b10 0x7fd5c415e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:55.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.136+0000 7fd5c27fc700 1 --2- 172.21.15.17:0/26422844 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5c40cabf0 0x7fd5c415e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:55.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.136+0000 7fd5c2ffd700 1 -- 172.21.15.17:0/26422844 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5c40cabf0 msgr2=0x7fd5c415e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:55.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.136+0000 7fd5c2ffd700 1 --2- 172.21.15.17:0/26422844 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5c40cabf0 0x7fd5c415e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:55.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.136+0000 7fd5c2ffd700 1 -- 172.21.15.17:0/26422844 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5c4159b10 msgr2=0x7fd5c415e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:55.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.136+0000 7fd5c2ffd700 1 --2- 172.21.15.17:0/26422844 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5c4159b10 0x7fd5c415e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:55.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.137+0000 7fd5c2ffd700 1 -- 172.21.15.17:0/26422844 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5bc009a20 con 0x7fd5c406d140 2023-10-06T04:43:55.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.137+0000 7fd5c27fc700 1 --2- 172.21.15.17:0/26422844 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5c40cabf0 0x7fd5c415e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:43:55.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.137+0000 7fd5c2ffd700 1 --2- 172.21.15.17:0/26422844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5c406d140 0x7fd5c416de10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd5c4064590 tx=0x7fd5bc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:55.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.137+0000 7fd5baffd700 1 -- 172.21.15.17:0/26422844 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc012970 con 0x7fd5c406d140 2023-10-06T04:43:55.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.137+0000 7fd5baffd700 1 -- 172.21.15.17:0/26422844 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5bc012af0 con 0x7fd5c406d140 2023-10-06T04:43:55.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.137+0000 7fd5c9a0f700 1 -- 172.21.15.17:0/26422844 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5c415d0e0 con 0x7fd5c406d140 2023-10-06T04:43:55.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.137+0000 7fd5baffd700 1 -- 172.21.15.17:0/26422844 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc027470 con 0x7fd5c406d140 2023-10-06T04:43:55.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.137+0000 7fd5c9a0f700 1 -- 172.21.15.17:0/26422844 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c415f0f0 con 0x7fd5c406d140 2023-10-06T04:43:55.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.138+0000 7fd5c9a0f700 1 -- 172.21.15.17:0/26422844 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5c415d600 con 0x7fd5c406d140 2023-10-06T04:43:55.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.138+0000 7fd5baffd700 1 -- 172.21.15.17:0/26422844 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd5bc024070 con 0x7fd5c406d140 2023-10-06T04:43:55.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.139+0000 7fd5baffd700 1 --2- 172.21.15.17:0/26422844 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd5a4066f30 0x7fd5a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:55.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.139+0000 7fd5baffd700 1 -- 172.21.15.17:0/26422844 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd5bc086af0 con 0x7fd5c406d140 2023-10-06T04:43:55.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.139+0000 7fd5c27fc700 1 --2- 172.21.15.17:0/26422844 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd5a4066f30 0x7fd5a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:55.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.139+0000 7fd5c27fc700 1 --2- 172.21.15.17:0/26422844 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd5a4066f30 0x7fd5a40693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd5c40b6120 tx=0x7fd5ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:55.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.143+0000 7fd5baffd700 1 -- 172.21.15.17:0/26422844 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd5c415d600 con 0x7fd5c406d140 2023-10-06T04:43:55.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.337+0000 7fd5c9a0f700 1 -- 172.21.15.17:0/26422844 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd5c415d600 con 0x7fd5c406d140 2023-10-06T04:43:55.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.338+0000 7fd5baffd700 1 -- 172.21.15.17:0/26422844 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd5c415d600 con 0x7fd5c406d140 2023-10-06T04:43:55.340 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-10-06T04:43:55.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.339+0000 7fd5c9a0f700 1 -- 172.21.15.17:0/26422844 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd5a4066f30 msgr2=0x7fd5a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:55.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.339+0000 7fd5c9a0f700 1 --2- 172.21.15.17:0/26422844 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd5a4066f30 0x7fd5a40693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd5c40b6120 tx=0x7fd5ac008040 comp rx=0 tx=0).stop 2023-10-06T04:43:55.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.340+0000 7fd5c9a0f700 1 -- 172.21.15.17:0/26422844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5c406d140 msgr2=0x7fd5c416de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:55.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.340+0000 7fd5c9a0f700 1 --2- 172.21.15.17:0/26422844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5c406d140 0x7fd5c416de10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd5c4064590 tx=0x7fd5bc018000 comp rx=0 tx=0).stop 2023-10-06T04:43:55.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.340+0000 7fd5c9a0f700 1 -- 172.21.15.17:0/26422844 shutdown_connections 2023-10-06T04:43:55.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.340+0000 7fd5c9a0f700 1 --2- 172.21.15.17:0/26422844 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd5a4066f30 0x7fd5a40693e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:55.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.340+0000 7fd5c9a0f700 1 --2- 172.21.15.17:0/26422844 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5c4159b10 0x7fd5c415e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:55.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.340+0000 7fd5c9a0f700 1 --2- 172.21.15.17:0/26422844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5c406d140 0x7fd5c416de10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:55.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.340+0000 7fd5c9a0f700 1 --2- 172.21.15.17:0/26422844 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5c40cabf0 0x7fd5c415e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:55.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.340+0000 7fd5c9a0f700 1 -- 172.21.15.17:0/26422844 >> 172.21.15.17:0/26422844 conn(0x7fd5c406cd40 msgr2=0x7fd5c4158a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:55.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.340+0000 7fd5c9a0f700 1 -- 172.21.15.17:0/26422844 shutdown_connections 2023-10-06T04:43:55.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.340+0000 7fd5c9a0f700 1 -- 172.21.15.17:0/26422844 wait complete. 2023-10-06T04:43:55.353 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:43:55.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.471+0000 7f28d70df700 1 Processor -- start 2023-10-06T04:43:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.471+0000 7f28d70df700 1 -- start start 2023-10-06T04:43:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.471+0000 7f28d70df700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f28d006dc50 0x7f28d015dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.472+0000 7f28d70df700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f28d0067ce0 0x7f28d0068120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.472+0000 7f28d70df700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d015ae80 con 0x7f28d0070520 2023-10-06T04:43:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.472+0000 7f28d70df700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d006e020 con 0x7f28d0067ce0 2023-10-06T04:43:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.472+0000 7f28d70df700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d015d910 con 0x7f28d006dc50 2023-10-06T04:43:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.472+0000 7f28d567c700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f28d0067ce0 0x7f28d0068120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.472+0000 7f28d567c700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f28d0067ce0 0x7f28d0068120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35110/0 (socket says 172.21.15.17:35110) 2023-10-06T04:43:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.472+0000 7f28d567c700 1 -- 172.21.15.17:0/336702432 learned_addr learned my addr 172.21.15.17:0/336702432 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.472+0000 7f28d4e7b700 1 --2- 172.21.15.17:0/336702432 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f28d006dc50 0x7f28d015dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.472+0000 7f28d567c700 1 -- 172.21.15.17:0/336702432 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f28d006dc50 msgr2=0x7f28d015dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:55.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.472+0000 7f28d567c700 1 --2- 172.21.15.17:0/336702432 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f28d006dc50 0x7f28d015dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:55.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.472+0000 7f28d567c700 1 -- 172.21.15.17:0/336702432 >> v1:172.21.15.136:6789/0 conn(0x7f28d0070520 legacy=0x7f28d0159d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:55.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.472+0000 7f28d567c700 1 -- 172.21.15.17:0/336702432 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d0068660 con 0x7f28d0067ce0 2023-10-06T04:43:55.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.472+0000 7f28d4e7b700 1 --2- 172.21.15.17:0/336702432 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f28d006dc50 0x7f28d015dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:43:55.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.472+0000 7f28d567c700 1 --2- 172.21.15.17:0/336702432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28d0067ce0 0x7f28d0068120 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f28c00099b0 tx=0x7f28c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=564b9c1022b8abbd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:55.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.472+0000 7f28cf7fe700 1 -- 172.21.15.17:0/336702432 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c000b820 con 0x7f28d0067ce0 2023-10-06T04:43:55.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.472+0000 7f28cf7fe700 1 -- 172.21.15.17:0/336702432 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c000b980 con 0x7f28d0067ce0 2023-10-06T04:43:55.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.472+0000 7f28cf7fe700 1 -- 172.21.15.17:0/336702432 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c000bd20 con 0x7f28d0067ce0 2023-10-06T04:43:55.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.473+0000 7f28d70df700 1 -- 172.21.15.17:0/336702432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28d0067ce0 msgr2=0x7f28d0068120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:55.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.473+0000 7f28d70df700 1 --2- 172.21.15.17:0/336702432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28d0067ce0 0x7f28d0068120 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f28c00099b0 tx=0x7f28c0009250 comp rx=0 tx=0).stop 2023-10-06T04:43:55.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.473+0000 7f28d70df700 1 -- 172.21.15.17:0/336702432 shutdown_connections 2023-10-06T04:43:55.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.473+0000 7f28d70df700 1 --2- 172.21.15.17:0/336702432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28d0067ce0 0x7f28d0068120 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:55.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.473+0000 7f28d70df700 1 --2- 172.21.15.17:0/336702432 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f28d006dc50 0x7f28d015dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:55.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.473+0000 7f28d70df700 1 -- 172.21.15.17:0/336702432 >> 172.21.15.17:0/336702432 conn(0x7f28d00ccae0 msgr2=0x7f28d00ccee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:55.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.473+0000 7f28d70df700 1 -- 172.21.15.17:0/336702432 shutdown_connections 2023-10-06T04:43:55.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.473+0000 7f28d70df700 1 -- 172.21.15.17:0/336702432 wait complete. 2023-10-06T04:43:55.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.474+0000 7f28d70df700 1 Processor -- start 2023-10-06T04:43:55.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.474+0000 7f28d70df700 1 -- start start 2023-10-06T04:43:55.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.475+0000 7f28d70df700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28d0067ce0 0x7f28d00c24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:55.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.475+0000 7f28d70df700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f28d006dc50 0x7f28d016a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:55.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.475+0000 7f28d70df700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28d0070520 0x7f28d0167330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:55.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.475+0000 7f28d70df700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d00c2b90 con 0x7f28d0070520 2023-10-06T04:43:55.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.475+0000 7f28d70df700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d016af20 con 0x7f28d0067ce0 2023-10-06T04:43:55.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.475+0000 7f28d70df700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d016d700 con 0x7f28d006dc50 2023-10-06T04:43:55.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.475+0000 7f28d567c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28d0070520 0x7f28d0167330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:55.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.475+0000 7f28d567c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28d0070520 0x7f28d0167330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35114/0 (socket says 172.21.15.17:35114) 2023-10-06T04:43:55.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.475+0000 7f28d567c700 1 -- 172.21.15.17:0/78891595 learned_addr learned my addr 172.21.15.17:0/78891595 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:55.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.475+0000 7f28d4e7b700 1 --2- 172.21.15.17:0/78891595 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28d0067ce0 0x7f28d00c24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:55.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.475+0000 7f28cffff700 1 --2- 172.21.15.17:0/78891595 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f28d006dc50 0x7f28d016a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:55.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.475+0000 7f28d567c700 1 -- 172.21.15.17:0/78891595 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f28d006dc50 msgr2=0x7f28d016a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:55.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.475+0000 7f28d567c700 1 --2- 172.21.15.17:0/78891595 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f28d006dc50 0x7f28d016a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:55.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.475+0000 7f28d567c700 1 -- 172.21.15.17:0/78891595 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28d0067ce0 msgr2=0x7f28d00c24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:55.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.475+0000 7f28d567c700 1 --2- 172.21.15.17:0/78891595 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28d0067ce0 0x7f28d00c24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:55.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.475+0000 7f28d567c700 1 -- 172.21.15.17:0/78891595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c00094f0 con 0x7f28d0070520 2023-10-06T04:43:55.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.475+0000 7f28cffff700 1 --2- 172.21.15.17:0/78891595 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f28d006dc50 0x7f28d016a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:43:55.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.475+0000 7f28d567c700 1 --2- 172.21.15.17:0/78891595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28d0070520 0x7f28d0167330 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f28c00030c0 tx=0x7f28c0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:55.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.476+0000 7f28ccff9700 1 -- 172.21.15.17:0/78891595 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c001b450 con 0x7f28d0070520 2023-10-06T04:43:55.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.476+0000 7f28ccff9700 1 -- 172.21.15.17:0/78891595 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c0020070 con 0x7f28d0070520 2023-10-06T04:43:55.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.476+0000 7f28d70df700 1 -- 172.21.15.17:0/78891595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d016d9e0 con 0x7f28d0070520 2023-10-06T04:43:55.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.476+0000 7f28ccff9700 1 -- 172.21.15.17:0/78891595 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c001b800 con 0x7f28d0070520 2023-10-06T04:43:55.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.476+0000 7f28d70df700 1 -- 172.21.15.17:0/78891595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d016dfa0 con 0x7f28d0070520 2023-10-06T04:43:55.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.477+0000 7f28d70df700 1 -- 172.21.15.17:0/78891595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28d016e310 con 0x7f28d0070520 2023-10-06T04:43:55.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.477+0000 7f28ccff9700 1 -- 172.21.15.17:0/78891595 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f28c0022030 con 0x7f28d0070520 2023-10-06T04:43:55.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.477+0000 7f28ccff9700 1 --2- 172.21.15.17:0/78891595 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f28b0066f30 0x7f28b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:55.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.478+0000 7f28ccff9700 1 -- 172.21.15.17:0/78891595 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f28c0086660 con 0x7f28d0070520 2023-10-06T04:43:55.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.478+0000 7f28d4e7b700 1 --2- 172.21.15.17:0/78891595 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f28b0066f30 0x7f28b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:55.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.478+0000 7f28d4e7b700 1 --2- 172.21.15.17:0/78891595 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f28b0066f30 0x7f28b00693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f28c800d6e0 tx=0x7f28c8007850 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:55.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.482+0000 7f28ccff9700 1 -- 172.21.15.17:0/78891595 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28c0053770 con 0x7f28d0070520 2023-10-06T04:43:55.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.676+0000 7f28d70df700 1 -- 172.21.15.17:0/78891595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28d016e310 con 0x7f28d0070520 2023-10-06T04:43:55.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.677+0000 7f28ccff9700 1 -- 172.21.15.17:0/78891595 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f28c0056d90 con 0x7f28d0070520 2023-10-06T04:43:55.680 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:43:55.681 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":21,"fsid":"780777c4-2b25-4d35-9058-c9f2d62e3ad9","created":"2023-10-06T04:43:10.578520+0000","modified":"2023-10-06T04:43:30.789916+0000","last_up_change":"2023-10-06T04:43:20.682958+0000","last_in_change":"2023-10-06T04:43:12.978917+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:43:21.795733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:43:22.389592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:43:26.914728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:43:28.173678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"84737b08-575c-46dd-9488-073ae8504494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6809","nonce":90656},{"type":"v1","addr":"172.21.15.17:6811","nonce":90656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":90656},{"type":"v1","addr":"172.21.15.17:6814","nonce":90656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":90656},{"type":"v1","addr":"172.21.15.17:6822","nonce":90656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":90656},{"type":"v1","addr":"172.21.15.17:6818","nonce":90656}]},"public_addr":"172.21.15.17:6811/90656","cluster_addr":"172.21.15.17:6814/90656","heartbeat_back_addr":"172.21.15.17:6822/90656","heartbeat_front_addr":"172.21.15.17:6818/90656","state":["exists","up"]},{"osd":1,"uuid":"dffeb740-58a2-4fd6-8ff1-a0a11a2cc709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":90655},{"type":"v1","addr":"172.21.15.17:6801","nonce":90655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":90655},{"type":"v1","addr":"172.21.15.17:6803","nonce":90655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":90655},{"type":"v1","addr":"172.21.15.17:6807","nonce":90655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":90655},{"type":"v1","addr":"172.21.15.17:6805","nonce":90655}]},"public_addr":"172.21.15.17:6801/90655","cluster_addr":"172.21.15.17:6803/90655","heartbeat_back_addr":"172.21.15.17:6807/90655","heartbeat_front_addr":"172.21.15.17:6805/90655","state":["exists","up"]},{"osd":2,"uuid":"48bd6831-763d-48c2-b515-e02c216d608b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":90657},{"type":"v1","addr":"172.21.15.17:6810","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":90657},{"type":"v1","addr":"172.21.15.17:6815","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":90657},{"type":"v1","addr":"172.21.15.17:6823","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":90657},{"type":"v1","addr":"172.21.15.17:6819","nonce":90657}]},"public_addr":"172.21.15.17:6810/90657","cluster_addr":"172.21.15.17:6815/90657","heartbeat_back_addr":"172.21.15.17:6823/90657","heartbeat_front_addr":"172.21.15.17:6819/90657","state":["exists","up"]},{"osd":3,"uuid":"ae7dbb23-abe7-4bd3-a4df-6f5963d6804c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":90688},{"type":"v1","addr":"172.21.15.17:6825","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":90688},{"type":"v1","addr":"172.21.15.17:6827","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":90688},{"type":"v1","addr":"172.21.15.17:6831","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":90688},{"type":"v1","addr":"172.21.15.17:6829","nonce":90688}]},"public_addr":"172.21.15.17:6825/90688","cluster_addr":"172.21.15.17:6827/90688","heartbeat_back_addr":"172.21.15.17:6831/90688","heartbeat_front_addr":"172.21.15.17:6829/90688","state":["exists","up"]},{"osd":4,"uuid":"29991fb4-1667-4ea3-aca0-d55db27f3bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":90902},{"type":"v1","addr":"172.21.15.136:6801","nonce":90902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":90902},{"type":"v1","addr":"172.21.15.136:6803","nonce":90902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":90902},{"type":"v1","addr":"172.21.15.136:6807","nonce":90902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":90902},{"type":"v1","addr":"172.21.15.136:6805","nonce":90902}]},"public_addr":"172.21.15.136:6801/90902","cluster_addr":"172.21.15.136:6803/90902","heartbeat_back_addr":"172.21.15.136:6807/90902","heartbeat_front_addr":"172.21.15.136:6805/90902","state":["exists","up"]},{"osd":5,"uuid":"398b4ff9-03fc-421f-882c-ba12aa088eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":90901},{"type":"v1","addr":"172.21.15.136:6809","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":90901},{"type":"v1","addr":"172.21.15.136:6811","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":90901},{"type":"v1","addr":"172.21.15.136:6815","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":90901},{"type":"v1","addr":"172.21.15.136:6813","nonce":90901}]},"public_addr":"172.21.15.136:6809/90901","cluster_addr":"172.21.15.136:6811/90901","heartbeat_back_addr":"172.21.15.136:6815/90901","heartbeat_front_addr":"172.21.15.136:6813/90901","state":["exists","up"]},{"osd":6,"uuid":"1bb91a72-4dab-4cdb-aa1d-2b8a9edf1ad0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":90927},{"type":"v1","addr":"172.21.15.136:6825","nonce":90927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":90927},{"type":"v1","addr":"172.21.15.136:6827","nonce":90927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":90927},{"type":"v1","addr":"172.21.15.136:6831","nonce":90927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":90927},{"type":"v1","addr":"172.21.15.136:6829","nonce":90927}]},"public_addr":"172.21.15.136:6825/90927","cluster_addr":"172.21.15.136:6827/90927","heartbeat_back_addr":"172.21.15.136:6831/90927","heartbeat_front_addr":"172.21.15.136:6829/90927","state":["exists","up"]},{"osd":7,"uuid":"719b654e-010d-4aa4-8c13-83fdde242b47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":90934},{"type":"v1","addr":"172.21.15.136:6817","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":90934},{"type":"v1","addr":"172.21.15.136:6819","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":90934},{"type":"v1","addr":"172.21.15.136:6824","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":90934},{"type":"v1","addr":"172.21.15.136:6821","nonce":90934}]},"public_addr":"172.21.15.136:6817/90934","cluster_addr":"172.21.15.136:6819/90934","heartbeat_back_addr":"172.21.15.136:6824/90934","heartbeat_front_addr":"172.21.15.136:6821/90934","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.157479+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.140520+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.190743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.231396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.156510+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.145822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.202888+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.139532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:43:55.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.679+0000 7f28d70df700 1 -- 172.21.15.17:0/78891595 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f28b0066f30 msgr2=0x7f28b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:55.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.679+0000 7f28d70df700 1 --2- 172.21.15.17:0/78891595 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f28b0066f30 0x7f28b00693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f28c800d6e0 tx=0x7f28c8007850 comp rx=0 tx=0).stop 2023-10-06T04:43:55.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.679+0000 7f28d70df700 1 -- 172.21.15.17:0/78891595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28d0070520 msgr2=0x7f28d0167330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:55.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.679+0000 7f28d70df700 1 --2- 172.21.15.17:0/78891595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28d0070520 0x7f28d0167330 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f28c00030c0 tx=0x7f28c0016000 comp rx=0 tx=0).stop 2023-10-06T04:43:55.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.680+0000 7f28d70df700 1 -- 172.21.15.17:0/78891595 shutdown_connections 2023-10-06T04:43:55.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.680+0000 7f28d70df700 1 --2- 172.21.15.17:0/78891595 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f28b0066f30 0x7f28b00693e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:55.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.680+0000 7f28d70df700 1 --2- 172.21.15.17:0/78891595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28d0070520 0x7f28d0167330 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:55.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.680+0000 7f28d70df700 1 --2- 172.21.15.17:0/78891595 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28d0067ce0 0x7f28d00c24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:55.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.680+0000 7f28d70df700 1 --2- 172.21.15.17:0/78891595 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f28d006dc50 0x7f28d016a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:55.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.680+0000 7f28d70df700 1 -- 172.21.15.17:0/78891595 >> 172.21.15.17:0/78891595 conn(0x7f28d00ccae0 msgr2=0x7f28d0157b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:55.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.680+0000 7f28d70df700 1 -- 172.21.15.17:0/78891595 shutdown_connections 2023-10-06T04:43:55.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.680+0000 7f28d70df700 1 -- 172.21.15.17:0/78891595 wait complete. 2023-10-06T04:43:55.694 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:43:21.795733+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:43:22.389592+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:43:26.914728+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:43:28.173678+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:43:55.694 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:43:55.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.815+0000 7fe3452e3700 1 Processor -- start 2023-10-06T04:43:55.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.815+0000 7fe3452e3700 1 -- start start 2023-10-06T04:43:55.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.815+0000 7fe3452e3700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe3400cabf0 0x7fe3400c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:55.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.815+0000 7fe3452e3700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe340159b10 0x7fe34006f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:55.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.815+0000 7fe3452e3700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3400d1120 con 0x7fe34006d140 2023-10-06T04:43:55.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.815+0000 7fe3452e3700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3400d1400 con 0x7fe340159b10 2023-10-06T04:43:55.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.815+0000 7fe3452e3700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe34006e920 con 0x7fe3400cabf0 2023-10-06T04:43:55.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.815+0000 7fe33e7fc700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe340159b10 0x7fe34006f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:55.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.816+0000 7fe33e7fc700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe340159b10 0x7fe34006f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35126/0 (socket says 172.21.15.17:35126) 2023-10-06T04:43:55.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.816+0000 7fe33e7fc700 1 -- 172.21.15.17:0/473248198 learned_addr learned my addr 172.21.15.17:0/473248198 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:55.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.816+0000 7fe33effd700 1 --2- 172.21.15.17:0/473248198 >> v2:172.21.15.136:3300/0 conn(0x7fe3400cabf0 0x7fe3400c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:55.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.816+0000 7fe33e7fc700 1 -- 172.21.15.17:0/473248198 >> v2:172.21.15.136:3300/0 conn(0x7fe3400cabf0 msgr2=0x7fe3400c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:55.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.816+0000 7fe33e7fc700 1 --2- 172.21.15.17:0/473248198 >> v2:172.21.15.136:3300/0 conn(0x7fe3400cabf0 0x7fe3400c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:55.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.816+0000 7fe33e7fc700 1 -- 172.21.15.17:0/473248198 >> v1:172.21.15.136:6789/0 conn(0x7fe34006d140 legacy=0x7fe34006f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:55.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.816+0000 7fe33e7fc700 1 -- 172.21.15.17:0/473248198 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe34006ec00 con 0x7fe340159b10 2023-10-06T04:43:55.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.816+0000 7fe33e7fc700 1 --2- 172.21.15.17:0/473248198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe340159b10 0x7fe34006f120 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe3400ce130 tx=0x7fe328009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e052b8d3ac815fdf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:55.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.816+0000 7fe33dffb700 1 -- 172.21.15.17:0/473248198 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32800b860 con 0x7fe340159b10 2023-10-06T04:43:55.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.816+0000 7fe33dffb700 1 -- 172.21.15.17:0/473248198 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe32800b9c0 con 0x7fe340159b10 2023-10-06T04:43:55.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.816+0000 7fe33dffb700 1 -- 172.21.15.17:0/473248198 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32800bd60 con 0x7fe340159b10 2023-10-06T04:43:55.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.817+0000 7fe3452e3700 1 -- 172.21.15.17:0/473248198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe340159b10 msgr2=0x7fe34006f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:55.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.817+0000 7fe3452e3700 1 --2- 172.21.15.17:0/473248198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe340159b10 0x7fe34006f120 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe3400ce130 tx=0x7fe328009250 comp rx=0 tx=0).stop 2023-10-06T04:43:55.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.817+0000 7fe3452e3700 1 -- 172.21.15.17:0/473248198 shutdown_connections 2023-10-06T04:43:55.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.817+0000 7fe3452e3700 1 --2- 172.21.15.17:0/473248198 >> v2:172.21.15.136:3300/0 conn(0x7fe3400cabf0 0x7fe3400c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:55.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.817+0000 7fe3452e3700 1 --2- 172.21.15.17:0/473248198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe340159b10 0x7fe34006f120 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:55.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.817+0000 7fe3452e3700 1 -- 172.21.15.17:0/473248198 >> 172.21.15.17:0/473248198 conn(0x7fe34006cd40 msgr2=0x7fe3400d0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:55.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.817+0000 7fe3452e3700 1 -- 172.21.15.17:0/473248198 shutdown_connections 2023-10-06T04:43:55.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.817+0000 7fe3452e3700 1 -- 172.21.15.17:0/473248198 wait complete. 2023-10-06T04:43:55.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.818+0000 7fe3452e3700 1 Processor -- start 2023-10-06T04:43:55.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.818+0000 7fe3452e3700 1 -- start start 2023-10-06T04:43:55.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.819+0000 7fe3452e3700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe34006d140 0x7fe3400c6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:55.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.819+0000 7fe3452e3700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe3400cabf0 0x7fe340169e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:55.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.819+0000 7fe3452e3700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe340159b10 0x7fe34016a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:55.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.819+0000 7fe3452e3700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34016aee0 con 0x7fe340159b10 2023-10-06T04:43:55.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.819+0000 7fe3452e3700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3400c4a90 con 0x7fe3400cabf0 2023-10-06T04:43:55.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.819+0000 7fe3452e3700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3400c4d70 con 0x7fe34006d140 2023-10-06T04:43:55.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.819+0000 7fe33f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe340159b10 0x7fe34016a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:55.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.819+0000 7fe33f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe340159b10 0x7fe34016a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35130/0 (socket says 172.21.15.17:35130) 2023-10-06T04:43:55.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.819+0000 7fe33f7fe700 1 -- 172.21.15.17:0/1520361070 learned_addr learned my addr 172.21.15.17:0/1520361070 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:55.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.819+0000 7fe33effd700 1 --2- 172.21.15.17:0/1520361070 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe34006d140 0x7fe3400c6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:55.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.819+0000 7fe33e7fc700 1 --2- 172.21.15.17:0/1520361070 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe3400cabf0 0x7fe340169e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:55.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.819+0000 7fe33f7fe700 1 -- 172.21.15.17:0/1520361070 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe34006d140 msgr2=0x7fe3400c6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:55.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.819+0000 7fe33f7fe700 1 --2- 172.21.15.17:0/1520361070 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe34006d140 0x7fe3400c6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:55.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.819+0000 7fe33f7fe700 1 -- 172.21.15.17:0/1520361070 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe3400cabf0 msgr2=0x7fe340169e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:55.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.819+0000 7fe33f7fe700 1 --2- 172.21.15.17:0/1520361070 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe3400cabf0 0x7fe340169e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:55.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.819+0000 7fe33f7fe700 1 -- 172.21.15.17:0/1520361070 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3280094f0 con 0x7fe340159b10 2023-10-06T04:43:55.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.819+0000 7fe33effd700 1 --2- 172.21.15.17:0/1520361070 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe34006d140 0x7fe3400c6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:43:55.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.819+0000 7fe33f7fe700 1 --2- 172.21.15.17:0/1520361070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe340159b10 0x7fe34016a3a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe33000c910 tx=0x7fe3300016b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:55.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.819+0000 7fe336ffd700 1 -- 172.21.15.17:0/1520361070 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe330012630 con 0x7fe340159b10 2023-10-06T04:43:55.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.819+0000 7fe336ffd700 1 -- 172.21.15.17:0/1520361070 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe330012790 con 0x7fe340159b10 2023-10-06T04:43:55.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.820+0000 7fe3452e3700 1 -- 172.21.15.17:0/1520361070 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3400c5050 con 0x7fe340159b10 2023-10-06T04:43:55.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.820+0000 7fe336ffd700 1 -- 172.21.15.17:0/1520361070 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe330012b10 con 0x7fe340159b10 2023-10-06T04:43:55.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.820+0000 7fe3452e3700 1 -- 172.21.15.17:0/1520361070 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe340155730 con 0x7fe340159b10 2023-10-06T04:43:55.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.820+0000 7fe3452e3700 1 -- 172.21.15.17:0/1520361070 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe340070810 con 0x7fe340159b10 2023-10-06T04:43:55.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.821+0000 7fe336ffd700 1 -- 172.21.15.17:0/1520361070 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe33001a3a0 con 0x7fe340159b10 2023-10-06T04:43:55.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.821+0000 7fe336ffd700 1 --2- 172.21.15.17:0/1520361070 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe320066f30 0x7fe3200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:55.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.821+0000 7fe336ffd700 1 -- 172.21.15.17:0/1520361070 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe3300848c0 con 0x7fe340159b10 2023-10-06T04:43:55.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.821+0000 7fe33effd700 1 --2- 172.21.15.17:0/1520361070 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe320066f30 0x7fe3200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:55.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.822+0000 7fe33effd700 1 --2- 172.21.15.17:0/1520361070 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe320066f30 0x7fe3200693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe338006aa0 tx=0x7fe338008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:55.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:55.826+0000 7fe336ffd700 1 -- 172.21.15.17:0/1520361070 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe330055460 con 0x7fe340159b10 2023-10-06T04:43:56.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.020+0000 7fe3452e3700 1 -- 172.21.15.17:0/1520361070 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe3400cc2f0 con 0x7fe340159b10 2023-10-06T04:43:56.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.021+0000 7fe336ffd700 1 -- 172.21.15.17:0/1520361070 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe330054ff0 con 0x7fe340159b10 2023-10-06T04:43:56.023 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-10-06T04:43:56.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.022+0000 7fe3452e3700 1 -- 172.21.15.17:0/1520361070 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe320066f30 msgr2=0x7fe3200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:56.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.022+0000 7fe3452e3700 1 --2- 172.21.15.17:0/1520361070 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe320066f30 0x7fe3200693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe338006aa0 tx=0x7fe338008040 comp rx=0 tx=0).stop 2023-10-06T04:43:56.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.022+0000 7fe3452e3700 1 -- 172.21.15.17:0/1520361070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe340159b10 msgr2=0x7fe34016a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:56.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.022+0000 7fe3452e3700 1 --2- 172.21.15.17:0/1520361070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe340159b10 0x7fe34016a3a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe33000c910 tx=0x7fe3300016b0 comp rx=0 tx=0).stop 2023-10-06T04:43:56.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.022+0000 7fe3452e3700 1 -- 172.21.15.17:0/1520361070 shutdown_connections 2023-10-06T04:43:56.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.023+0000 7fe3452e3700 1 --2- 172.21.15.17:0/1520361070 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe320066f30 0x7fe3200693e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:56.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.023+0000 7fe3452e3700 1 --2- 172.21.15.17:0/1520361070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe340159b10 0x7fe34016a3a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:56.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.023+0000 7fe3452e3700 1 --2- 172.21.15.17:0/1520361070 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe34006d140 0x7fe3400c6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:56.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.023+0000 7fe3452e3700 1 --2- 172.21.15.17:0/1520361070 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe3400cabf0 0x7fe340169e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:56.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.023+0000 7fe3452e3700 1 -- 172.21.15.17:0/1520361070 >> 172.21.15.17:0/1520361070 conn(0x7fe34006cd40 msgr2=0x7fe3400c8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:56.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.023+0000 7fe3452e3700 1 -- 172.21.15.17:0/1520361070 shutdown_connections 2023-10-06T04:43:56.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.023+0000 7fe3452e3700 1 -- 172.21.15.17:0/1520361070 wait complete. 2023-10-06T04:43:56.036 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:43:56.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.156+0000 7ff70fcab700 1 Processor -- start 2023-10-06T04:43:56.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.156+0000 7ff70fcab700 1 -- start start 2023-10-06T04:43:56.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.157+0000 7ff70fcab700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff7080cabf0 0x7ff7080c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:56.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.157+0000 7ff70fcab700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff708159b10 0x7ff70806f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:56.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.157+0000 7ff70fcab700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7080d1120 con 0x7ff70806d140 2023-10-06T04:43:56.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.157+0000 7ff70fcab700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7080d1400 con 0x7ff7080cabf0 2023-10-06T04:43:56.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.157+0000 7ff70fcab700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff70806e920 con 0x7ff708159b10 2023-10-06T04:43:56.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.157+0000 7ff70da47700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff7080cabf0 0x7ff7080c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:56.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.157+0000 7ff70e248700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7ff70806d140 0x7ff70806f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:43936/0 (socket says 172.21.15.17:43936) 2023-10-06T04:43:56.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.157+0000 7ff70e248700 1 -- 172.21.15.17:0/3617891069 learned_addr learned my addr 172.21.15.17:0/3617891069 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:56.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.157+0000 7ff70d246700 1 --2- 172.21.15.17:0/3617891069 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff708159b10 0x7ff70806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:56.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.158+0000 7ff70da47700 1 -- 172.21.15.17:0/3617891069 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff708159b10 msgr2=0x7ff70806f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:56.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.158+0000 7ff70da47700 1 --2- 172.21.15.17:0/3617891069 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff708159b10 0x7ff70806f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:56.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.158+0000 7ff70da47700 1 -- 172.21.15.17:0/3617891069 >> v1:172.21.15.17:6789/0 conn(0x7ff70806d140 legacy=0x7ff70806f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:56.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.158+0000 7ff70da47700 1 -- 172.21.15.17:0/3617891069 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff70806ec00 con 0x7ff7080cabf0 2023-10-06T04:43:56.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.158+0000 7ff70ca45700 1 -- 172.21.15.17:0/3617891069 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3162344043 0 0) 0x7ff7080d1120 con 0x7ff70806d140 2023-10-06T04:43:56.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.158+0000 7ff70da47700 1 --2- 172.21.15.17:0/3617891069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7080cabf0 0x7ff7080c7660 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff700009eb0 tx=0x7ff700009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76c988a1f72e26eb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:56.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.158+0000 7ff70ca45700 1 -- 172.21.15.17:0/3617891069 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70000e070 con 0x7ff7080cabf0 2023-10-06T04:43:56.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.158+0000 7ff70ca45700 1 -- 172.21.15.17:0/3617891069 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70000bc30 con 0x7ff7080cabf0 2023-10-06T04:43:56.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.158+0000 7ff70ca45700 1 -- 172.21.15.17:0/3617891069 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff700012430 con 0x7ff7080cabf0 2023-10-06T04:43:56.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.158+0000 7ff70fcab700 1 -- 172.21.15.17:0/3617891069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7080cabf0 msgr2=0x7ff7080c7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:56.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.158+0000 7ff70fcab700 1 --2- 172.21.15.17:0/3617891069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7080cabf0 0x7ff7080c7660 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff700009eb0 tx=0x7ff700009780 comp rx=0 tx=0).stop 2023-10-06T04:43:56.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.158+0000 7ff70fcab700 1 -- 172.21.15.17:0/3617891069 shutdown_connections 2023-10-06T04:43:56.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.158+0000 7ff70fcab700 1 --2- 172.21.15.17:0/3617891069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7080cabf0 0x7ff7080c7660 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:56.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.158+0000 7ff70fcab700 1 --2- 172.21.15.17:0/3617891069 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff708159b10 0x7ff70806f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:56.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.158+0000 7ff70fcab700 1 -- 172.21.15.17:0/3617891069 >> 172.21.15.17:0/3617891069 conn(0x7ff70806cd40 msgr2=0x7ff7080d0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:56.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.159+0000 7ff70fcab700 1 -- 172.21.15.17:0/3617891069 shutdown_connections 2023-10-06T04:43:56.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.159+0000 7ff70fcab700 1 -- 172.21.15.17:0/3617891069 wait complete. 2023-10-06T04:43:56.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.160+0000 7ff70fcab700 1 Processor -- start 2023-10-06T04:43:56.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.160+0000 7ff70fcab700 1 -- start start 2023-10-06T04:43:56.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.160+0000 7ff70fcab700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff70806d140 0x7ff7080c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:56.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.160+0000 7ff70fcab700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7080cabf0 0x7ff70815d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:56.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.160+0000 7ff70fcab700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff708159b10 0x7ff70815d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:56.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.160+0000 7ff70fcab700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7080b3400 con 0x7ff708159b10 2023-10-06T04:43:56.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.160+0000 7ff70fcab700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70815dc70 con 0x7ff7080cabf0 2023-10-06T04:43:56.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.160+0000 7ff70fcab700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff70815df50 con 0x7ff70806d140 2023-10-06T04:43:56.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.160+0000 7ff70e248700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff708159b10 0x7ff70815d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:56.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.160+0000 7ff70e248700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff708159b10 0x7ff70815d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35150/0 (socket says 172.21.15.17:35150) 2023-10-06T04:43:56.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.160+0000 7ff70e248700 1 -- 172.21.15.17:0/2920403892 learned_addr learned my addr 172.21.15.17:0/2920403892 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:56.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.161+0000 7ff70da47700 1 --2- 172.21.15.17:0/2920403892 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff70806d140 0x7ff7080c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:56.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.161+0000 7ff70d246700 1 --2- 172.21.15.17:0/2920403892 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7080cabf0 0x7ff70815d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:56.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.161+0000 7ff70e248700 1 -- 172.21.15.17:0/2920403892 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff70806d140 msgr2=0x7ff7080c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:56.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.161+0000 7ff70e248700 1 --2- 172.21.15.17:0/2920403892 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff70806d140 0x7ff7080c8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:56.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.161+0000 7ff70e248700 1 -- 172.21.15.17:0/2920403892 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7080cabf0 msgr2=0x7ff70815d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:56.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.161+0000 7ff70e248700 1 --2- 172.21.15.17:0/2920403892 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7080cabf0 0x7ff70815d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:56.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.161+0000 7ff70e248700 1 -- 172.21.15.17:0/2920403892 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff700009a20 con 0x7ff708159b10 2023-10-06T04:43:56.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.161+0000 7ff70d246700 1 --2- 172.21.15.17:0/2920403892 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7080cabf0 0x7ff70815d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:43:56.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.161+0000 7ff70e248700 1 --2- 172.21.15.17:0/2920403892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff708159b10 0x7ff70815d5f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff6f800c500 tx=0x7ff6f8007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:56.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.161+0000 7ff705ffb700 1 -- 172.21.15.17:0/2920403892 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f8005b30 con 0x7ff708159b10 2023-10-06T04:43:56.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.161+0000 7ff705ffb700 1 -- 172.21.15.17:0/2920403892 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f8005c90 con 0x7ff708159b10 2023-10-06T04:43:56.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.161+0000 7ff70fcab700 1 -- 172.21.15.17:0/2920403892 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff70815e230 con 0x7ff708159b10 2023-10-06T04:43:56.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.161+0000 7ff705ffb700 1 -- 172.21.15.17:0/2920403892 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f8007320 con 0x7ff708159b10 2023-10-06T04:43:56.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.161+0000 7ff70fcab700 1 -- 172.21.15.17:0/2920403892 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7080c6d40 con 0x7ff708159b10 2023-10-06T04:43:56.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.162+0000 7ff70fcab700 1 -- 172.21.15.17:0/2920403892 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff70804c380 con 0x7ff708159b10 2023-10-06T04:43:56.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.163+0000 7ff705ffb700 1 -- 172.21.15.17:0/2920403892 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff6f801b3b0 con 0x7ff708159b10 2023-10-06T04:43:56.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.163+0000 7ff705ffb700 1 --2- 172.21.15.17:0/2920403892 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff6f4066f30 0x7ff6f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:56.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.163+0000 7ff705ffb700 1 -- 172.21.15.17:0/2920403892 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff6f8083c00 con 0x7ff708159b10 2023-10-06T04:43:56.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.163+0000 7ff70da47700 1 --2- 172.21.15.17:0/2920403892 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff6f4066f30 0x7ff6f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:56.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.163+0000 7ff70da47700 1 --2- 172.21.15.17:0/2920403892 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff6f4066f30 0x7ff6f40693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff700009eb0 tx=0x7ff700017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:56.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.167+0000 7ff705ffb700 1 -- 172.21.15.17:0/2920403892 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff6f8050c70 con 0x7ff708159b10 2023-10-06T04:43:56.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.361+0000 7ff70fcab700 1 -- 172.21.15.17:0/2920403892 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff70806de80 con 0x7ff708159b10 2023-10-06T04:43:56.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.361+0000 7ff705ffb700 1 -- 172.21.15.17:0/2920403892 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff6f80170a0 con 0x7ff708159b10 2023-10-06T04:43:56.363 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-10-06T04:43:56.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.363+0000 7ff70fcab700 1 -- 172.21.15.17:0/2920403892 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff6f4066f30 msgr2=0x7ff6f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:56.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.363+0000 7ff70fcab700 1 --2- 172.21.15.17:0/2920403892 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff6f4066f30 0x7ff6f40693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff700009eb0 tx=0x7ff700017000 comp rx=0 tx=0).stop 2023-10-06T04:43:56.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.363+0000 7ff70fcab700 1 -- 172.21.15.17:0/2920403892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff708159b10 msgr2=0x7ff70815d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:56.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.363+0000 7ff70fcab700 1 --2- 172.21.15.17:0/2920403892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff708159b10 0x7ff70815d5f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff6f800c500 tx=0x7ff6f8007f60 comp rx=0 tx=0).stop 2023-10-06T04:43:56.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.363+0000 7ff70fcab700 1 -- 172.21.15.17:0/2920403892 shutdown_connections 2023-10-06T04:43:56.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.363+0000 7ff70fcab700 1 --2- 172.21.15.17:0/2920403892 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff6f4066f30 0x7ff6f40693e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:56.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.363+0000 7ff70fcab700 1 --2- 172.21.15.17:0/2920403892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff708159b10 0x7ff70815d5f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:56.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.363+0000 7ff70fcab700 1 --2- 172.21.15.17:0/2920403892 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff70806d140 0x7ff7080c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:56.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.364+0000 7ff70fcab700 1 --2- 172.21.15.17:0/2920403892 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7080cabf0 0x7ff70815d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:56.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.364+0000 7ff70fcab700 1 -- 172.21.15.17:0/2920403892 >> 172.21.15.17:0/2920403892 conn(0x7ff70806cd40 msgr2=0x7ff7080c9620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:56.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.364+0000 7ff70fcab700 1 -- 172.21.15.17:0/2920403892 shutdown_connections 2023-10-06T04:43:56.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.364+0000 7ff70fcab700 1 -- 172.21.15.17:0/2920403892 wait complete. 2023-10-06T04:43:56.377 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:43:56.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.498+0000 7f5c51cba700 1 Processor -- start 2023-10-06T04:43:56.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.498+0000 7f5c51cba700 1 -- start start 2023-10-06T04:43:56.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.499+0000 7f5c51cba700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f5c4c159b10 0x7f5c4c06f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:56.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.499+0000 7f5c51cba700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5c4c06d140 0x7f5c4c06f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:56.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.499+0000 7f5c51cba700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c4c0d1120 con 0x7f5c4c0cabf0 2023-10-06T04:43:56.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.499+0000 7f5c51cba700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c4c0d1400 con 0x7f5c4c159b10 2023-10-06T04:43:56.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.499+0000 7f5c51cba700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c06e920 con 0x7f5c4c06d140 2023-10-06T04:43:56.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.499+0000 7f5c4affd700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f5c4c159b10 0x7f5c4c06f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:56.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.499+0000 7f5c4bfff700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5c4c06d140 0x7f5c4c06f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:56.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.499+0000 7f5c4affd700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f5c4c159b10 0x7f5c4c06f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.17:40908/0 (socket says 172.21.15.17:40908) 2023-10-06T04:43:56.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.499+0000 7f5c4b7fe700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f5c4c0cabf0 0x7f5c4c0c7660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.17:55526/0 (socket says 172.21.15.17:55526) 2023-10-06T04:43:56.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.499+0000 7f5c4affd700 1 -- 172.21.15.17:0/4234718175 learned_addr learned my addr 172.21.15.17:0/4234718175 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:56.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.500+0000 7f5c4affd700 1 -- 172.21.15.17:0/4234718175 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5c4c06d140 msgr2=0x7f5c4c06f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:56.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.500+0000 7f5c4affd700 1 --2- 172.21.15.17:0/4234718175 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5c4c06d140 0x7f5c4c06f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:56.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.500+0000 7f5c4affd700 1 -- 172.21.15.17:0/4234718175 >> v1:172.21.15.136:6789/0 conn(0x7f5c4c0cabf0 legacy=0x7f5c4c0c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:56.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.500+0000 7f5c4affd700 1 -- 172.21.15.17:0/4234718175 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c4c06ec00 con 0x7f5c4c159b10 2023-10-06T04:43:56.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.500+0000 7f5c4a7fc700 1 -- 172.21.15.17:0/4234718175 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 182909675 0 0) 0x7f5c4c0d1120 con 0x7f5c4c0cabf0 2023-10-06T04:43:56.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.500+0000 7f5c4affd700 1 --2- 172.21.15.17:0/4234718175 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c4c159b10 0x7f5c4c06f120 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5c400099b0 tx=0x7f5c40009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a9c576971f0144 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:56.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.500+0000 7f5c4a7fc700 1 -- 172.21.15.17:0/4234718175 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c40009ea0 con 0x7f5c4c159b10 2023-10-06T04:43:56.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.500+0000 7f5c4a7fc700 1 -- 172.21.15.17:0/4234718175 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c4000b860 con 0x7f5c4c159b10 2023-10-06T04:43:56.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.500+0000 7f5c4a7fc700 1 -- 172.21.15.17:0/4234718175 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4000bc00 con 0x7f5c4c159b10 2023-10-06T04:43:56.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.501+0000 7f5c51cba700 1 -- 172.21.15.17:0/4234718175 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c4c159b10 msgr2=0x7f5c4c06f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:56.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.501+0000 7f5c51cba700 1 --2- 172.21.15.17:0/4234718175 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c4c159b10 0x7f5c4c06f120 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5c400099b0 tx=0x7f5c40009250 comp rx=0 tx=0).stop 2023-10-06T04:43:56.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.501+0000 7f5c51cba700 1 -- 172.21.15.17:0/4234718175 shutdown_connections 2023-10-06T04:43:56.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.501+0000 7f5c51cba700 1 --2- 172.21.15.17:0/4234718175 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5c4c06d140 0x7f5c4c06f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:56.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.501+0000 7f5c51cba700 1 --2- 172.21.15.17:0/4234718175 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c4c159b10 0x7f5c4c06f120 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:56.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.501+0000 7f5c51cba700 1 -- 172.21.15.17:0/4234718175 >> 172.21.15.17:0/4234718175 conn(0x7f5c4c06cd40 msgr2=0x7f5c4c0d0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:56.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.501+0000 7f5c51cba700 1 -- 172.21.15.17:0/4234718175 shutdown_connections 2023-10-06T04:43:56.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.501+0000 7f5c51cba700 1 -- 172.21.15.17:0/4234718175 wait complete. 2023-10-06T04:43:56.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.502+0000 7f5c51cba700 1 Processor -- start 2023-10-06T04:43:56.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.502+0000 7f5c51cba700 1 -- start start 2023-10-06T04:43:56.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.503+0000 7f5c51cba700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c4c06d140 0x7f5c4c0b5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:56.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.503+0000 7f5c51cba700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5c4c0cabf0 0x7f5c4c09bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:56.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.503+0000 7f5c51cba700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c4c159b10 0x7f5c4c156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:56.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.503+0000 7f5c51cba700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c09bab0 con 0x7f5c4c06d140 2023-10-06T04:43:56.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.503+0000 7f5c51cba700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c09ac20 con 0x7f5c4c159b10 2023-10-06T04:43:56.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.503+0000 7f5c51cba700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c09aea0 con 0x7f5c4c0cabf0 2023-10-06T04:43:56.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.503+0000 7f5c4b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c4c06d140 0x7f5c4c0b5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:56.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.503+0000 7f5c4b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c4c06d140 0x7f5c4c0b5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35154/0 (socket says 172.21.15.17:35154) 2023-10-06T04:43:56.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.503+0000 7f5c4b7fe700 1 -- 172.21.15.17:0/4254585001 learned_addr learned my addr 172.21.15.17:0/4254585001 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:56.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.503+0000 7f5c4affd700 1 --2- 172.21.15.17:0/4254585001 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5c4c0cabf0 0x7f5c4c09bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:56.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.503+0000 7f5c4bfff700 1 --2- 172.21.15.17:0/4254585001 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c4c159b10 0x7f5c4c156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:56.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.503+0000 7f5c4b7fe700 1 -- 172.21.15.17:0/4254585001 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5c4c0cabf0 msgr2=0x7f5c4c09bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:56.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.503+0000 7f5c4b7fe700 1 --2- 172.21.15.17:0/4254585001 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5c4c0cabf0 0x7f5c4c09bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:56.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.503+0000 7f5c4b7fe700 1 -- 172.21.15.17:0/4254585001 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c4c159b10 msgr2=0x7f5c4c156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:56.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.503+0000 7f5c4b7fe700 1 --2- 172.21.15.17:0/4254585001 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c4c159b10 0x7f5c4c156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:56.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.503+0000 7f5c4b7fe700 1 -- 172.21.15.17:0/4254585001 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c400094f0 con 0x7f5c4c06d140 2023-10-06T04:43:56.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.503+0000 7f5c4b7fe700 1 --2- 172.21.15.17:0/4254585001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c4c06d140 0x7f5c4c0b5590 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00c840 tx=0x7f5c3c007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:56.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.504+0000 7f5c337fe700 1 -- 172.21.15.17:0/4254585001 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c005b90 con 0x7f5c4c06d140 2023-10-06T04:43:56.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.504+0000 7f5c337fe700 1 -- 172.21.15.17:0/4254585001 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3c005d10 con 0x7f5c4c06d140 2023-10-06T04:43:56.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.504+0000 7f5c51cba700 1 -- 172.21.15.17:0/4254585001 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c4c09b180 con 0x7f5c4c06d140 2023-10-06T04:43:56.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.504+0000 7f5c337fe700 1 -- 172.21.15.17:0/4254585001 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c007320 con 0x7f5c4c06d140 2023-10-06T04:43:56.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.504+0000 7f5c51cba700 1 -- 172.21.15.17:0/4254585001 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c4c09b740 con 0x7f5c4c06d140 2023-10-06T04:43:56.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.505+0000 7f5c51cba700 1 -- 172.21.15.17:0/4254585001 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c4c09bd90 con 0x7f5c4c06d140 2023-10-06T04:43:56.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.505+0000 7f5c337fe700 1 -- 172.21.15.17:0/4254585001 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5c3c01b3b0 con 0x7f5c4c06d140 2023-10-06T04:43:56.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.505+0000 7f5c337fe700 1 --2- 172.21.15.17:0/4254585001 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5c38066f30 0x7f5c380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:56.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.506+0000 7f5c337fe700 1 -- 172.21.15.17:0/4254585001 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5c3c083be0 con 0x7f5c4c06d140 2023-10-06T04:43:56.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.506+0000 7f5c4affd700 1 --2- 172.21.15.17:0/4254585001 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5c38066f30 0x7f5c380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:56.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.506+0000 7f5c4affd700 1 --2- 172.21.15.17:0/4254585001 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5c38066f30 0x7f5c380693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5c400099b0 tx=0x7f5c40017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:56.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.510+0000 7f5c337fe700 1 -- 172.21.15.17:0/4254585001 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5c3c050cf0 con 0x7f5c4c06d140 2023-10-06T04:43:56.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.700+0000 7f5c51cba700 1 -- 172.21.15.17:0/4254585001 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5c4c071310 con 0x7f5c4c06d140 2023-10-06T04:43:56.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.701+0000 7f5c337fe700 1 -- 172.21.15.17:0/4254585001 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5c3c017020 con 0x7f5c4c06d140 2023-10-06T04:43:56.703 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-10-06T04:43:56.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.703+0000 7f5c51cba700 1 -- 172.21.15.17:0/4254585001 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5c38066f30 msgr2=0x7f5c380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:56.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.703+0000 7f5c51cba700 1 --2- 172.21.15.17:0/4254585001 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5c38066f30 0x7f5c380693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5c400099b0 tx=0x7f5c40017000 comp rx=0 tx=0).stop 2023-10-06T04:43:56.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.703+0000 7f5c51cba700 1 -- 172.21.15.17:0/4254585001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c4c06d140 msgr2=0x7f5c4c0b5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:56.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.703+0000 7f5c51cba700 1 --2- 172.21.15.17:0/4254585001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c4c06d140 0x7f5c4c0b5590 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00c840 tx=0x7f5c3c007de0 comp rx=0 tx=0).stop 2023-10-06T04:43:56.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.703+0000 7f5c51cba700 1 -- 172.21.15.17:0/4254585001 shutdown_connections 2023-10-06T04:43:56.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.703+0000 7f5c51cba700 1 --2- 172.21.15.17:0/4254585001 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5c38066f30 0x7f5c380693e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:56.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.703+0000 7f5c51cba700 1 --2- 172.21.15.17:0/4254585001 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c4c159b10 0x7f5c4c156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:56.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.703+0000 7f5c51cba700 1 --2- 172.21.15.17:0/4254585001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c4c06d140 0x7f5c4c0b5590 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:56.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.703+0000 7f5c51cba700 1 --2- 172.21.15.17:0/4254585001 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5c4c0cabf0 0x7f5c4c09bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:56.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.703+0000 7f5c51cba700 1 -- 172.21.15.17:0/4254585001 >> 172.21.15.17:0/4254585001 conn(0x7f5c4c06cd40 msgr2=0x7f5c4c0c9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:56.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.703+0000 7f5c51cba700 1 -- 172.21.15.17:0/4254585001 shutdown_connections 2023-10-06T04:43:56.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.703+0000 7f5c51cba700 1 -- 172.21.15.17:0/4254585001 wait complete. 2023-10-06T04:43:56.717 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:43:56.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.836+0000 7f6b06bf5700 1 Processor -- start 2023-10-06T04:43:56.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.836+0000 7f6b06bf5700 1 -- start start 2023-10-06T04:43:56.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.837+0000 7f6b06bf5700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6b001595c0 0x7f6b0006eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:56.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.837+0000 7f6b06bf5700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6b0006f240 0x7f6b000b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:56.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.837+0000 7f6b06bf5700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b000b23c0 con 0x7f6b000afe60 2023-10-06T04:43:56.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.837+0000 7f6b06bf5700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b0006efe0 con 0x7f6b0006f240 2023-10-06T04:43:56.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.837+0000 7f6b06bf5700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b0006e610 con 0x7f6b001595c0 2023-10-06T04:43:56.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.837+0000 7f6afffff700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6b0006f240 0x7f6b000b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:56.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.837+0000 7f6b05192700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f6b000afe60 0x7f6b000b0260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:43948/0 (socket says 172.21.15.17:43948) 2023-10-06T04:43:56.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.837+0000 7f6b05192700 1 -- 172.21.15.17:0/455514319 learned_addr learned my addr 172.21.15.17:0/455514319 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:56.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.838+0000 7f6b04991700 1 --2- 172.21.15.17:0/455514319 >> v2:172.21.15.136:3300/0 conn(0x7f6b001595c0 0x7f6b0006eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:56.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.838+0000 7f6afffff700 1 -- 172.21.15.17:0/455514319 >> v2:172.21.15.136:3300/0 conn(0x7f6b001595c0 msgr2=0x7f6b0006eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:56.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.838+0000 7f6afffff700 1 --2- 172.21.15.17:0/455514319 >> v2:172.21.15.136:3300/0 conn(0x7f6b001595c0 0x7f6b0006eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:56.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.838+0000 7f6afffff700 1 -- 172.21.15.17:0/455514319 >> v1:172.21.15.17:6789/0 conn(0x7f6b000afe60 legacy=0x7f6b000b0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:56.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.838+0000 7f6afffff700 1 -- 172.21.15.17:0/455514319 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b0015a9a0 con 0x7f6b0006f240 2023-10-06T04:43:56.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.838+0000 7f6aff7fe700 1 -- 172.21.15.17:0/455514319 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4018278138 0 0) 0x7f6af0001110 con 0x7f6b000afe60 2023-10-06T04:43:56.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.838+0000 7f6afffff700 1 --2- 172.21.15.17:0/455514319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b0006f240 0x7f6b000b1ac0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6b000713a0 tx=0x7f6af40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6671202180282cc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:56.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.838+0000 7f6aff7fe700 1 -- 172.21.15.17:0/455514319 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af400b6b0 con 0x7f6b0006f240 2023-10-06T04:43:56.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.838+0000 7f6aff7fe700 1 -- 172.21.15.17:0/455514319 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af400b810 con 0x7f6b0006f240 2023-10-06T04:43:56.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.838+0000 7f6aff7fe700 1 -- 172.21.15.17:0/455514319 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af400bbb0 con 0x7f6b0006f240 2023-10-06T04:43:56.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.839+0000 7f6b06bf5700 1 -- 172.21.15.17:0/455514319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b0006f240 msgr2=0x7f6b000b1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:56.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.839+0000 7f6b06bf5700 1 --2- 172.21.15.17:0/455514319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b0006f240 0x7f6b000b1ac0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6b000713a0 tx=0x7f6af40091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:56.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.839+0000 7f6b06bf5700 1 -- 172.21.15.17:0/455514319 shutdown_connections 2023-10-06T04:43:56.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.839+0000 7f6b06bf5700 1 --2- 172.21.15.17:0/455514319 >> v2:172.21.15.136:3300/0 conn(0x7f6b001595c0 0x7f6b0006eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:56.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.839+0000 7f6b06bf5700 1 --2- 172.21.15.17:0/455514319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b0006f240 0x7f6b000b1ac0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:56.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.839+0000 7f6b06bf5700 1 -- 172.21.15.17:0/455514319 >> 172.21.15.17:0/455514319 conn(0x7f6b0006c560 msgr2=0x7f6b0006c960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:56.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.839+0000 7f6b06bf5700 1 -- 172.21.15.17:0/455514319 shutdown_connections 2023-10-06T04:43:56.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.839+0000 7f6b06bf5700 1 -- 172.21.15.17:0/455514319 wait complete. 2023-10-06T04:43:56.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.840+0000 7f6b06bf5700 1 Processor -- start 2023-10-06T04:43:56.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.840+0000 7f6b06bf5700 1 -- start start 2023-10-06T04:43:56.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.841+0000 7f6b06bf5700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b0006f240 0x7f6b00155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:56.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.841+0000 7f6b06bf5700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6b000afe60 0x7f6b00157300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:56.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.841+0000 7f6b06bf5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6b001595c0 0x7f6b001520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:56.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.841+0000 7f6b06bf5700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0013ba30 con 0x7f6b0006f240 2023-10-06T04:43:56.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.841+0000 7f6b06bf5700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b00155e40 con 0x7f6b001595c0 2023-10-06T04:43:56.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.841+0000 7f6b06bf5700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b00157840 con 0x7f6b000afe60 2023-10-06T04:43:56.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.841+0000 7f6b04991700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b0006f240 0x7f6b00155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:56.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.841+0000 7f6b04991700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b0006f240 0x7f6b00155900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35174/0 (socket says 172.21.15.17:35174) 2023-10-06T04:43:56.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.841+0000 7f6b04991700 1 -- 172.21.15.17:0/1037683197 learned_addr learned my addr 172.21.15.17:0/1037683197 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:56.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.841+0000 7f6b05192700 1 --2- 172.21.15.17:0/1037683197 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6b001595c0 0x7f6b001520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:56.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.841+0000 7f6afffff700 1 --2- 172.21.15.17:0/1037683197 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6b000afe60 0x7f6b00157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:56.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.841+0000 7f6b04991700 1 -- 172.21.15.17:0/1037683197 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6b000afe60 msgr2=0x7f6b00157300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:56.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.841+0000 7f6b04991700 1 --2- 172.21.15.17:0/1037683197 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6b000afe60 0x7f6b00157300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:56.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.841+0000 7f6b04991700 1 -- 172.21.15.17:0/1037683197 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6b001595c0 msgr2=0x7f6b001520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:56.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.841+0000 7f6b04991700 1 --2- 172.21.15.17:0/1037683197 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6b001595c0 0x7f6b001520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:56.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.841+0000 7f6b04991700 1 -- 172.21.15.17:0/1037683197 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af4009420 con 0x7f6b0006f240 2023-10-06T04:43:56.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.841+0000 7f6b04991700 1 --2- 172.21.15.17:0/1037683197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b0006f240 0x7f6b00155900 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6af800e190 tx=0x7f6af8009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:56.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.841+0000 7f6afcff9700 1 -- 172.21.15.17:0/1037683197 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af800ed80 con 0x7f6b0006f240 2023-10-06T04:43:56.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.841+0000 7f6afcff9700 1 -- 172.21.15.17:0/1037683197 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af8014420 con 0x7f6b0006f240 2023-10-06T04:43:56.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.841+0000 7f6afcff9700 1 -- 172.21.15.17:0/1037683197 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af80147e0 con 0x7f6b0006f240 2023-10-06T04:43:56.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.841+0000 7f6b06bf5700 1 -- 172.21.15.17:0/1037683197 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b00157b00 con 0x7f6b0006f240 2023-10-06T04:43:56.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.841+0000 7f6b06bf5700 1 -- 172.21.15.17:0/1037683197 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b001580c0 con 0x7f6b0006f240 2023-10-06T04:43:56.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.842+0000 7f6b06bf5700 1 -- 172.21.15.17:0/1037683197 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b0004c380 con 0x7f6b0006f240 2023-10-06T04:43:56.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.843+0000 7f6afcff9700 1 -- 172.21.15.17:0/1037683197 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6af8014b90 con 0x7f6b0006f240 2023-10-06T04:43:56.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.843+0000 7f6afcff9700 1 --2- 172.21.15.17:0/1037683197 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6aec066f30 0x7f6aec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:56.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.843+0000 7f6afcff9700 1 -- 172.21.15.17:0/1037683197 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6af8084e10 con 0x7f6b0006f240 2023-10-06T04:43:56.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.843+0000 7f6afffff700 1 --2- 172.21.15.17:0/1037683197 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6aec066f30 0x7f6aec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:56.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.844+0000 7f6afffff700 1 --2- 172.21.15.17:0/1037683197 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6aec066f30 0x7f6aec0693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6b0006f680 tx=0x7f6af4017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:56.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:56.847+0000 7f6afcff9700 1 -- 172.21.15.17:0/1037683197 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6af8051f20 con 0x7f6b0006f240 2023-10-06T04:43:57.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.039+0000 7f6b06bf5700 1 -- 172.21.15.17:0/1037683197 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6b0006dce0 con 0x7f6b0006f240 2023-10-06T04:43:57.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.039+0000 7f6afcff9700 1 -- 172.21.15.17:0/1037683197 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6af8009a60 con 0x7f6b0006f240 2023-10-06T04:43:57.041 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-10-06T04:43:57.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.041+0000 7f6b06bf5700 1 -- 172.21.15.17:0/1037683197 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6aec066f30 msgr2=0x7f6aec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:57.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.041+0000 7f6b06bf5700 1 --2- 172.21.15.17:0/1037683197 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6aec066f30 0x7f6aec0693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6b0006f680 tx=0x7f6af4017000 comp rx=0 tx=0).stop 2023-10-06T04:43:57.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.041+0000 7f6b06bf5700 1 -- 172.21.15.17:0/1037683197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b0006f240 msgr2=0x7f6b00155900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:57.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.041+0000 7f6b06bf5700 1 --2- 172.21.15.17:0/1037683197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b0006f240 0x7f6b00155900 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6af800e190 tx=0x7f6af8009920 comp rx=0 tx=0).stop 2023-10-06T04:43:57.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.041+0000 7f6b06bf5700 1 -- 172.21.15.17:0/1037683197 shutdown_connections 2023-10-06T04:43:57.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.041+0000 7f6b06bf5700 1 --2- 172.21.15.17:0/1037683197 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6aec066f30 0x7f6aec0693e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:57.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.041+0000 7f6b06bf5700 1 --2- 172.21.15.17:0/1037683197 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6b001595c0 0x7f6b001520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:57.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.041+0000 7f6b06bf5700 1 --2- 172.21.15.17:0/1037683197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b0006f240 0x7f6b00155900 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:57.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.041+0000 7f6b06bf5700 1 --2- 172.21.15.17:0/1037683197 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6b000afe60 0x7f6b00157300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:57.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.041+0000 7f6b06bf5700 1 -- 172.21.15.17:0/1037683197 >> 172.21.15.17:0/1037683197 conn(0x7f6b0006c560 msgr2=0x7f6b000af470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:57.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.041+0000 7f6b06bf5700 1 -- 172.21.15.17:0/1037683197 shutdown_connections 2023-10-06T04:43:57.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.041+0000 7f6b06bf5700 1 -- 172.21.15.17:0/1037683197 wait complete. 2023-10-06T04:43:57.055 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:43:57.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.172+0000 7f8299964700 1 Processor -- start 2023-10-06T04:43:57.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.172+0000 7f8299964700 1 -- start start 2023-10-06T04:43:57.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.173+0000 7f8299964700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f82940cf3b0 0x7f82941594a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:57.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.173+0000 7f8299964700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f82940af0a0 0x7f82941599e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:57.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.173+0000 7f8299964700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82940cbd80 con 0x7f82940ccfc0 2023-10-06T04:43:57.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.173+0000 7f8299964700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82940af5f0 con 0x7f82940cf3b0 2023-10-06T04:43:57.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.173+0000 7f8299964700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82940af8d0 con 0x7f82940af0a0 2023-10-06T04:43:57.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.173+0000 7f8293fff700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f82940cf3b0 0x7f82941594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:57.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.173+0000 7f8298962700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f82940ccfc0 0x7f82940cc210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:43954/0 (socket says 172.21.15.17:43954) 2023-10-06T04:43:57.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.173+0000 7f8298962700 1 -- 172.21.15.17:0/1581813189 learned_addr learned my addr 172.21.15.17:0/1581813189 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:57.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.173+0000 7f8299163700 1 --2- 172.21.15.17:0/1581813189 >> v2:172.21.15.136:3300/0 conn(0x7f82940af0a0 0x7f82941599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:57.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.173+0000 7f8293fff700 1 -- 172.21.15.17:0/1581813189 >> v2:172.21.15.136:3300/0 conn(0x7f82940af0a0 msgr2=0x7f82941599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:57.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.173+0000 7f8293fff700 1 --2- 172.21.15.17:0/1581813189 >> v2:172.21.15.136:3300/0 conn(0x7f82940af0a0 0x7f82941599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:57.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.173+0000 7f8293fff700 1 -- 172.21.15.17:0/1581813189 >> v1:172.21.15.17:6789/0 conn(0x7f82940ccfc0 legacy=0x7f82940cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:57.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.173+0000 7f8293fff700 1 -- 172.21.15.17:0/1581813189 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82940afbb0 con 0x7f82940cf3b0 2023-10-06T04:43:57.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.173+0000 7f82937fe700 1 -- 172.21.15.17:0/1581813189 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2895490141 0 0) 0x7f82940cbd80 con 0x7f82940ccfc0 2023-10-06T04:43:57.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.174+0000 7f8293fff700 1 --2- 172.21.15.17:0/1581813189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82940cf3b0 0x7f82941594a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f82840098e0 tx=0x7f82840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=963df675a309c41e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:57.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.174+0000 7f82937fe700 1 -- 172.21.15.17:0/1581813189 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8284011630 con 0x7f82940cf3b0 2023-10-06T04:43:57.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.174+0000 7f82937fe700 1 -- 172.21.15.17:0/1581813189 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8284011790 con 0x7f82940cf3b0 2023-10-06T04:43:57.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.174+0000 7f82937fe700 1 -- 172.21.15.17:0/1581813189 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8284011b30 con 0x7f82940cf3b0 2023-10-06T04:43:57.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.174+0000 7f8299964700 1 -- 172.21.15.17:0/1581813189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82940cf3b0 msgr2=0x7f82941594a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:57.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.174+0000 7f8299964700 1 --2- 172.21.15.17:0/1581813189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82940cf3b0 0x7f82941594a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f82840098e0 tx=0x7f82840091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:57.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.174+0000 7f8299964700 1 -- 172.21.15.17:0/1581813189 shutdown_connections 2023-10-06T04:43:57.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.174+0000 7f8299964700 1 --2- 172.21.15.17:0/1581813189 >> v2:172.21.15.136:3300/0 conn(0x7f82940af0a0 0x7f82941599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:57.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.174+0000 7f8299964700 1 --2- 172.21.15.17:0/1581813189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82940cf3b0 0x7f82941594a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:57.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.174+0000 7f8299964700 1 -- 172.21.15.17:0/1581813189 >> 172.21.15.17:0/1581813189 conn(0x7f829406cff0 msgr2=0x7f829406da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:57.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.174+0000 7f8299964700 1 -- 172.21.15.17:0/1581813189 shutdown_connections 2023-10-06T04:43:57.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.174+0000 7f8299964700 1 -- 172.21.15.17:0/1581813189 wait complete. 2023-10-06T04:43:57.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.175+0000 7f8299964700 1 Processor -- start 2023-10-06T04:43:57.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.176+0000 7f8299964700 1 -- start start 2023-10-06T04:43:57.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.176+0000 7f8299964700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f82940af0a0 0x7f82940c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:57.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.176+0000 7f8299964700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82940ccfc0 0x7f8294155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:57.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.176+0000 7f8299964700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8294157ac0 0x7f8294157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:57.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.176+0000 7f8299964700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82941584a0 con 0x7f82940ccfc0 2023-10-06T04:43:57.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.176+0000 7f8299964700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82940c99e0 con 0x7f8294157ac0 2023-10-06T04:43:57.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.176+0000 7f8299964700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82940c8dd0 con 0x7f82940af0a0 2023-10-06T04:43:57.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.176+0000 7f8293fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82940ccfc0 0x7f8294155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:57.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.176+0000 7f8293fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82940ccfc0 0x7f8294155420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35186/0 (socket says 172.21.15.17:35186) 2023-10-06T04:43:57.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.176+0000 7f8293fff700 1 -- 172.21.15.17:0/1654947041 learned_addr learned my addr 172.21.15.17:0/1654947041 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:57.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.177+0000 7f8298962700 1 --2- 172.21.15.17:0/1654947041 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f82940af0a0 0x7f82940c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:57.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.177+0000 7f8299163700 1 --2- 172.21.15.17:0/1654947041 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8294157ac0 0x7f8294157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:57.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.177+0000 7f8293fff700 1 -- 172.21.15.17:0/1654947041 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f82940af0a0 msgr2=0x7f82940c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:57.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.177+0000 7f8293fff700 1 --2- 172.21.15.17:0/1654947041 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f82940af0a0 0x7f82940c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:57.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.177+0000 7f8293fff700 1 -- 172.21.15.17:0/1654947041 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8294157ac0 msgr2=0x7f8294157f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:57.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.177+0000 7f8293fff700 1 --2- 172.21.15.17:0/1654947041 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8294157ac0 0x7f8294157f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:57.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.177+0000 7f8293fff700 1 -- 172.21.15.17:0/1654947041 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8284009420 con 0x7f82940ccfc0 2023-10-06T04:43:57.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.177+0000 7f8293fff700 1 --2- 172.21.15.17:0/1654947041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82940ccfc0 0x7f8294155420 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f82840091e0 tx=0x7f8284017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:57.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.177+0000 7f8290ff9700 1 -- 172.21.15.17:0/1654947041 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8284011900 con 0x7f82940ccfc0 2023-10-06T04:43:57.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.177+0000 7f8290ff9700 1 -- 172.21.15.17:0/1654947041 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8284011a60 con 0x7f82940ccfc0 2023-10-06T04:43:57.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.177+0000 7f8299964700 1 -- 172.21.15.17:0/1654947041 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82940c90b0 con 0x7f82940ccfc0 2023-10-06T04:43:57.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.177+0000 7f8290ff9700 1 -- 172.21.15.17:0/1654947041 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8284025670 con 0x7f82940ccfc0 2023-10-06T04:43:57.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.177+0000 7f8299964700 1 -- 172.21.15.17:0/1654947041 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82940c9670 con 0x7f82940ccfc0 2023-10-06T04:43:57.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.178+0000 7f8299964700 1 -- 172.21.15.17:0/1654947041 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8294169830 con 0x7f82940ccfc0 2023-10-06T04:43:57.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.178+0000 7f8290ff9700 1 -- 172.21.15.17:0/1654947041 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8284023070 con 0x7f82940ccfc0 2023-10-06T04:43:57.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.179+0000 7f8290ff9700 1 --2- 172.21.15.17:0/1654947041 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8274066f30 0x7f82740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:57.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.179+0000 7f8290ff9700 1 -- 172.21.15.17:0/1654947041 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8284085bf0 con 0x7f82940ccfc0 2023-10-06T04:43:57.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.179+0000 7f8298962700 1 --2- 172.21.15.17:0/1654947041 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8274066f30 0x7f82740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:57.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.179+0000 7f8298962700 1 --2- 172.21.15.17:0/1654947041 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8274066f30 0x7f82740693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f828c002230 tx=0x7f828c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:57.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.183+0000 7f8290ff9700 1 -- 172.21.15.17:0/1654947041 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8284052d00 con 0x7f82940ccfc0 2023-10-06T04:43:57.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.378+0000 7f8299964700 1 -- 172.21.15.17:0/1654947041 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f829404c380 con 0x7f82940ccfc0 2023-10-06T04:43:57.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.379+0000 7f8290ff9700 1 -- 172.21.15.17:0/1654947041 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f8284056320 con 0x7f82940ccfc0 2023-10-06T04:43:57.381 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:43:57.381 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":21,"fsid":"780777c4-2b25-4d35-9058-c9f2d62e3ad9","created":"2023-10-06T04:43:10.578520+0000","modified":"2023-10-06T04:43:30.789916+0000","last_up_change":"2023-10-06T04:43:20.682958+0000","last_in_change":"2023-10-06T04:43:12.978917+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:43:21.795733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:43:22.389592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:43:26.914728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:43:28.173678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"84737b08-575c-46dd-9488-073ae8504494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6809","nonce":90656},{"type":"v1","addr":"172.21.15.17:6811","nonce":90656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":90656},{"type":"v1","addr":"172.21.15.17:6814","nonce":90656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":90656},{"type":"v1","addr":"172.21.15.17:6822","nonce":90656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":90656},{"type":"v1","addr":"172.21.15.17:6818","nonce":90656}]},"public_addr":"172.21.15.17:6811/90656","cluster_addr":"172.21.15.17:6814/90656","heartbeat_back_addr":"172.21.15.17:6822/90656","heartbeat_front_addr":"172.21.15.17:6818/90656","state":["exists","up"]},{"osd":1,"uuid":"dffeb740-58a2-4fd6-8ff1-a0a11a2cc709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":90655},{"type":"v1","addr":"172.21.15.17:6801","nonce":90655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":90655},{"type":"v1","addr":"172.21.15.17:6803","nonce":90655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":90655},{"type":"v1","addr":"172.21.15.17:6807","nonce":90655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":90655},{"type":"v1","addr":"172.21.15.17:6805","nonce":90655}]},"public_addr":"172.21.15.17:6801/90655","cluster_addr":"172.21.15.17:6803/90655","heartbeat_back_addr":"172.21.15.17:6807/90655","heartbeat_front_addr":"172.21.15.17:6805/90655","state":["exists","up"]},{"osd":2,"uuid":"48bd6831-763d-48c2-b515-e02c216d608b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":90657},{"type":"v1","addr":"172.21.15.17:6810","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":90657},{"type":"v1","addr":"172.21.15.17:6815","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":90657},{"type":"v1","addr":"172.21.15.17:6823","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":90657},{"type":"v1","addr":"172.21.15.17:6819","nonce":90657}]},"public_addr":"172.21.15.17:6810/90657","cluster_addr":"172.21.15.17:6815/90657","heartbeat_back_addr":"172.21.15.17:6823/90657","heartbeat_front_addr":"172.21.15.17:6819/90657","state":["exists","up"]},{"osd":3,"uuid":"ae7dbb23-abe7-4bd3-a4df-6f5963d6804c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":90688},{"type":"v1","addr":"172.21.15.17:6825","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":90688},{"type":"v1","addr":"172.21.15.17:6827","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":90688},{"type":"v1","addr":"172.21.15.17:6831","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":90688},{"type":"v1","addr":"172.21.15.17:6829","nonce":90688}]},"public_addr":"172.21.15.17:6825/90688","cluster_addr":"172.21.15.17:6827/90688","heartbeat_back_addr":"172.21.15.17:6831/90688","heartbeat_front_addr":"172.21.15.17:6829/90688","state":["exists","up"]},{"osd":4,"uuid":"29991fb4-1667-4ea3-aca0-d55db27f3bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":90902},{"type":"v1","addr":"172.21.15.136:6801","nonce":90902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":90902},{"type":"v1","addr":"172.21.15.136:6803","nonce":90902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":90902},{"type":"v1","addr":"172.21.15.136:6807","nonce":90902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":90902},{"type":"v1","addr":"172.21.15.136:6805","nonce":90902}]},"public_addr":"172.21.15.136:6801/90902","cluster_addr":"172.21.15.136:6803/90902","heartbeat_back_addr":"172.21.15.136:6807/90902","heartbeat_front_addr":"172.21.15.136:6805/90902","state":["exists","up"]},{"osd":5,"uuid":"398b4ff9-03fc-421f-882c-ba12aa088eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":90901},{"type":"v1","addr":"172.21.15.136:6809","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":90901},{"type":"v1","addr":"172.21.15.136:6811","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":90901},{"type":"v1","addr":"172.21.15.136:6815","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":90901},{"type":"v1","addr":"172.21.15.136:6813","nonce":90901}]},"public_addr":"172.21.15.136:6809/90901","cluster_addr":"172.21.15.136:6811/90901","heartbeat_back_addr":"172.21.15.136:6815/90901","heartbeat_front_addr":"172.21.15.136:6813/90901","state":["exists","up"]},{"osd":6,"uuid":"1bb91a72-4dab-4cdb-aa1d-2b8a9edf1ad0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":90927},{"type":"v1","addr":"172.21.15.136:6825","nonce":90927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":90927},{"type":"v1","addr":"172.21.15.136:6827","nonce":90927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":90927},{"type":"v1","addr":"172.21.15.136:6831","nonce":90927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":90927},{"type":"v1","addr":"172.21.15.136:6829","nonce":90927}]},"public_addr":"172.21.15.136:6825/90927","cluster_addr":"172.21.15.136:6827/90927","heartbeat_back_addr":"172.21.15.136:6831/90927","heartbeat_front_addr":"172.21.15.136:6829/90927","state":["exists","up"]},{"osd":7,"uuid":"719b654e-010d-4aa4-8c13-83fdde242b47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":90934},{"type":"v1","addr":"172.21.15.136:6817","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":90934},{"type":"v1","addr":"172.21.15.136:6819","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":90934},{"type":"v1","addr":"172.21.15.136:6824","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":90934},{"type":"v1","addr":"172.21.15.136:6821","nonce":90934}]},"public_addr":"172.21.15.136:6817/90934","cluster_addr":"172.21.15.136:6819/90934","heartbeat_back_addr":"172.21.15.136:6824/90934","heartbeat_front_addr":"172.21.15.136:6821/90934","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.157479+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.140520+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.190743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.231396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.156510+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.145822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.202888+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.139532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:43:57.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.381+0000 7f8299964700 1 -- 172.21.15.17:0/1654947041 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8274066f30 msgr2=0x7f82740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:57.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.381+0000 7f8299964700 1 --2- 172.21.15.17:0/1654947041 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8274066f30 0x7f82740693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f828c002230 tx=0x7f828c009040 comp rx=0 tx=0).stop 2023-10-06T04:43:57.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.381+0000 7f8299964700 1 -- 172.21.15.17:0/1654947041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82940ccfc0 msgr2=0x7f8294155420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:57.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.381+0000 7f8299964700 1 --2- 172.21.15.17:0/1654947041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82940ccfc0 0x7f8294155420 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f82840091e0 tx=0x7f8284017000 comp rx=0 tx=0).stop 2023-10-06T04:43:57.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.381+0000 7f8299964700 1 -- 172.21.15.17:0/1654947041 shutdown_connections 2023-10-06T04:43:57.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.381+0000 7f8299964700 1 --2- 172.21.15.17:0/1654947041 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8274066f30 0x7f82740693e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:57.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.381+0000 7f8299964700 1 --2- 172.21.15.17:0/1654947041 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8294157ac0 0x7f8294157f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:57.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.381+0000 7f8299964700 1 --2- 172.21.15.17:0/1654947041 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f82940af0a0 0x7f82940c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:57.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.381+0000 7f8299964700 1 --2- 172.21.15.17:0/1654947041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82940ccfc0 0x7f8294155420 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:57.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.382+0000 7f8299964700 1 -- 172.21.15.17:0/1654947041 >> 172.21.15.17:0/1654947041 conn(0x7f829406cff0 msgr2=0x7f82940ca7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:57.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.382+0000 7f8299964700 1 -- 172.21.15.17:0/1654947041 shutdown_connections 2023-10-06T04:43:57.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.382+0000 7f8299964700 1 -- 172.21.15.17:0/1654947041 wait complete. 2023-10-06T04:43:57.395 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:43:21.795733+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:43:22.389592+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:43:26.914728+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:43:28.173678+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:43:57.396 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:43:57.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.515+0000 7f517a36a700 1 Processor -- start 2023-10-06T04:43:57.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.516+0000 7f517a36a700 1 -- start start 2023-10-06T04:43:57.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.516+0000 7f517a36a700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f51740cabf0 0x7f51740c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:57.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.516+0000 7f517a36a700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51740d1120 con 0x7f5174159b10 2023-10-06T04:43:57.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.516+0000 7f517a36a700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51740d1400 con 0x7f517406d140 2023-10-06T04:43:57.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.516+0000 7f517a36a700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f517406e920 con 0x7f51740cabf0 2023-10-06T04:43:57.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.516+0000 7f51737fe700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f5174159b10 0x7f517406f120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:43956/0 (socket says 172.21.15.17:43956) 2023-10-06T04:43:57.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.517+0000 7f51737fe700 1 -- 172.21.15.17:0/4002382485 learned_addr learned my addr 172.21.15.17:0/4002382485 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:57.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.517+0000 7f5173fff700 1 --2- 172.21.15.17:0/4002382485 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f51740cabf0 0x7f51740c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:57.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.517+0000 7f5172ffd700 1 -- 172.21.15.17:0/4002382485 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 65583347 0 0) 0x7f51740d1120 con 0x7f5174159b10 2023-10-06T04:43:57.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.517+0000 7f5172ffd700 1 -- 172.21.15.17:0/4002382485 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f515c003570 con 0x7f5174159b10 2023-10-06T04:43:57.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.517+0000 7f5172ffd700 1 -- 172.21.15.17:0/4002382485 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1840886491 0 0) 0x7f515c003570 con 0x7f5174159b10 2023-10-06T04:43:57.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.517+0000 7f5172ffd700 1 -- 172.21.15.17:0/4002382485 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f51740cabf0 msgr2=0x7f51740c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:57.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.517+0000 7f5172ffd700 1 --2- 172.21.15.17:0/4002382485 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f51740cabf0 0x7f51740c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:57.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.517+0000 7f5172ffd700 1 -- 172.21.15.17:0/4002382485 >> v1:172.21.15.136:6789/0 conn(0x7f517406d140 legacy=0x7f51741634c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:57.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.517+0000 7f5172ffd700 1 -- 172.21.15.17:0/4002382485 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f517406ec00 con 0x7f5174159b10 2023-10-06T04:43:57.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.517+0000 7f5172ffd700 1 -- 172.21.15.17:0/4002382485 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4268781140 0 0) 0x7f5168001470 con 0x7f5174159b10 2023-10-06T04:43:57.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.517+0000 7f5172ffd700 1 -- 172.21.15.17:0/4002382485 >> v1:172.21.15.17:6789/0 conn(0x7f5174159b10 legacy=0x7f517406f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:57.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.517+0000 7f5172ffd700 1 --2- 172.21.15.17:0/4002382485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f515c003a90 0x7f515c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:57.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.517+0000 7f5172ffd700 1 --2- 172.21.15.17:0/4002382485 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f51740cabf0 0x7f515c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:57.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.517+0000 7f5172ffd700 1 --2- 172.21.15.17:0/4002382485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f515c004d50 0x7f515c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:57.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.517+0000 7f5172ffd700 1 -- 172.21.15.17:0/4002382485 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517406e920 con 0x7f515c003a90 2023-10-06T04:43:57.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.517+0000 7f5172ffd700 1 -- 172.21.15.17:0/4002382485 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515c00bb70 con 0x7f515c004d50 2023-10-06T04:43:57.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.517+0000 7f5172ffd700 1 -- 172.21.15.17:0/4002382485 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f515c00bd30 con 0x7f51740cabf0 2023-10-06T04:43:57.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.517+0000 7f5173fff700 1 --2- 172.21.15.17:0/4002382485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f515c003a90 0x7f515c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:57.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.517+0000 7f51737fe700 1 --2- 172.21.15.17:0/4002382485 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f51740cabf0 0x7f515c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:57.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.517+0000 7f5178907700 1 --2- 172.21.15.17:0/4002382485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f515c004d50 0x7f515c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:57.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.518+0000 7f5173fff700 1 -- 172.21.15.17:0/4002382485 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f51740cabf0 msgr2=0x7f515c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:57.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.518+0000 7f5173fff700 1 --2- 172.21.15.17:0/4002382485 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f51740cabf0 0x7f515c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:57.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.518+0000 7f5173fff700 1 -- 172.21.15.17:0/4002382485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f515c004d50 msgr2=0x7f515c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:57.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.518+0000 7f5173fff700 1 --2- 172.21.15.17:0/4002382485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f515c004d50 0x7f515c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:57.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.518+0000 7f5173fff700 1 -- 172.21.15.17:0/4002382485 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f515c003570 con 0x7f515c003a90 2023-10-06T04:43:57.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.518+0000 7f5173fff700 1 --2- 172.21.15.17:0/4002382485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f515c003a90 0x7f515c003ea0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5164009bf0 tx=0x7f5164009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1045d5ab7086d86b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:57.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.518+0000 7f5172ffd700 1 -- 172.21.15.17:0/4002382485 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5164005a00 con 0x7f515c003a90 2023-10-06T04:43:57.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.518+0000 7f5172ffd700 1 -- 172.21.15.17:0/4002382485 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5164005b60 con 0x7f515c003a90 2023-10-06T04:43:57.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.518+0000 7f5172ffd700 1 -- 172.21.15.17:0/4002382485 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516400e710 con 0x7f515c003a90 2023-10-06T04:43:57.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.518+0000 7f517a36a700 1 -- 172.21.15.17:0/4002382485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f515c003a90 msgr2=0x7f515c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:57.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.518+0000 7f517a36a700 1 --2- 172.21.15.17:0/4002382485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f515c003a90 0x7f515c003ea0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5164009bf0 tx=0x7f5164009120 comp rx=0 tx=0).stop 2023-10-06T04:43:57.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.518+0000 7f5178907700 1 -- 172.21.15.17:0/4002382485 reap_dead start 2023-10-06T04:43:57.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.518+0000 7f517a36a700 1 -- 172.21.15.17:0/4002382485 shutdown_connections 2023-10-06T04:43:57.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.518+0000 7f517a36a700 1 -- 172.21.15.17:0/4002382485 >> 172.21.15.17:0/4002382485 conn(0x7f517406cd40 msgr2=0x7f51740d0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:57.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.518+0000 7f517a36a700 1 -- 172.21.15.17:0/4002382485 shutdown_connections 2023-10-06T04:43:57.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.518+0000 7f517a36a700 1 -- 172.21.15.17:0/4002382485 wait complete. 2023-10-06T04:43:57.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.519+0000 7f517a36a700 1 Processor -- start 2023-10-06T04:43:57.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.520+0000 7f517a36a700 1 -- start start 2023-10-06T04:43:57.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.520+0000 7f517a36a700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f515c003a90 0x7f51740c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:57.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.520+0000 7f517a36a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51740c59e0 0x7f517415e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:57.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.520+0000 7f517a36a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f517415ebd0 0x7f51740b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:57.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.520+0000 7f517a36a700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517415e200 con 0x7f517415ebd0 2023-10-06T04:43:57.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.520+0000 7f517a36a700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517415d8d0 con 0x7f51740c59e0 2023-10-06T04:43:57.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.520+0000 7f517a36a700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f517415dbb0 con 0x7f515c003a90 2023-10-06T04:43:57.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.521+0000 7f5178907700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f517415ebd0 0x7f51740b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:57.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.521+0000 7f5178907700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f517415ebd0 0x7f51740b43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35200/0 (socket says 172.21.15.17:35200) 2023-10-06T04:43:57.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.521+0000 7f5178907700 1 -- 172.21.15.17:0/126527324 learned_addr learned my addr 172.21.15.17:0/126527324 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:57.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.521+0000 7f5173fff700 1 --2- 172.21.15.17:0/126527324 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f515c003a90 0x7f51740c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:57.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.521+0000 7f51737fe700 1 --2- 172.21.15.17:0/126527324 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51740c59e0 0x7f517415e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:57.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.521+0000 7f5178907700 1 -- 172.21.15.17:0/126527324 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f515c003a90 msgr2=0x7f51740c68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:57.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.521+0000 7f5178907700 1 --2- 172.21.15.17:0/126527324 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f515c003a90 0x7f51740c68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:57.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.521+0000 7f5178907700 1 -- 172.21.15.17:0/126527324 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51740c59e0 msgr2=0x7f517415e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:57.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.521+0000 7f5178907700 1 --2- 172.21.15.17:0/126527324 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51740c59e0 0x7f517415e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:57.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.521+0000 7f5178907700 1 -- 172.21.15.17:0/126527324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f517415de90 con 0x7f517415ebd0 2023-10-06T04:43:57.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.521+0000 7f5178907700 1 --2- 172.21.15.17:0/126527324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f517415ebd0 0x7f51740b43d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f51740c4060 tx=0x7f516c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:57.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.521+0000 7f515bfff700 1 -- 172.21.15.17:0/126527324 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c0032e0 con 0x7f517415ebd0 2023-10-06T04:43:57.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.521+0000 7f515bfff700 1 -- 172.21.15.17:0/126527324 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516c001580 con 0x7f517415ebd0 2023-10-06T04:43:57.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.521+0000 7f517a36a700 1 -- 172.21.15.17:0/126527324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f517415d5c0 con 0x7f517415ebd0 2023-10-06T04:43:57.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.521+0000 7f515bfff700 1 -- 172.21.15.17:0/126527324 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c001940 con 0x7f517415ebd0 2023-10-06T04:43:57.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.521+0000 7f517a36a700 1 -- 172.21.15.17:0/126527324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51740c6e00 con 0x7f517415ebd0 2023-10-06T04:43:57.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.522+0000 7f517a36a700 1 -- 172.21.15.17:0/126527324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f517404c380 con 0x7f517415ebd0 2023-10-06T04:43:57.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.523+0000 7f515bfff700 1 -- 172.21.15.17:0/126527324 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f516c001d30 con 0x7f517415ebd0 2023-10-06T04:43:57.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.523+0000 7f515bfff700 1 --2- 172.21.15.17:0/126527324 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5160066f30 0x7f51600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:57.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.523+0000 7f515bfff700 1 -- 172.21.15.17:0/126527324 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f516c0844b0 con 0x7f517415ebd0 2023-10-06T04:43:57.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.523+0000 7f5173fff700 1 --2- 172.21.15.17:0/126527324 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5160066f30 0x7f51600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:57.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.523+0000 7f5173fff700 1 --2- 172.21.15.17:0/126527324 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5160066f30 0x7f51600693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5164009bf0 tx=0x7f5164019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:57.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.527+0000 7f515bfff700 1 -- 172.21.15.17:0/126527324 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f516c0515c0 con 0x7f517415ebd0 2023-10-06T04:43:57.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.720+0000 7f517a36a700 1 -- 172.21.15.17:0/126527324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f51740c7900 con 0x7f517415ebd0 2023-10-06T04:43:57.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.721+0000 7f515bfff700 1 -- 172.21.15.17:0/126527324 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f516c054be0 con 0x7f517415ebd0 2023-10-06T04:43:57.723 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-10-06T04:43:57.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.723+0000 7f517a36a700 1 -- 172.21.15.17:0/126527324 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5160066f30 msgr2=0x7f51600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:57.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.723+0000 7f517a36a700 1 --2- 172.21.15.17:0/126527324 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5160066f30 0x7f51600693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5164009bf0 tx=0x7f5164019000 comp rx=0 tx=0).stop 2023-10-06T04:43:57.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.723+0000 7f517a36a700 1 -- 172.21.15.17:0/126527324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f517415ebd0 msgr2=0x7f51740b43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:57.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.723+0000 7f517a36a700 1 --2- 172.21.15.17:0/126527324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f517415ebd0 0x7f51740b43d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f51740c4060 tx=0x7f516c009040 comp rx=0 tx=0).stop 2023-10-06T04:43:57.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.723+0000 7f517a36a700 1 -- 172.21.15.17:0/126527324 shutdown_connections 2023-10-06T04:43:57.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.723+0000 7f517a36a700 1 --2- 172.21.15.17:0/126527324 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5160066f30 0x7f51600693e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:57.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.723+0000 7f517a36a700 1 --2- 172.21.15.17:0/126527324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f517415ebd0 0x7f51740b43d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:57.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.723+0000 7f517a36a700 1 --2- 172.21.15.17:0/126527324 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f515c003a90 0x7f51740c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:57.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.723+0000 7f517a36a700 1 --2- 172.21.15.17:0/126527324 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51740c59e0 0x7f517415e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:57.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.723+0000 7f517a36a700 1 -- 172.21.15.17:0/126527324 >> 172.21.15.17:0/126527324 conn(0x7f517406cd40 msgr2=0x7f51740ce550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:57.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.723+0000 7f517a36a700 1 -- 172.21.15.17:0/126527324 shutdown_connections 2023-10-06T04:43:57.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.723+0000 7f517a36a700 1 -- 172.21.15.17:0/126527324 wait complete. 2023-10-06T04:43:57.737 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:43:57.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.857+0000 7f718aa70700 1 Processor -- start 2023-10-06T04:43:57.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.857+0000 7f718aa70700 1 -- start start 2023-10-06T04:43:57.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.857+0000 7f718aa70700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f71840cabf0 0x7f71840c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:57.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.857+0000 7f718aa70700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71840d1120 con 0x7f7184159b10 2023-10-06T04:43:57.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.857+0000 7f718aa70700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71840d1400 con 0x7f718406d140 2023-10-06T04:43:57.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.857+0000 7f718aa70700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f718406e920 con 0x7f71840cabf0 2023-10-06T04:43:57.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.858+0000 7f7183fff700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f7184159b10 0x7f718406f120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:43964/0 (socket says 172.21.15.17:43964) 2023-10-06T04:43:57.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.858+0000 7f7183fff700 1 -- 172.21.15.17:0/4238579789 learned_addr learned my addr 172.21.15.17:0/4238579789 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:57.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.858+0000 7f718880c700 1 --2- 172.21.15.17:0/4238579789 >> v2:172.21.15.136:3300/0 conn(0x7f71840cabf0 0x7f71840c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:57.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.858+0000 7f71837fe700 1 -- 172.21.15.17:0/4238579789 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1385098299 0 0) 0x7f71840d1120 con 0x7f7184159b10 2023-10-06T04:43:57.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.858+0000 7f71837fe700 1 -- 172.21.15.17:0/4238579789 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7170003570 con 0x7f7184159b10 2023-10-06T04:43:57.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.858+0000 7f71837fe700 1 -- 172.21.15.17:0/4238579789 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 119025155 0 0) 0x7f7170003570 con 0x7f7184159b10 2023-10-06T04:43:57.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.858+0000 7f718880c700 1 -- 172.21.15.17:0/4238579789 >> v1:172.21.15.136:6789/0 conn(0x7f718406d140 legacy=0x7f71841634c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:57.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.858+0000 7f718880c700 1 -- 172.21.15.17:0/4238579789 >> v1:172.21.15.17:6789/0 conn(0x7f7184159b10 legacy=0x7f718406f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:57.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.858+0000 7f718880c700 1 -- 172.21.15.17:0/4238579789 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f718406ec00 con 0x7f71840cabf0 2023-10-06T04:43:57.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.858+0000 7f718880c700 1 --2- 172.21.15.17:0/4238579789 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f71840cabf0 0x7f71840c7660 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f716c0098d0 tx=0x7f716c009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c14153804a9ff9b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:57.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.859+0000 7f71837fe700 1 -- 172.21.15.17:0/4238579789 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7174001470 con 0x7f71840cabf0 2023-10-06T04:43:57.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.859+0000 7f71837fe700 1 -- 172.21.15.17:0/4238579789 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716c011420 con 0x7f71840cabf0 2023-10-06T04:43:57.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.859+0000 7f71837fe700 1 -- 172.21.15.17:0/4238579789 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c0117e0 con 0x7f71840cabf0 2023-10-06T04:43:57.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.859+0000 7f718aa70700 1 -- 172.21.15.17:0/4238579789 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f71840cabf0 msgr2=0x7f71840c7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:57.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.859+0000 7f718aa70700 1 --2- 172.21.15.17:0/4238579789 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f71840cabf0 0x7f71840c7660 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f716c0098d0 tx=0x7f716c009120 comp rx=0 tx=0).stop 2023-10-06T04:43:57.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.859+0000 7f718aa70700 1 -- 172.21.15.17:0/4238579789 shutdown_connections 2023-10-06T04:43:57.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.859+0000 7f718aa70700 1 --2- 172.21.15.17:0/4238579789 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f71840cabf0 0x7f71840c7660 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:57.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.859+0000 7f718aa70700 1 -- 172.21.15.17:0/4238579789 >> 172.21.15.17:0/4238579789 conn(0x7f718406cd40 msgr2=0x7f71840d0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:57.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.859+0000 7f718aa70700 1 -- 172.21.15.17:0/4238579789 shutdown_connections 2023-10-06T04:43:57.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.859+0000 7f718aa70700 1 -- 172.21.15.17:0/4238579789 wait complete. 2023-10-06T04:43:57.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.860+0000 7f718aa70700 1 Processor -- start 2023-10-06T04:43:57.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.860+0000 7f718aa70700 1 -- start start 2023-10-06T04:43:57.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.861+0000 7f718aa70700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f718406d140 0x7f7184156cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:57.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.861+0000 7f718aa70700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f71840cabf0 0x7f718409bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:57.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.861+0000 7f718aa70700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7184159b10 0x7f718409daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:57.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.861+0000 7f718aa70700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718409ac50 con 0x7f7184159b10 2023-10-06T04:43:57.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.861+0000 7f718aa70700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718409bab0 con 0x7f718406d140 2023-10-06T04:43:57.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.861+0000 7f718aa70700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f718409aea0 con 0x7f71840cabf0 2023-10-06T04:43:57.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.861+0000 7f718900d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7184159b10 0x7f718409daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:57.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.861+0000 7f718900d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7184159b10 0x7f718409daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35204/0 (socket says 172.21.15.17:35204) 2023-10-06T04:43:57.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.861+0000 7f718900d700 1 -- 172.21.15.17:0/3747523389 learned_addr learned my addr 172.21.15.17:0/3747523389 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:57.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.861+0000 7f718880c700 1 --2- 172.21.15.17:0/3747523389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f718406d140 0x7f7184156cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:57.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.861+0000 7f7183fff700 1 --2- 172.21.15.17:0/3747523389 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f71840cabf0 0x7f718409bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:57.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.862+0000 7f718900d700 1 -- 172.21.15.17:0/3747523389 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f71840cabf0 msgr2=0x7f718409bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:57.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.862+0000 7f718900d700 1 --2- 172.21.15.17:0/3747523389 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f71840cabf0 0x7f718409bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:57.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.862+0000 7f718900d700 1 -- 172.21.15.17:0/3747523389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f718406d140 msgr2=0x7f7184156cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:57.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.862+0000 7f718900d700 1 --2- 172.21.15.17:0/3747523389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f718406d140 0x7f7184156cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:57.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.862+0000 7f718900d700 1 -- 172.21.15.17:0/3747523389 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716c0093c0 con 0x7f7184159b10 2023-10-06T04:43:57.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.862+0000 7f718900d700 1 --2- 172.21.15.17:0/3747523389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7184159b10 0x7f718409daa0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f717c00c980 tx=0x7f717c001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:57.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.862+0000 7f7180ff9700 1 -- 172.21.15.17:0/3747523389 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c00a7e0 con 0x7f7184159b10 2023-10-06T04:43:57.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.862+0000 7f7180ff9700 1 -- 172.21.15.17:0/3747523389 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717c00a940 con 0x7f7184159b10 2023-10-06T04:43:57.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.862+0000 7f7180ff9700 1 -- 172.21.15.17:0/3747523389 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c00ad00 con 0x7f7184159b10 2023-10-06T04:43:57.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.862+0000 7f718aa70700 1 -- 172.21.15.17:0/3747523389 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f718409b180 con 0x7f7184159b10 2023-10-06T04:43:57.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.862+0000 7f718aa70700 1 -- 172.21.15.17:0/3747523389 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f718409b7c0 con 0x7f7184159b10 2023-10-06T04:43:57.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.863+0000 7f718aa70700 1 -- 172.21.15.17:0/3747523389 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71841572f0 con 0x7f7184159b10 2023-10-06T04:43:57.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.863+0000 7f7180ff9700 1 -- 172.21.15.17:0/3747523389 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f717c003030 con 0x7f7184159b10 2023-10-06T04:43:57.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.864+0000 7f7180ff9700 1 --2- 172.21.15.17:0/3747523389 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7164066f30 0x7f71640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:57.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.864+0000 7f7180ff9700 1 -- 172.21.15.17:0/3747523389 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f717c0847d0 con 0x7f7184159b10 2023-10-06T04:43:57.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.864+0000 7f718880c700 1 --2- 172.21.15.17:0/3747523389 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7164066f30 0x7f71640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:57.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.864+0000 7f718880c700 1 --2- 172.21.15.17:0/3747523389 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7164066f30 0x7f71640693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f716c003080 tx=0x7f716c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:57.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:57.868+0000 7f7180ff9700 1 -- 172.21.15.17:0/3747523389 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f717c0518e0 con 0x7f7184159b10 2023-10-06T04:43:58.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.058+0000 7f718aa70700 1 -- 172.21.15.17:0/3747523389 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f71840cdd40 con 0x7f7184159b10 2023-10-06T04:43:58.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.059+0000 7f7180ff9700 1 -- 172.21.15.17:0/3747523389 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f717c00ae60 con 0x7f7184159b10 2023-10-06T04:43:58.061 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-10-06T04:43:58.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.060+0000 7f718aa70700 1 -- 172.21.15.17:0/3747523389 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7164066f30 msgr2=0x7f71640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:58.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.060+0000 7f718aa70700 1 --2- 172.21.15.17:0/3747523389 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7164066f30 0x7f71640693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f716c003080 tx=0x7f716c017000 comp rx=0 tx=0).stop 2023-10-06T04:43:58.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.061+0000 7f718aa70700 1 -- 172.21.15.17:0/3747523389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7184159b10 msgr2=0x7f718409daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:58.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.061+0000 7f718aa70700 1 --2- 172.21.15.17:0/3747523389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7184159b10 0x7f718409daa0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f717c00c980 tx=0x7f717c001770 comp rx=0 tx=0).stop 2023-10-06T04:43:58.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.061+0000 7f718aa70700 1 -- 172.21.15.17:0/3747523389 shutdown_connections 2023-10-06T04:43:58.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.061+0000 7f718aa70700 1 --2- 172.21.15.17:0/3747523389 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7164066f30 0x7f71640693e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:58.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.061+0000 7f718aa70700 1 --2- 172.21.15.17:0/3747523389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7184159b10 0x7f718409daa0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:58.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.061+0000 7f718aa70700 1 --2- 172.21.15.17:0/3747523389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f718406d140 0x7f7184156cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:58.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.061+0000 7f718aa70700 1 --2- 172.21.15.17:0/3747523389 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f71840cabf0 0x7f718409bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:58.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.061+0000 7f718aa70700 1 -- 172.21.15.17:0/3747523389 >> 172.21.15.17:0/3747523389 conn(0x7f718406cd40 msgr2=0x7f71840c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:58.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.061+0000 7f718aa70700 1 -- 172.21.15.17:0/3747523389 shutdown_connections 2023-10-06T04:43:58.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.061+0000 7f718aa70700 1 -- 172.21.15.17:0/3747523389 wait complete. 2023-10-06T04:43:58.074 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:43:58.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.194+0000 7ff419808700 1 Processor -- start 2023-10-06T04:43:58.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.194+0000 7ff419808700 1 -- start start 2023-10-06T04:43:58.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.195+0000 7ff419808700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff4140cec40 0x7ff4140cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:58.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.195+0000 7ff419808700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff4140cb330 0x7ff4140cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:58.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.195+0000 7ff419808700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4140ccbb0 con 0x7ff4140c5540 2023-10-06T04:43:58.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.195+0000 7ff419808700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4140cd240 con 0x7ff4140cec40 2023-10-06T04:43:58.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.195+0000 7ff419808700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4140cbce0 con 0x7ff4140cb330 2023-10-06T04:43:58.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.195+0000 7ff412ffd700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff4140cec40 0x7ff4140cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:58.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.195+0000 7ff4137fe700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7ff4140c5540 0x7ff4140c5960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:43978/0 (socket says 172.21.15.17:43978) 2023-10-06T04:43:58.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.195+0000 7ff4137fe700 1 -- 172.21.15.17:0/3857277718 learned_addr learned my addr 172.21.15.17:0/3857277718 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:58.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.195+0000 7ff4127fc700 1 --2- 172.21.15.17:0/3857277718 >> v2:172.21.15.136:3300/0 conn(0x7ff4140cb330 0x7ff4140cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:58.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.195+0000 7ff412ffd700 1 -- 172.21.15.17:0/3857277718 >> v2:172.21.15.136:3300/0 conn(0x7ff4140cb330 msgr2=0x7ff4140cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:58.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.196+0000 7ff412ffd700 1 --2- 172.21.15.17:0/3857277718 >> v2:172.21.15.136:3300/0 conn(0x7ff4140cb330 0x7ff4140cb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:58.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.196+0000 7ff412ffd700 1 -- 172.21.15.17:0/3857277718 >> v1:172.21.15.17:6789/0 conn(0x7ff4140c5540 legacy=0x7ff4140c5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:58.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.196+0000 7ff412ffd700 1 -- 172.21.15.17:0/3857277718 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4140cf550 con 0x7ff4140cec40 2023-10-06T04:43:58.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.196+0000 7ff411ffb700 1 -- 172.21.15.17:0/3857277718 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1920541830 0 0) 0x7ff4140ccbb0 con 0x7ff4140c5540 2023-10-06T04:43:58.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.196+0000 7ff412ffd700 1 --2- 172.21.15.17:0/3857277718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4140cec40 0x7ff4140cf010 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff414088640 tx=0x7ff40c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70aed31b8891d447 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:58.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.196+0000 7ff411ffb700 1 -- 172.21.15.17:0/3857277718 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c005c10 con 0x7ff4140cec40 2023-10-06T04:43:58.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.196+0000 7ff411ffb700 1 -- 172.21.15.17:0/3857277718 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40c005d70 con 0x7ff4140cec40 2023-10-06T04:43:58.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.196+0000 7ff411ffb700 1 -- 172.21.15.17:0/3857277718 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c006260 con 0x7ff4140cec40 2023-10-06T04:43:58.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.196+0000 7ff419808700 1 -- 172.21.15.17:0/3857277718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4140cec40 msgr2=0x7ff4140cf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:58.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.196+0000 7ff419808700 1 --2- 172.21.15.17:0/3857277718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4140cec40 0x7ff4140cf010 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff414088640 tx=0x7ff40c009120 comp rx=0 tx=0).stop 2023-10-06T04:43:58.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.196+0000 7ff419808700 1 -- 172.21.15.17:0/3857277718 shutdown_connections 2023-10-06T04:43:58.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.196+0000 7ff419808700 1 --2- 172.21.15.17:0/3857277718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4140cec40 0x7ff4140cf010 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:58.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.196+0000 7ff419808700 1 --2- 172.21.15.17:0/3857277718 >> v2:172.21.15.136:3300/0 conn(0x7ff4140cb330 0x7ff4140cb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:58.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.196+0000 7ff419808700 1 -- 172.21.15.17:0/3857277718 >> 172.21.15.17:0/3857277718 conn(0x7ff414099960 msgr2=0x7ff41406cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:58.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.196+0000 7ff419808700 1 -- 172.21.15.17:0/3857277718 shutdown_connections 2023-10-06T04:43:58.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.196+0000 7ff419808700 1 -- 172.21.15.17:0/3857277718 wait complete. 2023-10-06T04:43:58.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.198+0000 7ff419808700 1 Processor -- start 2023-10-06T04:43:58.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.198+0000 7ff419808700 1 -- start start 2023-10-06T04:43:58.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.198+0000 7ff419808700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff4140c5540 0x7ff4140b2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:58.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.198+0000 7ff419808700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff4140cb330 0x7ff41415db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:58.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.198+0000 7ff419808700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4140cec40 0x7ff414156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:58.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.198+0000 7ff419808700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41415d6f0 con 0x7ff4140cec40 2023-10-06T04:43:58.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.198+0000 7ff419808700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4140af370 con 0x7ff4140cb330 2023-10-06T04:43:58.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.198+0000 7ff419808700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4140b0220 con 0x7ff4140c5540 2023-10-06T04:43:58.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.199+0000 7ff4137fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4140cec40 0x7ff414156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:58.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.199+0000 7ff4137fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4140cec40 0x7ff414156ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35218/0 (socket says 172.21.15.17:35218) 2023-10-06T04:43:58.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.199+0000 7ff4137fe700 1 -- 172.21.15.17:0/1329952445 learned_addr learned my addr 172.21.15.17:0/1329952445 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:58.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.199+0000 7ff4127fc700 1 --2- 172.21.15.17:0/1329952445 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff4140cb330 0x7ff41415db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:58.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.199+0000 7ff412ffd700 1 --2- 172.21.15.17:0/1329952445 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff4140c5540 0x7ff4140b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:58.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.199+0000 7ff4137fe700 1 -- 172.21.15.17:0/1329952445 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff4140c5540 msgr2=0x7ff4140b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:58.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.199+0000 7ff4137fe700 1 --2- 172.21.15.17:0/1329952445 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff4140c5540 0x7ff4140b2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:58.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.199+0000 7ff4137fe700 1 -- 172.21.15.17:0/1329952445 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff4140cb330 msgr2=0x7ff41415db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:58.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.199+0000 7ff4137fe700 1 --2- 172.21.15.17:0/1329952445 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff4140cb330 0x7ff41415db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:58.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.199+0000 7ff4137fe700 1 -- 172.21.15.17:0/1329952445 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40c0093c0 con 0x7ff4140cec40 2023-10-06T04:43:58.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.199+0000 7ff412ffd700 1 --2- 172.21.15.17:0/1329952445 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff4140c5540 0x7ff4140b2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:43:58.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.199+0000 7ff4137fe700 1 --2- 172.21.15.17:0/1329952445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4140cec40 0x7ff414156ac0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff40400ccc0 tx=0x7ff404001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:58.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.199+0000 7ff40affd700 1 -- 172.21.15.17:0/1329952445 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40400ab30 con 0x7ff4140cec40 2023-10-06T04:43:58.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.199+0000 7ff40affd700 1 -- 172.21.15.17:0/1329952445 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40400ac90 con 0x7ff4140cec40 2023-10-06T04:43:58.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.199+0000 7ff419808700 1 -- 172.21.15.17:0/1329952445 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4140b0500 con 0x7ff4140cec40 2023-10-06T04:43:58.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.199+0000 7ff40affd700 1 -- 172.21.15.17:0/1329952445 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff404007340 con 0x7ff4140cec40 2023-10-06T04:43:58.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.199+0000 7ff419808700 1 -- 172.21.15.17:0/1329952445 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff41415d380 con 0x7ff4140cec40 2023-10-06T04:43:58.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.200+0000 7ff419808700 1 -- 172.21.15.17:0/1329952445 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff41415d8a0 con 0x7ff4140cec40 2023-10-06T04:43:58.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.201+0000 7ff40affd700 1 -- 172.21.15.17:0/1329952445 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff4040076f0 con 0x7ff4140cec40 2023-10-06T04:43:58.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.201+0000 7ff40affd700 1 --2- 172.21.15.17:0/1329952445 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff3f4066f30 0x7ff3f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:58.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.201+0000 7ff40affd700 1 -- 172.21.15.17:0/1329952445 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff404084ab0 con 0x7ff4140cec40 2023-10-06T04:43:58.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.201+0000 7ff412ffd700 1 --2- 172.21.15.17:0/1329952445 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff3f4066f30 0x7ff3f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:58.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.201+0000 7ff412ffd700 1 --2- 172.21.15.17:0/1329952445 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff3f4066f30 0x7ff3f40693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff40c0030c0 tx=0x7ff40c016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:58.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.205+0000 7ff40affd700 1 -- 172.21.15.17:0/1329952445 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff41415d8a0 con 0x7ff4140cec40 2023-10-06T04:43:58.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.399+0000 7ff419808700 1 -- 172.21.15.17:0/1329952445 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff41415d8a0 con 0x7ff4140cec40 2023-10-06T04:43:58.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.400+0000 7ff40affd700 1 -- 172.21.15.17:0/1329952445 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff41415d8a0 con 0x7ff4140cec40 2023-10-06T04:43:58.401 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-10-06T04:43:58.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.402+0000 7ff419808700 1 -- 172.21.15.17:0/1329952445 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff3f4066f30 msgr2=0x7ff3f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:58.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.402+0000 7ff419808700 1 --2- 172.21.15.17:0/1329952445 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff3f4066f30 0x7ff3f40693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff40c0030c0 tx=0x7ff40c016000 comp rx=0 tx=0).stop 2023-10-06T04:43:58.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.402+0000 7ff419808700 1 -- 172.21.15.17:0/1329952445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4140cec40 msgr2=0x7ff414156ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:58.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.402+0000 7ff419808700 1 --2- 172.21.15.17:0/1329952445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4140cec40 0x7ff414156ac0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff40400ccc0 tx=0x7ff404001a80 comp rx=0 tx=0).stop 2023-10-06T04:43:58.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.402+0000 7ff419808700 1 -- 172.21.15.17:0/1329952445 shutdown_connections 2023-10-06T04:43:58.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.402+0000 7ff419808700 1 --2- 172.21.15.17:0/1329952445 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff3f4066f30 0x7ff3f40693e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:58.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.402+0000 7ff419808700 1 --2- 172.21.15.17:0/1329952445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4140cec40 0x7ff414156ac0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:58.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.402+0000 7ff419808700 1 --2- 172.21.15.17:0/1329952445 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff4140c5540 0x7ff4140b2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:58.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.402+0000 7ff419808700 1 --2- 172.21.15.17:0/1329952445 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff4140cb330 0x7ff41415db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:58.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.402+0000 7ff419808700 1 -- 172.21.15.17:0/1329952445 >> 172.21.15.17:0/1329952445 conn(0x7ff414099960 msgr2=0x7ff41406f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:58.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.402+0000 7ff419808700 1 -- 172.21.15.17:0/1329952445 shutdown_connections 2023-10-06T04:43:58.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.402+0000 7ff419808700 1 -- 172.21.15.17:0/1329952445 wait complete. 2023-10-06T04:43:58.416 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:43:58.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.536+0000 7fc2842a1700 1 Processor -- start 2023-10-06T04:43:58.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.536+0000 7fc2842a1700 1 -- start start 2023-10-06T04:43:58.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.537+0000 7fc2842a1700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc27c06d140 0x7fc27c06f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:58.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.537+0000 7fc2842a1700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc27c0d1120 con 0x7fc27c0cabf0 2023-10-06T04:43:58.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.537+0000 7fc2842a1700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc27c0d1400 con 0x7fc27c159b10 2023-10-06T04:43:58.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.537+0000 7fc2842a1700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc27c06e920 con 0x7fc27c06d140 2023-10-06T04:43:58.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.537+0000 7fc28203d700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fc27c0cabf0 0x7fc27c0c7660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:43986/0 (socket says 172.21.15.17:43986) 2023-10-06T04:43:58.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.537+0000 7fc28203d700 1 -- 172.21.15.17:0/2238104339 learned_addr learned my addr 172.21.15.17:0/2238104339 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:58.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.537+0000 7fc28103b700 1 -- 172.21.15.17:0/2238104339 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2522679861 0 0) 0x7fc27c0d1120 con 0x7fc27c0cabf0 2023-10-06T04:43:58.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.537+0000 7fc28283e700 1 --2- 172.21.15.17:0/2238104339 >> v2:172.21.15.136:3300/0 conn(0x7fc27c06d140 0x7fc27c06f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:58.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.537+0000 7fc28103b700 1 -- 172.21.15.17:0/2238104339 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc268003570 con 0x7fc27c0cabf0 2023-10-06T04:43:58.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.537+0000 7fc28103b700 1 -- 172.21.15.17:0/2238104339 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3627489638 0 0) 0x7fc268003570 con 0x7fc27c0cabf0 2023-10-06T04:43:58.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.537+0000 7fc28103b700 1 -- 172.21.15.17:0/2238104339 >> v2:172.21.15.136:3300/0 conn(0x7fc27c06d140 msgr2=0x7fc27c06f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:58.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.537+0000 7fc28103b700 1 --2- 172.21.15.17:0/2238104339 >> v2:172.21.15.136:3300/0 conn(0x7fc27c06d140 0x7fc27c06f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:58.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.537+0000 7fc28103b700 1 -- 172.21.15.17:0/2238104339 >> v1:172.21.15.136:6789/0 conn(0x7fc27c159b10 legacy=0x7fc27c06f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:58.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.537+0000 7fc28103b700 1 -- 172.21.15.17:0/2238104339 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc27c06ec00 con 0x7fc27c0cabf0 2023-10-06T04:43:58.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.537+0000 7fc28103b700 1 -- 172.21.15.17:0/2238104339 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4268781140 0 0) 0x7fc2780015f0 con 0x7fc27c0cabf0 2023-10-06T04:43:58.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.537+0000 7fc28103b700 1 -- 172.21.15.17:0/2238104339 >> v1:172.21.15.17:6789/0 conn(0x7fc27c0cabf0 legacy=0x7fc27c0c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:58.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.537+0000 7fc28103b700 1 --2- 172.21.15.17:0/2238104339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc268003a60 0x7fc268003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:58.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.537+0000 7fc28103b700 1 --2- 172.21.15.17:0/2238104339 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc268004810 0x7fc268004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:58.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.537+0000 7fc28103b700 1 --2- 172.21.15.17:0/2238104339 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc2680051c0 0x7fc26800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:58.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.537+0000 7fc28103b700 1 -- 172.21.15.17:0/2238104339 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c06e920 con 0x7fc268003a60 2023-10-06T04:43:58.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.537+0000 7fc28103b700 1 -- 172.21.15.17:0/2238104339 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26800c160 con 0x7fc268004810 2023-10-06T04:43:58.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.537+0000 7fc28103b700 1 -- 172.21.15.17:0/2238104339 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc26800c320 con 0x7fc2680051c0 2023-10-06T04:43:58.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.538+0000 7fc28203d700 1 --2- 172.21.15.17:0/2238104339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc268003a60 0x7fc268003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:58.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.538+0000 7fc28183c700 1 --2- 172.21.15.17:0/2238104339 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc268004810 0x7fc268004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:58.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.538+0000 7fc28283e700 1 --2- 172.21.15.17:0/2238104339 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc2680051c0 0x7fc26800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:58.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.538+0000 7fc28203d700 1 -- 172.21.15.17:0/2238104339 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc2680051c0 msgr2=0x7fc26800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:58.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.538+0000 7fc28203d700 1 --2- 172.21.15.17:0/2238104339 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc2680051c0 0x7fc26800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:58.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.538+0000 7fc28203d700 1 -- 172.21.15.17:0/2238104339 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc268004810 msgr2=0x7fc268004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:58.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.538+0000 7fc28203d700 1 --2- 172.21.15.17:0/2238104339 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc268004810 0x7fc268004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:58.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.538+0000 7fc28203d700 1 -- 172.21.15.17:0/2238104339 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc268003570 con 0x7fc268003a60 2023-10-06T04:43:58.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.538+0000 7fc28283e700 1 -- 172.21.15.17:0/2238104339 reap_dead start 2023-10-06T04:43:58.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.538+0000 7fc28203d700 1 --2- 172.21.15.17:0/2238104339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc268003a60 0x7fc268003e70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc27800c3c0 tx=0x7fc278007920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=499e6455d5221353 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:58.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.538+0000 7fc28103b700 1 -- 172.21.15.17:0/2238104339 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27800cc90 con 0x7fc268003a60 2023-10-06T04:43:58.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.538+0000 7fc28103b700 1 -- 172.21.15.17:0/2238104339 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc27800ce10 con 0x7fc268003a60 2023-10-06T04:43:58.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.538+0000 7fc28103b700 1 -- 172.21.15.17:0/2238104339 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc278007320 con 0x7fc268003a60 2023-10-06T04:43:58.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.539+0000 7fc2842a1700 1 -- 172.21.15.17:0/2238104339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc268003a60 msgr2=0x7fc268003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:58.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.539+0000 7fc2842a1700 1 --2- 172.21.15.17:0/2238104339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc268003a60 0x7fc268003e70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc27800c3c0 tx=0x7fc278007920 comp rx=0 tx=0).stop 2023-10-06T04:43:58.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.539+0000 7fc2842a1700 1 -- 172.21.15.17:0/2238104339 shutdown_connections 2023-10-06T04:43:58.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.539+0000 7fc2842a1700 1 --2- 172.21.15.17:0/2238104339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc268003a60 0x7fc268003e70 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:58.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.539+0000 7fc2842a1700 1 -- 172.21.15.17:0/2238104339 >> 172.21.15.17:0/2238104339 conn(0x7fc27c06cd40 msgr2=0x7fc27c0d0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:58.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.539+0000 7fc2842a1700 1 -- 172.21.15.17:0/2238104339 shutdown_connections 2023-10-06T04:43:58.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.539+0000 7fc2842a1700 1 -- 172.21.15.17:0/2238104339 wait complete. 2023-10-06T04:43:58.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.540+0000 7fc2842a1700 1 Processor -- start 2023-10-06T04:43:58.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.540+0000 7fc2842a1700 1 -- start start 2023-10-06T04:43:58.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.541+0000 7fc2842a1700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc268003a60 0x7fc27c0c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:58.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.541+0000 7fc2842a1700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc27c0c5360 0x7fc27c0b4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:58.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.541+0000 7fc2842a1700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc27c154c40 0x7fc27c156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:58.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.541+0000 7fc2842a1700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c0c66a0 con 0x7fc27c0c5360 2023-10-06T04:43:58.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.541+0000 7fc2842a1700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c0b4b60 con 0x7fc268003a60 2023-10-06T04:43:58.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.541+0000 7fc2842a1700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c0c57d0 con 0x7fc27c154c40 2023-10-06T04:43:58.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.541+0000 7fc28183c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc27c0c5360 0x7fc27c0b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:58.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.541+0000 7fc28183c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc27c0c5360 0x7fc27c0b4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35232/0 (socket says 172.21.15.17:35232) 2023-10-06T04:43:58.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.541+0000 7fc28183c700 1 -- 172.21.15.17:0/862314960 learned_addr learned my addr 172.21.15.17:0/862314960 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:58.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.541+0000 7fc28283e700 1 --2- 172.21.15.17:0/862314960 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc27c154c40 0x7fc27c156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:58.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.541+0000 7fc28203d700 1 --2- 172.21.15.17:0/862314960 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc268003a60 0x7fc27c0c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:58.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.541+0000 7fc28183c700 1 -- 172.21.15.17:0/862314960 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc27c154c40 msgr2=0x7fc27c156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:58.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.541+0000 7fc28183c700 1 --2- 172.21.15.17:0/862314960 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc27c154c40 0x7fc27c156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:58.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.541+0000 7fc28183c700 1 -- 172.21.15.17:0/862314960 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc268003a60 msgr2=0x7fc27c0c6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:58.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.541+0000 7fc28183c700 1 --2- 172.21.15.17:0/862314960 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc268003a60 0x7fc27c0c6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:58.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.541+0000 7fc28183c700 1 -- 172.21.15.17:0/862314960 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc27c0c5a90 con 0x7fc27c0c5360 2023-10-06T04:43:58.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.541+0000 7fc28203d700 1 --2- 172.21.15.17:0/862314960 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc268003a60 0x7fc27c0c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:43:58.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.541+0000 7fc28183c700 1 --2- 172.21.15.17:0/862314960 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc27c0c5360 0x7fc27c0b4620 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0028d0 tx=0x7fc26c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:58.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.541+0000 7fc2727fc700 1 -- 172.21.15.17:0/862314960 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26c006820 con 0x7fc27c0c5360 2023-10-06T04:43:58.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.541+0000 7fc2727fc700 1 -- 172.21.15.17:0/862314960 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26c006980 con 0x7fc27c0c5360 2023-10-06T04:43:58.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.541+0000 7fc2842a1700 1 -- 172.21.15.17:0/862314960 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc27c0c5d70 con 0x7fc27c0c5360 2023-10-06T04:43:58.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.541+0000 7fc2727fc700 1 -- 172.21.15.17:0/862314960 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26c006d20 con 0x7fc27c0c5360 2023-10-06T04:43:58.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.541+0000 7fc2842a1700 1 -- 172.21.15.17:0/862314960 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc27c0c6330 con 0x7fc27c0c5360 2023-10-06T04:43:58.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.542+0000 7fc2842a1700 1 -- 172.21.15.17:0/862314960 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc27c0c7070 con 0x7fc27c0c5360 2023-10-06T04:43:58.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.543+0000 7fc2727fc700 1 -- 172.21.15.17:0/862314960 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc26c007260 con 0x7fc27c0c5360 2023-10-06T04:43:58.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.543+0000 7fc2727fc700 1 --2- 172.21.15.17:0/862314960 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc260066f30 0x7fc2600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:58.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.543+0000 7fc2727fc700 1 -- 172.21.15.17:0/862314960 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc26c084590 con 0x7fc27c0c5360 2023-10-06T04:43:58.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.543+0000 7fc28203d700 1 --2- 172.21.15.17:0/862314960 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc260066f30 0x7fc2600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:58.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.544+0000 7fc28203d700 1 --2- 172.21.15.17:0/862314960 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc260066f30 0x7fc2600693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc278008fd0 tx=0x7fc278015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:58.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.548+0000 7fc2727fc700 1 -- 172.21.15.17:0/862314960 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc26c0516a0 con 0x7fc27c0c5360 2023-10-06T04:43:58.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.740+0000 7fc2842a1700 1 -- 172.21.15.17:0/862314960 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc27c06fbb0 con 0x7fc27c0c5360 2023-10-06T04:43:58.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.741+0000 7fc2727fc700 1 -- 172.21.15.17:0/862314960 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc26c054cc0 con 0x7fc27c0c5360 2023-10-06T04:43:58.743 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-10-06T04:43:58.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.743+0000 7fc2842a1700 1 -- 172.21.15.17:0/862314960 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc260066f30 msgr2=0x7fc2600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:58.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.743+0000 7fc2842a1700 1 --2- 172.21.15.17:0/862314960 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc260066f30 0x7fc2600693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc278008fd0 tx=0x7fc278015000 comp rx=0 tx=0).stop 2023-10-06T04:43:58.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.743+0000 7fc2842a1700 1 -- 172.21.15.17:0/862314960 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc27c0c5360 msgr2=0x7fc27c0b4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:58.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.743+0000 7fc2842a1700 1 --2- 172.21.15.17:0/862314960 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc27c0c5360 0x7fc27c0b4620 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0028d0 tx=0x7fc26c007d30 comp rx=0 tx=0).stop 2023-10-06T04:43:58.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.743+0000 7fc2842a1700 1 -- 172.21.15.17:0/862314960 shutdown_connections 2023-10-06T04:43:58.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.743+0000 7fc2842a1700 1 --2- 172.21.15.17:0/862314960 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc260066f30 0x7fc2600693e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:58.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.743+0000 7fc2842a1700 1 --2- 172.21.15.17:0/862314960 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc27c154c40 0x7fc27c156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:58.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.743+0000 7fc2842a1700 1 --2- 172.21.15.17:0/862314960 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc268003a60 0x7fc27c0c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:58.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.743+0000 7fc2842a1700 1 --2- 172.21.15.17:0/862314960 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc27c0c5360 0x7fc27c0b4620 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:58.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.743+0000 7fc2842a1700 1 -- 172.21.15.17:0/862314960 >> 172.21.15.17:0/862314960 conn(0x7fc27c06cd40 msgr2=0x7fc27c0cfc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:58.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.743+0000 7fc2842a1700 1 -- 172.21.15.17:0/862314960 shutdown_connections 2023-10-06T04:43:58.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.743+0000 7fc2842a1700 1 -- 172.21.15.17:0/862314960 wait complete. 2023-10-06T04:43:58.776 INFO:tasks.cephfs_test_runner:Starting test: test_backtrace (tasks.cephfs.test_backtrace.TestBacktrace) That the 'parent' 'layout' and 'symlink' xattrs on the head objects of files 2023-10-06T04:43:58.776 INFO:tasks.cephfs_test_runner:test_backtrace (tasks.cephfs.test_backtrace.TestBacktrace) 2023-10-06T04:43:58.776 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_backtrace.TestBacktrace.test_backtrace' 2023-10-06T04:43:58.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.894+0000 7f3fdba61700 1 Processor -- start 2023-10-06T04:43:58.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.894+0000 7f3fdba61700 1 -- start start 2023-10-06T04:43:58.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.895+0000 7f3fdba61700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3fd40b0800 0x7f3fd406c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:58.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.895+0000 7f3fdba61700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fd40cafa0 con 0x7f3fd41410d0 2023-10-06T04:43:58.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.895+0000 7f3fdba61700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fd40cb280 con 0x7f3fd4140d00 2023-10-06T04:43:58.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.895+0000 7f3fdba61700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fd40cb560 con 0x7f3fd40b0800 2023-10-06T04:43:58.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.895+0000 7f3fd8ffc700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f3fd41410d0 0x7f3fd40b00f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:43992/0 (socket says 172.21.15.17:43992) 2023-10-06T04:43:58.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.895+0000 7f3fd8ffc700 1 -- 172.21.15.17:0/1744927246 learned_addr learned my addr 172.21.15.17:0/1744927246 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:58.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.895+0000 7f3fd9ffe700 1 --2- 172.21.15.17:0/1744927246 >> v2:172.21.15.136:3300/0 conn(0x7f3fd40b0800 0x7f3fd406c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:58.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.895+0000 7f3fcbfff700 1 -- 172.21.15.17:0/1744927246 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 997730477 0 0) 0x7f3fd40cafa0 con 0x7f3fd41410d0 2023-10-06T04:43:58.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.895+0000 7f3fcbfff700 1 -- 172.21.15.17:0/1744927246 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fc0003570 con 0x7f3fd41410d0 2023-10-06T04:43:58.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.896+0000 7f3fd9ffe700 1 -- 172.21.15.17:0/1744927246 >> v1:172.21.15.136:6789/0 conn(0x7f3fd4140d00 legacy=0x7f3fd40cc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:58.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.896+0000 7f3fcbfff700 1 -- 172.21.15.17:0/1744927246 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2999224835 0 0) 0x7f3fc0003570 con 0x7f3fd41410d0 2023-10-06T04:43:58.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.896+0000 7f3fd9ffe700 1 -- 172.21.15.17:0/1744927246 >> v1:172.21.15.17:6789/0 conn(0x7f3fd41410d0 legacy=0x7f3fd40b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:58.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.896+0000 7f3fd9ffe700 1 -- 172.21.15.17:0/1744927246 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd40cb840 con 0x7f3fd40b0800 2023-10-06T04:43:58.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.896+0000 7f3fd9ffe700 1 --2- 172.21.15.17:0/1744927246 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fd40b0800 0x7f3fd406c560 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc009e90 tx=0x7f3fcc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7a9a62fa7180795 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:58.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.896+0000 7f3fcbfff700 1 -- 172.21.15.17:0/1744927246 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc00e070 con 0x7f3fd40b0800 2023-10-06T04:43:58.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.896+0000 7f3fcbfff700 1 -- 172.21.15.17:0/1744927246 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fcc00b920 con 0x7f3fd40b0800 2023-10-06T04:43:58.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.896+0000 7f3fcbfff700 1 -- 172.21.15.17:0/1744927246 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc4001470 con 0x7f3fd40b0800 2023-10-06T04:43:58.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.896+0000 7f3fdba61700 1 -- 172.21.15.17:0/1744927246 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fd40b0800 msgr2=0x7f3fd406c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:58.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.896+0000 7f3fdba61700 1 --2- 172.21.15.17:0/1744927246 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fd40b0800 0x7f3fd406c560 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc009e90 tx=0x7f3fcc009780 comp rx=0 tx=0).stop 2023-10-06T04:43:58.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.897+0000 7f3fdba61700 1 -- 172.21.15.17:0/1744927246 shutdown_connections 2023-10-06T04:43:58.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.897+0000 7f3fdba61700 1 --2- 172.21.15.17:0/1744927246 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fd40b0800 0x7f3fd406c560 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:58.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.897+0000 7f3fdba61700 1 -- 172.21.15.17:0/1744927246 >> 172.21.15.17:0/1744927246 conn(0x7f3fd406e140 msgr2=0x7f3fd40cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:58.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.897+0000 7f3fdba61700 1 -- 172.21.15.17:0/1744927246 shutdown_connections 2023-10-06T04:43:58.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.897+0000 7f3fdba61700 1 -- 172.21.15.17:0/1744927246 wait complete. 2023-10-06T04:43:58.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.898+0000 7f3fdba61700 1 Processor -- start 2023-10-06T04:43:58.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.898+0000 7f3fdba61700 1 -- start start 2023-10-06T04:43:58.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.899+0000 7f3fdba61700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fd40b0800 0x7f3fd40c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:58.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.899+0000 7f3fdba61700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fd4140d00 0x7f3fd4134b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:58.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.899+0000 7f3fdba61700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3fd41410d0 0x7f3fd40c20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:58.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.899+0000 7f3fdba61700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd40c36c0 con 0x7f3fd4140d00 2023-10-06T04:43:58.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.899+0000 7f3fdba61700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd40c4090 con 0x7f3fd40b0800 2023-10-06T04:43:58.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.899+0000 7f3fdba61700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd40c2ab0 con 0x7f3fd41410d0 2023-10-06T04:43:58.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.899+0000 7f3fd8ffc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fd4140d00 0x7f3fd4134b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:58.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.899+0000 7f3fd8ffc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fd4140d00 0x7f3fd4134b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35242/0 (socket says 172.21.15.17:35242) 2023-10-06T04:43:58.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.899+0000 7f3fd8ffc700 1 -- 172.21.15.17:0/2851863707 learned_addr learned my addr 172.21.15.17:0/2851863707 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:58.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.899+0000 7f3fd9ffe700 1 --2- 172.21.15.17:0/2851863707 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3fd41410d0 0x7f3fd40c20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:58.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.899+0000 7f3fd97fd700 1 --2- 172.21.15.17:0/2851863707 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fd40b0800 0x7f3fd40c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:58.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.899+0000 7f3fd8ffc700 1 -- 172.21.15.17:0/2851863707 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3fd41410d0 msgr2=0x7f3fd40c20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:58.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.899+0000 7f3fd8ffc700 1 --2- 172.21.15.17:0/2851863707 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3fd41410d0 0x7f3fd40c20d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:58.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.899+0000 7f3fd8ffc700 1 -- 172.21.15.17:0/2851863707 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fd40b0800 msgr2=0x7f3fd40c3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:58.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.899+0000 7f3fd8ffc700 1 --2- 172.21.15.17:0/2851863707 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fd40b0800 0x7f3fd40c3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:58.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.899+0000 7f3fd8ffc700 1 -- 172.21.15.17:0/2851863707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fcc009a20 con 0x7f3fd4140d00 2023-10-06T04:43:58.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.899+0000 7f3fd97fd700 1 --2- 172.21.15.17:0/2851863707 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fd40b0800 0x7f3fd40c3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:43:58.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.899+0000 7f3fd8ffc700 1 --2- 172.21.15.17:0/2851863707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fd4140d00 0x7f3fd4134b30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3fc400cb90 tx=0x7f3fc4001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:58.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.899+0000 7f3fc97fa700 1 -- 172.21.15.17:0/2851863707 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc4001d40 con 0x7f3fd4140d00 2023-10-06T04:43:58.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.899+0000 7f3fc97fa700 1 -- 172.21.15.17:0/2851863707 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc4007360 con 0x7f3fd4140d00 2023-10-06T04:43:58.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.899+0000 7f3fdba61700 1 -- 172.21.15.17:0/2851863707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fd40c2d90 con 0x7f3fd4140d00 2023-10-06T04:43:58.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.899+0000 7f3fc97fa700 1 -- 172.21.15.17:0/2851863707 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc4004830 con 0x7f3fd4140d00 2023-10-06T04:43:58.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.899+0000 7f3fdba61700 1 -- 172.21.15.17:0/2851863707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fd40c3350 con 0x7f3fd4140d00 2023-10-06T04:43:58.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.900+0000 7f3fdba61700 1 -- 172.21.15.17:0/2851863707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fd40c3830 con 0x7f3fd4140d00 2023-10-06T04:43:58.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.901+0000 7f3fc97fa700 1 -- 172.21.15.17:0/2851863707 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3fc4004ba0 con 0x7f3fd4140d00 2023-10-06T04:43:58.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.901+0000 7f3fc97fa700 1 --2- 172.21.15.17:0/2851863707 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3fb8066f30 0x7f3fb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:58.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.901+0000 7f3fc97fa700 1 -- 172.21.15.17:0/2851863707 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3fc4083e40 con 0x7f3fd4140d00 2023-10-06T04:43:58.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.901+0000 7f3fd97fd700 1 --2- 172.21.15.17:0/2851863707 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3fb8066f30 0x7f3fb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:58.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.902+0000 7f3fd97fd700 1 --2- 172.21.15.17:0/2851863707 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3fb8066f30 0x7f3fb80693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0001840 tx=0x7f3fd0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:58.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:58.906+0000 7f3fc97fa700 1 -- 172.21.15.17:0/2851863707 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3fc4050fd0 con 0x7f3fd4140d00 2023-10-06T04:43:59.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.178+0000 7f3fdba61700 1 -- 172.21.15.17:0/2851863707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_backtrace.TestBacktrace.test_backtrace"]} v 0) v1 -- 0x7f3fd4063ff0 con 0x7f3fd4140d00 2023-10-06T04:43:59.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.335+0000 7f3fc97fa700 1 -- 172.21.15.17:0/2851863707 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_backtrace.TestBacktrace.test_backtrace"]}]=0 v48) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3fc40180d0 con 0x7f3fd4140d00 2023-10-06T04:43:59.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.337+0000 7f3fdba61700 1 -- 172.21.15.17:0/2851863707 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3fb8066f30 msgr2=0x7f3fb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:59.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.337+0000 7f3fdba61700 1 --2- 172.21.15.17:0/2851863707 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3fb8066f30 0x7f3fb80693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0001840 tx=0x7f3fd0009040 comp rx=0 tx=0).stop 2023-10-06T04:43:59.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.337+0000 7f3fdba61700 1 -- 172.21.15.17:0/2851863707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fd4140d00 msgr2=0x7f3fd4134b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:59.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.337+0000 7f3fdba61700 1 --2- 172.21.15.17:0/2851863707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fd4140d00 0x7f3fd4134b30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3fc400cb90 tx=0x7f3fc4001ab0 comp rx=0 tx=0).stop 2023-10-06T04:43:59.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.337+0000 7f3fdba61700 1 -- 172.21.15.17:0/2851863707 shutdown_connections 2023-10-06T04:43:59.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.337+0000 7f3fdba61700 1 --2- 172.21.15.17:0/2851863707 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3fb8066f30 0x7f3fb80693e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:59.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.337+0000 7f3fdba61700 1 --2- 172.21.15.17:0/2851863707 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3fd41410d0 0x7f3fd40c20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:59.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.337+0000 7f3fdba61700 1 --2- 172.21.15.17:0/2851863707 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fd40b0800 0x7f3fd40c3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:59.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.337+0000 7f3fdba61700 1 --2- 172.21.15.17:0/2851863707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fd4140d00 0x7f3fd4134b30 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:59.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.337+0000 7f3fdba61700 1 -- 172.21.15.17:0/2851863707 >> 172.21.15.17:0/2851863707 conn(0x7f3fd406e140 msgr2=0x7f3fd40b2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:59.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.337+0000 7f3fdba61700 1 -- 172.21.15.17:0/2851863707 shutdown_connections 2023-10-06T04:43:59.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.337+0000 7f3fdba61700 1 -- 172.21.15.17:0/2851863707 wait complete. 2023-10-06T04:43:59.351 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T04:43:59.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.471+0000 7fca9b879700 1 Processor -- start 2023-10-06T04:43:59.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.472+0000 7fca9b879700 1 -- start start 2023-10-06T04:43:59.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.472+0000 7fca9b879700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fca94159800 0x7fca940af520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:59.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.472+0000 7fca9b879700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fca940af0c0 0x7fca9406b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:59.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.472+0000 7fca9b879700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca940aec30 con 0x7fca940b1140 2023-10-06T04:43:59.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.472+0000 7fca9b879700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca940ae300 con 0x7fca94159800 2023-10-06T04:43:59.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.472+0000 7fca9b879700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca940ae5e0 con 0x7fca940af0c0 2023-10-06T04:43:59.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.472+0000 7fca99615700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fca94159800 0x7fca940af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:59.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.472+0000 7fca99e16700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fca940b1140 0x7fca9406c560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:44008/0 (socket says 172.21.15.17:44008) 2023-10-06T04:43:59.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.472+0000 7fca99e16700 1 -- 172.21.15.17:0/341818142 learned_addr learned my addr 172.21.15.17:0/341818142 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:43:59.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.473+0000 7fca98e14700 1 --2- 172.21.15.17:0/341818142 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fca940af0c0 0x7fca9406b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:59.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.473+0000 7fca99615700 1 -- 172.21.15.17:0/341818142 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fca940af0c0 msgr2=0x7fca9406b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:43:59.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.473+0000 7fca99615700 1 --2- 172.21.15.17:0/341818142 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fca940af0c0 0x7fca9406b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:59.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.473+0000 7fca99615700 1 -- 172.21.15.17:0/341818142 >> v1:172.21.15.17:6789/0 conn(0x7fca940b1140 legacy=0x7fca9406c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:59.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.473+0000 7fca93fff700 1 -- 172.21.15.17:0/341818142 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1748936418 0 0) 0x7fca940aec30 con 0x7fca940b1140 2023-10-06T04:43:59.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.473+0000 7fca99615700 1 -- 172.21.15.17:0/341818142 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca940ae8c0 con 0x7fca94159800 2023-10-06T04:43:59.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.473+0000 7fca99615700 1 --2- 172.21.15.17:0/341818142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca94159800 0x7fca940af520 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fca8c0098e0 tx=0x7fca8c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5096150a1b3426 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:59.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.473+0000 7fca93fff700 1 -- 172.21.15.17:0/341818142 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8c009e80 con 0x7fca94159800 2023-10-06T04:43:59.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.473+0000 7fca93fff700 1 -- 172.21.15.17:0/341818142 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca8c00b860 con 0x7fca94159800 2023-10-06T04:43:59.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.473+0000 7fca93fff700 1 -- 172.21.15.17:0/341818142 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8c00bbe0 con 0x7fca94159800 2023-10-06T04:43:59.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.474+0000 7fca9b879700 1 -- 172.21.15.17:0/341818142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca94159800 msgr2=0x7fca940af520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:59.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.474+0000 7fca9b879700 1 --2- 172.21.15.17:0/341818142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca94159800 0x7fca940af520 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fca8c0098e0 tx=0x7fca8c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:43:59.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.474+0000 7fca9b879700 1 -- 172.21.15.17:0/341818142 shutdown_connections 2023-10-06T04:43:59.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.474+0000 7fca9b879700 1 --2- 172.21.15.17:0/341818142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca94159800 0x7fca940af520 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:59.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.474+0000 7fca9b879700 1 --2- 172.21.15.17:0/341818142 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fca940af0c0 0x7fca9406b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:59.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.474+0000 7fca9b879700 1 -- 172.21.15.17:0/341818142 >> 172.21.15.17:0/341818142 conn(0x7fca940cde20 msgr2=0x7fca9406ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:59.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.474+0000 7fca9b879700 1 -- 172.21.15.17:0/341818142 shutdown_connections 2023-10-06T04:43:59.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.474+0000 7fca9b879700 1 -- 172.21.15.17:0/341818142 wait complete. 2023-10-06T04:43:59.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.475+0000 7fca9b879700 1 Processor -- start 2023-10-06T04:43:59.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.475+0000 7fca9b879700 1 -- start start 2023-10-06T04:43:59.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.476+0000 7fca9b879700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fca940af0c0 0x7fca9406c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:59.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.476+0000 7fca9b879700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca940b1140 0x7fca940a9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:59.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.476+0000 7fca9b879700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca94159800 0x7fca9414ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:59.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.476+0000 7fca9b879700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca940aa350 con 0x7fca940b1140 2023-10-06T04:43:59.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.476+0000 7fca9b879700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca940aa630 con 0x7fca94159800 2023-10-06T04:43:59.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.476+0000 7fca9b879700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca940aa910 con 0x7fca940af0c0 2023-10-06T04:43:59.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.476+0000 7fca98e14700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca940b1140 0x7fca940a9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:59.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.476+0000 7fca98e14700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca940b1140 0x7fca940a9890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35248/0 (socket says 172.21.15.17:35248) 2023-10-06T04:43:59.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.476+0000 7fca98e14700 1 -- 172.21.15.17:0/3831939087 learned_addr learned my addr 172.21.15.17:0/3831939087 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:43:59.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.476+0000 7fca99615700 1 --2- 172.21.15.17:0/3831939087 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fca940af0c0 0x7fca9406c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:59.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.476+0000 7fca99e16700 1 --2- 172.21.15.17:0/3831939087 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca94159800 0x7fca9414ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:59.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.476+0000 7fca98e14700 1 -- 172.21.15.17:0/3831939087 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fca940af0c0 msgr2=0x7fca9406c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:59.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.476+0000 7fca98e14700 1 --2- 172.21.15.17:0/3831939087 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fca940af0c0 0x7fca9406c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:59.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.476+0000 7fca98e14700 1 -- 172.21.15.17:0/3831939087 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca94159800 msgr2=0x7fca9414ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:59.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.476+0000 7fca98e14700 1 --2- 172.21.15.17:0/3831939087 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca94159800 0x7fca9414ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:59.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.476+0000 7fca98e14700 1 -- 172.21.15.17:0/3831939087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca8c009420 con 0x7fca940b1140 2023-10-06T04:43:59.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.476+0000 7fca99e16700 1 --2- 172.21.15.17:0/3831939087 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca94159800 0x7fca9414ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:43:59.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.476+0000 7fca98e14700 1 --2- 172.21.15.17:0/3831939087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca940b1140 0x7fca940a9890 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fca8800d860 tx=0x7fca88008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:59.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.477+0000 7fca917fa700 1 -- 172.21.15.17:0/3831939087 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca880125f0 con 0x7fca940b1140 2023-10-06T04:43:59.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.477+0000 7fca917fa700 1 -- 172.21.15.17:0/3831939087 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca88012750 con 0x7fca940b1140 2023-10-06T04:43:59.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.477+0000 7fca9b879700 1 -- 172.21.15.17:0/3831939087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca940aabf0 con 0x7fca940b1140 2023-10-06T04:43:59.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.477+0000 7fca917fa700 1 -- 172.21.15.17:0/3831939087 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca88012af0 con 0x7fca940b1140 2023-10-06T04:43:59.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.477+0000 7fca9b879700 1 -- 172.21.15.17:0/3831939087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca9416d400 con 0x7fca940b1140 2023-10-06T04:43:59.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.478+0000 7fca9b879700 1 -- 172.21.15.17:0/3831939087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca9404c380 con 0x7fca940b1140 2023-10-06T04:43:59.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.478+0000 7fca917fa700 1 -- 172.21.15.17:0/3831939087 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fca8801e460 con 0x7fca940b1140 2023-10-06T04:43:59.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.479+0000 7fca917fa700 1 --2- 172.21.15.17:0/3831939087 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fca80066f30 0x7fca800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:43:59.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.479+0000 7fca99615700 1 --2- 172.21.15.17:0/3831939087 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fca80066f30 0x7fca800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:43:59.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.479+0000 7fca917fa700 1 -- 172.21.15.17:0/3831939087 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fca88084c80 con 0x7fca940b1140 2023-10-06T04:43:59.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.479+0000 7fca99615700 1 --2- 172.21.15.17:0/3831939087 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fca80066f30 0x7fca800693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fca8c0093a0 tx=0x7fca8c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:43:59.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.483+0000 7fca917fa700 1 -- 172.21.15.17:0/3831939087 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca88055820 con 0x7fca940b1140 2023-10-06T04:43:59.677 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:43:59.679 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:43:59.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.678+0000 7fca9b879700 1 -- 172.21.15.17:0/3831939087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fca940afa60 con 0x7fca940b1140 2023-10-06T04:43:59.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.681+0000 7fca917fa700 1 -- 172.21.15.17:0/3831939087 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fca880553b0 con 0x7fca940b1140 2023-10-06T04:43:59.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.684+0000 7fca9b879700 1 -- 172.21.15.17:0/3831939087 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fca80066f30 msgr2=0x7fca800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:59.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.684+0000 7fca9b879700 1 --2- 172.21.15.17:0/3831939087 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fca80066f30 0x7fca800693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fca8c0093a0 tx=0x7fca8c017000 comp rx=0 tx=0).stop 2023-10-06T04:43:59.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.684+0000 7fca9b879700 1 -- 172.21.15.17:0/3831939087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca940b1140 msgr2=0x7fca940a9890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:43:59.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.684+0000 7fca9b879700 1 --2- 172.21.15.17:0/3831939087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca940b1140 0x7fca940a9890 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fca8800d860 tx=0x7fca88008040 comp rx=0 tx=0).stop 2023-10-06T04:43:59.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.684+0000 7fca9b879700 1 -- 172.21.15.17:0/3831939087 shutdown_connections 2023-10-06T04:43:59.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.684+0000 7fca9b879700 1 --2- 172.21.15.17:0/3831939087 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fca80066f30 0x7fca800693e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:59.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.684+0000 7fca9b879700 1 --2- 172.21.15.17:0/3831939087 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca94159800 0x7fca9414ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:59.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.684+0000 7fca9b879700 1 --2- 172.21.15.17:0/3831939087 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fca940af0c0 0x7fca9406c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:59.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.684+0000 7fca9b879700 1 --2- 172.21.15.17:0/3831939087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca940b1140 0x7fca940a9890 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:43:59.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.684+0000 7fca9b879700 1 -- 172.21.15.17:0/3831939087 >> 172.21.15.17:0/3831939087 conn(0x7fca940cde20 msgr2=0x7fca94068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:43:59.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.684+0000 7fca9b879700 1 -- 172.21.15.17:0/3831939087 shutdown_connections 2023-10-06T04:43:59.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:43:59.684+0000 7fca9b879700 1 -- 172.21.15.17:0/3831939087 wait complete. 2023-10-06T04:43:59.699 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T04:43:59.699 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T04:43:59.811 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T04:43:59.855 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T04:43:59.855 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T04:43:59.855 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:43:59.855 DEBUG:teuthology.orchestra.run.smithi017:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-06T04:43:59.891 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2023-10-06T04:43:59.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:59.891 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T04:43:59.947 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T04:43:59.947 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:43:59.947 DEBUG:teuthology.orchestra.run.smithi136:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-06T04:43:59.987 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi136.front.sepia.ceph.com 2023-10-06T04:43:59.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:43:59.988 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T04:44:00.043 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-06T04:44:00.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:44:00.044 DEBUG:teuthology.orchestra.run.smithi017:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-06T04:44:00.082 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2023-10-06T04:44:00.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:00.082 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T04:44:00.138 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-06T04:44:00.138 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:44:00.138 DEBUG:teuthology.orchestra.run.smithi136:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-06T04:44:00.176 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi136.front.sepia.ceph.com 2023-10-06T04:44:00.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:00.177 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T04:44:00.232 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T04:44:00.233 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:44:00.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.351+0000 7ff7cfcb0700 1 Processor -- start 2023-10-06T04:44:00.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.351+0000 7ff7cfcb0700 1 -- start start 2023-10-06T04:44:00.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.352+0000 7ff7cfcb0700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff7c813fb70 0x7ff7c806b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:00.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.352+0000 7ff7cfcb0700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff7c806ba40 0x7ff7c80c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:00.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.352+0000 7ff7cfcb0700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff7c80ca350 0x7ff7c80af000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:00.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.352+0000 7ff7cfcb0700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c80ca8d0 con 0x7ff7c813fb70 2023-10-06T04:44:00.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.352+0000 7ff7cfcb0700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c80cabb0 con 0x7ff7c80ca350 2023-10-06T04:44:00.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.352+0000 7ff7cfcb0700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c806ad00 con 0x7ff7c806ba40 2023-10-06T04:44:00.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.352+0000 7ff7cda4c700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff7c813fb70 0x7ff7c806b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:00.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.352+0000 7ff7cda4c700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff7c813fb70 0x7ff7c806b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35256/0 (socket says 172.21.15.17:35256) 2023-10-06T04:44:00.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.352+0000 7ff7cda4c700 1 -- 172.21.15.17:0/742041035 learned_addr learned my addr 172.21.15.17:0/742041035 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:00.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.352+0000 7ff7ce24d700 1 --2- 172.21.15.17:0/742041035 >> v2:172.21.15.136:3300/0 conn(0x7ff7c80ca350 0x7ff7c80af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:00.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.352+0000 7ff7cd24b700 1 --2- 172.21.15.17:0/742041035 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff7c806ba40 0x7ff7c80c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:00.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.352+0000 7ff7cda4c700 1 -- 172.21.15.17:0/742041035 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff7c806ba40 msgr2=0x7ff7c80c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:00.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.352+0000 7ff7cda4c700 1 --2- 172.21.15.17:0/742041035 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff7c806ba40 0x7ff7c80c9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:00.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.352+0000 7ff7cda4c700 1 -- 172.21.15.17:0/742041035 >> v2:172.21.15.136:3300/0 conn(0x7ff7c80ca350 msgr2=0x7ff7c80af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:00.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.352+0000 7ff7cda4c700 1 --2- 172.21.15.17:0/742041035 >> v2:172.21.15.136:3300/0 conn(0x7ff7c80ca350 0x7ff7c80af000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:00.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.352+0000 7ff7cda4c700 1 -- 172.21.15.17:0/742041035 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c806afe0 con 0x7ff7c813fb70 2023-10-06T04:44:00.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.352+0000 7ff7cda4c700 1 --2- 172.21.15.17:0/742041035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7c813fb70 0x7ff7c806b500 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff7c80aed60 tx=0x7ff7b800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf279772840a7f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:00.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.352+0000 7ff7cca4a700 1 -- 172.21.15.17:0/742041035 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b800db40 con 0x7ff7c813fb70 2023-10-06T04:44:00.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.352+0000 7ff7cca4a700 1 -- 172.21.15.17:0/742041035 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b800dca0 con 0x7ff7c813fb70 2023-10-06T04:44:00.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.352+0000 7ff7cca4a700 1 -- 172.21.15.17:0/742041035 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b80196b0 con 0x7ff7c813fb70 2023-10-06T04:44:00.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.353+0000 7ff7cfcb0700 1 -- 172.21.15.17:0/742041035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7c813fb70 msgr2=0x7ff7c806b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:00.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.353+0000 7ff7cfcb0700 1 --2- 172.21.15.17:0/742041035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7c813fb70 0x7ff7c806b500 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff7c80aed60 tx=0x7ff7b800b4f0 comp rx=0 tx=0).stop 2023-10-06T04:44:00.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.353+0000 7ff7cfcb0700 1 -- 172.21.15.17:0/742041035 shutdown_connections 2023-10-06T04:44:00.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.353+0000 7ff7cfcb0700 1 --2- 172.21.15.17:0/742041035 >> v2:172.21.15.136:3300/0 conn(0x7ff7c80ca350 0x7ff7c80af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:00.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.353+0000 7ff7cfcb0700 1 --2- 172.21.15.17:0/742041035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7c813fb70 0x7ff7c806b500 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:00.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.353+0000 7ff7cfcb0700 1 --2- 172.21.15.17:0/742041035 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff7c806ba40 0x7ff7c80c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:00.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.353+0000 7ff7cfcb0700 1 -- 172.21.15.17:0/742041035 >> 172.21.15.17:0/742041035 conn(0x7ff7c80675f0 msgr2=0x7ff7c80679f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:00.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.353+0000 7ff7cfcb0700 1 -- 172.21.15.17:0/742041035 shutdown_connections 2023-10-06T04:44:00.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.353+0000 7ff7cfcb0700 1 -- 172.21.15.17:0/742041035 wait complete. 2023-10-06T04:44:00.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.355+0000 7ff7cfcb0700 1 Processor -- start 2023-10-06T04:44:00.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.355+0000 7ff7cfcb0700 1 -- start start 2023-10-06T04:44:00.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.355+0000 7ff7cfcb0700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff7c806ba40 0x7ff7c813bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:00.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.355+0000 7ff7cfcb0700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7c80ca350 0x7ff7c80c2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:00.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.355+0000 7ff7cfcb0700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7c813fb70 0x7ff7c80c25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:00.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.355+0000 7ff7cfcb0700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c8157850 con 0x7ff7c80ca350 2023-10-06T04:44:00.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.355+0000 7ff7cfcb0700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c8156c40 con 0x7ff7c813fb70 2023-10-06T04:44:00.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.355+0000 7ff7cfcb0700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c8156f20 con 0x7ff7c806ba40 2023-10-06T04:44:00.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.355+0000 7ff7cd24b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7c80ca350 0x7ff7c80c2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:00.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.355+0000 7ff7cd24b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7c80ca350 0x7ff7c80c2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35262/0 (socket says 172.21.15.17:35262) 2023-10-06T04:44:00.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.355+0000 7ff7cd24b700 1 -- 172.21.15.17:0/1728027371 learned_addr learned my addr 172.21.15.17:0/1728027371 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:00.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.356+0000 7ff7ce24d700 1 --2- 172.21.15.17:0/1728027371 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7c813fb70 0x7ff7c80c25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:00.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.356+0000 7ff7cda4c700 1 --2- 172.21.15.17:0/1728027371 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff7c806ba40 0x7ff7c813bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:00.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.356+0000 7ff7cd24b700 1 -- 172.21.15.17:0/1728027371 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff7c806ba40 msgr2=0x7ff7c813bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:00.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.356+0000 7ff7cd24b700 1 --2- 172.21.15.17:0/1728027371 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff7c806ba40 0x7ff7c813bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:00.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.356+0000 7ff7cd24b700 1 -- 172.21.15.17:0/1728027371 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7c813fb70 msgr2=0x7ff7c80c25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:00.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.356+0000 7ff7cd24b700 1 --2- 172.21.15.17:0/1728027371 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7c813fb70 0x7ff7c80c25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:00.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.356+0000 7ff7cd24b700 1 -- 172.21.15.17:0/1728027371 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b800b790 con 0x7ff7c80ca350 2023-10-06T04:44:00.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.356+0000 7ff7cd24b700 1 --2- 172.21.15.17:0/1728027371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7c80ca350 0x7ff7c80c2070 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc00ec50 tx=0x7ff7bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:00.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.356+0000 7ff7c5ffb700 1 -- 172.21.15.17:0/1728027371 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc00c850 con 0x7ff7c80ca350 2023-10-06T04:44:00.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.356+0000 7ff7c5ffb700 1 -- 172.21.15.17:0/1728027371 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7bc00c9b0 con 0x7ff7c80ca350 2023-10-06T04:44:00.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.356+0000 7ff7cfcb0700 1 -- 172.21.15.17:0/1728027371 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c8157200 con 0x7ff7c80ca350 2023-10-06T04:44:00.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.356+0000 7ff7c5ffb700 1 -- 172.21.15.17:0/1728027371 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc00cd70 con 0x7ff7c80ca350 2023-10-06T04:44:00.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.356+0000 7ff7cfcb0700 1 -- 172.21.15.17:0/1728027371 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c813c440 con 0x7ff7c80ca350 2023-10-06T04:44:00.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.357+0000 7ff7cfcb0700 1 -- 172.21.15.17:0/1728027371 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c8063ff0 con 0x7ff7c80ca350 2023-10-06T04:44:00.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.358+0000 7ff7c5ffb700 1 -- 172.21.15.17:0/1728027371 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff7bc013680 con 0x7ff7c80ca350 2023-10-06T04:44:00.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.358+0000 7ff7c5ffb700 1 --2- 172.21.15.17:0/1728027371 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff7b4066f30 0x7ff7b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:00.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.358+0000 7ff7c5ffb700 1 -- 172.21.15.17:0/1728027371 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff7bc0848a0 con 0x7ff7c80ca350 2023-10-06T04:44:00.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.358+0000 7ff7cda4c700 1 --2- 172.21.15.17:0/1728027371 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff7b4066f30 0x7ff7b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:00.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.359+0000 7ff7cda4c700 1 --2- 172.21.15.17:0/1728027371 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff7b4066f30 0x7ff7b40693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff7c80aed60 tx=0x7ff7b801b000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:00.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.362+0000 7ff7c5ffb700 1 -- 172.21.15.17:0/1728027371 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff7bc0519b0 con 0x7ff7c80ca350 2023-10-06T04:44:00.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.606+0000 7ff7cfcb0700 1 -- 172.21.15.17:0/1728027371 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7c80c17d0 con 0x7ff7c80ca350 2023-10-06T04:44:00.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.607+0000 7ff7c5ffb700 1 -- 172.21.15.17:0/1728027371 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4597 (secure 0 0 0) 0x7ff7bc054fd0 con 0x7ff7c80ca350 2023-10-06T04:44:00.609 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:00.609 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/3001699743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3001699743},{"type":"v1","addr":"172.21.15.136:6833","nonce":3001699743}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/1891609455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1891609455},{"type":"v1","addr":"172.21.15.17:6835","nonce":1891609455}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/2697752124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":2697752124},{"type":"v1","addr":"172.21.15.17:6837","nonce":2697752124}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:43:29.199801+0000","modified":"2023-10-06T04:43:32.817081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6835/1496795591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":1496795591},{"type":"v1","addr":"172.21.15.136:6835","nonce":1496795591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:44:00.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.609+0000 7ff7cfcb0700 1 -- 172.21.15.17:0/1728027371 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff7b4066f30 msgr2=0x7ff7b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:00.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.609+0000 7ff7cfcb0700 1 --2- 172.21.15.17:0/1728027371 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff7b4066f30 0x7ff7b40693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff7c80aed60 tx=0x7ff7b801b000 comp rx=0 tx=0).stop 2023-10-06T04:44:00.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.609+0000 7ff7cfcb0700 1 -- 172.21.15.17:0/1728027371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7c80ca350 msgr2=0x7ff7c80c2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:00.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.609+0000 7ff7cfcb0700 1 --2- 172.21.15.17:0/1728027371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7c80ca350 0x7ff7c80c2070 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc00ec50 tx=0x7ff7bc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:00.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.609+0000 7ff7cfcb0700 1 -- 172.21.15.17:0/1728027371 shutdown_connections 2023-10-06T04:44:00.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.609+0000 7ff7cfcb0700 1 --2- 172.21.15.17:0/1728027371 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff7b4066f30 0x7ff7b40693e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:00.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.609+0000 7ff7cfcb0700 1 --2- 172.21.15.17:0/1728027371 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7c813fb70 0x7ff7c80c25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:00.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.609+0000 7ff7cfcb0700 1 --2- 172.21.15.17:0/1728027371 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff7c806ba40 0x7ff7c813bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:00.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.609+0000 7ff7cfcb0700 1 --2- 172.21.15.17:0/1728027371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7c80ca350 0x7ff7c80c2070 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:00.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.609+0000 7ff7cfcb0700 1 -- 172.21.15.17:0/1728027371 >> 172.21.15.17:0/1728027371 conn(0x7ff7c80675f0 msgr2=0x7ff7c80c0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:00.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.609+0000 7ff7cfcb0700 1 -- 172.21.15.17:0/1728027371 shutdown_connections 2023-10-06T04:44:00.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.609+0000 7ff7cfcb0700 1 -- 172.21.15.17:0/1728027371 wait complete. 2023-10-06T04:44:00.612 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 7 2023-10-06T04:44:00.623 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:44:00.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.740+0000 7fd35403b700 1 Processor -- start 2023-10-06T04:44:00.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.741+0000 7fd35403b700 1 -- start start 2023-10-06T04:44:00.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.741+0000 7fd35403b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd34c142d50 0x7fd34c0c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:00.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.741+0000 7fd35403b700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd34c06c560 0x7fd34c06c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:00.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.741+0000 7fd35403b700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd34c06cf10 con 0x7fd34c0caf00 2023-10-06T04:44:00.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.741+0000 7fd35403b700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd34c0c3070 con 0x7fd34c06c560 2023-10-06T04:44:00.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.741+0000 7fd35403b700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd34c0c3a40 con 0x7fd34c142d50 2023-10-06T04:44:00.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.742+0000 7fd3515d6700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd34c06c560 0x7fd34c06c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:00.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.742+0000 7fd3525d8700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fd34c0caf00 0x7fd34c0cb340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55730/0 (socket says 172.21.15.17:55730) 2023-10-06T04:44:00.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.742+0000 7fd3525d8700 1 -- 172.21.15.17:0/1125529009 learned_addr learned my addr 172.21.15.17:0/1125529009 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:00.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.742+0000 7fd351dd7700 1 --2- 172.21.15.17:0/1125529009 >> v2:172.21.15.136:3300/0 conn(0x7fd34c142d50 0x7fd34c0c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:00.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.742+0000 7fd3515d6700 1 -- 172.21.15.17:0/1125529009 >> v2:172.21.15.136:3300/0 conn(0x7fd34c142d50 msgr2=0x7fd34c0c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:00.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.742+0000 7fd3515d6700 1 --2- 172.21.15.17:0/1125529009 >> v2:172.21.15.136:3300/0 conn(0x7fd34c142d50 0x7fd34c0c3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:00.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.742+0000 7fd3515d6700 1 -- 172.21.15.17:0/1125529009 >> v1:172.21.15.17:6789/0 conn(0x7fd34c0caf00 legacy=0x7fd34c0cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:00.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.742+0000 7fd3515d6700 1 -- 172.21.15.17:0/1125529009 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34c0cbb50 con 0x7fd34c06c560 2023-10-06T04:44:00.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.742+0000 7fd350dd5700 1 -- 172.21.15.17:0/1125529009 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2889516582 0 0) 0x7fd34c06cf10 con 0x7fd34c0caf00 2023-10-06T04:44:00.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.742+0000 7fd3515d6700 1 --2- 172.21.15.17:0/1125529009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd34c06c560 0x7fd34c06c9d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd34c06e570 tx=0x7fd3400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=423468aef4b8d872 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:00.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.742+0000 7fd350dd5700 1 -- 172.21.15.17:0/1125529009 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34000b6b0 con 0x7fd34c06c560 2023-10-06T04:44:00.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.742+0000 7fd350dd5700 1 -- 172.21.15.17:0/1125529009 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34000b810 con 0x7fd34c06c560 2023-10-06T04:44:00.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.742+0000 7fd350dd5700 1 -- 172.21.15.17:0/1125529009 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34000bbb0 con 0x7fd34c06c560 2023-10-06T04:44:00.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.743+0000 7fd35403b700 1 -- 172.21.15.17:0/1125529009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd34c06c560 msgr2=0x7fd34c06c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:00.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.743+0000 7fd35403b700 1 --2- 172.21.15.17:0/1125529009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd34c06c560 0x7fd34c06c9d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd34c06e570 tx=0x7fd3400091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:00.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.743+0000 7fd35403b700 1 -- 172.21.15.17:0/1125529009 shutdown_connections 2023-10-06T04:44:00.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.743+0000 7fd35403b700 1 --2- 172.21.15.17:0/1125529009 >> v2:172.21.15.136:3300/0 conn(0x7fd34c142d50 0x7fd34c0c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:00.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.743+0000 7fd35403b700 1 --2- 172.21.15.17:0/1125529009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd34c06c560 0x7fd34c06c9d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:00.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.743+0000 7fd35403b700 1 -- 172.21.15.17:0/1125529009 >> 172.21.15.17:0/1125529009 conn(0x7fd34c06e140 msgr2=0x7fd34c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:00.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.743+0000 7fd35403b700 1 -- 172.21.15.17:0/1125529009 shutdown_connections 2023-10-06T04:44:00.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.743+0000 7fd35403b700 1 -- 172.21.15.17:0/1125529009 wait complete. 2023-10-06T04:44:00.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.744+0000 7fd35403b700 1 Processor -- start 2023-10-06T04:44:00.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.744+0000 7fd35403b700 1 -- start start 2023-10-06T04:44:00.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.745+0000 7fd35403b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd34c06c560 0x7fd34c1412f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:00.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.745+0000 7fd35403b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd34c0caf00 0x7fd34c0b1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:00.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.745+0000 7fd35403b700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd34c142d50 0x7fd34c0c63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:00.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.745+0000 7fd35403b700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c0b2ec0 con 0x7fd34c0caf00 2023-10-06T04:44:00.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.745+0000 7fd35403b700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c15cb30 con 0x7fd34c06c560 2023-10-06T04:44:00.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.745+0000 7fd35403b700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c0b22b0 con 0x7fd34c142d50 2023-10-06T04:44:00.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.745+0000 7fd3515d6700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd34c0caf00 0x7fd34c0b1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:00.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.745+0000 7fd3515d6700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd34c0caf00 0x7fd34c0b1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60116/0 (socket says 172.21.15.17:60116) 2023-10-06T04:44:00.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.745+0000 7fd3515d6700 1 -- 172.21.15.17:0/4239327732 learned_addr learned my addr 172.21.15.17:0/4239327732 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:00.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.745+0000 7fd351dd7700 1 --2- 172.21.15.17:0/4239327732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd34c06c560 0x7fd34c1412f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:00.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.745+0000 7fd3525d8700 1 --2- 172.21.15.17:0/4239327732 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd34c142d50 0x7fd34c0c63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:00.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.745+0000 7fd3515d6700 1 -- 172.21.15.17:0/4239327732 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd34c142d50 msgr2=0x7fd34c0c63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:00.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.745+0000 7fd3515d6700 1 --2- 172.21.15.17:0/4239327732 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd34c142d50 0x7fd34c0c63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:00.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.745+0000 7fd3515d6700 1 -- 172.21.15.17:0/4239327732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd34c06c560 msgr2=0x7fd34c1412f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:00.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.745+0000 7fd3515d6700 1 --2- 172.21.15.17:0/4239327732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd34c06c560 0x7fd34c1412f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:00.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.745+0000 7fd3515d6700 1 -- 172.21.15.17:0/4239327732 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd340009420 con 0x7fd34c0caf00 2023-10-06T04:44:00.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.745+0000 7fd3515d6700 1 --2- 172.21.15.17:0/4239327732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd34c0caf00 0x7fd34c0b1bb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd34c0646d0 tx=0x7fd340017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:00.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.746+0000 7fd349ffb700 1 -- 172.21.15.17:0/4239327732 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd340000d10 con 0x7fd34c0caf00 2023-10-06T04:44:00.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.746+0000 7fd349ffb700 1 -- 172.21.15.17:0/4239327732 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34000b980 con 0x7fd34c0caf00 2023-10-06T04:44:00.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.746+0000 7fd35403b700 1 -- 172.21.15.17:0/4239327732 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd34c0b2590 con 0x7fd34c0caf00 2023-10-06T04:44:00.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.746+0000 7fd349ffb700 1 -- 172.21.15.17:0/4239327732 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd340025420 con 0x7fd34c0caf00 2023-10-06T04:44:00.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.746+0000 7fd35403b700 1 -- 172.21.15.17:0/4239327732 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd34c0b2b50 con 0x7fd34c0caf00 2023-10-06T04:44:00.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.747+0000 7fd35403b700 1 -- 172.21.15.17:0/4239327732 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd34c063ff0 con 0x7fd34c0caf00 2023-10-06T04:44:00.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.747+0000 7fd349ffb700 1 -- 172.21.15.17:0/4239327732 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd340023070 con 0x7fd34c0caf00 2023-10-06T04:44:00.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.747+0000 7fd349ffb700 1 --2- 172.21.15.17:0/4239327732 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd338066f30 0x7fd3380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:00.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.748+0000 7fd349ffb700 1 -- 172.21.15.17:0/4239327732 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd340085c30 con 0x7fd34c0caf00 2023-10-06T04:44:00.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.748+0000 7fd351dd7700 1 --2- 172.21.15.17:0/4239327732 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd338066f30 0x7fd3380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:00.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.748+0000 7fd351dd7700 1 --2- 172.21.15.17:0/4239327732 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd338066f30 0x7fd3380693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd344006fd0 tx=0x7fd344008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:00.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.752+0000 7fd349ffb700 1 -- 172.21.15.17:0/4239327732 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd340052d40 con 0x7fd34c0caf00 2023-10-06T04:44:00.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.949+0000 7fd35403b700 1 -- 172.21.15.17:0/4239327732 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd34c0b3000 con 0x7fd34c0caf00 2023-10-06T04:44:00.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.950+0000 7fd349ffb700 1 -- 172.21.15.17:0/4239327732 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16866 (secure 0 0 0) 0x7fd34c0b3000 con 0x7fd34c0caf00 2023-10-06T04:44:00.952 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:00.952 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":21,"fsid":"780777c4-2b25-4d35-9058-c9f2d62e3ad9","created":"2023-10-06T04:43:10.578520+0000","modified":"2023-10-06T04:43:30.789916+0000","last_up_change":"2023-10-06T04:43:20.682958+0000","last_in_change":"2023-10-06T04:43:12.978917+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:43:21.795733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:43:22.389592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:43:26.914728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:43:28.173678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"84737b08-575c-46dd-9488-073ae8504494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6809","nonce":90656},{"type":"v1","addr":"172.21.15.17:6811","nonce":90656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":90656},{"type":"v1","addr":"172.21.15.17:6814","nonce":90656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":90656},{"type":"v1","addr":"172.21.15.17:6822","nonce":90656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":90656},{"type":"v1","addr":"172.21.15.17:6818","nonce":90656}]},"public_addr":"172.21.15.17:6811/90656","cluster_addr":"172.21.15.17:6814/90656","heartbeat_back_addr":"172.21.15.17:6822/90656","heartbeat_front_addr":"172.21.15.17:6818/90656","state":["exists","up"]},{"osd":1,"uuid":"dffeb740-58a2-4fd6-8ff1-a0a11a2cc709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":90655},{"type":"v1","addr":"172.21.15.17:6801","nonce":90655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":90655},{"type":"v1","addr":"172.21.15.17:6803","nonce":90655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":90655},{"type":"v1","addr":"172.21.15.17:6807","nonce":90655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":90655},{"type":"v1","addr":"172.21.15.17:6805","nonce":90655}]},"public_addr":"172.21.15.17:6801/90655","cluster_addr":"172.21.15.17:6803/90655","heartbeat_back_addr":"172.21.15.17:6807/90655","heartbeat_front_addr":"172.21.15.17:6805/90655","state":["exists","up"]},{"osd":2,"uuid":"48bd6831-763d-48c2-b515-e02c216d608b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":90657},{"type":"v1","addr":"172.21.15.17:6810","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":90657},{"type":"v1","addr":"172.21.15.17:6815","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":90657},{"type":"v1","addr":"172.21.15.17:6823","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":90657},{"type":"v1","addr":"172.21.15.17:6819","nonce":90657}]},"public_addr":"172.21.15.17:6810/90657","cluster_addr":"172.21.15.17:6815/90657","heartbeat_back_addr":"172.21.15.17:6823/90657","heartbeat_front_addr":"172.21.15.17:6819/90657","state":["exists","up"]},{"osd":3,"uuid":"ae7dbb23-abe7-4bd3-a4df-6f5963d6804c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":90688},{"type":"v1","addr":"172.21.15.17:6825","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":90688},{"type":"v1","addr":"172.21.15.17:6827","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":90688},{"type":"v1","addr":"172.21.15.17:6831","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":90688},{"type":"v1","addr":"172.21.15.17:6829","nonce":90688}]},"public_addr":"172.21.15.17:6825/90688","cluster_addr":"172.21.15.17:6827/90688","heartbeat_back_addr":"172.21.15.17:6831/90688","heartbeat_front_addr":"172.21.15.17:6829/90688","state":["exists","up"]},{"osd":4,"uuid":"29991fb4-1667-4ea3-aca0-d55db27f3bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":90902},{"type":"v1","addr":"172.21.15.136:6801","nonce":90902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":90902},{"type":"v1","addr":"172.21.15.136:6803","nonce":90902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":90902},{"type":"v1","addr":"172.21.15.136:6807","nonce":90902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":90902},{"type":"v1","addr":"172.21.15.136:6805","nonce":90902}]},"public_addr":"172.21.15.136:6801/90902","cluster_addr":"172.21.15.136:6803/90902","heartbeat_back_addr":"172.21.15.136:6807/90902","heartbeat_front_addr":"172.21.15.136:6805/90902","state":["exists","up"]},{"osd":5,"uuid":"398b4ff9-03fc-421f-882c-ba12aa088eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":90901},{"type":"v1","addr":"172.21.15.136:6809","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":90901},{"type":"v1","addr":"172.21.15.136:6811","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":90901},{"type":"v1","addr":"172.21.15.136:6815","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":90901},{"type":"v1","addr":"172.21.15.136:6813","nonce":90901}]},"public_addr":"172.21.15.136:6809/90901","cluster_addr":"172.21.15.136:6811/90901","heartbeat_back_addr":"172.21.15.136:6815/90901","heartbeat_front_addr":"172.21.15.136:6813/90901","state":["exists","up"]},{"osd":6,"uuid":"1bb91a72-4dab-4cdb-aa1d-2b8a9edf1ad0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":90927},{"type":"v1","addr":"172.21.15.136:6825","nonce":90927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":90927},{"type":"v1","addr":"172.21.15.136:6827","nonce":90927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":90927},{"type":"v1","addr":"172.21.15.136:6831","nonce":90927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":90927},{"type":"v1","addr":"172.21.15.136:6829","nonce":90927}]},"public_addr":"172.21.15.136:6825/90927","cluster_addr":"172.21.15.136:6827/90927","heartbeat_back_addr":"172.21.15.136:6831/90927","heartbeat_front_addr":"172.21.15.136:6829/90927","state":["exists","up"]},{"osd":7,"uuid":"719b654e-010d-4aa4-8c13-83fdde242b47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":90934},{"type":"v1","addr":"172.21.15.136:6817","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":90934},{"type":"v1","addr":"172.21.15.136:6819","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":90934},{"type":"v1","addr":"172.21.15.136:6824","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":90934},{"type":"v1","addr":"172.21.15.136:6821","nonce":90934}]},"public_addr":"172.21.15.136:6817/90934","cluster_addr":"172.21.15.136:6819/90934","heartbeat_back_addr":"172.21.15.136:6824/90934","heartbeat_front_addr":"172.21.15.136:6821/90934","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.157479+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.140520+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.190743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.231396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.156510+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.145822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.202888+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.139532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:44:00.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.952+0000 7fd35403b700 1 -- 172.21.15.17:0/4239327732 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd338066f30 msgr2=0x7fd3380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:00.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.952+0000 7fd35403b700 1 --2- 172.21.15.17:0/4239327732 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd338066f30 0x7fd3380693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd344006fd0 tx=0x7fd344008040 comp rx=0 tx=0).stop 2023-10-06T04:44:00.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.952+0000 7fd35403b700 1 -- 172.21.15.17:0/4239327732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd34c0caf00 msgr2=0x7fd34c0b1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:00.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.952+0000 7fd35403b700 1 --2- 172.21.15.17:0/4239327732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd34c0caf00 0x7fd34c0b1bb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd34c0646d0 tx=0x7fd340017000 comp rx=0 tx=0).stop 2023-10-06T04:44:00.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.952+0000 7fd35403b700 1 -- 172.21.15.17:0/4239327732 shutdown_connections 2023-10-06T04:44:00.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.952+0000 7fd35403b700 1 --2- 172.21.15.17:0/4239327732 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd338066f30 0x7fd3380693e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:00.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.952+0000 7fd35403b700 1 --2- 172.21.15.17:0/4239327732 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd34c142d50 0x7fd34c0c63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:00.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.952+0000 7fd35403b700 1 --2- 172.21.15.17:0/4239327732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd34c06c560 0x7fd34c1412f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:00.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.952+0000 7fd35403b700 1 --2- 172.21.15.17:0/4239327732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd34c0caf00 0x7fd34c0b1bb0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:00.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.952+0000 7fd35403b700 1 -- 172.21.15.17:0/4239327732 >> 172.21.15.17:0/4239327732 conn(0x7fd34c06e140 msgr2=0x7fd34c141a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:00.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.952+0000 7fd35403b700 1 -- 172.21.15.17:0/4239327732 shutdown_connections 2023-10-06T04:44:00.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:00.952+0000 7fd35403b700 1 -- 172.21.15.17:0/4239327732 wait complete. 2023-10-06T04:44:00.967 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:43:21.795733+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:43:22.389592+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:43:26.914728+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:43:28.173678+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:44:00.967 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:44:01.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.087+0000 7fc66c71c700 1 Processor -- start 2023-10-06T04:44:01.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.087+0000 7fc66c71c700 1 -- start start 2023-10-06T04:44:01.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.088+0000 7fc66c71c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc664159800 0x7fc6640af520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:01.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.088+0000 7fc66c71c700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6640aec30 con 0x7fc66406bb60 2023-10-06T04:44:01.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.088+0000 7fc66c71c700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6640ae300 con 0x7fc6640af0c0 2023-10-06T04:44:01.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.088+0000 7fc66c71c700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6640ae5e0 con 0x7fc664159800 2023-10-06T04:44:01.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.088+0000 7fc66acb9700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fc66406bb60 0x7fc664159bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55744/0 (socket says 172.21.15.17:55744) 2023-10-06T04:44:01.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.088+0000 7fc66acb9700 1 -- 172.21.15.17:0/2403337741 learned_addr learned my addr 172.21.15.17:0/2403337741 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:01.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.089+0000 7fc66a4b8700 1 --2- 172.21.15.17:0/2403337741 >> v2:172.21.15.136:3300/0 conn(0x7fc664159800 0x7fc6640af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:01.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.089+0000 7fc6694b6700 1 -- 172.21.15.17:0/2403337741 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3791960320 0 0) 0x7fc6640aec30 con 0x7fc66406bb60 2023-10-06T04:44:01.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.089+0000 7fc6694b6700 1 -- 172.21.15.17:0/2403337741 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc64c003570 con 0x7fc66406bb60 2023-10-06T04:44:01.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.089+0000 7fc6694b6700 1 -- 172.21.15.17:0/2403337741 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 181217796 0 0) 0x7fc64c003570 con 0x7fc66406bb60 2023-10-06T04:44:01.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.089+0000 7fc6694b6700 1 -- 172.21.15.17:0/2403337741 >> v2:172.21.15.136:3300/0 conn(0x7fc664159800 msgr2=0x7fc6640af520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:01.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.089+0000 7fc6694b6700 1 --2- 172.21.15.17:0/2403337741 >> v2:172.21.15.136:3300/0 conn(0x7fc664159800 0x7fc6640af520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:01.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.089+0000 7fc6694b6700 1 -- 172.21.15.17:0/2403337741 >> v1:172.21.15.136:6789/0 conn(0x7fc6640af0c0 legacy=0x7fc66406b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:01.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.089+0000 7fc6694b6700 1 -- 172.21.15.17:0/2403337741 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6640ae8c0 con 0x7fc66406bb60 2023-10-06T04:44:01.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.089+0000 7fc6694b6700 1 -- 172.21.15.17:0/2403337741 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4268781140 0 0) 0x7fc6540017f0 con 0x7fc66406bb60 2023-10-06T04:44:01.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.089+0000 7fc6694b6700 1 -- 172.21.15.17:0/2403337741 >> v1:172.21.15.17:6789/0 conn(0x7fc66406bb60 legacy=0x7fc664159bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:01.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.089+0000 7fc6694b6700 1 --2- 172.21.15.17:0/2403337741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc64c003ab0 0x7fc64c003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:01.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.089+0000 7fc6694b6700 1 --2- 172.21.15.17:0/2403337741 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc64c004810 0x7fc64c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:01.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.089+0000 7fc6694b6700 1 --2- 172.21.15.17:0/2403337741 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc64c005290 0x7fc64c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:01.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.089+0000 7fc6694b6700 1 -- 172.21.15.17:0/2403337741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6640ae5e0 con 0x7fc64c003ab0 2023-10-06T04:44:01.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.089+0000 7fc6694b6700 1 -- 172.21.15.17:0/2403337741 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c00c250 con 0x7fc64c004810 2023-10-06T04:44:01.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.089+0000 7fc6694b6700 1 -- 172.21.15.17:0/2403337741 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c00c410 con 0x7fc64c005290 2023-10-06T04:44:01.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.089+0000 7fc66a4b8700 1 --2- 172.21.15.17:0/2403337741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc64c003ab0 0x7fc64c003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:01.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.089+0000 7fc669cb7700 1 --2- 172.21.15.17:0/2403337741 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc64c004810 0x7fc64c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:01.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.089+0000 7fc66acb9700 1 --2- 172.21.15.17:0/2403337741 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc64c005290 0x7fc64c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:01.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.089+0000 7fc66a4b8700 1 -- 172.21.15.17:0/2403337741 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc64c005290 msgr2=0x7fc64c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:01.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.089+0000 7fc66a4b8700 1 --2- 172.21.15.17:0/2403337741 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc64c005290 0x7fc64c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:01.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.089+0000 7fc66a4b8700 1 -- 172.21.15.17:0/2403337741 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc64c004810 msgr2=0x7fc64c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:01.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.089+0000 7fc66a4b8700 1 --2- 172.21.15.17:0/2403337741 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc64c004810 0x7fc64c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:01.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.089+0000 7fc66a4b8700 1 -- 172.21.15.17:0/2403337741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64c003570 con 0x7fc64c003ab0 2023-10-06T04:44:01.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.089+0000 7fc66acb9700 1 -- 172.21.15.17:0/2403337741 reap_dead start 2023-10-06T04:44:01.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.090+0000 7fc66a4b8700 1 --2- 172.21.15.17:0/2403337741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc64c003ab0 0x7fc64c003ec0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc65c009c00 tx=0x7fc65c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bcc5c2d3c3e5c3b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:01.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.090+0000 7fc6694b6700 1 -- 172.21.15.17:0/2403337741 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65c00e710 con 0x7fc64c003ab0 2023-10-06T04:44:01.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.090+0000 7fc6694b6700 1 -- 172.21.15.17:0/2403337741 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc65c00e870 con 0x7fc64c003ab0 2023-10-06T04:44:01.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.090+0000 7fc6694b6700 1 -- 172.21.15.17:0/2403337741 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65c00ec30 con 0x7fc64c003ab0 2023-10-06T04:44:01.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.090+0000 7fc66c71c700 1 -- 172.21.15.17:0/2403337741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc64c003ab0 msgr2=0x7fc64c003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:01.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.090+0000 7fc66c71c700 1 --2- 172.21.15.17:0/2403337741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc64c003ab0 0x7fc64c003ec0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc65c009c00 tx=0x7fc65c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:01.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.090+0000 7fc66c71c700 1 -- 172.21.15.17:0/2403337741 shutdown_connections 2023-10-06T04:44:01.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.090+0000 7fc66c71c700 1 --2- 172.21.15.17:0/2403337741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc64c003ab0 0x7fc64c003ec0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:01.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.090+0000 7fc66c71c700 1 -- 172.21.15.17:0/2403337741 >> 172.21.15.17:0/2403337741 conn(0x7fc6640cde20 msgr2=0x7fc66406ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:01.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.090+0000 7fc66c71c700 1 -- 172.21.15.17:0/2403337741 shutdown_connections 2023-10-06T04:44:01.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.090+0000 7fc66c71c700 1 -- 172.21.15.17:0/2403337741 wait complete. 2023-10-06T04:44:01.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.091+0000 7fc66c71c700 1 Processor -- start 2023-10-06T04:44:01.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.091+0000 7fc66c71c700 1 -- start start 2023-10-06T04:44:01.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.092+0000 7fc66c71c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc64c003ab0 0x7fc6640aa250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:01.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.092+0000 7fc66c71c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc66415c8e0 0x7fc6640ab2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:01.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.092+0000 7fc66c71c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc664147320 0x7fc6640ab7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:01.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.092+0000 7fc66c71c700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66415a0c0 con 0x7fc664147320 2023-10-06T04:44:01.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.092+0000 7fc66c71c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66415c040 con 0x7fc64c003ab0 2023-10-06T04:44:01.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.092+0000 7fc66c71c700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc66415c320 con 0x7fc66415c8e0 2023-10-06T04:44:01.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.092+0000 7fc66acb9700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc664147320 0x7fc6640ab7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:01.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.092+0000 7fc66acb9700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc664147320 0x7fc6640ab7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60126/0 (socket says 172.21.15.17:60126) 2023-10-06T04:44:01.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.092+0000 7fc66acb9700 1 -- 172.21.15.17:0/138565214 learned_addr learned my addr 172.21.15.17:0/138565214 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:01.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.092+0000 7fc66a4b8700 1 --2- 172.21.15.17:0/138565214 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc64c003ab0 0x7fc6640aa250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:01.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.092+0000 7fc669cb7700 1 --2- 172.21.15.17:0/138565214 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc66415c8e0 0x7fc6640ab2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:01.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.092+0000 7fc66acb9700 1 -- 172.21.15.17:0/138565214 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc66415c8e0 msgr2=0x7fc6640ab2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:01.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.092+0000 7fc66acb9700 1 --2- 172.21.15.17:0/138565214 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc66415c8e0 0x7fc6640ab2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:01.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.092+0000 7fc66acb9700 1 -- 172.21.15.17:0/138565214 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc64c003ab0 msgr2=0x7fc6640aa250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:01.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.092+0000 7fc66acb9700 1 --2- 172.21.15.17:0/138565214 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc64c003ab0 0x7fc6640aa250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:01.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.092+0000 7fc66acb9700 1 -- 172.21.15.17:0/138565214 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc664159d50 con 0x7fc664147320 2023-10-06T04:44:01.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.093+0000 7fc669cb7700 1 --2- 172.21.15.17:0/138565214 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc66415c8e0 0x7fc6640ab2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:01.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.093+0000 7fc66acb9700 1 --2- 172.21.15.17:0/138565214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc664147320 0x7fc6640ab7f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc66406bf60 tx=0x7fc6640ae4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:01.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.093+0000 7fc6627fc700 1 -- 172.21.15.17:0/138565214 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65400ac90 con 0x7fc664147320 2023-10-06T04:44:01.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.093+0000 7fc6627fc700 1 -- 172.21.15.17:0/138565214 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc65400ae10 con 0x7fc664147320 2023-10-06T04:44:01.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.093+0000 7fc6627fc700 1 -- 172.21.15.17:0/138565214 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc654013640 con 0x7fc664147320 2023-10-06T04:44:01.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.093+0000 7fc66c71c700 1 -- 172.21.15.17:0/138565214 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc66416a8c0 con 0x7fc664147320 2023-10-06T04:44:01.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.093+0000 7fc66c71c700 1 -- 172.21.15.17:0/138565214 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc664169710 con 0x7fc664147320 2023-10-06T04:44:01.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.094+0000 7fc66c71c700 1 -- 172.21.15.17:0/138565214 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc66404c380 con 0x7fc664147320 2023-10-06T04:44:01.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.094+0000 7fc6627fc700 1 -- 172.21.15.17:0/138565214 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc654013a70 con 0x7fc664147320 2023-10-06T04:44:01.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.095+0000 7fc6627fc700 1 --2- 172.21.15.17:0/138565214 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc650066f30 0x7fc6500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:01.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.095+0000 7fc6627fc700 1 -- 172.21.15.17:0/138565214 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc654084d80 con 0x7fc664147320 2023-10-06T04:44:01.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.095+0000 7fc66a4b8700 1 --2- 172.21.15.17:0/138565214 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc650066f30 0x7fc6500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:01.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.095+0000 7fc66a4b8700 1 --2- 172.21.15.17:0/138565214 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc650066f30 0x7fc6500693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc65c0091e0 tx=0x7fc65c01a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:01.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.099+0000 7fc6627fc700 1 -- 172.21.15.17:0/138565214 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc654051e90 con 0x7fc664147320 2023-10-06T04:44:01.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.291+0000 7fc66c71c700 1 -- 172.21.15.17:0/138565214 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc6640b1140 con 0x7fc664147320 2023-10-06T04:44:01.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.292+0000 7fc6627fc700 1 -- 172.21.15.17:0/138565214 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc6540554b0 con 0x7fc664147320 2023-10-06T04:44:01.293 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-10-06T04:44:01.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.293+0000 7fc66c71c700 1 -- 172.21.15.17:0/138565214 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc650066f30 msgr2=0x7fc6500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:01.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.293+0000 7fc66c71c700 1 --2- 172.21.15.17:0/138565214 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc650066f30 0x7fc6500693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc65c0091e0 tx=0x7fc65c01a000 comp rx=0 tx=0).stop 2023-10-06T04:44:01.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.293+0000 7fc66c71c700 1 -- 172.21.15.17:0/138565214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc664147320 msgr2=0x7fc6640ab7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:01.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.293+0000 7fc66c71c700 1 --2- 172.21.15.17:0/138565214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc664147320 0x7fc6640ab7f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc66406bf60 tx=0x7fc6640ae4d0 comp rx=0 tx=0).stop 2023-10-06T04:44:01.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.294+0000 7fc66c71c700 1 -- 172.21.15.17:0/138565214 shutdown_connections 2023-10-06T04:44:01.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.294+0000 7fc66c71c700 1 --2- 172.21.15.17:0/138565214 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc650066f30 0x7fc6500693e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:01.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.294+0000 7fc66c71c700 1 --2- 172.21.15.17:0/138565214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc664147320 0x7fc6640ab7f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:01.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.294+0000 7fc66c71c700 1 --2- 172.21.15.17:0/138565214 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc64c003ab0 0x7fc6640aa250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:01.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.294+0000 7fc66c71c700 1 --2- 172.21.15.17:0/138565214 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc66415c8e0 0x7fc6640ab2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:01.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.294+0000 7fc66c71c700 1 -- 172.21.15.17:0/138565214 >> 172.21.15.17:0/138565214 conn(0x7fc6640cde20 msgr2=0x7fc6640acd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:01.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.294+0000 7fc66c71c700 1 -- 172.21.15.17:0/138565214 shutdown_connections 2023-10-06T04:44:01.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.294+0000 7fc66c71c700 1 -- 172.21.15.17:0/138565214 wait complete. 2023-10-06T04:44:01.307 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:44:01.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.430+0000 7f6749270700 1 Processor -- start 2023-10-06T04:44:01.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.430+0000 7f6749270700 1 -- start start 2023-10-06T04:44:01.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.431+0000 7f6749270700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6744159b10 0x7f674406f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:01.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.431+0000 7f6749270700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f674406d140 0x7f674406f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:01.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.431+0000 7f6749270700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67440d1120 con 0x7f67440cabf0 2023-10-06T04:44:01.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.431+0000 7f6749270700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67440d1400 con 0x7f674406d140 2023-10-06T04:44:01.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.431+0000 7f6749270700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f674406e920 con 0x7f6744159b10 2023-10-06T04:44:01.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.431+0000 7f67427fc700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6744159b10 0x7f674406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:01.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.431+0000 7f67437fe700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f674406d140 0x7f674406f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:01.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.431+0000 7f6742ffd700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f67440cabf0 0x7f67440c7660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.17:47696/0 (socket says 172.21.15.17:47696) 2023-10-06T04:44:01.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.431+0000 7f6742ffd700 1 -- 172.21.15.17:0/4188910879 learned_addr learned my addr 172.21.15.17:0/4188910879 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:01.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.431+0000 7f67437fe700 1 -- 172.21.15.17:0/4188910879 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6744159b10 msgr2=0x7f674406f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:01.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.431+0000 7f67437fe700 1 --2- 172.21.15.17:0/4188910879 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6744159b10 0x7f674406f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:01.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.431+0000 7f67437fe700 1 -- 172.21.15.17:0/4188910879 >> v1:172.21.15.136:6789/0 conn(0x7f67440cabf0 legacy=0x7f67440c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:01.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.431+0000 7f67437fe700 1 -- 172.21.15.17:0/4188910879 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f674406ec00 con 0x7f674406d140 2023-10-06T04:44:01.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.431+0000 7f67427fc700 1 --2- 172.21.15.17:0/4188910879 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6744159b10 0x7f674406f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:44:01.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.432+0000 7f67437fe700 1 --2- 172.21.15.17:0/4188910879 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f674406d140 0x7f674406f660 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f673c009e60 tx=0x7f673c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1f9649d7097264f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:01.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.432+0000 7f6741ffb700 1 -- 172.21.15.17:0/4188910879 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673c00e070 con 0x7f674406d140 2023-10-06T04:44:01.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.432+0000 7f6741ffb700 1 -- 172.21.15.17:0/4188910879 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673c00bb60 con 0x7f674406d140 2023-10-06T04:44:01.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.432+0000 7f6741ffb700 1 -- 172.21.15.17:0/4188910879 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673c012430 con 0x7f674406d140 2023-10-06T04:44:01.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.432+0000 7f6749270700 1 -- 172.21.15.17:0/4188910879 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f674406d140 msgr2=0x7f674406f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:01.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.432+0000 7f6749270700 1 --2- 172.21.15.17:0/4188910879 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f674406d140 0x7f674406f660 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f673c009e60 tx=0x7f673c009780 comp rx=0 tx=0).stop 2023-10-06T04:44:01.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.432+0000 7f6749270700 1 -- 172.21.15.17:0/4188910879 shutdown_connections 2023-10-06T04:44:01.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.432+0000 7f6749270700 1 --2- 172.21.15.17:0/4188910879 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f674406d140 0x7f674406f660 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:01.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.432+0000 7f6749270700 1 --2- 172.21.15.17:0/4188910879 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6744159b10 0x7f674406f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:01.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.432+0000 7f6749270700 1 -- 172.21.15.17:0/4188910879 >> 172.21.15.17:0/4188910879 conn(0x7f674406cd40 msgr2=0x7f67440d0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:01.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.432+0000 7f6749270700 1 -- 172.21.15.17:0/4188910879 shutdown_connections 2023-10-06T04:44:01.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.432+0000 7f6749270700 1 -- 172.21.15.17:0/4188910879 wait complete. 2023-10-06T04:44:01.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.434+0000 7f6749270700 1 Processor -- start 2023-10-06T04:44:01.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.434+0000 7f6749270700 1 -- start start 2023-10-06T04:44:01.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.434+0000 7f6749270700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f674406d140 0x7f674415c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:01.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.434+0000 7f6749270700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f67440cabf0 0x7f674415c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:01.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.434+0000 7f6749270700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6744159b10 0x7f674415ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:01.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.434+0000 7f6749270700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67440c6be0 con 0x7f674406d140 2023-10-06T04:44:01.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.434+0000 7f6749270700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674415e1e0 con 0x7f6744159b10 2023-10-06T04:44:01.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.434+0000 7f6749270700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67441573e0 con 0x7f67440cabf0 2023-10-06T04:44:01.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.435+0000 7f6742ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f674406d140 0x7f674415c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:01.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.435+0000 7f6742ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f674406d140 0x7f674415c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60138/0 (socket says 172.21.15.17:60138) 2023-10-06T04:44:01.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.435+0000 7f6742ffd700 1 -- 172.21.15.17:0/131890511 learned_addr learned my addr 172.21.15.17:0/131890511 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:01.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.435+0000 7f67437fe700 1 --2- 172.21.15.17:0/131890511 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6744159b10 0x7f674415ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:01.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.435+0000 7f67427fc700 1 --2- 172.21.15.17:0/131890511 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f67440cabf0 0x7f674415c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:01.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.435+0000 7f6742ffd700 1 -- 172.21.15.17:0/131890511 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f67440cabf0 msgr2=0x7f674415c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:01.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.435+0000 7f6742ffd700 1 --2- 172.21.15.17:0/131890511 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f67440cabf0 0x7f674415c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:01.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.435+0000 7f6742ffd700 1 -- 172.21.15.17:0/131890511 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6744159b10 msgr2=0x7f674415ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:01.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.435+0000 7f6742ffd700 1 --2- 172.21.15.17:0/131890511 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6744159b10 0x7f674415ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:01.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.435+0000 7f6742ffd700 1 -- 172.21.15.17:0/131890511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672c009420 con 0x7f674406d140 2023-10-06T04:44:01.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.435+0000 7f6742ffd700 1 --2- 172.21.15.17:0/131890511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f674406d140 0x7f674415c390 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f673400c790 tx=0x7f6734007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:01.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.435+0000 7f673affd700 1 -- 172.21.15.17:0/131890511 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6734005c50 con 0x7f674406d140 2023-10-06T04:44:01.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.435+0000 7f673affd700 1 -- 172.21.15.17:0/131890511 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6734005db0 con 0x7f674406d140 2023-10-06T04:44:01.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.435+0000 7f6749270700 1 -- 172.21.15.17:0/131890511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f673c009a20 con 0x7f674406d140 2023-10-06T04:44:01.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.435+0000 7f673affd700 1 -- 172.21.15.17:0/131890511 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6734007320 con 0x7f674406d140 2023-10-06T04:44:01.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.435+0000 7f6749270700 1 -- 172.21.15.17:0/131890511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f674415ed00 con 0x7f674406d140 2023-10-06T04:44:01.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.436+0000 7f6749270700 1 -- 172.21.15.17:0/131890511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f674404c380 con 0x7f674406d140 2023-10-06T04:44:01.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.437+0000 7f673affd700 1 -- 172.21.15.17:0/131890511 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f673401b3b0 con 0x7f674406d140 2023-10-06T04:44:01.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.437+0000 7f673affd700 1 --2- 172.21.15.17:0/131890511 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6724066f30 0x7f67240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:01.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.437+0000 7f673affd700 1 -- 172.21.15.17:0/131890511 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6734083b90 con 0x7f674406d140 2023-10-06T04:44:01.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.437+0000 7f67427fc700 1 --2- 172.21.15.17:0/131890511 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6724066f30 0x7f67240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:01.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.438+0000 7f67427fc700 1 --2- 172.21.15.17:0/131890511 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6724066f30 0x7f67240693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f67440c9fe0 tx=0x7f672c0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:01.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.441+0000 7f673affd700 1 -- 172.21.15.17:0/131890511 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6734050ca0 con 0x7f674406d140 2023-10-06T04:44:01.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.635+0000 7f6749270700 1 -- 172.21.15.17:0/131890511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6744071310 con 0x7f674406d140 2023-10-06T04:44:01.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.635+0000 7f673affd700 1 -- 172.21.15.17:0/131890511 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6734017070 con 0x7f674406d140 2023-10-06T04:44:01.637 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-10-06T04:44:01.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.637+0000 7f6749270700 1 -- 172.21.15.17:0/131890511 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6724066f30 msgr2=0x7f67240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:01.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.637+0000 7f6749270700 1 --2- 172.21.15.17:0/131890511 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6724066f30 0x7f67240693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f67440c9fe0 tx=0x7f672c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:01.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.637+0000 7f6749270700 1 -- 172.21.15.17:0/131890511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f674406d140 msgr2=0x7f674415c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:01.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.637+0000 7f6749270700 1 --2- 172.21.15.17:0/131890511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f674406d140 0x7f674415c390 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f673400c790 tx=0x7f6734007f60 comp rx=0 tx=0).stop 2023-10-06T04:44:01.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.637+0000 7f6749270700 1 -- 172.21.15.17:0/131890511 shutdown_connections 2023-10-06T04:44:01.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.637+0000 7f6749270700 1 --2- 172.21.15.17:0/131890511 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6724066f30 0x7f67240693e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:01.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.637+0000 7f6749270700 1 --2- 172.21.15.17:0/131890511 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6744159b10 0x7f674415ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:01.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.637+0000 7f6749270700 1 --2- 172.21.15.17:0/131890511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f674406d140 0x7f674415c390 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:01.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.637+0000 7f6749270700 1 --2- 172.21.15.17:0/131890511 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f67440cabf0 0x7f674415c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:01.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.637+0000 7f6749270700 1 -- 172.21.15.17:0/131890511 >> 172.21.15.17:0/131890511 conn(0x7f674406cd40 msgr2=0x7f67440cd950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:01.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.637+0000 7f6749270700 1 -- 172.21.15.17:0/131890511 shutdown_connections 2023-10-06T04:44:01.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.637+0000 7f6749270700 1 -- 172.21.15.17:0/131890511 wait complete. 2023-10-06T04:44:01.651 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:44:01.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.772+0000 7f1559e41700 1 Processor -- start 2023-10-06T04:44:01.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.772+0000 7f1559e41700 1 -- start start 2023-10-06T04:44:01.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.772+0000 7f1559e41700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f15541566b0 0x7f15540c1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:01.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.772+0000 7f1559e41700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f15540ae890 0x7f15540c2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:01.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.772+0000 7f1559e41700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15540af020 con 0x7f1554156a80 2023-10-06T04:44:01.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.772+0000 7f1559e41700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15540c2a90 con 0x7f15541566b0 2023-10-06T04:44:01.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.772+0000 7f1559e41700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15540c7300 con 0x7f15540ae890 2023-10-06T04:44:01.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.773+0000 7f154affd700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f1554156a80 0x7f15540ae180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55752/0 (socket says 172.21.15.17:55752) 2023-10-06T04:44:01.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.773+0000 7f154affd700 1 -- 172.21.15.17:0/1468014699 learned_addr learned my addr 172.21.15.17:0/1468014699 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:01.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.773+0000 7f15537fe700 1 --2- 172.21.15.17:0/1468014699 >> v2:172.21.15.136:3300/0 conn(0x7f15541566b0 0x7f15540c1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:01.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.773+0000 7f1553fff700 1 --2- 172.21.15.17:0/1468014699 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f15540ae890 0x7f15540c2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:01.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.773+0000 7f1552ffd700 1 -- 172.21.15.17:0/1468014699 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1733993313 0 0) 0x7f15540af020 con 0x7f1554156a80 2023-10-06T04:44:01.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.773+0000 7f1552ffd700 1 -- 172.21.15.17:0/1468014699 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1540003570 con 0x7f1554156a80 2023-10-06T04:44:01.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.773+0000 7f15537fe700 1 -- 172.21.15.17:0/1468014699 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f15540ae890 msgr2=0x7f15540c2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:01.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.773+0000 7f15537fe700 1 --2- 172.21.15.17:0/1468014699 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f15540ae890 0x7f15540c2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:01.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.773+0000 7f1552ffd700 1 -- 172.21.15.17:0/1468014699 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3683420820 0 0) 0x7f1540003570 con 0x7f1554156a80 2023-10-06T04:44:01.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.773+0000 7f15537fe700 1 -- 172.21.15.17:0/1468014699 >> v1:172.21.15.17:6789/0 conn(0x7f1554156a80 legacy=0x7f15540ae180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:01.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.773+0000 7f15537fe700 1 -- 172.21.15.17:0/1468014699 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15540c12a0 con 0x7f15541566b0 2023-10-06T04:44:01.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.773+0000 7f15537fe700 1 --2- 172.21.15.17:0/1468014699 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15541566b0 0x7f15540c1f20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f15440098e0 tx=0x7f15440091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e10aec81a4325ae8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:01.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.774+0000 7f1552ffd700 1 -- 172.21.15.17:0/1468014699 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c001470 con 0x7f15541566b0 2023-10-06T04:44:01.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.774+0000 7f1552ffd700 1 -- 172.21.15.17:0/1468014699 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1544011420 con 0x7f15541566b0 2023-10-06T04:44:01.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.774+0000 7f1552ffd700 1 -- 172.21.15.17:0/1468014699 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15440117c0 con 0x7f15541566b0 2023-10-06T04:44:01.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.774+0000 7f1559e41700 1 -- 172.21.15.17:0/1468014699 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15541566b0 msgr2=0x7f15540c1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:01.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.774+0000 7f1559e41700 1 --2- 172.21.15.17:0/1468014699 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15541566b0 0x7f15540c1f20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f15440098e0 tx=0x7f15440091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:01.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.774+0000 7f1559e41700 1 -- 172.21.15.17:0/1468014699 shutdown_connections 2023-10-06T04:44:01.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.774+0000 7f1559e41700 1 --2- 172.21.15.17:0/1468014699 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f15540ae890 0x7f15540c2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:01.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.774+0000 7f1559e41700 1 --2- 172.21.15.17:0/1468014699 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15541566b0 0x7f15540c1f20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:01.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.774+0000 7f1559e41700 1 -- 172.21.15.17:0/1468014699 >> 172.21.15.17:0/1468014699 conn(0x7f155406d030 msgr2=0x7f15540cc260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:01.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.774+0000 7f1559e41700 1 -- 172.21.15.17:0/1468014699 shutdown_connections 2023-10-06T04:44:01.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.774+0000 7f1559e41700 1 -- 172.21.15.17:0/1468014699 wait complete. 2023-10-06T04:44:01.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.775+0000 7f1559e41700 1 Processor -- start 2023-10-06T04:44:01.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.775+0000 7f1559e41700 1 -- start start 2023-10-06T04:44:01.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.776+0000 7f1559e41700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15540ae890 0x7f155414b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:01.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.776+0000 7f1559e41700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15541566b0 0x7f15540b0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:01.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.776+0000 7f1559e41700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1554156a80 0x7f15540b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:01.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.776+0000 7f1559e41700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155414b5a0 con 0x7f15540ae890 2023-10-06T04:44:01.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.776+0000 7f1559e41700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15540b11f0 con 0x7f15541566b0 2023-10-06T04:44:01.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.776+0000 7f1559e41700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15540cb6f0 con 0x7f1554156a80 2023-10-06T04:44:01.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.776+0000 7f15537fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15540ae890 0x7f155414b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:01.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.776+0000 7f15537fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15540ae890 0x7f155414b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60146/0 (socket says 172.21.15.17:60146) 2023-10-06T04:44:01.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.776+0000 7f15537fe700 1 -- 172.21.15.17:0/6122383 learned_addr learned my addr 172.21.15.17:0/6122383 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:01.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.776+0000 7f154affd700 1 --2- 172.21.15.17:0/6122383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15541566b0 0x7f15540b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:01.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.776+0000 7f1553fff700 1 --2- 172.21.15.17:0/6122383 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1554156a80 0x7f15540b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:01.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.777+0000 7f15537fe700 1 -- 172.21.15.17:0/6122383 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1554156a80 msgr2=0x7f15540b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:01.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.777+0000 7f15537fe700 1 --2- 172.21.15.17:0/6122383 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1554156a80 0x7f15540b0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:01.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.777+0000 7f15537fe700 1 -- 172.21.15.17:0/6122383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15541566b0 msgr2=0x7f15540b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:01.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.777+0000 7f15537fe700 1 --2- 172.21.15.17:0/6122383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15541566b0 0x7f15540b0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:01.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.777+0000 7f15537fe700 1 -- 172.21.15.17:0/6122383 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1544009420 con 0x7f15540ae890 2023-10-06T04:44:01.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.777+0000 7f154affd700 1 --2- 172.21.15.17:0/6122383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15541566b0 0x7f15540b0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:01.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.777+0000 7f15537fe700 1 --2- 172.21.15.17:0/6122383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15540ae890 0x7f155414b060 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f15440030c0 tx=0x7f1544016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:01.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.777+0000 7f154bfff700 1 -- 172.21.15.17:0/6122383 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154401cc90 con 0x7f15540ae890 2023-10-06T04:44:01.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.777+0000 7f154bfff700 1 -- 172.21.15.17:0/6122383 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f154401cdf0 con 0x7f15540ae890 2023-10-06T04:44:01.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.777+0000 7f154bfff700 1 -- 172.21.15.17:0/6122383 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154401a6a0 con 0x7f15540ae890 2023-10-06T04:44:01.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.777+0000 7f1559e41700 1 -- 172.21.15.17:0/6122383 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15540cb9d0 con 0x7f15540ae890 2023-10-06T04:44:01.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.777+0000 7f1559e41700 1 -- 172.21.15.17:0/6122383 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15540c3d40 con 0x7f15540ae890 2023-10-06T04:44:01.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.778+0000 7f1559e41700 1 -- 172.21.15.17:0/6122383 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f155404c380 con 0x7f15540ae890 2023-10-06T04:44:01.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.778+0000 7f154bfff700 1 -- 172.21.15.17:0/6122383 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f154401aad0 con 0x7f15540ae890 2023-10-06T04:44:01.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.779+0000 7f154bfff700 1 --2- 172.21.15.17:0/6122383 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1534066f30 0x7f15340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:01.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.779+0000 7f154bfff700 1 -- 172.21.15.17:0/6122383 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1544086010 con 0x7f15540ae890 2023-10-06T04:44:01.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.779+0000 7f154affd700 1 --2- 172.21.15.17:0/6122383 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1534066f30 0x7f15340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:01.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.779+0000 7f154affd700 1 --2- 172.21.15.17:0/6122383 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1534066f30 0x7f15340693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f15540cc610 tx=0x7f153c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:01.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.783+0000 7f154bfff700 1 -- 172.21.15.17:0/6122383 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1544053120 con 0x7f15540ae890 2023-10-06T04:44:01.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.979+0000 7f1559e41700 1 -- 172.21.15.17:0/6122383 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f155406dea0 con 0x7f15540ae890 2023-10-06T04:44:01.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.980+0000 7f154bfff700 1 -- 172.21.15.17:0/6122383 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1544056740 con 0x7f15540ae890 2023-10-06T04:44:01.982 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-10-06T04:44:01.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.982+0000 7f1559e41700 1 -- 172.21.15.17:0/6122383 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1534066f30 msgr2=0x7f15340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:01.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.982+0000 7f1559e41700 1 --2- 172.21.15.17:0/6122383 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1534066f30 0x7f15340693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f15540cc610 tx=0x7f153c009040 comp rx=0 tx=0).stop 2023-10-06T04:44:01.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.982+0000 7f1559e41700 1 -- 172.21.15.17:0/6122383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15540ae890 msgr2=0x7f155414b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:01.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.982+0000 7f1559e41700 1 --2- 172.21.15.17:0/6122383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15540ae890 0x7f155414b060 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f15440030c0 tx=0x7f1544016000 comp rx=0 tx=0).stop 2023-10-06T04:44:01.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.982+0000 7f1559e41700 1 -- 172.21.15.17:0/6122383 shutdown_connections 2023-10-06T04:44:01.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.982+0000 7f1559e41700 1 --2- 172.21.15.17:0/6122383 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1534066f30 0x7f15340693e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:01.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.982+0000 7f1559e41700 1 --2- 172.21.15.17:0/6122383 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1554156a80 0x7f15540b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:01.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.982+0000 7f1559e41700 1 --2- 172.21.15.17:0/6122383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15540ae890 0x7f155414b060 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:01.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.982+0000 7f1559e41700 1 --2- 172.21.15.17:0/6122383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15541566b0 0x7f15540b0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:01.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.982+0000 7f1559e41700 1 -- 172.21.15.17:0/6122383 >> 172.21.15.17:0/6122383 conn(0x7f155406d030 msgr2=0x7f15541541f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:01.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.982+0000 7f1559e41700 1 -- 172.21.15.17:0/6122383 shutdown_connections 2023-10-06T04:44:01.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:01.982+0000 7f1559e41700 1 -- 172.21.15.17:0/6122383 wait complete. 2023-10-06T04:44:01.996 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:44:02.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.115+0000 7f5997fff700 1 Processor -- start 2023-10-06T04:44:02.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.115+0000 7f5997fff700 1 -- start start 2023-10-06T04:44:02.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.116+0000 7f5997fff700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f59980af540 0x7f59980af910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:02.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.116+0000 7f5997fff700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f599815a650 0x7f599815d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:02.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.116+0000 7f5997fff700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f599815d660 con 0x7f59980cced0 2023-10-06T04:44:02.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.116+0000 7f5997fff700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59980ce890 con 0x7f599815a650 2023-10-06T04:44:02.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.116+0000 7f5997fff700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f599815aac0 con 0x7f59980af540 2023-10-06T04:44:02.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.116+0000 7f59967fc700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f599815a650 0x7f599815d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:02.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.116+0000 7f59977fe700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f59980cced0 0x7f599806c560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55758/0 (socket says 172.21.15.17:55758) 2023-10-06T04:44:02.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.116+0000 7f59977fe700 1 -- 172.21.15.17:0/185058907 learned_addr learned my addr 172.21.15.17:0/185058907 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:02.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.117+0000 7f5996ffd700 1 --2- 172.21.15.17:0/185058907 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f59980af540 0x7f59980af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:02.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.117+0000 7f59967fc700 1 -- 172.21.15.17:0/185058907 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f59980af540 msgr2=0x7f59980af910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:02.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.117+0000 7f59967fc700 1 --2- 172.21.15.17:0/185058907 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f59980af540 0x7f59980af910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:02.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.117+0000 7f59967fc700 1 -- 172.21.15.17:0/185058907 >> v1:172.21.15.17:6789/0 conn(0x7f59980cced0 legacy=0x7f599806c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:02.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.117+0000 7f5995ffb700 1 -- 172.21.15.17:0/185058907 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3029778032 0 0) 0x7f599815d660 con 0x7f59980cced0 2023-10-06T04:44:02.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.117+0000 7f59967fc700 1 -- 172.21.15.17:0/185058907 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f599815d890 con 0x7f599815a650 2023-10-06T04:44:02.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.117+0000 7f5996ffd700 1 --2- 172.21.15.17:0/185058907 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f59980af540 0x7f59980af910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:02.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.117+0000 7f59967fc700 1 --2- 172.21.15.17:0/185058907 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f599815a650 0x7f599815d120 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f59800098e0 tx=0x7f59800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cd0be4345b5003a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:02.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.117+0000 7f5995ffb700 1 -- 172.21.15.17:0/185058907 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5980009e80 con 0x7f599815a650 2023-10-06T04:44:02.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.117+0000 7f5995ffb700 1 -- 172.21.15.17:0/185058907 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598000b860 con 0x7f599815a650 2023-10-06T04:44:02.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.117+0000 7f5995ffb700 1 -- 172.21.15.17:0/185058907 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598000bbe0 con 0x7f599815a650 2023-10-06T04:44:02.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.117+0000 7f5997fff700 1 -- 172.21.15.17:0/185058907 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f599815a650 msgr2=0x7f599815d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:02.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.118+0000 7f5997fff700 1 --2- 172.21.15.17:0/185058907 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f599815a650 0x7f599815d120 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f59800098e0 tx=0x7f59800091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:02.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.118+0000 7f5997fff700 1 -- 172.21.15.17:0/185058907 shutdown_connections 2023-10-06T04:44:02.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.118+0000 7f5997fff700 1 --2- 172.21.15.17:0/185058907 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f59980af540 0x7f59980af910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:02.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.118+0000 7f5997fff700 1 --2- 172.21.15.17:0/185058907 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f599815a650 0x7f599815d120 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:02.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.118+0000 7f5997fff700 1 -- 172.21.15.17:0/185058907 >> 172.21.15.17:0/185058907 conn(0x7f599806d9b0 msgr2=0x7f599806ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:02.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.118+0000 7f5997fff700 1 -- 172.21.15.17:0/185058907 shutdown_connections 2023-10-06T04:44:02.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.118+0000 7f5997fff700 1 -- 172.21.15.17:0/185058907 wait complete. 2023-10-06T04:44:02.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.119+0000 7f5997fff700 1 Processor -- start 2023-10-06T04:44:02.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.119+0000 7f5997fff700 1 -- start start 2023-10-06T04:44:02.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.120+0000 7f5997fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59980af540 0x7f59980b3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:02.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.120+0000 7f5997fff700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f59980cced0 0x7f59980c7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:02.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.120+0000 7f5997fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f599815a650 0x7f5998151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:02.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.120+0000 7f5997fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59980c8440 con 0x7f59980af540 2023-10-06T04:44:02.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.120+0000 7f5997fff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59980b0210 con 0x7f599815a650 2023-10-06T04:44:02.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.120+0000 7f5997fff700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59980c7e80 con 0x7f59980cced0 2023-10-06T04:44:02.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.120+0000 7f5996ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59980af540 0x7f59980b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:02.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.120+0000 7f5996ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59980af540 0x7f59980b3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60162/0 (socket says 172.21.15.17:60162) 2023-10-06T04:44:02.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.120+0000 7f5996ffd700 1 -- 172.21.15.17:0/533322824 learned_addr learned my addr 172.21.15.17:0/533322824 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:02.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.120+0000 7f59967fc700 1 --2- 172.21.15.17:0/533322824 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f59980cced0 0x7f59980c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:02.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.120+0000 7f59977fe700 1 --2- 172.21.15.17:0/533322824 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f599815a650 0x7f5998151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:02.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.120+0000 7f5996ffd700 1 -- 172.21.15.17:0/533322824 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f59980cced0 msgr2=0x7f59980c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:02.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.120+0000 7f5996ffd700 1 --2- 172.21.15.17:0/533322824 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f59980cced0 0x7f59980c7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:02.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.120+0000 7f5996ffd700 1 -- 172.21.15.17:0/533322824 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f599815a650 msgr2=0x7f5998151000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:02.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.120+0000 7f5996ffd700 1 --2- 172.21.15.17:0/533322824 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f599815a650 0x7f5998151000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:02.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.120+0000 7f5996ffd700 1 -- 172.21.15.17:0/533322824 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5980009420 con 0x7f59980af540 2023-10-06T04:44:02.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.120+0000 7f59967fc700 1 --2- 172.21.15.17:0/533322824 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f59980cced0 0x7f59980c7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:02.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.120+0000 7f59977fe700 1 --2- 172.21.15.17:0/533322824 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f599815a650 0x7f5998151000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:02.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.120+0000 7f5996ffd700 1 --2- 172.21.15.17:0/533322824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59980af540 0x7f59980b3270 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f599000d180 tx=0x7f59900099f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:02.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.120+0000 7f598effd700 1 -- 172.21.15.17:0/533322824 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599000de20 con 0x7f59980af540 2023-10-06T04:44:02.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.120+0000 7f598effd700 1 -- 172.21.15.17:0/533322824 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599000f040 con 0x7f59980af540 2023-10-06T04:44:02.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.120+0000 7f5997fff700 1 -- 172.21.15.17:0/533322824 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59980c8160 con 0x7f59980af540 2023-10-06T04:44:02.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.120+0000 7f598effd700 1 -- 172.21.15.17:0/533322824 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5990015670 con 0x7f59980af540 2023-10-06T04:44:02.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.120+0000 7f5997fff700 1 -- 172.21.15.17:0/533322824 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59980b04f0 con 0x7f59980af540 2023-10-06T04:44:02.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.121+0000 7f5997fff700 1 -- 172.21.15.17:0/533322824 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59980b0a90 con 0x7f59980af540 2023-10-06T04:44:02.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.122+0000 7f598effd700 1 -- 172.21.15.17:0/533322824 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5990015a60 con 0x7f59980af540 2023-10-06T04:44:02.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.122+0000 7f598effd700 1 --2- 172.21.15.17:0/533322824 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5978066f30 0x7f59780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:02.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.122+0000 7f59967fc700 1 --2- 172.21.15.17:0/533322824 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5978066f30 0x7f59780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:02.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.122+0000 7f598effd700 1 -- 172.21.15.17:0/533322824 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5990084b20 con 0x7f59980af540 2023-10-06T04:44:02.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.123+0000 7f59967fc700 1 --2- 172.21.15.17:0/533322824 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5978066f30 0x7f59780693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f59980cde60 tx=0x7f5980017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:02.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.127+0000 7f598effd700 1 -- 172.21.15.17:0/533322824 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f599004e5a0 con 0x7f59980af540 2023-10-06T04:44:02.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.317+0000 7f5997fff700 1 -- 172.21.15.17:0/533322824 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f59980c7c10 con 0x7f59980af540 2023-10-06T04:44:02.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.317+0000 7f598effd700 1 -- 172.21.15.17:0/533322824 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f599001a0a0 con 0x7f59980af540 2023-10-06T04:44:02.319 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-10-06T04:44:02.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.319+0000 7f5997fff700 1 -- 172.21.15.17:0/533322824 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5978066f30 msgr2=0x7f59780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:02.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.319+0000 7f5997fff700 1 --2- 172.21.15.17:0/533322824 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5978066f30 0x7f59780693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f59980cde60 tx=0x7f5980017000 comp rx=0 tx=0).stop 2023-10-06T04:44:02.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.319+0000 7f5997fff700 1 -- 172.21.15.17:0/533322824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59980af540 msgr2=0x7f59980b3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:02.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.319+0000 7f5997fff700 1 --2- 172.21.15.17:0/533322824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59980af540 0x7f59980b3270 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f599000d180 tx=0x7f59900099f0 comp rx=0 tx=0).stop 2023-10-06T04:44:02.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.319+0000 7f5997fff700 1 -- 172.21.15.17:0/533322824 shutdown_connections 2023-10-06T04:44:02.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.319+0000 7f5997fff700 1 --2- 172.21.15.17:0/533322824 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5978066f30 0x7f59780693e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:02.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.319+0000 7f5997fff700 1 --2- 172.21.15.17:0/533322824 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f599815a650 0x7f5998151000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:02.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.319+0000 7f5997fff700 1 --2- 172.21.15.17:0/533322824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59980af540 0x7f59980b3270 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:02.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.319+0000 7f5997fff700 1 --2- 172.21.15.17:0/533322824 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f59980cced0 0x7f59980c7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:02.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.319+0000 7f5997fff700 1 -- 172.21.15.17:0/533322824 >> 172.21.15.17:0/533322824 conn(0x7f599806d9b0 msgr2=0x7f5998157a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:02.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.320+0000 7f5997fff700 1 -- 172.21.15.17:0/533322824 shutdown_connections 2023-10-06T04:44:02.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.320+0000 7f5997fff700 1 -- 172.21.15.17:0/533322824 wait complete. 2023-10-06T04:44:02.333 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:44:02.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.452+0000 7f3073663700 1 Processor -- start 2023-10-06T04:44:02.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.452+0000 7f3073663700 1 -- start start 2023-10-06T04:44:02.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.453+0000 7f3073663700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f306c0b12e0 0x7f306c0cea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:02.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.453+0000 7f3073663700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f306c0cfc80 con 0x7f306c159630 2023-10-06T04:44:02.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.453+0000 7f3073663700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f306c0cf070 con 0x7f306c0cd760 2023-10-06T04:44:02.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.453+0000 7f3073663700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f306c0cf350 con 0x7f306c0b12e0 2023-10-06T04:44:02.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.453+0000 7f30713ff700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f306c159630 0x7f306c0cd050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55768/0 (socket says 172.21.15.17:55768) 2023-10-06T04:44:02.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.453+0000 7f30713ff700 1 -- 172.21.15.17:0/4040484859 learned_addr learned my addr 172.21.15.17:0/4040484859 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:02.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.454+0000 7f3063fff700 1 -- 172.21.15.17:0/4040484859 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2754419224 0 0) 0x7f306c0cfc80 con 0x7f306c159630 2023-10-06T04:44:02.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.454+0000 7f3063fff700 1 -- 172.21.15.17:0/4040484859 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3058003570 con 0x7f306c159630 2023-10-06T04:44:02.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.454+0000 7f3071c00700 1 --2- 172.21.15.17:0/4040484859 >> v2:172.21.15.136:3300/0 conn(0x7f306c0b12e0 0x7f306c0cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:02.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.454+0000 7f3063fff700 1 -- 172.21.15.17:0/4040484859 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4069791849 0 0) 0x7f3058003570 con 0x7f306c159630 2023-10-06T04:44:02.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.454+0000 7f3063fff700 1 -- 172.21.15.17:0/4040484859 >> v2:172.21.15.136:3300/0 conn(0x7f306c0b12e0 msgr2=0x7f306c0cea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:02.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.454+0000 7f3063fff700 1 --2- 172.21.15.17:0/4040484859 >> v2:172.21.15.136:3300/0 conn(0x7f306c0b12e0 0x7f306c0cea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:02.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.454+0000 7f3063fff700 1 -- 172.21.15.17:0/4040484859 >> v1:172.21.15.136:6789/0 conn(0x7f306c0cd760 legacy=0x7f306c0ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:02.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.454+0000 7f3063fff700 1 -- 172.21.15.17:0/4040484859 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306c0cf630 con 0x7f306c159630 2023-10-06T04:44:02.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.454+0000 7f3063fff700 1 -- 172.21.15.17:0/4040484859 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4268781140 0 0) 0x7f305c001470 con 0x7f306c159630 2023-10-06T04:44:02.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.454+0000 7f3063fff700 1 -- 172.21.15.17:0/4040484859 >> v1:172.21.15.17:6789/0 conn(0x7f306c159630 legacy=0x7f306c0cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:02.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.454+0000 7f3063fff700 1 --2- 172.21.15.17:0/4040484859 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3058003a60 0x7f3058003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:02.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.454+0000 7f3063fff700 1 --2- 172.21.15.17:0/4040484859 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3058004810 0x7f3058004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:02.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.454+0000 7f3063fff700 1 --2- 172.21.15.17:0/4040484859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30580051c0 0x7f305800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:02.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.454+0000 7f3063fff700 1 -- 172.21.15.17:0/4040484859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306c0cf350 con 0x7f30580051c0 2023-10-06T04:44:02.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.454+0000 7f3063fff700 1 -- 172.21.15.17:0/4040484859 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305800c0d0 con 0x7f3058003a60 2023-10-06T04:44:02.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.454+0000 7f3063fff700 1 -- 172.21.15.17:0/4040484859 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f305800c290 con 0x7f3058004810 2023-10-06T04:44:02.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.454+0000 7f3071c00700 1 --2- 172.21.15.17:0/4040484859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30580051c0 0x7f305800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:02.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.454+0000 7f30713ff700 1 --2- 172.21.15.17:0/4040484859 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3058003a60 0x7f3058003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:02.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.454+0000 7f3070bfe700 1 --2- 172.21.15.17:0/4040484859 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3058004810 0x7f3058004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:02.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.454+0000 7f3071c00700 1 -- 172.21.15.17:0/4040484859 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3058004810 msgr2=0x7f3058004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:02.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.454+0000 7f3071c00700 1 --2- 172.21.15.17:0/4040484859 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3058004810 0x7f3058004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:02.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.454+0000 7f3071c00700 1 -- 172.21.15.17:0/4040484859 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3058003a60 msgr2=0x7f3058003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:02.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.454+0000 7f3071c00700 1 --2- 172.21.15.17:0/4040484859 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3058003a60 0x7f3058003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:02.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.454+0000 7f3071c00700 1 -- 172.21.15.17:0/4040484859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3058003570 con 0x7f30580051c0 2023-10-06T04:44:02.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.454+0000 7f3070bfe700 1 --2- 172.21.15.17:0/4040484859 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3058004810 0x7f3058004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:02.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.455+0000 7f3071c00700 1 -- 172.21.15.17:0/4040484859 reap_dead start 2023-10-06T04:44:02.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.455+0000 7f3071c00700 1 --2- 172.21.15.17:0/4040484859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30580051c0 0x7f305800ba60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f306c0b1740 tx=0x7f306400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0a28c36bcc03438 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:02.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.455+0000 7f3063fff700 1 -- 172.21.15.17:0/4040484859 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306400ea90 con 0x7f30580051c0 2023-10-06T04:44:02.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.455+0000 7f3063fff700 1 -- 172.21.15.17:0/4040484859 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306400f040 con 0x7f30580051c0 2023-10-06T04:44:02.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.455+0000 7f3063fff700 1 -- 172.21.15.17:0/4040484859 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306400ee40 con 0x7f30580051c0 2023-10-06T04:44:02.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.455+0000 7f3073663700 1 -- 172.21.15.17:0/4040484859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30580051c0 msgr2=0x7f305800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:02.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.455+0000 7f3073663700 1 --2- 172.21.15.17:0/4040484859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30580051c0 0x7f305800ba60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f306c0b1740 tx=0x7f306400b040 comp rx=0 tx=0).stop 2023-10-06T04:44:02.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.455+0000 7f3073663700 1 -- 172.21.15.17:0/4040484859 shutdown_connections 2023-10-06T04:44:02.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.455+0000 7f3073663700 1 --2- 172.21.15.17:0/4040484859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30580051c0 0x7f305800ba60 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:02.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.455+0000 7f3073663700 1 -- 172.21.15.17:0/4040484859 >> 172.21.15.17:0/4040484859 conn(0x7f306c06cff0 msgr2=0x7f306c06d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:02.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.456+0000 7f3073663700 1 -- 172.21.15.17:0/4040484859 shutdown_connections 2023-10-06T04:44:02.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.456+0000 7f3073663700 1 -- 172.21.15.17:0/4040484859 wait complete. 2023-10-06T04:44:02.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.457+0000 7f3073663700 1 Processor -- start 2023-10-06T04:44:02.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.457+0000 7f3073663700 1 -- start start 2023-10-06T04:44:02.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.457+0000 7f3073663700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30580051c0 0x7f306c148170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:02.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.457+0000 7f3073663700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f306c0b2ce0 0x7f306c0b5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:02.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.457+0000 7f3073663700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f306c0c53f0 0x7f306c0c5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:02.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.457+0000 7f3073663700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306c0b5aa0 con 0x7f306c0c53f0 2023-10-06T04:44:02.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.457+0000 7f3073663700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306c0ca680 con 0x7f30580051c0 2023-10-06T04:44:02.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.457+0000 7f3073663700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306c0c5dd0 con 0x7f306c0b2ce0 2023-10-06T04:44:02.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.458+0000 7f3071c00700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f306c0c53f0 0x7f306c0c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:02.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.458+0000 7f3071c00700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f306c0c53f0 0x7f306c0c5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60178/0 (socket says 172.21.15.17:60178) 2023-10-06T04:44:02.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.458+0000 7f3071c00700 1 -- 172.21.15.17:0/1329642957 learned_addr learned my addr 172.21.15.17:0/1329642957 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:02.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.458+0000 7f30713ff700 1 --2- 172.21.15.17:0/1329642957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30580051c0 0x7f306c148170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:02.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.458+0000 7f3070bfe700 1 --2- 172.21.15.17:0/1329642957 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f306c0b2ce0 0x7f306c0b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:02.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.458+0000 7f3071c00700 1 -- 172.21.15.17:0/1329642957 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f306c0b2ce0 msgr2=0x7f306c0b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:02.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.458+0000 7f3071c00700 1 --2- 172.21.15.17:0/1329642957 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f306c0b2ce0 0x7f306c0b5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:02.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.458+0000 7f3071c00700 1 -- 172.21.15.17:0/1329642957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30580051c0 msgr2=0x7f306c148170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:02.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.458+0000 7f3071c00700 1 --2- 172.21.15.17:0/1329642957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30580051c0 0x7f306c148170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:02.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.458+0000 7f3071c00700 1 -- 172.21.15.17:0/1329642957 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306c0c8d00 con 0x7f306c0c53f0 2023-10-06T04:44:02.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.458+0000 7f3070bfe700 1 --2- 172.21.15.17:0/1329642957 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f306c0b2ce0 0x7f306c0b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:02.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.458+0000 7f3071c00700 1 --2- 172.21.15.17:0/1329642957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f306c0c53f0 0x7f306c0c5890 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f306c0b3190 tx=0x7f3064019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:02.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.458+0000 7f30617fa700 1 -- 172.21.15.17:0/1329642957 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306401d660 con 0x7f306c0c53f0 2023-10-06T04:44:02.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.458+0000 7f30617fa700 1 -- 172.21.15.17:0/1329642957 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3064022070 con 0x7f306c0c53f0 2023-10-06T04:44:02.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.458+0000 7f30617fa700 1 -- 172.21.15.17:0/1329642957 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306401da30 con 0x7f306c0c53f0 2023-10-06T04:44:02.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.458+0000 7f3073663700 1 -- 172.21.15.17:0/1329642957 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f306c0b57d0 con 0x7f306c0c53f0 2023-10-06T04:44:02.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.458+0000 7f3073663700 1 -- 172.21.15.17:0/1329642957 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f306c0c86b0 con 0x7f306c0c53f0 2023-10-06T04:44:02.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.459+0000 7f3073663700 1 -- 172.21.15.17:0/1329642957 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f306c063ff0 con 0x7f306c0c53f0 2023-10-06T04:44:02.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.460+0000 7f30617fa700 1 -- 172.21.15.17:0/1329642957 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3064003020 con 0x7f306c0c53f0 2023-10-06T04:44:02.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.460+0000 7f30617fa700 1 --2- 172.21.15.17:0/1329642957 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3050066f30 0x7f30500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:02.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.460+0000 7f30617fa700 1 -- 172.21.15.17:0/1329642957 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3064024070 con 0x7f306c0c53f0 2023-10-06T04:44:02.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.460+0000 7f30713ff700 1 --2- 172.21.15.17:0/1329642957 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3050066f30 0x7f30500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:02.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.460+0000 7f30713ff700 1 --2- 172.21.15.17:0/1329642957 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3050066f30 0x7f30500693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f305c0015a0 tx=0x7f305c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:02.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.464+0000 7f30617fa700 1 -- 172.21.15.17:0/1329642957 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f30640536c0 con 0x7f306c0c53f0 2023-10-06T04:44:02.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.704+0000 7f3073663700 1 -- 172.21.15.17:0/1329642957 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f306c0cdea0 con 0x7f306c0c53f0 2023-10-06T04:44:02.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.705+0000 7f30617fa700 1 -- 172.21.15.17:0/1329642957 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f3064056ce0 con 0x7f306c0c53f0 2023-10-06T04:44:02.707 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:02.707 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/3001699743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3001699743},{"type":"v1","addr":"172.21.15.136:6833","nonce":3001699743}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/1891609455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1891609455},{"type":"v1","addr":"172.21.15.17:6835","nonce":1891609455}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/2697752124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":2697752124},{"type":"v1","addr":"172.21.15.17:6837","nonce":2697752124}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:43:29.199801+0000","modified":"2023-10-06T04:43:32.817081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6835/1496795591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":1496795591},{"type":"v1","addr":"172.21.15.136:6835","nonce":1496795591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:44:02.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.707+0000 7f3073663700 1 -- 172.21.15.17:0/1329642957 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3050066f30 msgr2=0x7f30500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:02.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.707+0000 7f3073663700 1 --2- 172.21.15.17:0/1329642957 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3050066f30 0x7f30500693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f305c0015a0 tx=0x7f305c009040 comp rx=0 tx=0).stop 2023-10-06T04:44:02.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.707+0000 7f3073663700 1 -- 172.21.15.17:0/1329642957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f306c0c53f0 msgr2=0x7f306c0c5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:02.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.707+0000 7f3073663700 1 --2- 172.21.15.17:0/1329642957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f306c0c53f0 0x7f306c0c5890 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f306c0b3190 tx=0x7f3064019000 comp rx=0 tx=0).stop 2023-10-06T04:44:02.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.707+0000 7f3073663700 1 -- 172.21.15.17:0/1329642957 shutdown_connections 2023-10-06T04:44:02.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.707+0000 7f3073663700 1 --2- 172.21.15.17:0/1329642957 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3050066f30 0x7f30500693e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:02.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.707+0000 7f3073663700 1 --2- 172.21.15.17:0/1329642957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f306c0c53f0 0x7f306c0c5890 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:02.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.707+0000 7f3073663700 1 --2- 172.21.15.17:0/1329642957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30580051c0 0x7f306c148170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:02.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.707+0000 7f3073663700 1 --2- 172.21.15.17:0/1329642957 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f306c0b2ce0 0x7f306c0b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:02.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.707+0000 7f3073663700 1 -- 172.21.15.17:0/1329642957 >> 172.21.15.17:0/1329642957 conn(0x7f306c06cff0 msgr2=0x7f306c158670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:02.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.707+0000 7f3073663700 1 -- 172.21.15.17:0/1329642957 shutdown_connections 2023-10-06T04:44:02.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.707+0000 7f3073663700 1 -- 172.21.15.17:0/1329642957 wait complete. 2023-10-06T04:44:02.711 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 7 2023-10-06T04:44:02.721 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:44:02.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.838+0000 7f612759e700 1 Processor -- start 2023-10-06T04:44:02.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.838+0000 7f612759e700 1 -- start start 2023-10-06T04:44:02.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.839+0000 7f612759e700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f61280cf3b0 0x7f61281594a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:02.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.839+0000 7f612759e700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f61280af0a0 0x7f61281599e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:02.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.839+0000 7f612759e700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61280cbd80 con 0x7f61280ccfc0 2023-10-06T04:44:02.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.839+0000 7f612759e700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61280af5f0 con 0x7f61280cf3b0 2023-10-06T04:44:02.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.839+0000 7f612759e700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61280af8d0 con 0x7f61280af0a0 2023-10-06T04:44:02.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.839+0000 7f6125d9b700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f61280cf3b0 0x7f61281594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:02.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.839+0000 7f6125d9b700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f61280cf3b0 0x7f61281594a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60194/0 (socket says 172.21.15.17:60194) 2023-10-06T04:44:02.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.839+0000 7f6125d9b700 1 -- 172.21.15.17:0/2335012644 learned_addr learned my addr 172.21.15.17:0/2335012644 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:02.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.839+0000 7f6126d9d700 1 --2- 172.21.15.17:0/2335012644 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f61280af0a0 0x7f61281599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:02.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.839+0000 7f6125d9b700 1 -- 172.21.15.17:0/2335012644 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f61280af0a0 msgr2=0x7f61281599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:02.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.839+0000 7f6125d9b700 1 --2- 172.21.15.17:0/2335012644 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f61280af0a0 0x7f61281599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:02.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.839+0000 7f6125d9b700 1 -- 172.21.15.17:0/2335012644 >> v1:172.21.15.136:6789/0 conn(0x7f61280ccfc0 legacy=0x7f61280cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:02.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.839+0000 7f6125d9b700 1 -- 172.21.15.17:0/2335012644 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61280afbb0 con 0x7f61280cf3b0 2023-10-06T04:44:02.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.840+0000 7f6125d9b700 1 --2- 172.21.15.17:0/2335012644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61280cf3b0 0x7f61281594a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f611c0099e0 tx=0x7f611c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8731fe022970c8cc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:02.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.840+0000 7f612559a700 1 -- 172.21.15.17:0/2335012644 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611c00b820 con 0x7f61280cf3b0 2023-10-06T04:44:02.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.840+0000 7f612559a700 1 -- 172.21.15.17:0/2335012644 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611c00b980 con 0x7f61280cf3b0 2023-10-06T04:44:02.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.840+0000 7f612559a700 1 -- 172.21.15.17:0/2335012644 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611c00bd20 con 0x7f61280cf3b0 2023-10-06T04:44:02.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.840+0000 7f612759e700 1 -- 172.21.15.17:0/2335012644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61280cf3b0 msgr2=0x7f61281594a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:02.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.840+0000 7f612759e700 1 --2- 172.21.15.17:0/2335012644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61280cf3b0 0x7f61281594a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f611c0099e0 tx=0x7f611c009250 comp rx=0 tx=0).stop 2023-10-06T04:44:02.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.840+0000 7f612759e700 1 -- 172.21.15.17:0/2335012644 shutdown_connections 2023-10-06T04:44:02.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.840+0000 7f612759e700 1 --2- 172.21.15.17:0/2335012644 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f61280af0a0 0x7f61281599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:02.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.840+0000 7f612759e700 1 --2- 172.21.15.17:0/2335012644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61280cf3b0 0x7f61281594a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:02.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.840+0000 7f612759e700 1 -- 172.21.15.17:0/2335012644 >> 172.21.15.17:0/2335012644 conn(0x7f612806cff0 msgr2=0x7f612806da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:02.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.840+0000 7f612759e700 1 -- 172.21.15.17:0/2335012644 shutdown_connections 2023-10-06T04:44:02.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.840+0000 7f612759e700 1 -- 172.21.15.17:0/2335012644 wait complete. 2023-10-06T04:44:02.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.841+0000 7f612759e700 1 Processor -- start 2023-10-06T04:44:02.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.842+0000 7f612759e700 1 -- start start 2023-10-06T04:44:02.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.842+0000 7f612759e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61280af0a0 0x7f6128148120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:02.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.842+0000 7f612759e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61280ccfc0 0x7f61280b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:02.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.842+0000 7f612759e700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6128169bc0 0x7f61280b5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:02.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.842+0000 7f612759e700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61280c75b0 con 0x7f61280ccfc0 2023-10-06T04:44:02.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.842+0000 7f612759e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61280c7b70 con 0x7f61280af0a0 2023-10-06T04:44:02.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.842+0000 7f612759e700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61280b3fd0 con 0x7f6128169bc0 2023-10-06T04:44:02.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.842+0000 7f6125d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61280ccfc0 0x7f61280b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:02.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.842+0000 7f6125d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61280ccfc0 0x7f61280b4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60202/0 (socket says 172.21.15.17:60202) 2023-10-06T04:44:02.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.842+0000 7f6125d9b700 1 -- 172.21.15.17:0/1380924765 learned_addr learned my addr 172.21.15.17:0/1380924765 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:02.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.842+0000 7f612659c700 1 --2- 172.21.15.17:0/1380924765 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61280af0a0 0x7f6128148120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:02.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.843+0000 7f6126d9d700 1 --2- 172.21.15.17:0/1380924765 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6128169bc0 0x7f61280b5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:02.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.843+0000 7f6125d9b700 1 -- 172.21.15.17:0/1380924765 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6128169bc0 msgr2=0x7f61280b5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:02.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.843+0000 7f6125d9b700 1 --2- 172.21.15.17:0/1380924765 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6128169bc0 0x7f61280b5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:02.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.843+0000 7f6125d9b700 1 -- 172.21.15.17:0/1380924765 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61280af0a0 msgr2=0x7f6128148120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:02.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.843+0000 7f6125d9b700 1 --2- 172.21.15.17:0/1380924765 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61280af0a0 0x7f6128148120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:02.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.843+0000 7f6125d9b700 1 -- 172.21.15.17:0/1380924765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f611c0094f0 con 0x7f61280ccfc0 2023-10-06T04:44:02.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.843+0000 7f6126d9d700 1 --2- 172.21.15.17:0/1380924765 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6128169bc0 0x7f61280b5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:02.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.843+0000 7f6125d9b700 1 --2- 172.21.15.17:0/1380924765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61280ccfc0 0x7f61280b4e20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f612806be20 tx=0x7f611c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:02.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.843+0000 7f61167fc700 1 -- 172.21.15.17:0/1380924765 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611c011e70 con 0x7f61280ccfc0 2023-10-06T04:44:02.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.843+0000 7f61167fc700 1 -- 172.21.15.17:0/1380924765 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611c01b430 con 0x7f61280ccfc0 2023-10-06T04:44:02.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.843+0000 7f61167fc700 1 -- 172.21.15.17:0/1380924765 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611c01b7f0 con 0x7f61280ccfc0 2023-10-06T04:44:02.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.843+0000 7f612759e700 1 -- 172.21.15.17:0/1380924765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61280b42b0 con 0x7f61280ccfc0 2023-10-06T04:44:02.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.843+0000 7f612759e700 1 -- 172.21.15.17:0/1380924765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6128148660 con 0x7f61280ccfc0 2023-10-06T04:44:02.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.844+0000 7f612759e700 1 -- 172.21.15.17:0/1380924765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61280c7d00 con 0x7f61280ccfc0 2023-10-06T04:44:02.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.844+0000 7f61167fc700 1 -- 172.21.15.17:0/1380924765 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f611c01bba0 con 0x7f61280ccfc0 2023-10-06T04:44:02.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.845+0000 7f61167fc700 1 --2- 172.21.15.17:0/1380924765 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6108066f30 0x7f61080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:02.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.845+0000 7f61167fc700 1 -- 172.21.15.17:0/1380924765 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f611c085e70 con 0x7f61280ccfc0 2023-10-06T04:44:02.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.845+0000 7f612659c700 1 --2- 172.21.15.17:0/1380924765 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6108066f30 0x7f61080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:02.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.845+0000 7f612659c700 1 --2- 172.21.15.17:0/1380924765 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6108066f30 0x7f61080693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6118003a80 tx=0x7f6118007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:02.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:02.849+0000 7f61167fc700 1 -- 172.21.15.17:0/1380924765 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f611c053000 con 0x7f61280ccfc0 2023-10-06T04:44:03.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.042+0000 7f612759e700 1 -- 172.21.15.17:0/1380924765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f612804c380 con 0x7f61280ccfc0 2023-10-06T04:44:03.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.043+0000 7f61167fc700 1 -- 172.21.15.17:0/1380924765 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f611c056620 con 0x7f61280ccfc0 2023-10-06T04:44:03.045 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:03.046 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":21,"fsid":"780777c4-2b25-4d35-9058-c9f2d62e3ad9","created":"2023-10-06T04:43:10.578520+0000","modified":"2023-10-06T04:43:30.789916+0000","last_up_change":"2023-10-06T04:43:20.682958+0000","last_in_change":"2023-10-06T04:43:12.978917+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:43:21.795733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:43:22.389592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:43:26.914728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:43:28.173678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"84737b08-575c-46dd-9488-073ae8504494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6809","nonce":90656},{"type":"v1","addr":"172.21.15.17:6811","nonce":90656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":90656},{"type":"v1","addr":"172.21.15.17:6814","nonce":90656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":90656},{"type":"v1","addr":"172.21.15.17:6822","nonce":90656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":90656},{"type":"v1","addr":"172.21.15.17:6818","nonce":90656}]},"public_addr":"172.21.15.17:6811/90656","cluster_addr":"172.21.15.17:6814/90656","heartbeat_back_addr":"172.21.15.17:6822/90656","heartbeat_front_addr":"172.21.15.17:6818/90656","state":["exists","up"]},{"osd":1,"uuid":"dffeb740-58a2-4fd6-8ff1-a0a11a2cc709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":90655},{"type":"v1","addr":"172.21.15.17:6801","nonce":90655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":90655},{"type":"v1","addr":"172.21.15.17:6803","nonce":90655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":90655},{"type":"v1","addr":"172.21.15.17:6807","nonce":90655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":90655},{"type":"v1","addr":"172.21.15.17:6805","nonce":90655}]},"public_addr":"172.21.15.17:6801/90655","cluster_addr":"172.21.15.17:6803/90655","heartbeat_back_addr":"172.21.15.17:6807/90655","heartbeat_front_addr":"172.21.15.17:6805/90655","state":["exists","up"]},{"osd":2,"uuid":"48bd6831-763d-48c2-b515-e02c216d608b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":90657},{"type":"v1","addr":"172.21.15.17:6810","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":90657},{"type":"v1","addr":"172.21.15.17:6815","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":90657},{"type":"v1","addr":"172.21.15.17:6823","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":90657},{"type":"v1","addr":"172.21.15.17:6819","nonce":90657}]},"public_addr":"172.21.15.17:6810/90657","cluster_addr":"172.21.15.17:6815/90657","heartbeat_back_addr":"172.21.15.17:6823/90657","heartbeat_front_addr":"172.21.15.17:6819/90657","state":["exists","up"]},{"osd":3,"uuid":"ae7dbb23-abe7-4bd3-a4df-6f5963d6804c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":90688},{"type":"v1","addr":"172.21.15.17:6825","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":90688},{"type":"v1","addr":"172.21.15.17:6827","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":90688},{"type":"v1","addr":"172.21.15.17:6831","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":90688},{"type":"v1","addr":"172.21.15.17:6829","nonce":90688}]},"public_addr":"172.21.15.17:6825/90688","cluster_addr":"172.21.15.17:6827/90688","heartbeat_back_addr":"172.21.15.17:6831/90688","heartbeat_front_addr":"172.21.15.17:6829/90688","state":["exists","up"]},{"osd":4,"uuid":"29991fb4-1667-4ea3-aca0-d55db27f3bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":90902},{"type":"v1","addr":"172.21.15.136:6801","nonce":90902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":90902},{"type":"v1","addr":"172.21.15.136:6803","nonce":90902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":90902},{"type":"v1","addr":"172.21.15.136:6807","nonce":90902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":90902},{"type":"v1","addr":"172.21.15.136:6805","nonce":90902}]},"public_addr":"172.21.15.136:6801/90902","cluster_addr":"172.21.15.136:6803/90902","heartbeat_back_addr":"172.21.15.136:6807/90902","heartbeat_front_addr":"172.21.15.136:6805/90902","state":["exists","up"]},{"osd":5,"uuid":"398b4ff9-03fc-421f-882c-ba12aa088eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":90901},{"type":"v1","addr":"172.21.15.136:6809","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":90901},{"type":"v1","addr":"172.21.15.136:6811","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":90901},{"type":"v1","addr":"172.21.15.136:6815","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":90901},{"type":"v1","addr":"172.21.15.136:6813","nonce":90901}]},"public_addr":"172.21.15.136:6809/90901","cluster_addr":"172.21.15.136:6811/90901","heartbeat_back_addr":"172.21.15.136:6815/90901","heartbeat_front_addr":"172.21.15.136:6813/90901","state":["exists","up"]},{"osd":6,"uuid":"1bb91a72-4dab-4cdb-aa1d-2b8a9edf1ad0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":90927},{"type":"v1","addr":"172.21.15.136:6825","nonce":90927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":90927},{"type":"v1","addr":"172.21.15.136:6827","nonce":90927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":90927},{"type":"v1","addr":"172.21.15.136:6831","nonce":90927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":90927},{"type":"v1","addr":"172.21.15.136:6829","nonce":90927}]},"public_addr":"172.21.15.136:6825/90927","cluster_addr":"172.21.15.136:6827/90927","heartbeat_back_addr":"172.21.15.136:6831/90927","heartbeat_front_addr":"172.21.15.136:6829/90927","state":["exists","up"]},{"osd":7,"uuid":"719b654e-010d-4aa4-8c13-83fdde242b47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":90934},{"type":"v1","addr":"172.21.15.136:6817","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":90934},{"type":"v1","addr":"172.21.15.136:6819","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":90934},{"type":"v1","addr":"172.21.15.136:6824","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":90934},{"type":"v1","addr":"172.21.15.136:6821","nonce":90934}]},"public_addr":"172.21.15.136:6817/90934","cluster_addr":"172.21.15.136:6819/90934","heartbeat_back_addr":"172.21.15.136:6824/90934","heartbeat_front_addr":"172.21.15.136:6821/90934","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.157479+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.140520+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.190743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.231396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.156510+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.145822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.202888+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.139532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:44:03.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.045+0000 7f612759e700 1 -- 172.21.15.17:0/1380924765 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6108066f30 msgr2=0x7f61080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:03.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.045+0000 7f612759e700 1 --2- 172.21.15.17:0/1380924765 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6108066f30 0x7f61080693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6118003a80 tx=0x7f6118007ec0 comp rx=0 tx=0).stop 2023-10-06T04:44:03.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.045+0000 7f612759e700 1 -- 172.21.15.17:0/1380924765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61280ccfc0 msgr2=0x7f61280b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:03.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.045+0000 7f612759e700 1 --2- 172.21.15.17:0/1380924765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61280ccfc0 0x7f61280b4e20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f612806be20 tx=0x7f611c017000 comp rx=0 tx=0).stop 2023-10-06T04:44:03.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.045+0000 7f612759e700 1 -- 172.21.15.17:0/1380924765 shutdown_connections 2023-10-06T04:44:03.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.045+0000 7f612759e700 1 --2- 172.21.15.17:0/1380924765 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6108066f30 0x7f61080693e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:03.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.045+0000 7f612759e700 1 --2- 172.21.15.17:0/1380924765 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6128169bc0 0x7f61280b5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:03.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.045+0000 7f612759e700 1 --2- 172.21.15.17:0/1380924765 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61280af0a0 0x7f6128148120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:03.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.045+0000 7f612759e700 1 --2- 172.21.15.17:0/1380924765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61280ccfc0 0x7f61280b4e20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:03.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.045+0000 7f612759e700 1 -- 172.21.15.17:0/1380924765 >> 172.21.15.17:0/1380924765 conn(0x7f612806cff0 msgr2=0x7f6128155e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:03.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.045+0000 7f612759e700 1 -- 172.21.15.17:0/1380924765 shutdown_connections 2023-10-06T04:44:03.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.045+0000 7f612759e700 1 -- 172.21.15.17:0/1380924765 wait complete. 2023-10-06T04:44:03.059 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T04:44:03.059 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:44:03.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.176+0000 7f7c9f543700 1 Processor -- start 2023-10-06T04:44:03.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.176+0000 7f7c9f543700 1 -- start start 2023-10-06T04:44:03.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.177+0000 7f7c9f543700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7c980cf3b0 0x7f7c981594a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:03.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.177+0000 7f7c9f543700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f7c980af0a0 0x7f7c981599e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:03.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.177+0000 7f7c9f543700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c980cbd80 con 0x7f7c980ccfc0 2023-10-06T04:44:03.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.177+0000 7f7c9f543700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c980af5f0 con 0x7f7c980cf3b0 2023-10-06T04:44:03.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.177+0000 7f7c9f543700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c980af8d0 con 0x7f7c980af0a0 2023-10-06T04:44:03.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.177+0000 7f7c9dd40700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7c980cf3b0 0x7f7c981594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:03.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.177+0000 7f7c9e541700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f7c980ccfc0 0x7f7c980cc210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55776/0 (socket says 172.21.15.17:55776) 2023-10-06T04:44:03.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.177+0000 7f7c9e541700 1 -- 172.21.15.17:0/1150868339 learned_addr learned my addr 172.21.15.17:0/1150868339 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:03.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.177+0000 7f7c9ed42700 1 --2- 172.21.15.17:0/1150868339 >> v2:172.21.15.136:3300/0 conn(0x7f7c980af0a0 0x7f7c981599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:03.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.177+0000 7f7c9dd40700 1 -- 172.21.15.17:0/1150868339 >> v2:172.21.15.136:3300/0 conn(0x7f7c980af0a0 msgr2=0x7f7c981599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:03.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.177+0000 7f7c9dd40700 1 --2- 172.21.15.17:0/1150868339 >> v2:172.21.15.136:3300/0 conn(0x7f7c980af0a0 0x7f7c981599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:03.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.177+0000 7f7c9dd40700 1 -- 172.21.15.17:0/1150868339 >> v1:172.21.15.17:6789/0 conn(0x7f7c980ccfc0 legacy=0x7f7c980cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:03.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.177+0000 7f7c9dd40700 1 -- 172.21.15.17:0/1150868339 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c980afbb0 con 0x7f7c980cf3b0 2023-10-06T04:44:03.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.177+0000 7f7c9d53f700 1 -- 172.21.15.17:0/1150868339 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4140537415 0 0) 0x7f7c980cbd80 con 0x7f7c980ccfc0 2023-10-06T04:44:03.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.178+0000 7f7c9ed42700 1 --2- 172.21.15.17:0/1150868339 >> v2:172.21.15.136:3300/0 conn(0x7f7c980af0a0 0x7f7c981599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:03.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.178+0000 7f7c9dd40700 1 --2- 172.21.15.17:0/1150868339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c980cf3b0 0x7f7c981594a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c0098e0 tx=0x7f7c8c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd0e894456752e8a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:03.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.178+0000 7f7c9d53f700 1 -- 172.21.15.17:0/1150868339 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c009e80 con 0x7f7c980cf3b0 2023-10-06T04:44:03.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.178+0000 7f7c9d53f700 1 -- 172.21.15.17:0/1150868339 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8c00b820 con 0x7f7c980cf3b0 2023-10-06T04:44:03.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.178+0000 7f7c9d53f700 1 -- 172.21.15.17:0/1150868339 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c00bba0 con 0x7f7c980cf3b0 2023-10-06T04:44:03.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.178+0000 7f7c9f543700 1 -- 172.21.15.17:0/1150868339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c980cf3b0 msgr2=0x7f7c981594a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:03.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.178+0000 7f7c9f543700 1 --2- 172.21.15.17:0/1150868339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c980cf3b0 0x7f7c981594a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c0098e0 tx=0x7f7c8c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:03.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.178+0000 7f7c9f543700 1 -- 172.21.15.17:0/1150868339 shutdown_connections 2023-10-06T04:44:03.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.178+0000 7f7c9f543700 1 --2- 172.21.15.17:0/1150868339 >> v2:172.21.15.136:3300/0 conn(0x7f7c980af0a0 0x7f7c981599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:03.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.178+0000 7f7c9f543700 1 --2- 172.21.15.17:0/1150868339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c980cf3b0 0x7f7c981594a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:03.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.178+0000 7f7c9f543700 1 -- 172.21.15.17:0/1150868339 >> 172.21.15.17:0/1150868339 conn(0x7f7c9806cff0 msgr2=0x7f7c9806da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:03.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.178+0000 7f7c9f543700 1 -- 172.21.15.17:0/1150868339 shutdown_connections 2023-10-06T04:44:03.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.178+0000 7f7c9f543700 1 -- 172.21.15.17:0/1150868339 wait complete. 2023-10-06T04:44:03.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.180+0000 7f7c9f543700 1 Processor -- start 2023-10-06T04:44:03.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.180+0000 7f7c9f543700 1 -- start start 2023-10-06T04:44:03.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.180+0000 7f7c9f543700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c980af0a0 0x7f7c981581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:03.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.180+0000 7f7c9f543700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7c980ccfc0 0x7f7c981586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:03.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.180+0000 7f7c9f543700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c980b5470 0x7f7c980b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:03.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.180+0000 7f7c9f543700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c980b61f0 con 0x7f7c980b5470 2023-10-06T04:44:03.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.180+0000 7f7c9f543700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c980b5950 con 0x7f7c980af0a0 2023-10-06T04:44:03.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.180+0000 7f7c9f543700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c980b5c30 con 0x7f7c980ccfc0 2023-10-06T04:44:03.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.180+0000 7f7c9ed42700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c980b5470 0x7f7c980b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:03.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.180+0000 7f7c9ed42700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c980b5470 0x7f7c980b13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60228/0 (socket says 172.21.15.17:60228) 2023-10-06T04:44:03.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.180+0000 7f7c9ed42700 1 -- 172.21.15.17:0/3924186558 learned_addr learned my addr 172.21.15.17:0/3924186558 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:03.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.181+0000 7f7c9e541700 1 --2- 172.21.15.17:0/3924186558 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c980af0a0 0x7f7c981581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:03.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.181+0000 7f7c9dd40700 1 --2- 172.21.15.17:0/3924186558 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7c980ccfc0 0x7f7c981586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:03.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.181+0000 7f7c9ed42700 1 -- 172.21.15.17:0/3924186558 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7c980ccfc0 msgr2=0x7f7c981586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:03.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.181+0000 7f7c9ed42700 1 --2- 172.21.15.17:0/3924186558 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7c980ccfc0 0x7f7c981586f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:03.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.181+0000 7f7c9ed42700 1 -- 172.21.15.17:0/3924186558 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c980af0a0 msgr2=0x7f7c981581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:03.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.181+0000 7f7c9ed42700 1 --2- 172.21.15.17:0/3924186558 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c980af0a0 0x7f7c981581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:03.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.181+0000 7f7c9ed42700 1 -- 172.21.15.17:0/3924186558 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c8c009420 con 0x7f7c980b5470 2023-10-06T04:44:03.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.181+0000 7f7c9e541700 1 --2- 172.21.15.17:0/3924186558 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c980af0a0 0x7f7c981581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:03.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.181+0000 7f7c9ed42700 1 --2- 172.21.15.17:0/3924186558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c980b5470 0x7f7c980b13f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7c88009fa0 tx=0x7f7c880099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:03.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.181+0000 7f7c967fc700 1 -- 172.21.15.17:0/3924186558 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8800dd10 con 0x7f7c980b5470 2023-10-06T04:44:03.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.181+0000 7f7c967fc700 1 -- 172.21.15.17:0/3924186558 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8800f040 con 0x7f7c980b5470 2023-10-06T04:44:03.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.181+0000 7f7c9f543700 1 -- 172.21.15.17:0/3924186558 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c980b5f10 con 0x7f7c980b5470 2023-10-06T04:44:03.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.181+0000 7f7c967fc700 1 -- 172.21.15.17:0/3924186558 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c88015650 con 0x7f7c980b5470 2023-10-06T04:44:03.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.181+0000 7f7c9f543700 1 -- 172.21.15.17:0/3924186558 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c980b1930 con 0x7f7c980b5470 2023-10-06T04:44:03.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.182+0000 7f7c9f543700 1 -- 172.21.15.17:0/3924186558 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c9804c380 con 0x7f7c980b5470 2023-10-06T04:44:03.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.182+0000 7f7c967fc700 1 -- 172.21.15.17:0/3924186558 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7c88015a40 con 0x7f7c980b5470 2023-10-06T04:44:03.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.183+0000 7f7c967fc700 1 --2- 172.21.15.17:0/3924186558 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7c84066f30 0x7f7c840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:03.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.183+0000 7f7c967fc700 1 -- 172.21.15.17:0/3924186558 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7c88084f20 con 0x7f7c980b5470 2023-10-06T04:44:03.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.183+0000 7f7c9e541700 1 --2- 172.21.15.17:0/3924186558 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7c84066f30 0x7f7c840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:03.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.183+0000 7f7c9e541700 1 --2- 172.21.15.17:0/3924186558 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7c84066f30 0x7f7c840693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7c90007fd0 tx=0x7f7c90009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:03.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.187+0000 7f7c967fc700 1 -- 172.21.15.17:0/3924186558 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c88052030 con 0x7f7c980b5470 2023-10-06T04:44:03.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.427+0000 7f7c9f543700 1 -- 172.21.15.17:0/3924186558 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c980c78a0 con 0x7f7c980b5470 2023-10-06T04:44:03.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.427+0000 7f7c967fc700 1 -- 172.21.15.17:0/3924186558 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f7c88055650 con 0x7f7c980b5470 2023-10-06T04:44:03.429 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:03.429 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/3001699743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3001699743},{"type":"v1","addr":"172.21.15.136:6833","nonce":3001699743}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/1891609455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1891609455},{"type":"v1","addr":"172.21.15.17:6835","nonce":1891609455}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/2697752124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":2697752124},{"type":"v1","addr":"172.21.15.17:6837","nonce":2697752124}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:43:29.199801+0000","modified":"2023-10-06T04:43:32.817081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6835/1496795591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":1496795591},{"type":"v1","addr":"172.21.15.136:6835","nonce":1496795591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:44:03.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.429+0000 7f7c9f543700 1 -- 172.21.15.17:0/3924186558 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7c84066f30 msgr2=0x7f7c840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:03.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.429+0000 7f7c9f543700 1 --2- 172.21.15.17:0/3924186558 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7c84066f30 0x7f7c840693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7c90007fd0 tx=0x7f7c90009040 comp rx=0 tx=0).stop 2023-10-06T04:44:03.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.429+0000 7f7c9f543700 1 -- 172.21.15.17:0/3924186558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c980b5470 msgr2=0x7f7c980b13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:03.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.429+0000 7f7c9f543700 1 --2- 172.21.15.17:0/3924186558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c980b5470 0x7f7c980b13f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7c88009fa0 tx=0x7f7c880099b0 comp rx=0 tx=0).stop 2023-10-06T04:44:03.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.429+0000 7f7c9f543700 1 -- 172.21.15.17:0/3924186558 shutdown_connections 2023-10-06T04:44:03.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.429+0000 7f7c9f543700 1 --2- 172.21.15.17:0/3924186558 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7c84066f30 0x7f7c840693e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:03.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.429+0000 7f7c9f543700 1 --2- 172.21.15.17:0/3924186558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c980b5470 0x7f7c980b13f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:03.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.429+0000 7f7c9f543700 1 --2- 172.21.15.17:0/3924186558 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c980af0a0 0x7f7c981581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:03.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.429+0000 7f7c9f543700 1 --2- 172.21.15.17:0/3924186558 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7c980ccfc0 0x7f7c981586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:03.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.429+0000 7f7c9f543700 1 -- 172.21.15.17:0/3924186558 >> 172.21.15.17:0/3924186558 conn(0x7f7c9806cff0 msgr2=0x7f7c980ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:03.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.429+0000 7f7c9f543700 1 -- 172.21.15.17:0/3924186558 shutdown_connections 2023-10-06T04:44:03.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.429+0000 7f7c9f543700 1 -- 172.21.15.17:0/3924186558 wait complete. 2023-10-06T04:44:03.432 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 7 2023-10-06T04:44:03.443 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:44:03.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.560+0000 7f17cc1b8700 1 Processor -- start 2023-10-06T04:44:03.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.560+0000 7f17cc1b8700 1 -- start start 2023-10-06T04:44:03.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.561+0000 7f17cc1b8700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f17c4159630 0x7f17c40cd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:03.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.561+0000 7f17cc1b8700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f17c40cea10 0x7f17c40b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:03.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.561+0000 7f17cc1b8700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c40cda00 con 0x7f17c40cd590 2023-10-06T04:44:03.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.561+0000 7f17cc1b8700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c40cee90 con 0x7f17c40cea10 2023-10-06T04:44:03.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.561+0000 7f17cc1b8700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c40cfc80 con 0x7f17c4159630 2023-10-06T04:44:03.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.561+0000 7f17ca755700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f17c40cea10 0x7f17c40b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:03.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.561+0000 7f17c9753700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f17c40cd590 0x7f17c40ce300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55790/0 (socket says 172.21.15.17:55790) 2023-10-06T04:44:03.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.561+0000 7f17c9753700 1 -- 172.21.15.17:0/1746368843 learned_addr learned my addr 172.21.15.17:0/1746368843 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:03.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.561+0000 7f17c9f54700 1 --2- 172.21.15.17:0/1746368843 >> v2:172.21.15.136:3300/0 conn(0x7f17c4159630 0x7f17c40cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:03.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.561+0000 7f17ca755700 1 -- 172.21.15.17:0/1746368843 >> v2:172.21.15.136:3300/0 conn(0x7f17c4159630 msgr2=0x7f17c40cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:03.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.561+0000 7f17ca755700 1 --2- 172.21.15.17:0/1746368843 >> v2:172.21.15.136:3300/0 conn(0x7f17c4159630 0x7f17c40cd050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:03.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.561+0000 7f17ca755700 1 -- 172.21.15.17:0/1746368843 >> v1:172.21.15.17:6789/0 conn(0x7f17c40cd590 legacy=0x7f17c40ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:03.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.561+0000 7f17ca755700 1 -- 172.21.15.17:0/1746368843 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c40cf070 con 0x7f17c40cea10 2023-10-06T04:44:03.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.561+0000 7f17c8f52700 1 -- 172.21.15.17:0/1746368843 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1458138513 0 0) 0x7f17c40cda00 con 0x7f17c40cd590 2023-10-06T04:44:03.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.561+0000 7f17c9f54700 1 --2- 172.21.15.17:0/1746368843 >> v2:172.21.15.136:3300/0 conn(0x7f17c4159630 0x7f17c40cd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:03.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.561+0000 7f17ca755700 1 --2- 172.21.15.17:0/1746368843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17c40cea10 0x7f17c40b02d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f17c4076960 tx=0x7f17b4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1830f6800c4b1b77 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:03.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.561+0000 7f17c8f52700 1 -- 172.21.15.17:0/1746368843 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b400e070 con 0x7f17c40cea10 2023-10-06T04:44:03.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.561+0000 7f17c8f52700 1 -- 172.21.15.17:0/1746368843 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b400bc30 con 0x7f17c40cea10 2023-10-06T04:44:03.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.561+0000 7f17c8f52700 1 -- 172.21.15.17:0/1746368843 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b4012430 con 0x7f17c40cea10 2023-10-06T04:44:03.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.562+0000 7f17cc1b8700 1 -- 172.21.15.17:0/1746368843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17c40cea10 msgr2=0x7f17c40b02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:03.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.562+0000 7f17cc1b8700 1 --2- 172.21.15.17:0/1746368843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17c40cea10 0x7f17c40b02d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f17c4076960 tx=0x7f17b4009780 comp rx=0 tx=0).stop 2023-10-06T04:44:03.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.562+0000 7f17cc1b8700 1 -- 172.21.15.17:0/1746368843 shutdown_connections 2023-10-06T04:44:03.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.562+0000 7f17cc1b8700 1 --2- 172.21.15.17:0/1746368843 >> v2:172.21.15.136:3300/0 conn(0x7f17c4159630 0x7f17c40cd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:03.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.562+0000 7f17cc1b8700 1 --2- 172.21.15.17:0/1746368843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17c40cea10 0x7f17c40b02d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:03.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.562+0000 7f17cc1b8700 1 -- 172.21.15.17:0/1746368843 >> 172.21.15.17:0/1746368843 conn(0x7f17c406cff0 msgr2=0x7f17c406d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:03.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.562+0000 7f17cc1b8700 1 -- 172.21.15.17:0/1746368843 shutdown_connections 2023-10-06T04:44:03.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.562+0000 7f17cc1b8700 1 -- 172.21.15.17:0/1746368843 wait complete. 2023-10-06T04:44:03.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.563+0000 7f17cc1b8700 1 Processor -- start 2023-10-06T04:44:03.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.563+0000 7f17cc1b8700 1 -- start start 2023-10-06T04:44:03.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.564+0000 7f17cc1b8700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17c40cd590 0x7f17c414e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:03.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.564+0000 7f17cc1b8700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17c40cea10 0x7f17c4159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:03.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.564+0000 7f17cc1b8700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f17c4159630 0x7f17c40c6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:03.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.564+0000 7f17cc1b8700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c415a980 con 0x7f17c40cea10 2023-10-06T04:44:03.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.564+0000 7f17cc1b8700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c414ebb0 con 0x7f17c40cd590 2023-10-06T04:44:03.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.564+0000 7f17cc1b8700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c415a3c0 con 0x7f17c4159630 2023-10-06T04:44:03.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.564+0000 7f17c9753700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17c40cea10 0x7f17c4159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:03.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.564+0000 7f17c9753700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17c40cea10 0x7f17c4159a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60246/0 (socket says 172.21.15.17:60246) 2023-10-06T04:44:03.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.564+0000 7f17c9753700 1 -- 172.21.15.17:0/836433217 learned_addr learned my addr 172.21.15.17:0/836433217 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:03.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.564+0000 7f17c9f54700 1 --2- 172.21.15.17:0/836433217 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17c40cd590 0x7f17c414e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:03.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.564+0000 7f17ca755700 1 --2- 172.21.15.17:0/836433217 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f17c4159630 0x7f17c40c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:03.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.564+0000 7f17c9753700 1 -- 172.21.15.17:0/836433217 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f17c4159630 msgr2=0x7f17c40c6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:03.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.564+0000 7f17c9753700 1 --2- 172.21.15.17:0/836433217 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f17c4159630 0x7f17c40c6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:03.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.564+0000 7f17c9753700 1 -- 172.21.15.17:0/836433217 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17c40cd590 msgr2=0x7f17c414e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:03.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.564+0000 7f17c9753700 1 --2- 172.21.15.17:0/836433217 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17c40cd590 0x7f17c414e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:03.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.564+0000 7f17c9753700 1 -- 172.21.15.17:0/836433217 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b4009a20 con 0x7f17c40cea10 2023-10-06T04:44:03.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.564+0000 7f17c9f54700 1 --2- 172.21.15.17:0/836433217 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17c40cd590 0x7f17c414e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:03.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.564+0000 7f17c9753700 1 --2- 172.21.15.17:0/836433217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17c40cea10 0x7f17c4159a00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f17b800c7e0 tx=0x7f17b8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:03.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.564+0000 7f17c1ffb700 1 -- 172.21.15.17:0/836433217 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b8005b30 con 0x7f17c40cea10 2023-10-06T04:44:03.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.565+0000 7f17c1ffb700 1 -- 172.21.15.17:0/836433217 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b8005c90 con 0x7f17c40cea10 2023-10-06T04:44:03.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.565+0000 7f17cc1b8700 1 -- 172.21.15.17:0/836433217 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17c415a6a0 con 0x7f17c40cea10 2023-10-06T04:44:03.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.565+0000 7f17c1ffb700 1 -- 172.21.15.17:0/836433217 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b8007300 con 0x7f17c40cea10 2023-10-06T04:44:03.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.565+0000 7f17cc1b8700 1 -- 172.21.15.17:0/836433217 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c4155c30 con 0x7f17c40cea10 2023-10-06T04:44:03.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.566+0000 7f17cc1b8700 1 -- 172.21.15.17:0/836433217 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c41560a0 con 0x7f17c40cea10 2023-10-06T04:44:03.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.566+0000 7f17c1ffb700 1 -- 172.21.15.17:0/836433217 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f17b80076b0 con 0x7f17c40cea10 2023-10-06T04:44:03.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.566+0000 7f17c1ffb700 1 --2- 172.21.15.17:0/836433217 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f17b0066f30 0x7f17b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:03.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.566+0000 7f17c1ffb700 1 -- 172.21.15.17:0/836433217 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f17b8084160 con 0x7f17c40cea10 2023-10-06T04:44:03.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.567+0000 7f17c9f54700 1 --2- 172.21.15.17:0/836433217 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f17b0066f30 0x7f17b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:03.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.567+0000 7f17c9f54700 1 --2- 172.21.15.17:0/836433217 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f17b0066f30 0x7f17b00693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f17bc006f00 tx=0x7f17bc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:03.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.571+0000 7f17c1ffb700 1 -- 172.21.15.17:0/836433217 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f17c41560a0 con 0x7f17c40cea10 2023-10-06T04:44:03.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.808+0000 7f17cc1b8700 1 -- 172.21.15.17:0/836433217 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17c41560a0 con 0x7f17c40cea10 2023-10-06T04:44:03.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.809+0000 7f17c1ffb700 1 -- 172.21.15.17:0/836433217 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f17c41560a0 con 0x7f17c40cea10 2023-10-06T04:44:03.811 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:03.811 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/3001699743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3001699743},{"type":"v1","addr":"172.21.15.136:6833","nonce":3001699743}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/1891609455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1891609455},{"type":"v1","addr":"172.21.15.17:6835","nonce":1891609455}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/2697752124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":2697752124},{"type":"v1","addr":"172.21.15.17:6837","nonce":2697752124}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:43:29.199801+0000","modified":"2023-10-06T04:43:32.817081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6835/1496795591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":1496795591},{"type":"v1","addr":"172.21.15.136:6835","nonce":1496795591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:44:03.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.811+0000 7f17cc1b8700 1 -- 172.21.15.17:0/836433217 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f17b0066f30 msgr2=0x7f17b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:03.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.811+0000 7f17cc1b8700 1 --2- 172.21.15.17:0/836433217 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f17b0066f30 0x7f17b00693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f17bc006f00 tx=0x7f17bc008040 comp rx=0 tx=0).stop 2023-10-06T04:44:03.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.811+0000 7f17cc1b8700 1 -- 172.21.15.17:0/836433217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17c40cea10 msgr2=0x7f17c4159a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:03.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.811+0000 7f17cc1b8700 1 --2- 172.21.15.17:0/836433217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17c40cea10 0x7f17c4159a00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f17b800c7e0 tx=0x7f17b8007df0 comp rx=0 tx=0).stop 2023-10-06T04:44:03.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.811+0000 7f17cc1b8700 1 -- 172.21.15.17:0/836433217 shutdown_connections 2023-10-06T04:44:03.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.811+0000 7f17cc1b8700 1 --2- 172.21.15.17:0/836433217 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f17b0066f30 0x7f17b00693e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:03.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.811+0000 7f17cc1b8700 1 --2- 172.21.15.17:0/836433217 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f17c4159630 0x7f17c40c6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:03.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.811+0000 7f17cc1b8700 1 --2- 172.21.15.17:0/836433217 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17c40cd590 0x7f17c414e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:03.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.811+0000 7f17cc1b8700 1 --2- 172.21.15.17:0/836433217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17c40cea10 0x7f17c4159a00 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:03.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.811+0000 7f17cc1b8700 1 -- 172.21.15.17:0/836433217 >> 172.21.15.17:0/836433217 conn(0x7f17c406cff0 msgr2=0x7f17c415e070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:03.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.811+0000 7f17cc1b8700 1 -- 172.21.15.17:0/836433217 shutdown_connections 2023-10-06T04:44:03.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.811+0000 7f17cc1b8700 1 -- 172.21.15.17:0/836433217 wait complete. 2023-10-06T04:44:03.816 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 7 2023-10-06T04:44:03.825 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:44:03.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.942+0000 7f90893d0700 1 Processor -- start 2023-10-06T04:44:03.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.942+0000 7f90893d0700 1 -- start start 2023-10-06T04:44:03.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.943+0000 7f90893d0700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9084159630 0x7f90840cd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:03.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.943+0000 7f90893d0700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f90840cd590 0x7f90840ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:03.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.943+0000 7f90893d0700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90840cda00 con 0x7f90840ce840 2023-10-06T04:44:03.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.943+0000 7f90893d0700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90840cfc80 con 0x7f90840cd590 2023-10-06T04:44:03.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.943+0000 7f90893d0700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90840cf070 con 0x7f9084159630 2023-10-06T04:44:03.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.943+0000 7f90827fc700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f90840cd590 0x7f90840ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:03.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.943+0000 7f9082ffd700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9084159630 0x7f90840cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:03.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.943+0000 7f90827fc700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f90840cd590 0x7f90840ce300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.17:47176/0 (socket says 172.21.15.17:47176) 2023-10-06T04:44:03.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.943+0000 7f90827fc700 1 -- 172.21.15.17:0/3132195430 learned_addr learned my addr 172.21.15.17:0/3132195430 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:03.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.943+0000 7f90837fe700 1 --1- 172.21.15.17:0/3132195430 >> v1:172.21.15.136:6789/0 conn(0x7f90840ce840 0x7f908415d2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.17:47708/0 (socket says 172.21.15.17:47708) 2023-10-06T04:44:03.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.943+0000 7f90827fc700 1 -- 172.21.15.17:0/3132195430 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9084159630 msgr2=0x7f90840cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:03.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.943+0000 7f90827fc700 1 --2- 172.21.15.17:0/3132195430 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9084159630 0x7f90840cd050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:03.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.943+0000 7f90827fc700 1 -- 172.21.15.17:0/3132195430 >> v1:172.21.15.136:6789/0 conn(0x7f90840ce840 legacy=0x7f908415d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:03.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.943+0000 7f90827fc700 1 -- 172.21.15.17:0/3132195430 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90840cf350 con 0x7f90840cd590 2023-10-06T04:44:03.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.944+0000 7f90827fc700 1 --2- 172.21.15.17:0/3132195430 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90840cd590 0x7f90840ce300 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f90780099b0 tx=0x7f9078009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f67707ca2768aefc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:03.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.944+0000 7f9081ffb700 1 -- 172.21.15.17:0/3132195430 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9078009ea0 con 0x7f90840cd590 2023-10-06T04:44:03.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.944+0000 7f9081ffb700 1 -- 172.21.15.17:0/3132195430 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907800b860 con 0x7f90840cd590 2023-10-06T04:44:03.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.944+0000 7f9081ffb700 1 -- 172.21.15.17:0/3132195430 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907800bc00 con 0x7f90840cd590 2023-10-06T04:44:03.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.944+0000 7f90893d0700 1 -- 172.21.15.17:0/3132195430 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90840cd590 msgr2=0x7f90840ce300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:03.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.944+0000 7f90893d0700 1 --2- 172.21.15.17:0/3132195430 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90840cd590 0x7f90840ce300 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f90780099b0 tx=0x7f9078009250 comp rx=0 tx=0).stop 2023-10-06T04:44:03.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.944+0000 7f90893d0700 1 -- 172.21.15.17:0/3132195430 shutdown_connections 2023-10-06T04:44:03.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.944+0000 7f90893d0700 1 --2- 172.21.15.17:0/3132195430 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9084159630 0x7f90840cd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:03.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.944+0000 7f90893d0700 1 --2- 172.21.15.17:0/3132195430 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90840cd590 0x7f90840ce300 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:03.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.944+0000 7f90893d0700 1 -- 172.21.15.17:0/3132195430 >> 172.21.15.17:0/3132195430 conn(0x7f908406cff0 msgr2=0x7f908406d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:03.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.944+0000 7f90893d0700 1 -- 172.21.15.17:0/3132195430 shutdown_connections 2023-10-06T04:44:03.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.944+0000 7f90893d0700 1 -- 172.21.15.17:0/3132195430 wait complete. 2023-10-06T04:44:03.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.946+0000 7f90893d0700 1 Processor -- start 2023-10-06T04:44:03.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.946+0000 7f90893d0700 1 -- start start 2023-10-06T04:44:03.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.946+0000 7f90893d0700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90840cd590 0x7f908414ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:03.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.946+0000 7f90893d0700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90840ce840 0x7f90841504d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:03.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.946+0000 7f90893d0700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9084159630 0x7f908415aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:03.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.946+0000 7f90893d0700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9084150f30 con 0x7f9084159630 2023-10-06T04:44:03.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.946+0000 7f90893d0700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90840b28b0 con 0x7f90840cd590 2023-10-06T04:44:03.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.946+0000 7f90893d0700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9084150a10 con 0x7f90840ce840 2023-10-06T04:44:03.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.946+0000 7f90837fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9084159630 0x7f908415aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:03.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.946+0000 7f90837fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9084159630 0x7f908415aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60260/0 (socket says 172.21.15.17:60260) 2023-10-06T04:44:03.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.946+0000 7f90837fe700 1 -- 172.21.15.17:0/38908259 learned_addr learned my addr 172.21.15.17:0/38908259 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:03.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.947+0000 7f9082ffd700 1 --2- 172.21.15.17:0/38908259 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90840cd590 0x7f908414ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:03.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.947+0000 7f90827fc700 1 --2- 172.21.15.17:0/38908259 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90840ce840 0x7f90841504d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:03.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.947+0000 7f90837fe700 1 -- 172.21.15.17:0/38908259 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90840ce840 msgr2=0x7f90841504d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:03.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.947+0000 7f90837fe700 1 --2- 172.21.15.17:0/38908259 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90840ce840 0x7f90841504d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:03.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.947+0000 7f90837fe700 1 -- 172.21.15.17:0/38908259 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90840cd590 msgr2=0x7f908414ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:03.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.947+0000 7f90837fe700 1 --2- 172.21.15.17:0/38908259 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90840cd590 0x7f908414ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:03.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.947+0000 7f90837fe700 1 -- 172.21.15.17:0/38908259 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90780094f0 con 0x7f9084159630 2023-10-06T04:44:03.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.947+0000 7f90827fc700 1 --2- 172.21.15.17:0/38908259 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90840ce840 0x7f90841504d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:03.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.947+0000 7f9082ffd700 1 --2- 172.21.15.17:0/38908259 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90840cd590 0x7f908414ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:03.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.947+0000 7f90837fe700 1 --2- 172.21.15.17:0/38908259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9084159630 0x7f908415aef0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f907c00cd00 tx=0x7f907c001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:03.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.947+0000 7f906affd700 1 -- 172.21.15.17:0/38908259 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c005df0 con 0x7f9084159630 2023-10-06T04:44:03.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.947+0000 7f906affd700 1 -- 172.21.15.17:0/38908259 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907c00a960 con 0x7f9084159630 2023-10-06T04:44:03.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.947+0000 7f90893d0700 1 -- 172.21.15.17:0/38908259 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f908415bee0 con 0x7f9084159630 2023-10-06T04:44:03.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.947+0000 7f906affd700 1 -- 172.21.15.17:0/38908259 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c00ad00 con 0x7f9084159630 2023-10-06T04:44:03.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.947+0000 7f90893d0700 1 -- 172.21.15.17:0/38908259 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90840b22e0 con 0x7f9084159630 2023-10-06T04:44:03.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.948+0000 7f90893d0700 1 -- 172.21.15.17:0/38908259 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90840b2660 con 0x7f9084159630 2023-10-06T04:44:03.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.949+0000 7f906affd700 1 -- 172.21.15.17:0/38908259 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f907c007300 con 0x7f9084159630 2023-10-06T04:44:03.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.949+0000 7f906affd700 1 --2- 172.21.15.17:0/38908259 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9070066f30 0x7f90700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:03.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.949+0000 7f906affd700 1 -- 172.21.15.17:0/38908259 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f907c0848c0 con 0x7f9084159630 2023-10-06T04:44:03.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.949+0000 7f9082ffd700 1 --2- 172.21.15.17:0/38908259 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9070066f30 0x7f90700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:03.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.949+0000 7f9082ffd700 1 --2- 172.21.15.17:0/38908259 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9070066f30 0x7f90700693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9074006f00 tx=0x7f9074008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:03.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:03.953+0000 7f906affd700 1 -- 172.21.15.17:0/38908259 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f907c0519d0 con 0x7f9084159630 2023-10-06T04:44:04.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.146+0000 7f90893d0700 1 -- 172.21.15.17:0/38908259 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9084063ff0 con 0x7f9084159630 2023-10-06T04:44:04.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.147+0000 7f906affd700 1 -- 172.21.15.17:0/38908259 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f907c00ae60 con 0x7f9084159630 2023-10-06T04:44:04.149 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:04.149 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":21,"fsid":"780777c4-2b25-4d35-9058-c9f2d62e3ad9","created":"2023-10-06T04:43:10.578520+0000","modified":"2023-10-06T04:43:30.789916+0000","last_up_change":"2023-10-06T04:43:20.682958+0000","last_in_change":"2023-10-06T04:43:12.978917+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:43:21.795733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:43:22.389592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:43:26.914728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:43:28.173678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"84737b08-575c-46dd-9488-073ae8504494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6809","nonce":90656},{"type":"v1","addr":"172.21.15.17:6811","nonce":90656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":90656},{"type":"v1","addr":"172.21.15.17:6814","nonce":90656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":90656},{"type":"v1","addr":"172.21.15.17:6822","nonce":90656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":90656},{"type":"v1","addr":"172.21.15.17:6818","nonce":90656}]},"public_addr":"172.21.15.17:6811/90656","cluster_addr":"172.21.15.17:6814/90656","heartbeat_back_addr":"172.21.15.17:6822/90656","heartbeat_front_addr":"172.21.15.17:6818/90656","state":["exists","up"]},{"osd":1,"uuid":"dffeb740-58a2-4fd6-8ff1-a0a11a2cc709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":90655},{"type":"v1","addr":"172.21.15.17:6801","nonce":90655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":90655},{"type":"v1","addr":"172.21.15.17:6803","nonce":90655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":90655},{"type":"v1","addr":"172.21.15.17:6807","nonce":90655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":90655},{"type":"v1","addr":"172.21.15.17:6805","nonce":90655}]},"public_addr":"172.21.15.17:6801/90655","cluster_addr":"172.21.15.17:6803/90655","heartbeat_back_addr":"172.21.15.17:6807/90655","heartbeat_front_addr":"172.21.15.17:6805/90655","state":["exists","up"]},{"osd":2,"uuid":"48bd6831-763d-48c2-b515-e02c216d608b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":90657},{"type":"v1","addr":"172.21.15.17:6810","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":90657},{"type":"v1","addr":"172.21.15.17:6815","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":90657},{"type":"v1","addr":"172.21.15.17:6823","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":90657},{"type":"v1","addr":"172.21.15.17:6819","nonce":90657}]},"public_addr":"172.21.15.17:6810/90657","cluster_addr":"172.21.15.17:6815/90657","heartbeat_back_addr":"172.21.15.17:6823/90657","heartbeat_front_addr":"172.21.15.17:6819/90657","state":["exists","up"]},{"osd":3,"uuid":"ae7dbb23-abe7-4bd3-a4df-6f5963d6804c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":90688},{"type":"v1","addr":"172.21.15.17:6825","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":90688},{"type":"v1","addr":"172.21.15.17:6827","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":90688},{"type":"v1","addr":"172.21.15.17:6831","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":90688},{"type":"v1","addr":"172.21.15.17:6829","nonce":90688}]},"public_addr":"172.21.15.17:6825/90688","cluster_addr":"172.21.15.17:6827/90688","heartbeat_back_addr":"172.21.15.17:6831/90688","heartbeat_front_addr":"172.21.15.17:6829/90688","state":["exists","up"]},{"osd":4,"uuid":"29991fb4-1667-4ea3-aca0-d55db27f3bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":90902},{"type":"v1","addr":"172.21.15.136:6801","nonce":90902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":90902},{"type":"v1","addr":"172.21.15.136:6803","nonce":90902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":90902},{"type":"v1","addr":"172.21.15.136:6807","nonce":90902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":90902},{"type":"v1","addr":"172.21.15.136:6805","nonce":90902}]},"public_addr":"172.21.15.136:6801/90902","cluster_addr":"172.21.15.136:6803/90902","heartbeat_back_addr":"172.21.15.136:6807/90902","heartbeat_front_addr":"172.21.15.136:6805/90902","state":["exists","up"]},{"osd":5,"uuid":"398b4ff9-03fc-421f-882c-ba12aa088eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":90901},{"type":"v1","addr":"172.21.15.136:6809","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":90901},{"type":"v1","addr":"172.21.15.136:6811","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":90901},{"type":"v1","addr":"172.21.15.136:6815","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":90901},{"type":"v1","addr":"172.21.15.136:6813","nonce":90901}]},"public_addr":"172.21.15.136:6809/90901","cluster_addr":"172.21.15.136:6811/90901","heartbeat_back_addr":"172.21.15.136:6815/90901","heartbeat_front_addr":"172.21.15.136:6813/90901","state":["exists","up"]},{"osd":6,"uuid":"1bb91a72-4dab-4cdb-aa1d-2b8a9edf1ad0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":90927},{"type":"v1","addr":"172.21.15.136:6825","nonce":90927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":90927},{"type":"v1","addr":"172.21.15.136:6827","nonce":90927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":90927},{"type":"v1","addr":"172.21.15.136:6831","nonce":90927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":90927},{"type":"v1","addr":"172.21.15.136:6829","nonce":90927}]},"public_addr":"172.21.15.136:6825/90927","cluster_addr":"172.21.15.136:6827/90927","heartbeat_back_addr":"172.21.15.136:6831/90927","heartbeat_front_addr":"172.21.15.136:6829/90927","state":["exists","up"]},{"osd":7,"uuid":"719b654e-010d-4aa4-8c13-83fdde242b47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":90934},{"type":"v1","addr":"172.21.15.136:6817","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":90934},{"type":"v1","addr":"172.21.15.136:6819","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":90934},{"type":"v1","addr":"172.21.15.136:6824","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":90934},{"type":"v1","addr":"172.21.15.136:6821","nonce":90934}]},"public_addr":"172.21.15.136:6817/90934","cluster_addr":"172.21.15.136:6819/90934","heartbeat_back_addr":"172.21.15.136:6824/90934","heartbeat_front_addr":"172.21.15.136:6821/90934","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.157479+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.140520+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.190743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.231396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.156510+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.145822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.202888+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.139532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:44:04.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.149+0000 7f90893d0700 1 -- 172.21.15.17:0/38908259 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9070066f30 msgr2=0x7f90700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:04.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.149+0000 7f90893d0700 1 --2- 172.21.15.17:0/38908259 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9070066f30 0x7f90700693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9074006f00 tx=0x7f9074008040 comp rx=0 tx=0).stop 2023-10-06T04:44:04.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.149+0000 7f90893d0700 1 -- 172.21.15.17:0/38908259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9084159630 msgr2=0x7f908415aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:04.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.149+0000 7f90893d0700 1 --2- 172.21.15.17:0/38908259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9084159630 0x7f908415aef0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f907c00cd00 tx=0x7f907c001b10 comp rx=0 tx=0).stop 2023-10-06T04:44:04.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.149+0000 7f90893d0700 1 -- 172.21.15.17:0/38908259 shutdown_connections 2023-10-06T04:44:04.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.149+0000 7f90893d0700 1 --2- 172.21.15.17:0/38908259 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9070066f30 0x7f90700693e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:04.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.149+0000 7f90893d0700 1 --2- 172.21.15.17:0/38908259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9084159630 0x7f908415aef0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:04.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.149+0000 7f90893d0700 1 --2- 172.21.15.17:0/38908259 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90840cd590 0x7f908414ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:04.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.149+0000 7f90893d0700 1 --2- 172.21.15.17:0/38908259 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90840ce840 0x7f90841504d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:04.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.149+0000 7f90893d0700 1 -- 172.21.15.17:0/38908259 >> 172.21.15.17:0/38908259 conn(0x7f908406cff0 msgr2=0x7f90840b0430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:04.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.149+0000 7f90893d0700 1 -- 172.21.15.17:0/38908259 shutdown_connections 2023-10-06T04:44:04.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.149+0000 7f90893d0700 1 -- 172.21.15.17:0/38908259 wait complete. 2023-10-06T04:44:04.164 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T04:44:04.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.282+0000 7fd687425700 1 Processor -- start 2023-10-06T04:44:04.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.282+0000 7fd687425700 1 -- start start 2023-10-06T04:44:04.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.283+0000 7fd687425700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd680151b50 0x7fd6800b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:04.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.283+0000 7fd687425700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6800b3d60 0x7fd680157de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:04.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.283+0000 7fd687425700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6800cae50 con 0x7fd680158320 2023-10-06T04:44:04.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.283+0000 7fd687425700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6800cbd10 con 0x7fd680151b50 2023-10-06T04:44:04.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.283+0000 7fd687425700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd68006a490 con 0x7fd6800b3d60 2023-10-06T04:44:04.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.283+0000 7fd6851c1700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd680151b50 0x7fd6800b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:04.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.283+0000 7fd6859c2700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fd680158320 0x7fd68015b0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55798/0 (socket says 172.21.15.17:55798) 2023-10-06T04:44:04.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.283+0000 7fd6859c2700 1 -- 172.21.15.17:0/3417055408 learned_addr learned my addr 172.21.15.17:0/3417055408 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:04.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.283+0000 7fd6849c0700 1 --2- 172.21.15.17:0/3417055408 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6800b3d60 0x7fd680157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:04.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.283+0000 7fd6851c1700 1 -- 172.21.15.17:0/3417055408 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6800b3d60 msgr2=0x7fd680157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:04.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.283+0000 7fd6851c1700 1 --2- 172.21.15.17:0/3417055408 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6800b3d60 0x7fd680157de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:04.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.283+0000 7fd6851c1700 1 -- 172.21.15.17:0/3417055408 >> v1:172.21.15.17:6789/0 conn(0x7fd680158320 legacy=0x7fd68015b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:04.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.283+0000 7fd67ffff700 1 -- 172.21.15.17:0/3417055408 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2040891934 0 0) 0x7fd670001110 con 0x7fd680158320 2023-10-06T04:44:04.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.283+0000 7fd6851c1700 1 -- 172.21.15.17:0/3417055408 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd680069480 con 0x7fd680151b50 2023-10-06T04:44:04.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.283+0000 7fd6851c1700 1 --2- 172.21.15.17:0/3417055408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd680151b50 0x7fd6800b3820 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd678009e60 tx=0x7fd678009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89b72d078b003379 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:04.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.284+0000 7fd67ffff700 1 -- 172.21.15.17:0/3417055408 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67800e070 con 0x7fd680151b50 2023-10-06T04:44:04.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.284+0000 7fd67ffff700 1 -- 172.21.15.17:0/3417055408 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67800bb60 con 0x7fd680151b50 2023-10-06T04:44:04.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.284+0000 7fd67ffff700 1 -- 172.21.15.17:0/3417055408 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd678012430 con 0x7fd680151b50 2023-10-06T04:44:04.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.284+0000 7fd687425700 1 -- 172.21.15.17:0/3417055408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd680151b50 msgr2=0x7fd6800b3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:04.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.284+0000 7fd687425700 1 --2- 172.21.15.17:0/3417055408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd680151b50 0x7fd6800b3820 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd678009e60 tx=0x7fd678009780 comp rx=0 tx=0).stop 2023-10-06T04:44:04.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.284+0000 7fd687425700 1 -- 172.21.15.17:0/3417055408 shutdown_connections 2023-10-06T04:44:04.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.284+0000 7fd687425700 1 --2- 172.21.15.17:0/3417055408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd680151b50 0x7fd6800b3820 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:04.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.284+0000 7fd687425700 1 --2- 172.21.15.17:0/3417055408 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6800b3d60 0x7fd680157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:04.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.284+0000 7fd687425700 1 -- 172.21.15.17:0/3417055408 >> 172.21.15.17:0/3417055408 conn(0x7fd680067df0 msgr2=0x7fd6800681f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:04.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.284+0000 7fd687425700 1 -- 172.21.15.17:0/3417055408 shutdown_connections 2023-10-06T04:44:04.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.284+0000 7fd687425700 1 -- 172.21.15.17:0/3417055408 wait complete. 2023-10-06T04:44:04.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.285+0000 7fd687425700 1 Processor -- start 2023-10-06T04:44:04.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.285+0000 7fd687425700 1 -- start start 2023-10-06T04:44:04.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.286+0000 7fd687425700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6800b3d60 0x7fd68014f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:04.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.286+0000 7fd687425700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd680151b50 0x7fd680156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:04.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.286+0000 7fd687425700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd680158320 0x7fd680156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:04.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.286+0000 7fd687425700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68006e680 con 0x7fd680158320 2023-10-06T04:44:04.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.286+0000 7fd687425700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68006d670 con 0x7fd680151b50 2023-10-06T04:44:04.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.286+0000 7fd687425700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd68006e1f0 con 0x7fd6800b3d60 2023-10-06T04:44:04.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.286+0000 7fd6859c2700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd680158320 0x7fd680156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:04.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.286+0000 7fd6859c2700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd680158320 0x7fd680156f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60274/0 (socket says 172.21.15.17:60274) 2023-10-06T04:44:04.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.286+0000 7fd6859c2700 1 -- 172.21.15.17:0/3071836998 learned_addr learned my addr 172.21.15.17:0/3071836998 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:04.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.286+0000 7fd6849c0700 1 --2- 172.21.15.17:0/3071836998 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd680151b50 0x7fd680156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:04.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.286+0000 7fd6851c1700 1 --2- 172.21.15.17:0/3071836998 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6800b3d60 0x7fd68014f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:04.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.287+0000 7fd6859c2700 1 -- 172.21.15.17:0/3071836998 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6800b3d60 msgr2=0x7fd68014f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:04.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.287+0000 7fd6859c2700 1 --2- 172.21.15.17:0/3071836998 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6800b3d60 0x7fd68014f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:04.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.287+0000 7fd6859c2700 1 -- 172.21.15.17:0/3071836998 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd680151b50 msgr2=0x7fd680156a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:04.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.287+0000 7fd6859c2700 1 --2- 172.21.15.17:0/3071836998 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd680151b50 0x7fd680156a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:04.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.287+0000 7fd6859c2700 1 -- 172.21.15.17:0/3071836998 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd678009a20 con 0x7fd680158320 2023-10-06T04:44:04.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.287+0000 7fd6859c2700 1 --2- 172.21.15.17:0/3071836998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd680158320 0x7fd680156f60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd67000c810 tx=0x7fd670007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:04.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.287+0000 7fd67d7fa700 1 -- 172.21.15.17:0/3071836998 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd670005b30 con 0x7fd680158320 2023-10-06T04:44:04.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.287+0000 7fd67d7fa700 1 -- 172.21.15.17:0/3071836998 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd670005cb0 con 0x7fd680158320 2023-10-06T04:44:04.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.287+0000 7fd687425700 1 -- 172.21.15.17:0/3071836998 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd68006d8c0 con 0x7fd680158320 2023-10-06T04:44:04.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.287+0000 7fd67d7fa700 1 -- 172.21.15.17:0/3071836998 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd670004a80 con 0x7fd680158320 2023-10-06T04:44:04.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.287+0000 7fd687425700 1 -- 172.21.15.17:0/3071836998 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd68006de80 con 0x7fd680158320 2023-10-06T04:44:04.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.288+0000 7fd687425700 1 -- 172.21.15.17:0/3071836998 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd68006e3a0 con 0x7fd680158320 2023-10-06T04:44:04.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.288+0000 7fd67d7fa700 1 -- 172.21.15.17:0/3071836998 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd670005030 con 0x7fd680158320 2023-10-06T04:44:04.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.289+0000 7fd67d7fa700 1 --2- 172.21.15.17:0/3071836998 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd66c066f30 0x7fd66c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:04.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.289+0000 7fd6851c1700 1 --2- 172.21.15.17:0/3071836998 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd66c066f30 0x7fd66c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:04.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.289+0000 7fd67d7fa700 1 -- 172.21.15.17:0/3071836998 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd670083990 con 0x7fd680158320 2023-10-06T04:44:04.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.289+0000 7fd6851c1700 1 --2- 172.21.15.17:0/3071836998 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd66c066f30 0x7fd66c0693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd6780097c0 tx=0x7fd678019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:04.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.293+0000 7fd67d7fa700 1 -- 172.21.15.17:0/3071836998 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd68006e3a0 con 0x7fd680158320 2023-10-06T04:44:04.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.531+0000 7fd687425700 1 -- 172.21.15.17:0/3071836998 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd6800cae50 con 0x7fd680158320 2023-10-06T04:44:04.533 INFO:tasks.ceph.mon.a.smithi017.stderr:2023-10-06T04:44:04.531+0000 7efe5a1a7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T04:44:04.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.535+0000 7fd67d7fa700 1 -- 172.21.15.17:0/3071836998 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd6800cae50 con 0x7fd680158320 2023-10-06T04:44:04.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.537+0000 7fd687425700 1 -- 172.21.15.17:0/3071836998 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd66c066f30 msgr2=0x7fd66c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:04.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.537+0000 7fd687425700 1 --2- 172.21.15.17:0/3071836998 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd66c066f30 0x7fd66c0693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd6780097c0 tx=0x7fd678019000 comp rx=0 tx=0).stop 2023-10-06T04:44:04.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.537+0000 7fd687425700 1 -- 172.21.15.17:0/3071836998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd680158320 msgr2=0x7fd680156f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:04.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.537+0000 7fd687425700 1 --2- 172.21.15.17:0/3071836998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd680158320 0x7fd680156f60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd67000c810 tx=0x7fd670007bd0 comp rx=0 tx=0).stop 2023-10-06T04:44:04.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.537+0000 7fd687425700 1 -- 172.21.15.17:0/3071836998 shutdown_connections 2023-10-06T04:44:04.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.537+0000 7fd687425700 1 --2- 172.21.15.17:0/3071836998 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd66c066f30 0x7fd66c0693e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:04.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.537+0000 7fd687425700 1 --2- 172.21.15.17:0/3071836998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd680158320 0x7fd680156f60 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:04.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.537+0000 7fd687425700 1 --2- 172.21.15.17:0/3071836998 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6800b3d60 0x7fd68014f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:04.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.537+0000 7fd687425700 1 --2- 172.21.15.17:0/3071836998 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd680151b50 0x7fd680156a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:04.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.537+0000 7fd687425700 1 -- 172.21.15.17:0/3071836998 >> 172.21.15.17:0/3071836998 conn(0x7fd680067df0 msgr2=0x7fd68014fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:04.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.537+0000 7fd687425700 1 -- 172.21.15.17:0/3071836998 shutdown_connections 2023-10-06T04:44:04.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.537+0000 7fd687425700 1 -- 172.21.15.17:0/3071836998 wait complete. 2023-10-06T04:44:04.542 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T04:44:04.542 INFO:tasks.ceph.mds.d.smithi136.stderr: -1716> 2023-10-06T04:43:33.826+0000 7f94b136a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T04:44:04.551 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T04:44:04.564 INFO:tasks.ceph.mds.d.smithi136.stdout:starting mds.d at 2023-10-06T04:44:04.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.671+0000 7ff2096ea700 1 Processor -- start 2023-10-06T04:44:04.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.671+0000 7ff2096ea700 1 -- start start 2023-10-06T04:44:04.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.671+0000 7ff2096ea700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff20406d140 0x7ff20406f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:04.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.672+0000 7ff2096ea700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2040d1120 con 0x7ff2040cabf0 2023-10-06T04:44:04.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.672+0000 7ff2096ea700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2040d1400 con 0x7ff204159b10 2023-10-06T04:44:04.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.672+0000 7ff2096ea700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff20406e920 con 0x7ff20406d140 2023-10-06T04:44:04.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.672+0000 7ff2037fe700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff20406d140 0x7ff20406f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:04.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.672+0000 7ff202ffd700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7ff2040cabf0 0x7ff2040c7660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55812/0 (socket says 172.21.15.17:55812) 2023-10-06T04:44:04.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.672+0000 7ff202ffd700 1 -- 172.21.15.17:0/4014419128 learned_addr learned my addr 172.21.15.17:0/4014419128 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:04.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.672+0000 7ff2037fe700 1 -- 172.21.15.17:0/4014419128 >> v1:172.21.15.136:6789/0 conn(0x7ff204159b10 legacy=0x7ff20406f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:04.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.672+0000 7ff2037fe700 1 -- 172.21.15.17:0/4014419128 >> v1:172.21.15.17:6789/0 conn(0x7ff2040cabf0 legacy=0x7ff2040c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:04.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.672+0000 7ff2037fe700 1 -- 172.21.15.17:0/4014419128 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20406ec00 con 0x7ff20406d140 2023-10-06T04:44:04.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.672+0000 7ff201ffb700 1 -- 172.21.15.17:0/4014419128 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2555265431 0 0) 0x7ff2040d1120 con 0x7ff2040cabf0 2023-10-06T04:44:04.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.672+0000 7ff2037fe700 1 --2- 172.21.15.17:0/4014419128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff20406d140 0x7ff20406f830 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc009e60 tx=0x7ff1fc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f773a7b9b64679ba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:04.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.672+0000 7ff201ffb700 1 -- 172.21.15.17:0/4014419128 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc00e070 con 0x7ff20406d140 2023-10-06T04:44:04.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.672+0000 7ff201ffb700 1 -- 172.21.15.17:0/4014419128 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1fc00bbf0 con 0x7ff20406d140 2023-10-06T04:44:04.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.672+0000 7ff201ffb700 1 -- 172.21.15.17:0/4014419128 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc012430 con 0x7ff20406d140 2023-10-06T04:44:04.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.673+0000 7ff2096ea700 1 -- 172.21.15.17:0/4014419128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff20406d140 msgr2=0x7ff20406f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:04.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.673+0000 7ff2096ea700 1 --2- 172.21.15.17:0/4014419128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff20406d140 0x7ff20406f830 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc009e60 tx=0x7ff1fc009780 comp rx=0 tx=0).stop 2023-10-06T04:44:04.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.673+0000 7ff2096ea700 1 -- 172.21.15.17:0/4014419128 shutdown_connections 2023-10-06T04:44:04.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.673+0000 7ff2096ea700 1 --2- 172.21.15.17:0/4014419128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff20406d140 0x7ff20406f830 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:04.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.673+0000 7ff2096ea700 1 -- 172.21.15.17:0/4014419128 >> 172.21.15.17:0/4014419128 conn(0x7ff20406cd40 msgr2=0x7ff2040d0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:04.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.673+0000 7ff2096ea700 1 -- 172.21.15.17:0/4014419128 shutdown_connections 2023-10-06T04:44:04.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.673+0000 7ff2096ea700 1 -- 172.21.15.17:0/4014419128 wait complete. 2023-10-06T04:44:04.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.674+0000 7ff2096ea700 1 Processor -- start 2023-10-06T04:44:04.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.674+0000 7ff2096ea700 1 -- start start 2023-10-06T04:44:04.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.675+0000 7ff2096ea700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff20406d140 0x7ff2041570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:04.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.675+0000 7ff2096ea700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff2040cabf0 0x7ff2040c6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:04.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.675+0000 7ff2096ea700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff204159b10 0x7ff20409d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:04.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.675+0000 7ff2096ea700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2041575f0 con 0x7ff204159b10 2023-10-06T04:44:04.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.675+0000 7ff2096ea700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20409ac30 con 0x7ff20406d140 2023-10-06T04:44:04.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.675+0000 7ff2096ea700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff20409a300 con 0x7ff2040cabf0 2023-10-06T04:44:04.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.675+0000 7ff2037fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff204159b10 0x7ff20409d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:04.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.675+0000 7ff2037fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff204159b10 0x7ff20409d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60298/0 (socket says 172.21.15.17:60298) 2023-10-06T04:44:04.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.675+0000 7ff202ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff20406d140 0x7ff2041570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:04.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.675+0000 7ff2037fe700 1 -- 172.21.15.17:0/2945334743 learned_addr learned my addr 172.21.15.17:0/2945334743 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:04.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.675+0000 7ff2027fc700 1 --2- 172.21.15.17:0/2945334743 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff2040cabf0 0x7ff2040c6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:04.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.675+0000 7ff2037fe700 1 -- 172.21.15.17:0/2945334743 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff2040cabf0 msgr2=0x7ff2040c6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:04.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.675+0000 7ff2037fe700 1 --2- 172.21.15.17:0/2945334743 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff2040cabf0 0x7ff2040c6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:04.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.675+0000 7ff2037fe700 1 -- 172.21.15.17:0/2945334743 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff20406d140 msgr2=0x7ff2041570b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:04.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.675+0000 7ff2037fe700 1 --2- 172.21.15.17:0/2945334743 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff20406d140 0x7ff2041570b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:04.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.675+0000 7ff2037fe700 1 -- 172.21.15.17:0/2945334743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1fc009a20 con 0x7ff204159b10 2023-10-06T04:44:04.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.676+0000 7ff2037fe700 1 --2- 172.21.15.17:0/2945334743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff204159b10 0x7ff20409d4a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc003000 tx=0x7ff1fc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:04.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.676+0000 7ff1faffd700 1 -- 172.21.15.17:0/2945334743 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc012e90 con 0x7ff204159b10 2023-10-06T04:44:04.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.676+0000 7ff1faffd700 1 -- 172.21.15.17:0/2945334743 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1fc01d640 con 0x7ff204159b10 2023-10-06T04:44:04.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.676+0000 7ff2096ea700 1 -- 172.21.15.17:0/2945334743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff20409a5e0 con 0x7ff204159b10 2023-10-06T04:44:04.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.676+0000 7ff1faffd700 1 -- 172.21.15.17:0/2945334743 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc01da00 con 0x7ff204159b10 2023-10-06T04:44:04.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.676+0000 7ff2096ea700 1 -- 172.21.15.17:0/2945334743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2040c5c50 con 0x7ff204159b10 2023-10-06T04:44:04.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.677+0000 7ff2096ea700 1 -- 172.21.15.17:0/2945334743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff20409ade0 con 0x7ff204159b10 2023-10-06T04:44:04.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.677+0000 7ff1faffd700 1 -- 172.21.15.17:0/2945334743 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff1fc024070 con 0x7ff204159b10 2023-10-06T04:44:04.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.678+0000 7ff1faffd700 1 --2- 172.21.15.17:0/2945334743 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff1e4066f30 0x7ff1e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:04.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.678+0000 7ff1faffd700 1 -- 172.21.15.17:0/2945334743 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6144+0+0 (secure 0 0 0) 0x7ff1fc087060 con 0x7ff204159b10 2023-10-06T04:44:04.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.678+0000 7ff202ffd700 1 --2- 172.21.15.17:0/2945334743 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff1e4066f30 0x7ff1e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:04.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.678+0000 7ff202ffd700 1 --2- 172.21.15.17:0/2945334743 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff1e4066f30 0x7ff1e40693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff1f4001360 tx=0x7ff1f4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:04.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.682+0000 7ff1faffd700 1 -- 172.21.15.17:0/2945334743 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff20409ade0 con 0x7ff204159b10 2023-10-06T04:44:04.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:04.918+0000 7ff2096ea700 1 -- 172.21.15.17:0/2945334743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff20409ada0 con 0x7ff204159b10 2023-10-06T04:44:05.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.535+0000 7ff1faffd700 1 -- 172.21.15.17:0/2945334743 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff1fc054120 con 0x7ff204159b10 2023-10-06T04:44:05.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.538+0000 7ff2096ea700 1 -- 172.21.15.17:0/2945334743 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff1e4066f30 msgr2=0x7ff1e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:05.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.538+0000 7ff2096ea700 1 --2- 172.21.15.17:0/2945334743 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff1e4066f30 0x7ff1e40693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff1f4001360 tx=0x7ff1f4009040 comp rx=0 tx=0).stop 2023-10-06T04:44:05.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.538+0000 7ff2096ea700 1 -- 172.21.15.17:0/2945334743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff204159b10 msgr2=0x7ff20409d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:05.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.538+0000 7ff2096ea700 1 --2- 172.21.15.17:0/2945334743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff204159b10 0x7ff20409d4a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc003000 tx=0x7ff1fc018000 comp rx=0 tx=0).stop 2023-10-06T04:44:05.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.538+0000 7ff2096ea700 1 -- 172.21.15.17:0/2945334743 shutdown_connections 2023-10-06T04:44:05.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.538+0000 7ff2096ea700 1 --2- 172.21.15.17:0/2945334743 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff1e4066f30 0x7ff1e40693e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:05.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.538+0000 7ff2096ea700 1 --2- 172.21.15.17:0/2945334743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff204159b10 0x7ff20409d4a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:05.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.538+0000 7ff2096ea700 1 --2- 172.21.15.17:0/2945334743 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff20406d140 0x7ff2041570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:05.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.538+0000 7ff2096ea700 1 --2- 172.21.15.17:0/2945334743 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff2040cabf0 0x7ff2040c6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:05.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.538+0000 7ff2096ea700 1 -- 172.21.15.17:0/2945334743 >> 172.21.15.17:0/2945334743 conn(0x7ff20406cd40 msgr2=0x7ff204158df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:05.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.538+0000 7ff2096ea700 1 -- 172.21.15.17:0/2945334743 shutdown_connections 2023-10-06T04:44:05.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.538+0000 7ff2096ea700 1 -- 172.21.15.17:0/2945334743 wait complete. 2023-10-06T04:44:05.554 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T04:44:05.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.679+0000 7f6c13032700 1 Processor -- start 2023-10-06T04:44:05.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.679+0000 7f6c13032700 1 -- start start 2023-10-06T04:44:05.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.679+0000 7f6c13032700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c0c159690 0x7f6c0c159a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:05.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.679+0000 7f6c13032700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6c0c0c9a20 0x7f6c0c06cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:05.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.679+0000 7f6c13032700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c0c0c8af0 con 0x7f6c0c06c810 2023-10-06T04:44:05.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.679+0000 7f6c13032700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c0c0c7ee0 con 0x7f6c0c0c9a20 2023-10-06T04:44:05.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.679+0000 7f6c13032700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c0c81c0 con 0x7f6c0c159690 2023-10-06T04:44:05.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.680+0000 7f6c0bfff700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f6c0c06c810 0x7f6c0c0c9310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55824/0 (socket says 172.21.15.17:55824) 2023-10-06T04:44:05.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.680+0000 7f6c0bfff700 1 -- 172.21.15.17:0/2683491184 learned_addr learned my addr 172.21.15.17:0/2683491184 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:05.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.680+0000 7f6c10dce700 1 --2- 172.21.15.17:0/2683491184 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c0c159690 0x7f6c0c159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:05.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.680+0000 7f6c115cf700 1 --2- 172.21.15.17:0/2683491184 >> v2:172.21.15.136:3300/0 conn(0x7f6c0c0c9a20 0x7f6c0c06cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:05.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.680+0000 7f6c0b7fe700 1 -- 172.21.15.17:0/2683491184 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 163752848 0 0) 0x7f6c0c0c8af0 con 0x7f6c0c06c810 2023-10-06T04:44:05.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.680+0000 7f6c0b7fe700 1 -- 172.21.15.17:0/2683491184 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bf8003570 con 0x7f6c0c06c810 2023-10-06T04:44:05.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.680+0000 7f6c115cf700 1 -- 172.21.15.17:0/2683491184 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c0c159690 msgr2=0x7f6c0c159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:05.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.680+0000 7f6c115cf700 1 --2- 172.21.15.17:0/2683491184 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c0c159690 0x7f6c0c159a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:05.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.680+0000 7f6c115cf700 1 -- 172.21.15.17:0/2683491184 >> v1:172.21.15.17:6789/0 conn(0x7f6c0c06c810 legacy=0x7f6c0c0c9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:05.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.680+0000 7f6c0b7fe700 1 -- 172.21.15.17:0/2683491184 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 448245004 0 0) 0x7f6bf8003570 con 0x7f6c0c06c810 2023-10-06T04:44:05.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.680+0000 7f6c115cf700 1 -- 172.21.15.17:0/2683491184 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0c0c84a0 con 0x7f6c0c0c9a20 2023-10-06T04:44:05.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.680+0000 7f6c10dce700 1 --2- 172.21.15.17:0/2683491184 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c0c159690 0x7f6c0c159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:44:05.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.680+0000 7f6c115cf700 1 --2- 172.21.15.17:0/2683491184 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c0c0c9a20 0x7f6c0c06cc80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6bf40098e0 tx=0x7f6bf40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d557d1d51bc611e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:05.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.681+0000 7f6c0b7fe700 1 -- 172.21.15.17:0/2683491184 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc001470 con 0x7f6c0c0c9a20 2023-10-06T04:44:05.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.681+0000 7f6c0b7fe700 1 -- 172.21.15.17:0/2683491184 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf4011420 con 0x7f6c0c0c9a20 2023-10-06T04:44:05.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.681+0000 7f6c0b7fe700 1 -- 172.21.15.17:0/2683491184 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf40117c0 con 0x7f6c0c0c9a20 2023-10-06T04:44:05.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.681+0000 7f6c13032700 1 -- 172.21.15.17:0/2683491184 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c0c0c9a20 msgr2=0x7f6c0c06cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:05.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.681+0000 7f6c13032700 1 --2- 172.21.15.17:0/2683491184 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c0c0c9a20 0x7f6c0c06cc80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6bf40098e0 tx=0x7f6bf40091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:05.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.681+0000 7f6c13032700 1 -- 172.21.15.17:0/2683491184 shutdown_connections 2023-10-06T04:44:05.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.681+0000 7f6c13032700 1 --2- 172.21.15.17:0/2683491184 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c0c0c9a20 0x7f6c0c06cc80 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:05.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.681+0000 7f6c13032700 1 --2- 172.21.15.17:0/2683491184 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c0c159690 0x7f6c0c159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:05.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.681+0000 7f6c13032700 1 -- 172.21.15.17:0/2683491184 >> 172.21.15.17:0/2683491184 conn(0x7f6c0c0cd4c0 msgr2=0x7f6c0c0cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:05.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.681+0000 7f6c13032700 1 -- 172.21.15.17:0/2683491184 shutdown_connections 2023-10-06T04:44:05.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.681+0000 7f6c13032700 1 -- 172.21.15.17:0/2683491184 wait complete. 2023-10-06T04:44:05.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.682+0000 7f6c13032700 1 Processor -- start 2023-10-06T04:44:05.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.683+0000 7f6c13032700 1 -- start start 2023-10-06T04:44:05.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.683+0000 7f6c13032700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c0c06c810 0x7f6c0c068a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:05.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.683+0000 7f6c13032700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c0c0c9a20 0x7f6c0c15d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:05.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.683+0000 7f6c13032700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c0c159690 0x7f6c0c15f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:05.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.683+0000 7f6c13032700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c14cb60 con 0x7f6c0c06c810 2023-10-06T04:44:05.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.683+0000 7f6c13032700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c068fd0 con 0x7f6c0c159690 2023-10-06T04:44:05.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.683+0000 7f6c13032700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c15dfc0 con 0x7f6c0c0c9a20 2023-10-06T04:44:05.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.683+0000 7f6c10dce700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c0c06c810 0x7f6c0c068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:05.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.683+0000 7f6c10dce700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c0c06c810 0x7f6c0c068a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60306/0 (socket says 172.21.15.17:60306) 2023-10-06T04:44:05.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.683+0000 7f6c10dce700 1 -- 172.21.15.17:0/392217598 learned_addr learned my addr 172.21.15.17:0/392217598 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:05.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.684+0000 7f6c115cf700 1 --2- 172.21.15.17:0/392217598 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c0c159690 0x7f6c0c15f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:05.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.684+0000 7f6c0bfff700 1 --2- 172.21.15.17:0/392217598 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c0c0c9a20 0x7f6c0c15d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:05.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.684+0000 7f6c10dce700 1 -- 172.21.15.17:0/392217598 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c0c0c9a20 msgr2=0x7f6c0c15d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:05.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.684+0000 7f6c10dce700 1 --2- 172.21.15.17:0/392217598 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c0c0c9a20 0x7f6c0c15d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:05.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.684+0000 7f6c10dce700 1 -- 172.21.15.17:0/392217598 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c0c159690 msgr2=0x7f6c0c15f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:05.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.684+0000 7f6c10dce700 1 --2- 172.21.15.17:0/392217598 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c0c159690 0x7f6c0c15f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:05.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.684+0000 7f6c10dce700 1 -- 172.21.15.17:0/392217598 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c04009a20 con 0x7f6c0c06c810 2023-10-06T04:44:05.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.684+0000 7f6c115cf700 1 --2- 172.21.15.17:0/392217598 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c0c159690 0x7f6c0c15f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:05.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.684+0000 7f6c10dce700 1 --2- 172.21.15.17:0/392217598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c0c06c810 0x7f6c0c068a90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6c0400c0c0 tx=0x7f6c0400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:05.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.684+0000 7f6c08ff9700 1 -- 172.21.15.17:0/392217598 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0400cd60 con 0x7f6c0c06c810 2023-10-06T04:44:05.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.684+0000 7f6c08ff9700 1 -- 172.21.15.17:0/392217598 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0400f040 con 0x7f6c0c06c810 2023-10-06T04:44:05.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.684+0000 7f6c13032700 1 -- 172.21.15.17:0/392217598 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bf4009420 con 0x7f6c0c06c810 2023-10-06T04:44:05.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.684+0000 7f6c08ff9700 1 -- 172.21.15.17:0/392217598 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c04014690 con 0x7f6c0c06c810 2023-10-06T04:44:05.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.684+0000 7f6c13032700 1 -- 172.21.15.17:0/392217598 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c0c15e860 con 0x7f6c0c06c810 2023-10-06T04:44:05.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.685+0000 7f6c13032700 1 -- 172.21.15.17:0/392217598 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c0c15e3b0 con 0x7f6c0c06c810 2023-10-06T04:44:05.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.685+0000 7f6c08ff9700 1 -- 172.21.15.17:0/392217598 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6c04014a00 con 0x7f6c0c06c810 2023-10-06T04:44:05.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.686+0000 7f6c08ff9700 1 --2- 172.21.15.17:0/392217598 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6bec066f30 0x7f6bec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:05.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.686+0000 7f6c08ff9700 1 -- 172.21.15.17:0/392217598 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f6c040855a0 con 0x7f6c0c06c810 2023-10-06T04:44:05.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.686+0000 7f6c0bfff700 1 --2- 172.21.15.17:0/392217598 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6bec066f30 0x7f6bec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:05.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.686+0000 7f6c0bfff700 1 --2- 172.21.15.17:0/392217598 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6bec066f30 0x7f6bec0693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc0011e0 tx=0x7f6bfc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:05.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.690+0000 7f6c08ff9700 1 -- 172.21.15.17:0/392217598 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c04052660 con 0x7f6c0c06c810 2023-10-06T04:44:05.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:05.884+0000 7f6c13032700 1 -- 172.21.15.17:0/392217598 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6c0c0718b0 con 0x7f6c0c06c810 2023-10-06T04:44:06.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.540+0000 7f6c08ff9700 1 -- 172.21.15.17:0/392217598 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6c04014cb0 con 0x7f6c0c06c810 2023-10-06T04:44:06.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.544+0000 7f6c13032700 1 -- 172.21.15.17:0/392217598 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6bec066f30 msgr2=0x7f6bec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:06.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.544+0000 7f6c13032700 1 --2- 172.21.15.17:0/392217598 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6bec066f30 0x7f6bec0693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc0011e0 tx=0x7f6bfc009040 comp rx=0 tx=0).stop 2023-10-06T04:44:06.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.544+0000 7f6c13032700 1 -- 172.21.15.17:0/392217598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c0c06c810 msgr2=0x7f6c0c068a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:06.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.544+0000 7f6c13032700 1 --2- 172.21.15.17:0/392217598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c0c06c810 0x7f6c0c068a90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6c0400c0c0 tx=0x7f6c0400b040 comp rx=0 tx=0).stop 2023-10-06T04:44:06.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.544+0000 7f6c13032700 1 -- 172.21.15.17:0/392217598 shutdown_connections 2023-10-06T04:44:06.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.544+0000 7f6c13032700 1 --2- 172.21.15.17:0/392217598 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6bec066f30 0x7f6bec0693e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:06.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.544+0000 7f6c13032700 1 --2- 172.21.15.17:0/392217598 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c0c159690 0x7f6c0c15f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:06.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.544+0000 7f6c13032700 1 --2- 172.21.15.17:0/392217598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c0c06c810 0x7f6c0c068a90 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:06.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.544+0000 7f6c13032700 1 --2- 172.21.15.17:0/392217598 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c0c0c9a20 0x7f6c0c15d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:06.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.544+0000 7f6c13032700 1 -- 172.21.15.17:0/392217598 >> 172.21.15.17:0/392217598 conn(0x7f6c0c0cd4c0 msgr2=0x7f6c0c14f380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:06.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.544+0000 7f6c13032700 1 -- 172.21.15.17:0/392217598 shutdown_connections 2023-10-06T04:44:06.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.545+0000 7f6c13032700 1 -- 172.21.15.17:0/392217598 wait complete. 2023-10-06T04:44:06.548 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2023-10-06T04:44:06.562 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T04:44:06.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.691+0000 7f08737cb700 1 Processor -- start 2023-10-06T04:44:06.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.691+0000 7f08737cb700 1 -- start start 2023-10-06T04:44:06.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.692+0000 7f08737cb700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f086c0cbb30 0x7f086c15bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:06.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.692+0000 7f08737cb700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f086c0cc050 con 0x7f086c150360 2023-10-06T04:44:06.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.692+0000 7f08737cb700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f086c15b130 con 0x7f086c0cb6b0 2023-10-06T04:44:06.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.692+0000 7f08737cb700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f086c0cc330 con 0x7f086c0cbb30 2023-10-06T04:44:06.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.692+0000 7f0871567700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f086c150360 0x7f086c150730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55836/0 (socket says 172.21.15.17:55836) 2023-10-06T04:44:06.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.692+0000 7f0871567700 1 -- 172.21.15.17:0/1965554592 learned_addr learned my addr 172.21.15.17:0/1965554592 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:06.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.692+0000 7f086bfff700 1 -- 172.21.15.17:0/1965554592 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4287574714 0 0) 0x7f086c0cc050 con 0x7f086c150360 2023-10-06T04:44:06.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.692+0000 7f0871d68700 1 --2- 172.21.15.17:0/1965554592 >> v2:172.21.15.136:3300/0 conn(0x7f086c0cbb30 0x7f086c15bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:06.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.692+0000 7f086bfff700 1 -- 172.21.15.17:0/1965554592 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0854003570 con 0x7f086c150360 2023-10-06T04:44:06.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.692+0000 7f086bfff700 1 -- 172.21.15.17:0/1965554592 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1173444415 0 0) 0x7f0854003570 con 0x7f086c150360 2023-10-06T04:44:06.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.692+0000 7f086bfff700 1 -- 172.21.15.17:0/1965554592 >> v2:172.21.15.136:3300/0 conn(0x7f086c0cbb30 msgr2=0x7f086c15bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:06.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.692+0000 7f086bfff700 1 --2- 172.21.15.17:0/1965554592 >> v2:172.21.15.136:3300/0 conn(0x7f086c0cbb30 0x7f086c15bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:06.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.692+0000 7f086bfff700 1 -- 172.21.15.17:0/1965554592 >> v1:172.21.15.136:6789/0 conn(0x7f086c0cb6b0 legacy=0x7f086c0cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:06.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.692+0000 7f086bfff700 1 -- 172.21.15.17:0/1965554592 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086c15b410 con 0x7f086c150360 2023-10-06T04:44:06.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.692+0000 7f086bfff700 1 -- 172.21.15.17:0/1965554592 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4268781140 0 0) 0x7f0864001470 con 0x7f086c150360 2023-10-06T04:44:06.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.692+0000 7f086bfff700 1 -- 172.21.15.17:0/1965554592 >> v1:172.21.15.17:6789/0 conn(0x7f086c150360 legacy=0x7f086c150730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:06.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.692+0000 7f086bfff700 1 --2- 172.21.15.17:0/1965554592 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0854003a60 0x7f0854003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:06.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.692+0000 7f086bfff700 1 --2- 172.21.15.17:0/1965554592 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0854004810 0x7f0854004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:06.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.693+0000 7f086bfff700 1 --2- 172.21.15.17:0/1965554592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08540051c0 0x7f085400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:06.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.693+0000 7f086bfff700 1 -- 172.21.15.17:0/1965554592 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c0cc330 con 0x7f08540051c0 2023-10-06T04:44:06.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.693+0000 7f086bfff700 1 -- 172.21.15.17:0/1965554592 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085400c160 con 0x7f0854004810 2023-10-06T04:44:06.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.693+0000 7f086bfff700 1 -- 172.21.15.17:0/1965554592 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f085400c320 con 0x7f0854003a60 2023-10-06T04:44:06.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.693+0000 7f0871d68700 1 --2- 172.21.15.17:0/1965554592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08540051c0 0x7f085400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:06.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.693+0000 7f0870d66700 1 --2- 172.21.15.17:0/1965554592 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0854004810 0x7f0854004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:06.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.693+0000 7f0871567700 1 --2- 172.21.15.17:0/1965554592 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0854003a60 0x7f0854003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:06.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.693+0000 7f0871d68700 1 -- 172.21.15.17:0/1965554592 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0854003a60 msgr2=0x7f0854003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:06.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.693+0000 7f0871d68700 1 --2- 172.21.15.17:0/1965554592 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0854003a60 0x7f0854003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:06.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.693+0000 7f0871d68700 1 -- 172.21.15.17:0/1965554592 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0854004810 msgr2=0x7f0854004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:06.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.693+0000 7f0871d68700 1 --2- 172.21.15.17:0/1965554592 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0854004810 0x7f0854004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:06.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.693+0000 7f0871d68700 1 -- 172.21.15.17:0/1965554592 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0854003570 con 0x7f08540051c0 2023-10-06T04:44:06.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.693+0000 7f0871d68700 1 -- 172.21.15.17:0/1965554592 reap_dead start 2023-10-06T04:44:06.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.693+0000 7f0871d68700 1 --2- 172.21.15.17:0/1965554592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08540051c0 0x7f085400ba60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f085c00e210 tx=0x7f085c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=691d2a25cf011367 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:06.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.693+0000 7f086bfff700 1 -- 172.21.15.17:0/1965554592 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c00eac0 con 0x7f08540051c0 2023-10-06T04:44:06.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.693+0000 7f086bfff700 1 -- 172.21.15.17:0/1965554592 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085c00f040 con 0x7f08540051c0 2023-10-06T04:44:06.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.693+0000 7f086bfff700 1 -- 172.21.15.17:0/1965554592 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c00ee70 con 0x7f08540051c0 2023-10-06T04:44:06.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.694+0000 7f08737cb700 1 -- 172.21.15.17:0/1965554592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08540051c0 msgr2=0x7f085400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:06.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.694+0000 7f08737cb700 1 --2- 172.21.15.17:0/1965554592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08540051c0 0x7f085400ba60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f085c00e210 tx=0x7f085c00b040 comp rx=0 tx=0).stop 2023-10-06T04:44:06.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.694+0000 7f08737cb700 1 -- 172.21.15.17:0/1965554592 shutdown_connections 2023-10-06T04:44:06.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.694+0000 7f08737cb700 1 --2- 172.21.15.17:0/1965554592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08540051c0 0x7f085400ba60 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:06.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.694+0000 7f08737cb700 1 -- 172.21.15.17:0/1965554592 >> 172.21.15.17:0/1965554592 conn(0x7f086c08a180 msgr2=0x7f086c099aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:06.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.694+0000 7f08737cb700 1 -- 172.21.15.17:0/1965554592 shutdown_connections 2023-10-06T04:44:06.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.694+0000 7f08737cb700 1 -- 172.21.15.17:0/1965554592 wait complete. 2023-10-06T04:44:06.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.695+0000 7f08737cb700 1 Processor -- start 2023-10-06T04:44:06.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.695+0000 7f08737cb700 1 -- start start 2023-10-06T04:44:06.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.696+0000 7f08737cb700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08540051c0 0x7f086c14ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:06.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.696+0000 7f08737cb700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f086c1581b0 0x7f086c0b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:06.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.696+0000 7f08737cb700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f086c14f680 0x7f086c14fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:06.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.696+0000 7f08737cb700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c150060 con 0x7f08540051c0 2023-10-06T04:44:06.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.696+0000 7f08737cb700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c16bb60 con 0x7f086c14f680 2023-10-06T04:44:06.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.696+0000 7f08737cb700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086c16af50 con 0x7f086c1581b0 2023-10-06T04:44:06.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.696+0000 7f0871567700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08540051c0 0x7f086c14ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:06.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.696+0000 7f0871567700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08540051c0 0x7f086c14ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60320/0 (socket says 172.21.15.17:60320) 2023-10-06T04:44:06.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.696+0000 7f0871567700 1 -- 172.21.15.17:0/2676742057 learned_addr learned my addr 172.21.15.17:0/2676742057 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:06.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.696+0000 7f0871d68700 1 --2- 172.21.15.17:0/2676742057 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f086c14f680 0x7f086c14fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:06.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.696+0000 7f0870d66700 1 --2- 172.21.15.17:0/2676742057 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f086c1581b0 0x7f086c0b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:06.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.696+0000 7f0871567700 1 -- 172.21.15.17:0/2676742057 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f086c1581b0 msgr2=0x7f086c0b5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:06.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.696+0000 7f0871567700 1 --2- 172.21.15.17:0/2676742057 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f086c1581b0 0x7f086c0b5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:06.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.696+0000 7f0871567700 1 -- 172.21.15.17:0/2676742057 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f086c14f680 msgr2=0x7f086c14fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:06.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.696+0000 7f0871567700 1 --2- 172.21.15.17:0/2676742057 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f086c14f680 0x7f086c14fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:06.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.696+0000 7f0871567700 1 -- 172.21.15.17:0/2676742057 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086c16b230 con 0x7f08540051c0 2023-10-06T04:44:06.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.696+0000 7f0871567700 1 --2- 172.21.15.17:0/2676742057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08540051c0 0x7f086c14ecb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f086400e800 tx=0x7f0864000cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:06.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.697+0000 7f08697fa700 1 -- 172.21.15.17:0/2676742057 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0864012500 con 0x7f08540051c0 2023-10-06T04:44:06.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.697+0000 7f08697fa700 1 -- 172.21.15.17:0/2676742057 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0864010040 con 0x7f08540051c0 2023-10-06T04:44:06.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.697+0000 7f08737cb700 1 -- 172.21.15.17:0/2676742057 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f086c16b510 con 0x7f08540051c0 2023-10-06T04:44:06.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.697+0000 7f08697fa700 1 -- 172.21.15.17:0/2676742057 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08640128b0 con 0x7f08540051c0 2023-10-06T04:44:06.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.697+0000 7f08737cb700 1 -- 172.21.15.17:0/2676742057 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f086c0b6380 con 0x7f08540051c0 2023-10-06T04:44:06.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.698+0000 7f08737cb700 1 -- 172.21.15.17:0/2676742057 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f086c16b9b0 con 0x7f08540051c0 2023-10-06T04:44:06.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.698+0000 7f08697fa700 1 -- 172.21.15.17:0/2676742057 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0864012c60 con 0x7f08540051c0 2023-10-06T04:44:06.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.698+0000 7f08697fa700 1 --2- 172.21.15.17:0/2676742057 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0858066f30 0x7f08580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:06.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.699+0000 7f08697fa700 1 -- 172.21.15.17:0/2676742057 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f0864083950 con 0x7f08540051c0 2023-10-06T04:44:06.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.699+0000 7f0870d66700 1 --2- 172.21.15.17:0/2676742057 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0858066f30 0x7f08580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:06.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.699+0000 7f0870d66700 1 --2- 172.21.15.17:0/2676742057 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0858066f30 0x7f08580693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f086c15bd80 tx=0x7f0860007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:06.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.703+0000 7f08697fa700 1 -- 172.21.15.17:0/2676742057 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0864050be0 con 0x7f08540051c0 2023-10-06T04:44:06.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:06.899+0000 7f08737cb700 1 -- 172.21.15.17:0/2676742057 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f086c0718b0 con 0x7f08540051c0 2023-10-06T04:44:07.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.543+0000 7f08697fa700 1 -- 172.21.15.17:0/2676742057 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0864019070 con 0x7f08540051c0 2023-10-06T04:44:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.546+0000 7f08737cb700 1 -- 172.21.15.17:0/2676742057 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0858066f30 msgr2=0x7f08580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.546+0000 7f08737cb700 1 --2- 172.21.15.17:0/2676742057 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0858066f30 0x7f08580693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f086c15bd80 tx=0x7f0860007d30 comp rx=0 tx=0).stop 2023-10-06T04:44:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.546+0000 7f08737cb700 1 -- 172.21.15.17:0/2676742057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08540051c0 msgr2=0x7f086c14ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.546+0000 7f08737cb700 1 --2- 172.21.15.17:0/2676742057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08540051c0 0x7f086c14ecb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f086400e800 tx=0x7f0864000cf0 comp rx=0 tx=0).stop 2023-10-06T04:44:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.547+0000 7f08737cb700 1 -- 172.21.15.17:0/2676742057 shutdown_connections 2023-10-06T04:44:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.547+0000 7f08737cb700 1 --2- 172.21.15.17:0/2676742057 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0858066f30 0x7f08580693e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.547+0000 7f08737cb700 1 --2- 172.21.15.17:0/2676742057 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f086c14f680 0x7f086c14fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.547+0000 7f08737cb700 1 --2- 172.21.15.17:0/2676742057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08540051c0 0x7f086c14ecb0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.547+0000 7f08737cb700 1 --2- 172.21.15.17:0/2676742057 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f086c1581b0 0x7f086c0b5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.547+0000 7f08737cb700 1 -- 172.21.15.17:0/2676742057 >> 172.21.15.17:0/2676742057 conn(0x7f086c08a180 msgr2=0x7f086c15c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:07.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.547+0000 7f08737cb700 1 -- 172.21.15.17:0/2676742057 shutdown_connections 2023-10-06T04:44:07.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.547+0000 7f08737cb700 1 -- 172.21.15.17:0/2676742057 wait complete. 2023-10-06T04:44:07.550 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2023-10-06T04:44:07.564 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T04:44:07.564 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T04:44:07.565 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T04:44:07.565 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:44:07.565 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T04:44:07.565 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T04:44:07.565 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T04:44:07.565 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:44:07.565 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T04:44:07.566 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T04:44:07.566 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T04:44:07.566 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:44:07.566 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T04:44:07.566 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T04:44:07.566 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T04:44:07.566 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:44:07.575 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T04:44:07.575 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T04:44:07.575 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T04:44:07.576 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T04:44:07.579 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T04:44:07.579 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T04:44:07.580 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T04:44:07.580 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T04:44:07.617 INFO:tasks.ceph.mds.a:Started 2023-10-06T04:44:07.617 DEBUG:teuthology.parallel:result is None 2023-10-06T04:44:07.618 INFO:tasks.ceph.mds.c:Started 2023-10-06T04:44:07.618 DEBUG:teuthology.parallel:result is None 2023-10-06T04:44:07.622 INFO:tasks.ceph.mds.b:Started 2023-10-06T04:44:07.623 DEBUG:teuthology.parallel:result is None 2023-10-06T04:44:07.623 INFO:tasks.ceph.mds.d:Started 2023-10-06T04:44:07.623 DEBUG:teuthology.parallel:result is None 2023-10-06T04:44:07.624 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T04:44:07.707 INFO:tasks.ceph.mds.b.smithi136.stdout:starting mds.b at 2023-10-06T04:44:07.707 INFO:tasks.ceph.mds.d.smithi136.stdout:starting mds.d at 2023-10-06T04:44:07.708 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2023-10-06T04:44:07.709 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2023-10-06T04:44:07.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.760+0000 7f842216a700 1 Processor -- start 2023-10-06T04:44:07.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.760+0000 7f842216a700 1 -- start start 2023-10-06T04:44:07.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.760+0000 7f842216a700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f841c15d610 0x7f841c0cac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:07.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.760+0000 7f842216a700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f841c1509a0 0x7f841c15b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:07.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.760+0000 7f842216a700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f841c15aed0 con 0x7f841c0cb1b0 2023-10-06T04:44:07.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.760+0000 7f842216a700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f841c0cb680 con 0x7f841c1509a0 2023-10-06T04:44:07.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.760+0000 7f842216a700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f841c0cb960 con 0x7f841c15d610 2023-10-06T04:44:07.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.761+0000 7f841bfff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f841c1509a0 0x7f841c15b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:07.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.761+0000 7f841b7fe700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f841c15d610 0x7f841c0cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:07.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.761+0000 7f841affd700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f841c0cb1b0 0x7f841c150290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.17:47748/0 (socket says 172.21.15.17:47748) 2023-10-06T04:44:07.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.761+0000 7f841affd700 1 -- 172.21.15.17:0/3029708571 learned_addr learned my addr 172.21.15.17:0/3029708571 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:07.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.761+0000 7f841bfff700 1 -- 172.21.15.17:0/3029708571 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f841c15d610 msgr2=0x7f841c0cac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:07.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.761+0000 7f841bfff700 1 --2- 172.21.15.17:0/3029708571 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f841c15d610 0x7f841c0cac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:07.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.761+0000 7f841bfff700 1 -- 172.21.15.17:0/3029708571 >> v1:172.21.15.136:6789/0 conn(0x7f841c0cb1b0 legacy=0x7f841c150290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:07.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.761+0000 7f841bfff700 1 -- 172.21.15.17:0/3029708571 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f841c0cbc40 con 0x7f841c1509a0 2023-10-06T04:44:07.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.761+0000 7f841a7fc700 1 -- 172.21.15.17:0/3029708571 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 189020481 0 0) 0x7f841c15aed0 con 0x7f841c0cb1b0 2023-10-06T04:44:07.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.761+0000 7f841b7fe700 1 --2- 172.21.15.17:0/3029708571 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f841c15d610 0x7f841c0cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:44:07.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.761+0000 7f841bfff700 1 --2- 172.21.15.17:0/3029708571 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f841c1509a0 0x7f841c15b380 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8414009e60 tx=0x7f8414009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8da4cac0458e81c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:07.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.761+0000 7f841a7fc700 1 -- 172.21.15.17:0/3029708571 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841400e070 con 0x7f841c1509a0 2023-10-06T04:44:07.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.761+0000 7f841a7fc700 1 -- 172.21.15.17:0/3029708571 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841400bb60 con 0x7f841c1509a0 2023-10-06T04:44:07.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.761+0000 7f841a7fc700 1 -- 172.21.15.17:0/3029708571 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8414012430 con 0x7f841c1509a0 2023-10-06T04:44:07.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.762+0000 7f842216a700 1 -- 172.21.15.17:0/3029708571 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f841c1509a0 msgr2=0x7f841c15b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:07.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.762+0000 7f842216a700 1 --2- 172.21.15.17:0/3029708571 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f841c1509a0 0x7f841c15b380 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8414009e60 tx=0x7f8414009780 comp rx=0 tx=0).stop 2023-10-06T04:44:07.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.762+0000 7f842216a700 1 -- 172.21.15.17:0/3029708571 shutdown_connections 2023-10-06T04:44:07.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.762+0000 7f842216a700 1 --2- 172.21.15.17:0/3029708571 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f841c1509a0 0x7f841c15b380 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:07.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.762+0000 7f842216a700 1 --2- 172.21.15.17:0/3029708571 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f841c15d610 0x7f841c0cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:07.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.762+0000 7f842216a700 1 -- 172.21.15.17:0/3029708571 >> 172.21.15.17:0/3029708571 conn(0x7f841c099960 msgr2=0x7f841c06cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:07.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.762+0000 7f842216a700 1 -- 172.21.15.17:0/3029708571 shutdown_connections 2023-10-06T04:44:07.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.762+0000 7f842216a700 1 -- 172.21.15.17:0/3029708571 wait complete. 2023-10-06T04:44:07.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.763+0000 7f842216a700 1 Processor -- start 2023-10-06T04:44:07.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.763+0000 7f842216a700 1 -- start start 2023-10-06T04:44:07.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.764+0000 7f842216a700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f841c0cb1b0 0x7f841c0b1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:07.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.764+0000 7f842216a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f841c1509a0 0x7f841c0c3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:07.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.764+0000 7f842216a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f841c15d610 0x7f841c16cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:07.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.764+0000 7f842216a700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841c0b2ac0 con 0x7f841c15d610 2023-10-06T04:44:07.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.764+0000 7f842216a700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841c0b1a20 con 0x7f841c1509a0 2023-10-06T04:44:07.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.764+0000 7f842216a700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f841c0b1d00 con 0x7f841c0cb1b0 2023-10-06T04:44:07.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.764+0000 7f841bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f841c15d610 0x7f841c16cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:07.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.764+0000 7f841bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f841c15d610 0x7f841c16cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60358/0 (socket says 172.21.15.17:60358) 2023-10-06T04:44:07.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.764+0000 7f841bfff700 1 -- 172.21.15.17:0/1009545973 learned_addr learned my addr 172.21.15.17:0/1009545973 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:07.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.764+0000 7f841b7fe700 1 --2- 172.21.15.17:0/1009545973 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f841c0cb1b0 0x7f841c0b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:07.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.764+0000 7f841affd700 1 --2- 172.21.15.17:0/1009545973 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f841c1509a0 0x7f841c0c3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:07.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.765+0000 7f841b7fe700 1 -- 172.21.15.17:0/1009545973 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f841c1509a0 msgr2=0x7f841c0c3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:07.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.765+0000 7f841b7fe700 1 --2- 172.21.15.17:0/1009545973 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f841c1509a0 0x7f841c0c3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:07.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.765+0000 7f841b7fe700 1 -- 172.21.15.17:0/1009545973 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f841c15d610 msgr2=0x7f841c16cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:07.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.765+0000 7f841b7fe700 1 --2- 172.21.15.17:0/1009545973 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f841c15d610 0x7f841c16cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:07.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.765+0000 7f841b7fe700 1 -- 172.21.15.17:0/1009545973 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f840c0093c0 con 0x7f841c0cb1b0 2023-10-06T04:44:07.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.765+0000 7f841b7fe700 1 --2- 172.21.15.17:0/1009545973 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f841c0cb1b0 0x7f841c0b1120 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f840c00ea80 tx=0x7f840c009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:07.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.765+0000 7f84137fe700 1 -- 172.21.15.17:0/1009545973 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840c00eec0 con 0x7f841c0cb1b0 2023-10-06T04:44:07.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.765+0000 7f84137fe700 1 -- 172.21.15.17:0/1009545973 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f840c005a00 con 0x7f841c0cb1b0 2023-10-06T04:44:07.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.765+0000 7f84137fe700 1 -- 172.21.15.17:0/1009545973 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840c005da0 con 0x7f841c0cb1b0 2023-10-06T04:44:07.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.765+0000 7f842216a700 1 -- 172.21.15.17:0/1009545973 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8414009a20 con 0x7f841c0cb1b0 2023-10-06T04:44:07.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.765+0000 7f842216a700 1 -- 172.21.15.17:0/1009545973 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f841c0b22c0 con 0x7f841c0cb1b0 2023-10-06T04:44:07.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.766+0000 7f842216a700 1 -- 172.21.15.17:0/1009545973 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f841c0b2910 con 0x7f841c0cb1b0 2023-10-06T04:44:07.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.767+0000 7f84137fe700 1 -- 172.21.15.17:0/1009545973 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f840c00ca00 con 0x7f841c0cb1b0 2023-10-06T04:44:07.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.767+0000 7f84137fe700 1 --2- 172.21.15.17:0/1009545973 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f83fc066f30 0x7f83fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:07.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.767+0000 7f84137fe700 1 -- 172.21.15.17:0/1009545973 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f840c084950 con 0x7f841c0cb1b0 2023-10-06T04:44:07.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.767+0000 7f841affd700 1 --2- 172.21.15.17:0/1009545973 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f83fc066f30 0x7f83fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:07.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.767+0000 7f841affd700 1 --2- 172.21.15.17:0/1009545973 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f83fc066f30 0x7f83fc0693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f841c16cef0 tx=0x7f8404007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:07.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.771+0000 7f84137fe700 1 -- 172.21.15.17:0/1009545973 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f840c051de0 con 0x7f841c0cb1b0 2023-10-06T04:44:07.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:07.983+0000 7f842216a700 1 -- 172.21.15.17:0/1009545973 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f841c0b1e40 con 0x7f841c0cb1b0 2023-10-06T04:44:08.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.564+0000 7f84137fe700 1 -- 172.21.15.17:0/1009545973 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) v1 ==== 97+0+0 (secure 0 0 0) 0x7f841c0b1e40 con 0x7f841c0cb1b0 2023-10-06T04:44:08.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.567+0000 7f842216a700 1 -- 172.21.15.17:0/1009545973 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f83fc066f30 msgr2=0x7f83fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:08.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.567+0000 7f842216a700 1 --2- 172.21.15.17:0/1009545973 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f83fc066f30 0x7f83fc0693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f841c16cef0 tx=0x7f8404007d30 comp rx=0 tx=0).stop 2023-10-06T04:44:08.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.567+0000 7f842216a700 1 -- 172.21.15.17:0/1009545973 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f841c0cb1b0 msgr2=0x7f841c0b1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:08.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.567+0000 7f842216a700 1 --2- 172.21.15.17:0/1009545973 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f841c0cb1b0 0x7f841c0b1120 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f840c00ea80 tx=0x7f840c009120 comp rx=0 tx=0).stop 2023-10-06T04:44:08.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.567+0000 7f842216a700 1 -- 172.21.15.17:0/1009545973 shutdown_connections 2023-10-06T04:44:08.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.567+0000 7f842216a700 1 --2- 172.21.15.17:0/1009545973 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f83fc066f30 0x7f83fc0693e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:08.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.567+0000 7f842216a700 1 --2- 172.21.15.17:0/1009545973 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f841c15d610 0x7f841c16cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:08.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.567+0000 7f842216a700 1 --2- 172.21.15.17:0/1009545973 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f841c0cb1b0 0x7f841c0b1120 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:08.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.567+0000 7f842216a700 1 --2- 172.21.15.17:0/1009545973 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f841c1509a0 0x7f841c0c3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:08.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.567+0000 7f842216a700 1 -- 172.21.15.17:0/1009545973 >> 172.21.15.17:0/1009545973 conn(0x7f841c099960 msgr2=0x7f841c06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:08.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.567+0000 7f842216a700 1 -- 172.21.15.17:0/1009545973 shutdown_connections 2023-10-06T04:44:08.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.567+0000 7f842216a700 1 -- 172.21.15.17:0/1009545973 wait complete. 2023-10-06T04:44:08.570 INFO:teuthology.orchestra.run.smithi017.stderr: removed all blocklist entries 2023-10-06T04:44:08.583 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T04:44:08.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.703+0000 7f5d86c9e700 1 Processor -- start 2023-10-06T04:44:08.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.703+0000 7f5d86c9e700 1 -- start start 2023-10-06T04:44:08.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.703+0000 7f5d86c9e700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5d800cd760 0x7f5d800ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:08.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.703+0000 7f5d86c9e700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f5d800ce840 0x7f5d800b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:08.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.703+0000 7f5d86c9e700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d800cfc80 con 0x7f5d80159630 2023-10-06T04:44:08.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.703+0000 7f5d86c9e700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d800cf070 con 0x7f5d800ce840 2023-10-06T04:44:08.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.704+0000 7f5d86c9e700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d800cf350 con 0x7f5d800cd760 2023-10-06T04:44:08.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.704+0000 7f5d7ffff700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5d800cd760 0x7f5d800ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:08.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.704+0000 7f5d8523b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f5d800ce840 0x7f5d800b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:08.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.704+0000 7f5d8523b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f5d800ce840 0x7f5d800b02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.17:47282/0 (socket says 172.21.15.17:47282) 2023-10-06T04:44:08.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.704+0000 7f5d84a3a700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f5d80159630 0x7f5d800cd050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.17:47758/0 (socket says 172.21.15.17:47758) 2023-10-06T04:44:08.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.704+0000 7f5d7ffff700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5d800cd760 0x7f5d800ce300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.17:48140/0 (socket says 172.21.15.17:48140) 2023-10-06T04:44:08.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.704+0000 7f5d8523b700 1 -- 172.21.15.17:0/3711887194 learned_addr learned my addr 172.21.15.17:0/3711887194 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:08.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.704+0000 7f5d7ffff700 1 -- 172.21.15.17:0/3711887194 >> v2:172.21.15.136:3300/0 conn(0x7f5d800ce840 msgr2=0x7f5d800b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:08.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.704+0000 7f5d7ffff700 1 --2- 172.21.15.17:0/3711887194 >> v2:172.21.15.136:3300/0 conn(0x7f5d800ce840 0x7f5d800b02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:08.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.704+0000 7f5d7ffff700 1 -- 172.21.15.17:0/3711887194 >> v1:172.21.15.136:6789/0 conn(0x7f5d80159630 legacy=0x7f5d800cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:08.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.704+0000 7f5d7ffff700 1 -- 172.21.15.17:0/3711887194 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d800cf630 con 0x7f5d800cd760 2023-10-06T04:44:08.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.704+0000 7f5d8523b700 1 --2- 172.21.15.17:0/3711887194 >> v2:172.21.15.136:3300/0 conn(0x7f5d800ce840 0x7f5d800b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:44:08.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.705+0000 7f5d7ffff700 1 --2- 172.21.15.17:0/3711887194 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5d800cd760 0x7f5d800ce300 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5d70009e60 tx=0x7f5d70009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37eb09aaefe40916 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:08.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.705+0000 7f5d7f7fe700 1 -- 172.21.15.17:0/3711887194 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7000e070 con 0x7f5d800cd760 2023-10-06T04:44:08.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.705+0000 7f5d7f7fe700 1 -- 172.21.15.17:0/3711887194 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7000bb60 con 0x7f5d800cd760 2023-10-06T04:44:08.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.705+0000 7f5d7f7fe700 1 -- 172.21.15.17:0/3711887194 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d70012430 con 0x7f5d800cd760 2023-10-06T04:44:08.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.705+0000 7f5d86c9e700 1 -- 172.21.15.17:0/3711887194 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5d800cd760 msgr2=0x7f5d800ce300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:08.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.705+0000 7f5d86c9e700 1 --2- 172.21.15.17:0/3711887194 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5d800cd760 0x7f5d800ce300 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5d70009e60 tx=0x7f5d70009780 comp rx=0 tx=0).stop 2023-10-06T04:44:08.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.705+0000 7f5d86c9e700 1 -- 172.21.15.17:0/3711887194 shutdown_connections 2023-10-06T04:44:08.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.705+0000 7f5d86c9e700 1 --2- 172.21.15.17:0/3711887194 >> v2:172.21.15.136:3300/0 conn(0x7f5d800ce840 0x7f5d800b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:08.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.705+0000 7f5d86c9e700 1 --2- 172.21.15.17:0/3711887194 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5d800cd760 0x7f5d800ce300 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:08.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.705+0000 7f5d86c9e700 1 -- 172.21.15.17:0/3711887194 >> 172.21.15.17:0/3711887194 conn(0x7f5d8006cff0 msgr2=0x7f5d8006d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:08.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.705+0000 7f5d86c9e700 1 -- 172.21.15.17:0/3711887194 shutdown_connections 2023-10-06T04:44:08.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.705+0000 7f5d86c9e700 1 -- 172.21.15.17:0/3711887194 wait complete. 2023-10-06T04:44:08.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.706+0000 7f5d86c9e700 1 Processor -- start 2023-10-06T04:44:08.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.707+0000 7f5d86c9e700 1 -- start start 2023-10-06T04:44:08.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.707+0000 7f5d86c9e700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5d800cd760 0x7f5d8014e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:08.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.707+0000 7f5d86c9e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d800ce840 0x7f5d80153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:08.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.707+0000 7f5d86c9e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d80159630 0x7f5d800c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:08.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.707+0000 7f5d86c9e700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d800b33f0 con 0x7f5d80159630 2023-10-06T04:44:08.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.707+0000 7f5d86c9e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d80153a40 con 0x7f5d800ce840 2023-10-06T04:44:08.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.707+0000 7f5d86c9e700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d80153d20 con 0x7f5d800cd760 2023-10-06T04:44:08.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.708+0000 7f5d8523b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d80159630 0x7f5d800c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:08.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.708+0000 7f5d8523b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d80159630 0x7f5d800c89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60370/0 (socket says 172.21.15.17:60370) 2023-10-06T04:44:08.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.708+0000 7f5d8523b700 1 -- 172.21.15.17:0/1899987347 learned_addr learned my addr 172.21.15.17:0/1899987347 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:08.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.708+0000 7f5d84a3a700 1 --2- 172.21.15.17:0/1899987347 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5d800cd760 0x7f5d8014e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:08.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.708+0000 7f5d7ffff700 1 --2- 172.21.15.17:0/1899987347 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d800ce840 0x7f5d80153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:08.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.708+0000 7f5d8523b700 1 -- 172.21.15.17:0/1899987347 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5d800cd760 msgr2=0x7f5d8014e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:08.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.708+0000 7f5d8523b700 1 --2- 172.21.15.17:0/1899987347 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5d800cd760 0x7f5d8014e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:08.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.708+0000 7f5d8523b700 1 -- 172.21.15.17:0/1899987347 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d800ce840 msgr2=0x7f5d80153060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:08.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.708+0000 7f5d8523b700 1 --2- 172.21.15.17:0/1899987347 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d800ce840 0x7f5d80153060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:08.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.708+0000 7f5d8523b700 1 -- 172.21.15.17:0/1899987347 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d680094f0 con 0x7f5d80159630 2023-10-06T04:44:08.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.708+0000 7f5d7ffff700 1 --2- 172.21.15.17:0/1899987347 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d800ce840 0x7f5d80153060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:08.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.708+0000 7f5d84a3a700 1 --2- 172.21.15.17:0/1899987347 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5d800cd760 0x7f5d8014e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:08.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.708+0000 7f5d8523b700 1 --2- 172.21.15.17:0/1899987347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d80159630 0x7f5d800c89d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5d6800ec50 tx=0x7f5d68009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:08.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.708+0000 7f5d7cff9700 1 -- 172.21.15.17:0/1899987347 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6800c9d0 con 0x7f5d80159630 2023-10-06T04:44:08.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.708+0000 7f5d7cff9700 1 -- 172.21.15.17:0/1899987347 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6800cb30 con 0x7f5d80159630 2023-10-06T04:44:08.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.708+0000 7f5d7cff9700 1 -- 172.21.15.17:0/1899987347 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d68013470 con 0x7f5d80159630 2023-10-06T04:44:08.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.708+0000 7f5d86c9e700 1 -- 172.21.15.17:0/1899987347 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d70009a20 con 0x7f5d80159630 2023-10-06T04:44:08.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.708+0000 7f5d86c9e700 1 -- 172.21.15.17:0/1899987347 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d801542e0 con 0x7f5d80159630 2023-10-06T04:44:08.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.709+0000 7f5d86c9e700 1 -- 172.21.15.17:0/1899987347 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d800b3560 con 0x7f5d80159630 2023-10-06T04:44:08.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.710+0000 7f5d7cff9700 1 -- 172.21.15.17:0/1899987347 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5d680138a0 con 0x7f5d80159630 2023-10-06T04:44:08.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.710+0000 7f5d7cff9700 1 --2- 172.21.15.17:0/1899987347 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5d60066f30 0x7f5d600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:08.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.710+0000 7f5d7cff9700 1 -- 172.21.15.17:0/1899987347 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f5d680846b0 con 0x7f5d80159630 2023-10-06T04:44:08.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.710+0000 7f5d84a3a700 1 --2- 172.21.15.17:0/1899987347 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5d60066f30 0x7f5d600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:08.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.710+0000 7f5d84a3a700 1 --2- 172.21.15.17:0/1899987347 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5d60066f30 0x7f5d600693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5d78007fd0 tx=0x7f5d78007e10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:08.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.714+0000 7f5d7cff9700 1 -- 172.21.15.17:0/1899987347 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5d68051b10 con 0x7f5d80159630 2023-10-06T04:44:08.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.989+0000 7f5d86c9e700 1 -- 172.21.15.17:0/1899987347 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f5d80063ff0 con 0x7f5d80159630 2023-10-06T04:44:08.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.990+0000 7f5d7cff9700 1 -- 172.21.15.17:0/1899987347 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f5d68055130 con 0x7f5d80159630 2023-10-06T04:44:08.992 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:08.992 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-06T04:44:08.992 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_dump": [ 2023-10-06T04:44:08.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:44:08.992 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.a", 2023-10-06T04:44:08.992 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQA4kB9lXdBsAxAA6fRUIR5ynZ+F2vjAKKVsGw==", 2023-10-06T04:44:08.992 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-10-06T04:44:08.992 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-10-06T04:44:08.992 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-10-06T04:44:08.992 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-10-06T04:44:08.992 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-10-06T04:44:08.992 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-06T04:44:08.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-06T04:44:08.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:44:08.993 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.b", 2023-10-06T04:44:08.993 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQA4kB9lvsXCDhAArUD6ZmTH/PP8IPww5dyovg==", 2023-10-06T04:44:08.993 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-10-06T04:44:08.993 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-10-06T04:44:08.993 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-10-06T04:44:08.993 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-10-06T04:44:08.993 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-10-06T04:44:08.993 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-06T04:44:08.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-06T04:44:08.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:44:08.994 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.c", 2023-10-06T04:44:08.994 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQA4kB9lRMxQChAAAnrAIAcduaTBhlOc1iaGiw==", 2023-10-06T04:44:08.994 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-10-06T04:44:08.994 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-10-06T04:44:08.994 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-10-06T04:44:08.994 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-10-06T04:44:08.994 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-10-06T04:44:08.994 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-06T04:44:08.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-06T04:44:08.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:44:08.996 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.d", 2023-10-06T04:44:08.996 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQA4kB9lPXqDFRAAoVkfsuGu0iWkL4H9o+c1sg==", 2023-10-06T04:44:08.996 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-10-06T04:44:08.996 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-10-06T04:44:08.996 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-10-06T04:44:08.996 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-10-06T04:44:08.996 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-10-06T04:44:08.996 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-06T04:44:08.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-06T04:44:08.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:44:08.997 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.0", 2023-10-06T04:44:08.997 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQA5kB9l6mtfNxAAETCAvqNWgLY8r5ydHqOzuA==", 2023-10-06T04:44:08.997 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-10-06T04:44:08.997 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-10-06T04:44:08.997 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-10-06T04:44:08.997 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-10-06T04:44:08.997 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-06T04:44:08.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-06T04:44:08.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:44:08.997 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.1", 2023-10-06T04:44:08.997 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQA8kB9loWweNRAA2nU24vbVpIm7YI8YI9hIVg==", 2023-10-06T04:44:08.998 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-10-06T04:44:08.998 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-10-06T04:44:08.998 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-10-06T04:44:08.998 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-10-06T04:44:08.998 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-06T04:44:08.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-06T04:44:08.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:44:08.998 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.2", 2023-10-06T04:44:08.998 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQA/kB9lRZI3MxAAKtPseh6IGMkGVesI2zOqkQ==", 2023-10-06T04:44:08.998 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-10-06T04:44:08.998 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-10-06T04:44:08.998 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-10-06T04:44:08.999 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-10-06T04:44:08.999 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-06T04:44:08.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-06T04:44:08.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:44:08.999 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.3", 2023-10-06T04:44:08.999 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQBCkB9lCV76MBAAOjvQKfTBcT9kvcyJfXfcDg==", 2023-10-06T04:44:08.999 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-10-06T04:44:08.999 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-10-06T04:44:08.999 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-10-06T04:44:08.999 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-10-06T04:44:08.999 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-06T04:44:08.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-06T04:44:09.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:44:09.000 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.4", 2023-10-06T04:44:09.000 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQBIkB9lsazVNxAAGgACdFU9gIcv45/rtI/kIA==", 2023-10-06T04:44:09.000 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-10-06T04:44:09.000 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-10-06T04:44:09.000 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-10-06T04:44:09.000 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-10-06T04:44:09.000 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-06T04:44:09.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-06T04:44:09.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:44:09.000 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.5", 2023-10-06T04:44:09.000 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQBLkB9l3zZHNhAAXdfolGZBT6tFi6vh609Y4A==", 2023-10-06T04:44:09.001 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-10-06T04:44:09.001 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-10-06T04:44:09.001 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-10-06T04:44:09.001 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-10-06T04:44:09.001 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-06T04:44:09.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-06T04:44:09.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:44:09.001 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.6", 2023-10-06T04:44:09.001 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQBOkB9lCGGMOBAAGUQkyBgDH3Y0rDZCWLfj9A==", 2023-10-06T04:44:09.001 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-10-06T04:44:09.001 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-10-06T04:44:09.001 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-10-06T04:44:09.001 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-10-06T04:44:09.002 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-06T04:44:09.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-06T04:44:09.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:44:09.002 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.7", 2023-10-06T04:44:09.002 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQBRkB9lkkCONRAAy3tQd1ontqlc+QNIahIfBg==", 2023-10-06T04:44:09.002 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-10-06T04:44:09.002 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2023-10-06T04:44:09.002 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2023-10-06T04:44:09.002 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-10-06T04:44:09.002 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-06T04:44:09.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-06T04:44:09.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:44:09.003 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.0", 2023-10-06T04:44:09.003 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQA4kB9l079oGRAAmUjlIyaaMC2sImYSH/lXiw==", 2023-10-06T04:44:09.003 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-10-06T04:44:09.003 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-10-06T04:44:09.003 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2023-10-06T04:44:09.003 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2023-10-06T04:44:09.003 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2023-10-06T04:44:09.003 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-06T04:44:09.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-06T04:44:09.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:44:09.003 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.1", 2023-10-06T04:44:09.003 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQA4kB9l8l7nIRAAMHeRz1/B4IPM9wmogZ3/GA==", 2023-10-06T04:44:09.004 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-10-06T04:44:09.004 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-10-06T04:44:09.004 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2023-10-06T04:44:09.004 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2023-10-06T04:44:09.004 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2023-10-06T04:44:09.004 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-06T04:44:09.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-06T04:44:09.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:44:09.004 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.2", 2023-10-06T04:44:09.004 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQA4kB9lVbzkHhAAYDQUlio3teu6amuS+9SFVg==", 2023-10-06T04:44:09.004 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-10-06T04:44:09.004 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-10-06T04:44:09.005 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2023-10-06T04:44:09.005 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2023-10-06T04:44:09.005 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2023-10-06T04:44:09.005 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-06T04:44:09.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-06T04:44:09.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:44:09.005 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.3", 2023-10-06T04:44:09.005 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQA4kB9lo1tFJxAANkgw2CGuDFlaf76loqaD+Q==", 2023-10-06T04:44:09.005 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-10-06T04:44:09.005 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2023-10-06T04:44:09.005 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2023-10-06T04:44:09.005 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2023-10-06T04:44:09.006 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2023-10-06T04:44:09.006 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-06T04:44:09.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-06T04:44:09.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:44:09.006 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.admin", 2023-10-06T04:44:09.006 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQA3kB9l4ocbJBAAIC0KEL0Ykx8Z8AhjTziO8w==", 2023-10-06T04:44:09.006 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-10-06T04:44:09.006 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2023-10-06T04:44:09.006 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2023-10-06T04:44:09.006 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2023-10-06T04:44:09.006 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-10-06T04:44:09.006 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-06T04:44:09.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-06T04:44:09.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:44:09.007 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.bootstrap-mds", 2023-10-06T04:44:09.007 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQBekB9ljDCHIhAA0/N00WHPk25ysqNctGZdrw==", 2023-10-06T04:44:09.007 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-10-06T04:44:09.007 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile bootstrap-mds" 2023-10-06T04:44:09.007 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-06T04:44:09.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-06T04:44:09.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:44:09.007 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.bootstrap-mgr", 2023-10-06T04:44:09.007 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQBekB9l/DqHIhAAHuWm6Yh/4+0+XmTqQ61F6g==", 2023-10-06T04:44:09.007 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-10-06T04:44:09.008 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-06T04:44:09.008 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-06T04:44:09.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-06T04:44:09.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:44:09.008 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.bootstrap-osd", 2023-10-06T04:44:09.008 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQBekB9lgEeHIhAARdgOBXQ6MyqqOWWveA0BqA==", 2023-10-06T04:44:09.008 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-10-06T04:44:09.008 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile bootstrap-osd" 2023-10-06T04:44:09.008 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-06T04:44:09.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-06T04:44:09.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:44:09.008 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.bootstrap-rbd", 2023-10-06T04:44:09.008 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQBekB9lBFWHIhAAKWX/JbccjxRL+Ipgw614dw==", 2023-10-06T04:44:09.009 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-10-06T04:44:09.009 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-06T04:44:09.009 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-06T04:44:09.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-06T04:44:09.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:44:09.009 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-06T04:44:09.009 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQBekB9lJmSHIhAAHmqw/0Us3g3ksWr4YdKGGA==", 2023-10-06T04:44:09.009 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-10-06T04:44:09.009 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-06T04:44:09.009 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-06T04:44:09.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-06T04:44:09.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:44:09.010 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.bootstrap-rgw", 2023-10-06T04:44:09.010 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQBekB9lq3GHIhAA4ODzdRjr/VOExLAGrx0zBw==", 2023-10-06T04:44:09.010 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-10-06T04:44:09.010 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-06T04:44:09.010 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-06T04:44:09.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-06T04:44:09.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:44:09.010 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.x", 2023-10-06T04:44:09.010 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQA4kB9lk5dJABAAdT9AgRCuNlJi0aXnxm563A==", 2023-10-06T04:44:09.010 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-10-06T04:44:09.010 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2023-10-06T04:44:09.011 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2023-10-06T04:44:09.011 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-10-06T04:44:09.011 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-06T04:44:09.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-06T04:44:09.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:44:09.011 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.y", 2023-10-06T04:44:09.011 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQA3kB9lXh2IOBAAvZDAmroP+EMMG3zXibVlUA==", 2023-10-06T04:44:09.011 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2023-10-06T04:44:09.011 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2023-10-06T04:44:09.011 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2023-10-06T04:44:09.011 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2023-10-06T04:44:09.011 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-06T04:44:09.011 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-06T04:44:09.012 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-06T04:44:09.012 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-06T04:44:09.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.992+0000 7f5d86c9e700 1 -- 172.21.15.17:0/1899987347 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5d60066f30 msgr2=0x7f5d600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:09.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.992+0000 7f5d86c9e700 1 --2- 172.21.15.17:0/1899987347 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5d60066f30 0x7f5d600693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5d78007fd0 tx=0x7f5d78007e10 comp rx=0 tx=0).stop 2023-10-06T04:44:09.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.992+0000 7f5d86c9e700 1 -- 172.21.15.17:0/1899987347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d80159630 msgr2=0x7f5d800c89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:09.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.992+0000 7f5d86c9e700 1 --2- 172.21.15.17:0/1899987347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d80159630 0x7f5d800c89d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5d6800ec50 tx=0x7f5d68009250 comp rx=0 tx=0).stop 2023-10-06T04:44:09.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.992+0000 7f5d86c9e700 1 -- 172.21.15.17:0/1899987347 shutdown_connections 2023-10-06T04:44:09.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.992+0000 7f5d86c9e700 1 --2- 172.21.15.17:0/1899987347 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5d60066f30 0x7f5d600693e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.992+0000 7f5d86c9e700 1 --2- 172.21.15.17:0/1899987347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d80159630 0x7f5d800c89d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.992+0000 7f5d86c9e700 1 --2- 172.21.15.17:0/1899987347 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5d800cd760 0x7f5d8014e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.992+0000 7f5d86c9e700 1 --2- 172.21.15.17:0/1899987347 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d800ce840 0x7f5d80153060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.992+0000 7f5d86c9e700 1 -- 172.21.15.17:0/1899987347 >> 172.21.15.17:0/1899987347 conn(0x7f5d8006cff0 msgr2=0x7f5d800b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:09.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.992+0000 7f5d86c9e700 1 -- 172.21.15.17:0/1899987347 shutdown_connections 2023-10-06T04:44:09.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:08.992+0000 7f5d86c9e700 1 -- 172.21.15.17:0/1899987347 wait complete. 2023-10-06T04:44:09.014 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-06T04:44:09.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.132+0000 7f503ba96700 1 Processor -- start 2023-10-06T04:44:09.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.132+0000 7f503ba96700 1 -- start start 2023-10-06T04:44:09.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.133+0000 7f503ba96700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f503415d610 0x7f50340cac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:09.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.133+0000 7f503ba96700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503415aed0 con 0x7f50341509a0 2023-10-06T04:44:09.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.133+0000 7f503ba96700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50340cb680 con 0x7f50340cb1b0 2023-10-06T04:44:09.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.133+0000 7f503ba96700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50340cb960 con 0x7f503415d610 2023-10-06T04:44:09.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.133+0000 7f5039832700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f503415d610 0x7f50340cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:09.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.133+0000 7f503a033700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f50341509a0 0x7f503415b380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55856/0 (socket says 172.21.15.17:55856) 2023-10-06T04:44:09.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.133+0000 7f503a033700 1 -- 172.21.15.17:0/784735087 learned_addr learned my addr 172.21.15.17:0/784735087 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:09.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.133+0000 7f5039832700 1 --2- 172.21.15.17:0/784735087 >> v2:172.21.15.17:3300/0 conn(0x7f503415d610 0x7f50340cac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60376/0 (socket says 172.21.15.17:60376) 2023-10-06T04:44:09.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.133+0000 7f5039832700 1 -- 172.21.15.17:0/784735087 >> v1:172.21.15.136:6789/0 conn(0x7f50340cb1b0 legacy=0x7f5034150290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:09.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.133+0000 7f5039832700 1 -- 172.21.15.17:0/784735087 >> v1:172.21.15.17:6789/0 conn(0x7f50341509a0 legacy=0x7f503415b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:09.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.133+0000 7f5039832700 1 -- 172.21.15.17:0/784735087 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50340cbc40 con 0x7f503415d610 2023-10-06T04:44:09.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.133+0000 7f5038830700 1 -- 172.21.15.17:0/784735087 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 478647889 0 0) 0x7f503415aed0 con 0x7f50341509a0 2023-10-06T04:44:09.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.133+0000 7f5039832700 1 --2- 172.21.15.17:0/784735087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f503415d610 0x7f50340cac70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f50300098d0 tx=0x7f5030009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53f207b11e211d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:09.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.133+0000 7f5038830700 1 -- 172.21.15.17:0/784735087 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5030009e70 con 0x7f503415d610 2023-10-06T04:44:09.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.133+0000 7f5038830700 1 -- 172.21.15.17:0/784735087 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5030005c10 con 0x7f503415d610 2023-10-06T04:44:09.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.133+0000 7f5038830700 1 -- 172.21.15.17:0/784735087 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503000b610 con 0x7f503415d610 2023-10-06T04:44:09.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.134+0000 7f503ba96700 1 -- 172.21.15.17:0/784735087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f503415d610 msgr2=0x7f50340cac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:09.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.134+0000 7f503ba96700 1 --2- 172.21.15.17:0/784735087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f503415d610 0x7f50340cac70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f50300098d0 tx=0x7f5030009120 comp rx=0 tx=0).stop 2023-10-06T04:44:09.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.134+0000 7f503ba96700 1 -- 172.21.15.17:0/784735087 shutdown_connections 2023-10-06T04:44:09.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.134+0000 7f503ba96700 1 --2- 172.21.15.17:0/784735087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f503415d610 0x7f50340cac70 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.134+0000 7f503ba96700 1 -- 172.21.15.17:0/784735087 >> 172.21.15.17:0/784735087 conn(0x7f5034099960 msgr2=0x7f503406cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:09.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.134+0000 7f503ba96700 1 -- 172.21.15.17:0/784735087 shutdown_connections 2023-10-06T04:44:09.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.134+0000 7f503ba96700 1 -- 172.21.15.17:0/784735087 wait complete. 2023-10-06T04:44:09.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.135+0000 7f503ba96700 1 Processor -- start 2023-10-06T04:44:09.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.135+0000 7f503ba96700 1 -- start start 2023-10-06T04:44:09.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.136+0000 7f503ba96700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50340cb1b0 0x7f503414fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:09.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.136+0000 7f503ba96700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50341509a0 0x7f5034152f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:09.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.136+0000 7f503ba96700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f503415d610 0x7f50341534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:09.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.136+0000 7f503ba96700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50340c4110 con 0x7f50340cb1b0 2023-10-06T04:44:09.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.136+0000 7f503ba96700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50340b3480 con 0x7f50341509a0 2023-10-06T04:44:09.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.136+0000 7f503ba96700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50340d0de0 con 0x7f503415d610 2023-10-06T04:44:09.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.136+0000 7f5039832700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50340cb1b0 0x7f503414fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:09.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.136+0000 7f5039832700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50340cb1b0 0x7f503414fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60390/0 (socket says 172.21.15.17:60390) 2023-10-06T04:44:09.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.136+0000 7f5039832700 1 -- 172.21.15.17:0/1967744850 learned_addr learned my addr 172.21.15.17:0/1967744850 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:09.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.136+0000 7f503a033700 1 --2- 172.21.15.17:0/1967744850 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f503415d610 0x7f50341534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:09.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.136+0000 7f5039031700 1 --2- 172.21.15.17:0/1967744850 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50341509a0 0x7f5034152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:09.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.136+0000 7f5039832700 1 -- 172.21.15.17:0/1967744850 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f503415d610 msgr2=0x7f50341534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:09.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.136+0000 7f5039832700 1 --2- 172.21.15.17:0/1967744850 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f503415d610 0x7f50341534b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.136+0000 7f5039832700 1 -- 172.21.15.17:0/1967744850 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50341509a0 msgr2=0x7f5034152f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:09.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.136+0000 7f5039832700 1 --2- 172.21.15.17:0/1967744850 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50341509a0 0x7f5034152f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.136+0000 7f5039832700 1 -- 172.21.15.17:0/1967744850 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50300093c0 con 0x7f50340cb1b0 2023-10-06T04:44:09.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.136+0000 7f503a033700 1 --2- 172.21.15.17:0/1967744850 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f503415d610 0x7f50341534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:09.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.136+0000 7f5039832700 1 --2- 172.21.15.17:0/1967744850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50340cb1b0 0x7f503414fa40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5030009160 tx=0x7f5030015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:09.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.137+0000 7f5029ffb700 1 -- 172.21.15.17:0/1967744850 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50300065f0 con 0x7f50340cb1b0 2023-10-06T04:44:09.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.137+0000 7f5029ffb700 1 -- 172.21.15.17:0/1967744850 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5030006750 con 0x7f50340cb1b0 2023-10-06T04:44:09.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.137+0000 7f503ba96700 1 -- 172.21.15.17:0/1967744850 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50340d10c0 con 0x7f50340cb1b0 2023-10-06T04:44:09.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.137+0000 7f5029ffb700 1 -- 172.21.15.17:0/1967744850 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503001c430 con 0x7f50340cb1b0 2023-10-06T04:44:09.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.137+0000 7f503ba96700 1 -- 172.21.15.17:0/1967744850 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50340b3a20 con 0x7f50340cb1b0 2023-10-06T04:44:09.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.138+0000 7f503ba96700 1 -- 172.21.15.17:0/1967744850 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50340b3c10 con 0x7f50340cb1b0 2023-10-06T04:44:09.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.138+0000 7f5029ffb700 1 -- 172.21.15.17:0/1967744850 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5030023070 con 0x7f50340cb1b0 2023-10-06T04:44:09.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.138+0000 7f5029ffb700 1 --2- 172.21.15.17:0/1967744850 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5018066f30 0x7f50180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:09.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.139+0000 7f5029ffb700 1 -- 172.21.15.17:0/1967744850 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f5030085d20 con 0x7f50340cb1b0 2023-10-06T04:44:09.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.139+0000 7f5039031700 1 --2- 172.21.15.17:0/1967744850 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5018066f30 0x7f50180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:09.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.139+0000 7f5039031700 1 --2- 172.21.15.17:0/1967744850 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5018066f30 0x7f50180693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5024006fd0 tx=0x7f5024008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:09.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.143+0000 7f5029ffb700 1 -- 172.21.15.17:0/1967744850 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5030053180 con 0x7f50340cb1b0 2023-10-06T04:44:09.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.416+0000 7f503ba96700 1 -- 172.21.15.17:0/1967744850 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f5034063ff0 con 0x7f50340cb1b0 2023-10-06T04:44:09.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.420+0000 7f5029ffb700 1 -- 172.21.15.17:0/1967744850 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f50300567a0 con 0x7f50340cb1b0 2023-10-06T04:44:09.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.422+0000 7f503ba96700 1 -- 172.21.15.17:0/1967744850 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5018066f30 msgr2=0x7f50180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:09.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.422+0000 7f503ba96700 1 --2- 172.21.15.17:0/1967744850 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5018066f30 0x7f50180693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5024006fd0 tx=0x7f5024008040 comp rx=0 tx=0).stop 2023-10-06T04:44:09.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.422+0000 7f503ba96700 1 -- 172.21.15.17:0/1967744850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50340cb1b0 msgr2=0x7f503414fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:09.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.422+0000 7f503ba96700 1 --2- 172.21.15.17:0/1967744850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50340cb1b0 0x7f503414fa40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5030009160 tx=0x7f5030015000 comp rx=0 tx=0).stop 2023-10-06T04:44:09.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.422+0000 7f503ba96700 1 -- 172.21.15.17:0/1967744850 shutdown_connections 2023-10-06T04:44:09.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.422+0000 7f503ba96700 1 --2- 172.21.15.17:0/1967744850 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5018066f30 0x7f50180693e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.422+0000 7f503ba96700 1 --2- 172.21.15.17:0/1967744850 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f503415d610 0x7f50341534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.422+0000 7f503ba96700 1 --2- 172.21.15.17:0/1967744850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50340cb1b0 0x7f503414fa40 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.422+0000 7f503ba96700 1 --2- 172.21.15.17:0/1967744850 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50341509a0 0x7f5034152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.422+0000 7f503ba96700 1 -- 172.21.15.17:0/1967744850 >> 172.21.15.17:0/1967744850 conn(0x7f5034099960 msgr2=0x7f50340b2670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:09.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.422+0000 7f503ba96700 1 -- 172.21.15.17:0/1967744850 shutdown_connections 2023-10-06T04:44:09.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.422+0000 7f503ba96700 1 -- 172.21.15.17:0/1967744850 wait complete. 2023-10-06T04:44:09.437 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-06T04:44:09.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.553+0000 7f075f497700 1 Processor -- start 2023-10-06T04:44:09.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.554+0000 7f075f497700 1 -- start start 2023-10-06T04:44:09.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.554+0000 7f075f497700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f075815d610 0x7f07580cac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:09.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.554+0000 7f075f497700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f07580cb1b0 0x7f0758150290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:09.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.554+0000 7f075f497700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f075815d9e0 0x7f07581507d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:09.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.554+0000 7f075f497700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f075815aed0 con 0x7f075815d610 2023-10-06T04:44:09.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.554+0000 7f075f497700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07580cb680 con 0x7f075815d9e0 2023-10-06T04:44:09.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.554+0000 7f075f497700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07580cb960 con 0x7f07580cb1b0 2023-10-06T04:44:09.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.554+0000 7f075d233700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f075815d610 0x7f07580cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:09.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.555+0000 7f075d233700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f075815d610 0x7f07580cac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60406/0 (socket says 172.21.15.17:60406) 2023-10-06T04:44:09.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.555+0000 7f075d233700 1 -- 172.21.15.17:0/4126491429 learned_addr learned my addr 172.21.15.17:0/4126491429 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:09.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.555+0000 7f075d233700 1 -- 172.21.15.17:0/4126491429 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f07580cb1b0 msgr2=0x7f0758150290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:09.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.555+0000 7f075ca32700 1 --2- 172.21.15.17:0/4126491429 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f07580cb1b0 0x7f0758150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:09.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.555+0000 7f075da34700 1 --2- 172.21.15.17:0/4126491429 >> v2:172.21.15.136:3300/0 conn(0x7f075815d9e0 0x7f07581507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:09.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.555+0000 7f075d233700 1 --2- 172.21.15.17:0/4126491429 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f07580cb1b0 0x7f0758150290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.555+0000 7f075d233700 1 -- 172.21.15.17:0/4126491429 >> v2:172.21.15.136:3300/0 conn(0x7f075815d9e0 msgr2=0x7f07581507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:09.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.555+0000 7f075d233700 1 --2- 172.21.15.17:0/4126491429 >> v2:172.21.15.136:3300/0 conn(0x7f075815d9e0 0x7f07581507d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.555+0000 7f075d233700 1 -- 172.21.15.17:0/4126491429 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07580cbc40 con 0x7f075815d610 2023-10-06T04:44:09.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.555+0000 7f075da34700 1 --2- 172.21.15.17:0/4126491429 >> v2:172.21.15.136:3300/0 conn(0x7f075815d9e0 0x7f07581507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:09.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.555+0000 7f075d233700 1 --2- 172.21.15.17:0/4126491429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f075815d610 0x7f07580cac70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f075808ab90 tx=0x7f0750009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be51b65453eec256 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:09.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.555+0000 7f0757fff700 1 -- 172.21.15.17:0/4126491429 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0750005c10 con 0x7f075815d610 2023-10-06T04:44:09.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.555+0000 7f0757fff700 1 -- 172.21.15.17:0/4126491429 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0750005d70 con 0x7f075815d610 2023-10-06T04:44:09.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.555+0000 7f0757fff700 1 -- 172.21.15.17:0/4126491429 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075000b880 con 0x7f075815d610 2023-10-06T04:44:09.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.556+0000 7f075f497700 1 -- 172.21.15.17:0/4126491429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f075815d610 msgr2=0x7f07580cac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:09.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.556+0000 7f075f497700 1 --2- 172.21.15.17:0/4126491429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f075815d610 0x7f07580cac70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f075808ab90 tx=0x7f0750009220 comp rx=0 tx=0).stop 2023-10-06T04:44:09.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.556+0000 7f075f497700 1 -- 172.21.15.17:0/4126491429 shutdown_connections 2023-10-06T04:44:09.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.556+0000 7f075f497700 1 --2- 172.21.15.17:0/4126491429 >> v2:172.21.15.136:3300/0 conn(0x7f075815d9e0 0x7f07581507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.556+0000 7f075f497700 1 --2- 172.21.15.17:0/4126491429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f075815d610 0x7f07580cac70 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.556+0000 7f075f497700 1 --2- 172.21.15.17:0/4126491429 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f07580cb1b0 0x7f0758150290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.556+0000 7f075f497700 1 -- 172.21.15.17:0/4126491429 >> 172.21.15.17:0/4126491429 conn(0x7f0758099960 msgr2=0x7f075806cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:09.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.556+0000 7f075f497700 1 -- 172.21.15.17:0/4126491429 shutdown_connections 2023-10-06T04:44:09.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.556+0000 7f075f497700 1 -- 172.21.15.17:0/4126491429 wait complete. 2023-10-06T04:44:09.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.557+0000 7f075f497700 1 Processor -- start 2023-10-06T04:44:09.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.557+0000 7f075f497700 1 -- start start 2023-10-06T04:44:09.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.558+0000 7f075f497700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f07580cb1b0 0x7f075806efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:09.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.558+0000 7f075f497700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f075815d610 0x7f07580c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:09.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.558+0000 7f075f497700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f075815d9e0 0x7f07580c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:09.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.558+0000 7f075f497700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07580c97e0 con 0x7f075815d9e0 2023-10-06T04:44:09.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.558+0000 7f075f497700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07580c9ac0 con 0x7f07580cb1b0 2023-10-06T04:44:09.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.558+0000 7f075f497700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07580c9da0 con 0x7f075815d610 2023-10-06T04:44:09.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.558+0000 7f075da34700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f075815d9e0 0x7f07580c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:09.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.558+0000 7f075da34700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f075815d9e0 0x7f07580c80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60412/0 (socket says 172.21.15.17:60412) 2023-10-06T04:44:09.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.558+0000 7f075da34700 1 -- 172.21.15.17:0/2652191102 learned_addr learned my addr 172.21.15.17:0/2652191102 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:09.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.558+0000 7f075d233700 1 --2- 172.21.15.17:0/2652191102 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f07580cb1b0 0x7f075806efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:09.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.558+0000 7f075ca32700 1 --2- 172.21.15.17:0/2652191102 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f075815d610 0x7f07580c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:09.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.559+0000 7f075da34700 1 -- 172.21.15.17:0/2652191102 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f075815d610 msgr2=0x7f07580c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:09.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.559+0000 7f075da34700 1 --2- 172.21.15.17:0/2652191102 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f075815d610 0x7f07580c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.559+0000 7f075da34700 1 -- 172.21.15.17:0/2652191102 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f07580cb1b0 msgr2=0x7f075806efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:09.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.559+0000 7f075da34700 1 --2- 172.21.15.17:0/2652191102 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f07580cb1b0 0x7f075806efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.559+0000 7f075da34700 1 -- 172.21.15.17:0/2652191102 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0750009480 con 0x7f075815d9e0 2023-10-06T04:44:09.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.559+0000 7f075da34700 1 --2- 172.21.15.17:0/2652191102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f075815d9e0 0x7f07580c80f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f074800cef0 tx=0x7f0748007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:09.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.560+0000 7f07557fa700 1 -- 172.21.15.17:0/2652191102 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074800ad20 con 0x7f075815d9e0 2023-10-06T04:44:09.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.560+0000 7f075f497700 1 -- 172.21.15.17:0/2652191102 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07580ca080 con 0x7f075815d9e0 2023-10-06T04:44:09.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.560+0000 7f075f497700 1 -- 172.21.15.17:0/2652191102 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f075814f1d0 con 0x7f075815d9e0 2023-10-06T04:44:09.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.560+0000 7f07557fa700 1 -- 172.21.15.17:0/2652191102 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074800ae80 con 0x7f075815d9e0 2023-10-06T04:44:09.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.560+0000 7f07557fa700 1 -- 172.21.15.17:0/2652191102 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0748016630 con 0x7f075815d9e0 2023-10-06T04:44:09.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.561+0000 7f075f497700 1 -- 172.21.15.17:0/2652191102 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07380052b0 con 0x7f075815d9e0 2023-10-06T04:44:09.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.562+0000 7f07557fa700 1 -- 172.21.15.17:0/2652191102 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0748016790 con 0x7f075815d9e0 2023-10-06T04:44:09.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.562+0000 7f07557fa700 1 --2- 172.21.15.17:0/2652191102 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0744066f30 0x7f07440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:09.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.562+0000 7f07557fa700 1 -- 172.21.15.17:0/2652191102 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f0748012070 con 0x7f075815d9e0 2023-10-06T04:44:09.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.563+0000 7f075d233700 1 --2- 172.21.15.17:0/2652191102 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0744066f30 0x7f07440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:09.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.563+0000 7f075d233700 1 --2- 172.21.15.17:0/2652191102 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0744066f30 0x7f07440693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0750009260 tx=0x7f0750016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:09.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.569+0000 7f07557fa700 1 -- 172.21.15.17:0/2652191102 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0748051df0 con 0x7f075815d9e0 2023-10-06T04:44:09.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.841+0000 7f075f497700 1 -- 172.21.15.17:0/2652191102 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f0738005ae0 con 0x7f075815d9e0 2023-10-06T04:44:09.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.845+0000 7f07557fa700 1 -- 172.21.15.17:0/2652191102 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0748055410 con 0x7f075815d9e0 2023-10-06T04:44:09.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.847+0000 7f075f497700 1 -- 172.21.15.17:0/2652191102 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0744066f30 msgr2=0x7f07440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:09.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.847+0000 7f075f497700 1 --2- 172.21.15.17:0/2652191102 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0744066f30 0x7f07440693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0750009260 tx=0x7f0750016000 comp rx=0 tx=0).stop 2023-10-06T04:44:09.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.847+0000 7f075f497700 1 -- 172.21.15.17:0/2652191102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f075815d9e0 msgr2=0x7f07580c80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:09.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.847+0000 7f075f497700 1 --2- 172.21.15.17:0/2652191102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f075815d9e0 0x7f07580c80f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f074800cef0 tx=0x7f0748007860 comp rx=0 tx=0).stop 2023-10-06T04:44:09.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.847+0000 7f075f497700 1 -- 172.21.15.17:0/2652191102 shutdown_connections 2023-10-06T04:44:09.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.847+0000 7f075f497700 1 --2- 172.21.15.17:0/2652191102 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0744066f30 0x7f07440693e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.847+0000 7f075f497700 1 --2- 172.21.15.17:0/2652191102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f075815d9e0 0x7f07580c80f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.847+0000 7f075f497700 1 --2- 172.21.15.17:0/2652191102 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f07580cb1b0 0x7f075806efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.847+0000 7f075f497700 1 --2- 172.21.15.17:0/2652191102 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f075815d610 0x7f07580c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.847+0000 7f075f497700 1 -- 172.21.15.17:0/2652191102 >> 172.21.15.17:0/2652191102 conn(0x7f0758099960 msgr2=0x7f075815b380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:09.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.847+0000 7f075f497700 1 -- 172.21.15.17:0/2652191102 shutdown_connections 2023-10-06T04:44:09.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.847+0000 7f075f497700 1 -- 172.21.15.17:0/2652191102 wait complete. 2023-10-06T04:44:09.862 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-06T04:44:09.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.979+0000 7fd65aacb700 1 Processor -- start 2023-10-06T04:44:09.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.979+0000 7fd65aacb700 1 -- start start 2023-10-06T04:44:09.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.979+0000 7fd65aacb700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6540bfff0 0x7fd65415bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:09.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.979+0000 7fd65aacb700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd65406b1f0 con 0x7fd6540abbe0 2023-10-06T04:44:09.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.979+0000 7fd65aacb700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd65406b4d0 con 0x7fd65406a570 2023-10-06T04:44:09.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.979+0000 7fd65aacb700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd65406b7b0 con 0x7fd6540bfff0 2023-10-06T04:44:09.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.980+0000 7fd659068700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fd6540abbe0 0x7fd65406c940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:55862/0 (socket says 172.21.15.17:55862) 2023-10-06T04:44:09.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.980+0000 7fd659068700 1 -- 172.21.15.17:0/3805194462 learned_addr learned my addr 172.21.15.17:0/3805194462 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:09.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.980+0000 7fd653fff700 1 --2- 172.21.15.17:0/3805194462 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6540bfff0 0x7fd65415bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:09.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.980+0000 7fd6537fe700 1 -- 172.21.15.17:0/3805194462 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2359627476 0 0) 0x7fd65406b1f0 con 0x7fd6540abbe0 2023-10-06T04:44:09.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.980+0000 7fd6537fe700 1 -- 172.21.15.17:0/3805194462 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd640003570 con 0x7fd6540abbe0 2023-10-06T04:44:09.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.980+0000 7fd6537fe700 1 -- 172.21.15.17:0/3805194462 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1762118482 0 0) 0x7fd65406b4d0 con 0x7fd65406a570 2023-10-06T04:44:09.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.980+0000 7fd6537fe700 1 -- 172.21.15.17:0/3805194462 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd65406b1f0 con 0x7fd65406a570 2023-10-06T04:44:09.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.980+0000 7fd6537fe700 1 -- 172.21.15.17:0/3805194462 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2581939969 0 0) 0x7fd640003570 con 0x7fd6540abbe0 2023-10-06T04:44:09.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.980+0000 7fd653fff700 1 -- 172.21.15.17:0/3805194462 >> v1:172.21.15.136:6789/0 conn(0x7fd65406a570 legacy=0x7fd65415b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:09.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.980+0000 7fd653fff700 1 -- 172.21.15.17:0/3805194462 >> v1:172.21.15.17:6789/0 conn(0x7fd6540abbe0 legacy=0x7fd65406c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:09.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.980+0000 7fd653fff700 1 -- 172.21.15.17:0/3805194462 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6540705e0 con 0x7fd6540bfff0 2023-10-06T04:44:09.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.980+0000 7fd653fff700 1 --2- 172.21.15.17:0/3805194462 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6540bfff0 0x7fd65415bc00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd63c009910 tx=0x7fd63c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8466001277afd16 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:09.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.981+0000 7fd6537fe700 1 -- 172.21.15.17:0/3805194462 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd644001470 con 0x7fd6540bfff0 2023-10-06T04:44:09.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.981+0000 7fd6537fe700 1 -- 172.21.15.17:0/3805194462 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd63c011420 con 0x7fd6540bfff0 2023-10-06T04:44:09.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.981+0000 7fd6537fe700 1 -- 172.21.15.17:0/3805194462 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63c0117c0 con 0x7fd6540bfff0 2023-10-06T04:44:09.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.981+0000 7fd65aacb700 1 -- 172.21.15.17:0/3805194462 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6540bfff0 msgr2=0x7fd65415bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:09.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.981+0000 7fd65aacb700 1 --2- 172.21.15.17:0/3805194462 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6540bfff0 0x7fd65415bc00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd63c009910 tx=0x7fd63c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.981+0000 7fd65aacb700 1 -- 172.21.15.17:0/3805194462 shutdown_connections 2023-10-06T04:44:09.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.981+0000 7fd65aacb700 1 --2- 172.21.15.17:0/3805194462 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6540bfff0 0x7fd65415bc00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.981+0000 7fd65aacb700 1 -- 172.21.15.17:0/3805194462 >> 172.21.15.17:0/3805194462 conn(0x7fd6540cd600 msgr2=0x7fd6540c95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:09.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.981+0000 7fd65aacb700 1 -- 172.21.15.17:0/3805194462 shutdown_connections 2023-10-06T04:44:09.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.981+0000 7fd65aacb700 1 -- 172.21.15.17:0/3805194462 wait complete. 2023-10-06T04:44:09.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.982+0000 7fd65aacb700 1 Processor -- start 2023-10-06T04:44:09.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.983+0000 7fd65aacb700 1 -- start start 2023-10-06T04:44:09.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.983+0000 7fd65aacb700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd65406a570 0x7fd654150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:09.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.983+0000 7fd65aacb700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6540abbe0 0x7fd654157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:09.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.983+0000 7fd65aacb700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6540bfff0 0x7fd6541553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:09.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.983+0000 7fd65aacb700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6540ca0a0 con 0x7fd6540abbe0 2023-10-06T04:44:09.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.983+0000 7fd65aacb700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6540ad7f0 con 0x7fd6540bfff0 2023-10-06T04:44:09.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.983+0000 7fd65aacb700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6540ab990 con 0x7fd65406a570 2023-10-06T04:44:09.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.983+0000 7fd653fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6540abbe0 0x7fd654157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:09.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.983+0000 7fd653fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6540abbe0 0x7fd654157d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60422/0 (socket says 172.21.15.17:60422) 2023-10-06T04:44:09.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.983+0000 7fd653fff700 1 -- 172.21.15.17:0/4119330842 learned_addr learned my addr 172.21.15.17:0/4119330842 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:09.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.983+0000 7fd659068700 1 --2- 172.21.15.17:0/4119330842 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6540bfff0 0x7fd6541553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:09.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.983+0000 7fd658867700 1 --2- 172.21.15.17:0/4119330842 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd65406a570 0x7fd654150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:09.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.984+0000 7fd653fff700 1 -- 172.21.15.17:0/4119330842 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd65406a570 msgr2=0x7fd654150000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:09.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.984+0000 7fd653fff700 1 --2- 172.21.15.17:0/4119330842 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd65406a570 0x7fd654150000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.984+0000 7fd653fff700 1 -- 172.21.15.17:0/4119330842 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6540bfff0 msgr2=0x7fd6541553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:09.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.984+0000 7fd653fff700 1 --2- 172.21.15.17:0/4119330842 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6540bfff0 0x7fd6541553a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:09.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.984+0000 7fd653fff700 1 -- 172.21.15.17:0/4119330842 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd63c009420 con 0x7fd6540abbe0 2023-10-06T04:44:09.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.984+0000 7fd653fff700 1 --2- 172.21.15.17:0/4119330842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6540abbe0 0x7fd654157d10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd63c0030c0 tx=0x7fd63c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:09.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.984+0000 7fd650ff9700 1 -- 172.21.15.17:0/4119330842 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63c01caf0 con 0x7fd6540abbe0 2023-10-06T04:44:09.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.984+0000 7fd650ff9700 1 -- 172.21.15.17:0/4119330842 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd63c01cc50 con 0x7fd6540abbe0 2023-10-06T04:44:09.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.984+0000 7fd65aacb700 1 -- 172.21.15.17:0/4119330842 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6540ab6b0 con 0x7fd6540abbe0 2023-10-06T04:44:09.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.984+0000 7fd650ff9700 1 -- 172.21.15.17:0/4119330842 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63c01a450 con 0x7fd6540abbe0 2023-10-06T04:44:09.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.984+0000 7fd65aacb700 1 -- 172.21.15.17:0/4119330842 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6540ad500 con 0x7fd6540abbe0 2023-10-06T04:44:09.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.985+0000 7fd65aacb700 1 -- 172.21.15.17:0/4119330842 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6540ad980 con 0x7fd6540abbe0 2023-10-06T04:44:09.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.985+0000 7fd650ff9700 1 -- 172.21.15.17:0/4119330842 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd63c01a800 con 0x7fd6540abbe0 2023-10-06T04:44:09.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.986+0000 7fd650ff9700 1 --2- 172.21.15.17:0/4119330842 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd634066f30 0x7fd6340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:09.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.986+0000 7fd650ff9700 1 -- 172.21.15.17:0/4119330842 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fd63c0860f0 con 0x7fd6540abbe0 2023-10-06T04:44:10.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.986+0000 7fd658867700 1 --2- 172.21.15.17:0/4119330842 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd634066f30 0x7fd6340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:10.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.986+0000 7fd658867700 1 --2- 172.21.15.17:0/4119330842 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd634066f30 0x7fd6340693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd64c0040a0 tx=0x7fd64c007f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:10.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:09.990+0000 7fd650ff9700 1 -- 172.21.15.17:0/4119330842 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd63c053550 con 0x7fd6540abbe0 2023-10-06T04:44:10.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.262+0000 7fd65aacb700 1 -- 172.21.15.17:0/4119330842 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fd654063ff0 con 0x7fd6540abbe0 2023-10-06T04:44:10.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.265+0000 7fd650ff9700 1 -- 172.21.15.17:0/4119330842 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd63c056b70 con 0x7fd6540abbe0 2023-10-06T04:44:10.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.267+0000 7fd65aacb700 1 -- 172.21.15.17:0/4119330842 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd634066f30 msgr2=0x7fd6340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:10.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.267+0000 7fd65aacb700 1 --2- 172.21.15.17:0/4119330842 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd634066f30 0x7fd6340693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd64c0040a0 tx=0x7fd64c007f90 comp rx=0 tx=0).stop 2023-10-06T04:44:10.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.267+0000 7fd65aacb700 1 -- 172.21.15.17:0/4119330842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6540abbe0 msgr2=0x7fd654157d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:10.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.267+0000 7fd65aacb700 1 --2- 172.21.15.17:0/4119330842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6540abbe0 0x7fd654157d10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd63c0030c0 tx=0x7fd63c016000 comp rx=0 tx=0).stop 2023-10-06T04:44:10.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.268+0000 7fd65aacb700 1 -- 172.21.15.17:0/4119330842 shutdown_connections 2023-10-06T04:44:10.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.268+0000 7fd65aacb700 1 --2- 172.21.15.17:0/4119330842 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd634066f30 0x7fd6340693e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:10.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.268+0000 7fd65aacb700 1 --2- 172.21.15.17:0/4119330842 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6540bfff0 0x7fd6541553a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:10.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.268+0000 7fd65aacb700 1 --2- 172.21.15.17:0/4119330842 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd65406a570 0x7fd654150000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:10.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.268+0000 7fd65aacb700 1 --2- 172.21.15.17:0/4119330842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6540abbe0 0x7fd654157d10 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:10.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.268+0000 7fd65aacb700 1 -- 172.21.15.17:0/4119330842 >> 172.21.15.17:0/4119330842 conn(0x7fd6540cd600 msgr2=0x7fd654156670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:10.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.268+0000 7fd65aacb700 1 -- 172.21.15.17:0/4119330842 shutdown_connections 2023-10-06T04:44:10.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.268+0000 7fd65aacb700 1 -- 172.21.15.17:0/4119330842 wait complete. 2023-10-06T04:44:10.282 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-06T04:44:10.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.400+0000 7f50c5268700 1 Processor -- start 2023-10-06T04:44:10.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.400+0000 7f50c5268700 1 -- start start 2023-10-06T04:44:10.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.401+0000 7f50c5268700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f50c015a820 0x7f50c00b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:10.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.401+0000 7f50c5268700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f50c00b24f0 0x7f50c01634f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:10.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.401+0000 7f50c5268700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50c00cee50 con 0x7f50c0157170 2023-10-06T04:44:10.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.401+0000 7f50c5268700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50c015d860 con 0x7f50c00b24f0 2023-10-06T04:44:10.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.401+0000 7f50c5268700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50c00b2930 con 0x7f50c015a820 2023-10-06T04:44:10.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.401+0000 7f50bf7fe700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f50c00b24f0 0x7f50c01634f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:10.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.401+0000 7f50bf7fe700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f50c00b24f0 0x7f50c01634f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60438/0 (socket says 172.21.15.17:60438) 2023-10-06T04:44:10.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.401+0000 7f50bf7fe700 1 -- 172.21.15.17:0/3003060398 learned_addr learned my addr 172.21.15.17:0/3003060398 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:10.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.401+0000 7f50bf7fe700 1 -- 172.21.15.17:0/3003060398 >> v2:172.21.15.136:3300/0 conn(0x7f50c015a820 msgr2=0x7f50c00b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:10.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.401+0000 7f50be7fc700 1 --2- 172.21.15.17:0/3003060398 >> v2:172.21.15.136:3300/0 conn(0x7f50c015a820 0x7f50c00b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:10.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.401+0000 7f50bf7fe700 1 --2- 172.21.15.17:0/3003060398 >> v2:172.21.15.136:3300/0 conn(0x7f50c015a820 0x7f50c00b1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:10.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.401+0000 7f50bf7fe700 1 -- 172.21.15.17:0/3003060398 >> v1:172.21.15.136:6789/0 conn(0x7f50c0157170 legacy=0x7f50c015d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:10.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.401+0000 7f50bf7fe700 1 -- 172.21.15.17:0/3003060398 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c0157540 con 0x7f50c00b24f0 2023-10-06T04:44:10.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.402+0000 7f50bf7fe700 1 --2- 172.21.15.17:0/3003060398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50c00b24f0 0x7f50c01634f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f50c00b66b0 tx=0x7f50b0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8d4994f17ea7834 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:10.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.402+0000 7f50bdffb700 1 -- 172.21.15.17:0/3003060398 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b000e070 con 0x7f50c00b24f0 2023-10-06T04:44:10.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.402+0000 7f50bdffb700 1 -- 172.21.15.17:0/3003060398 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b000ba10 con 0x7f50c00b24f0 2023-10-06T04:44:10.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.402+0000 7f50bdffb700 1 -- 172.21.15.17:0/3003060398 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b00092e0 con 0x7f50c00b24f0 2023-10-06T04:44:10.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.402+0000 7f50c5268700 1 -- 172.21.15.17:0/3003060398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50c00b24f0 msgr2=0x7f50c01634f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:10.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.402+0000 7f50c5268700 1 --2- 172.21.15.17:0/3003060398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50c00b24f0 0x7f50c01634f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f50c00b66b0 tx=0x7f50b0009840 comp rx=0 tx=0).stop 2023-10-06T04:44:10.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.402+0000 7f50c5268700 1 -- 172.21.15.17:0/3003060398 shutdown_connections 2023-10-06T04:44:10.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.402+0000 7f50c5268700 1 --2- 172.21.15.17:0/3003060398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50c00b24f0 0x7f50c01634f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:10.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.402+0000 7f50c5268700 1 --2- 172.21.15.17:0/3003060398 >> v2:172.21.15.136:3300/0 conn(0x7f50c015a820 0x7f50c00b1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:10.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.402+0000 7f50c5268700 1 -- 172.21.15.17:0/3003060398 >> 172.21.15.17:0/3003060398 conn(0x7f50c006c560 msgr2=0x7f50c006c960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:10.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.402+0000 7f50c5268700 1 -- 172.21.15.17:0/3003060398 shutdown_connections 2023-10-06T04:44:10.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.402+0000 7f50c5268700 1 -- 172.21.15.17:0/3003060398 wait complete. 2023-10-06T04:44:10.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.403+0000 7f50c5268700 1 Processor -- start 2023-10-06T04:44:10.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.403+0000 7f50c5268700 1 -- start start 2023-10-06T04:44:10.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.404+0000 7f50c5268700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f50c00b24f0 0x7f50c01530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:10.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.404+0000 7f50c5268700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50c0157170 0x7f50c00b1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:10.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.404+0000 7f50c5268700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50c015a820 0x7f50c00b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:10.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.404+0000 7f50c5268700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c00cd040 con 0x7f50c015a820 2023-10-06T04:44:10.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.404+0000 7f50c5268700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c016da20 con 0x7f50c0157170 2023-10-06T04:44:10.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.404+0000 7f50c5268700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c016d0f0 con 0x7f50c00b24f0 2023-10-06T04:44:10.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.404+0000 7f50bf7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50c015a820 0x7f50c00b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:10.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.404+0000 7f50bf7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50c015a820 0x7f50c00b1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60440/0 (socket says 172.21.15.17:60440) 2023-10-06T04:44:10.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.404+0000 7f50bf7fe700 1 -- 172.21.15.17:0/671512690 learned_addr learned my addr 172.21.15.17:0/671512690 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:10.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.405+0000 7f50be7fc700 1 --2- 172.21.15.17:0/671512690 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50c0157170 0x7f50c00b1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:10.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.405+0000 7f50bf7fe700 1 -- 172.21.15.17:0/671512690 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f50c00b24f0 msgr2=0x7f50c01530c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:10.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.405+0000 7f50bf7fe700 1 --2- 172.21.15.17:0/671512690 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f50c00b24f0 0x7f50c01530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:10.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.405+0000 7f50bf7fe700 1 -- 172.21.15.17:0/671512690 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50c0157170 msgr2=0x7f50c00b1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:10.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.405+0000 7f50bf7fe700 1 --2- 172.21.15.17:0/671512690 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50c0157170 0x7f50c00b1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:10.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.405+0000 7f50bf7fe700 1 -- 172.21.15.17:0/671512690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b0009ae0 con 0x7f50c015a820 2023-10-06T04:44:10.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.405+0000 7f50bf7fe700 1 --2- 172.21.15.17:0/671512690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50c015a820 0x7f50c00b1a80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f50c0088d80 tx=0x7f50b0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:10.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.405+0000 7f50b6ffd700 1 -- 172.21.15.17:0/671512690 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b00032f0 con 0x7f50c015a820 2023-10-06T04:44:10.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.405+0000 7f50b6ffd700 1 -- 172.21.15.17:0/671512690 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b0012e60 con 0x7f50c015a820 2023-10-06T04:44:10.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.405+0000 7f50c5268700 1 -- 172.21.15.17:0/671512690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c016d3d0 con 0x7f50c015a820 2023-10-06T04:44:10.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.405+0000 7f50b6ffd700 1 -- 172.21.15.17:0/671512690 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b001d670 con 0x7f50c015a820 2023-10-06T04:44:10.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.405+0000 7f50c5268700 1 -- 172.21.15.17:0/671512690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c0153600 con 0x7f50c015a820 2023-10-06T04:44:10.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.406+0000 7f50c5268700 1 -- 172.21.15.17:0/671512690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50c004c380 con 0x7f50c015a820 2023-10-06T04:44:10.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.406+0000 7f50b6ffd700 1 -- 172.21.15.17:0/671512690 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f50b001daa0 con 0x7f50c015a820 2023-10-06T04:44:10.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.407+0000 7f50b6ffd700 1 --2- 172.21.15.17:0/671512690 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f50a0066f30 0x7f50a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:10.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.407+0000 7f50b6ffd700 1 -- 172.21.15.17:0/671512690 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f50b0085c20 con 0x7f50c015a820 2023-10-06T04:44:10.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.407+0000 7f50beffd700 1 --2- 172.21.15.17:0/671512690 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f50a0066f30 0x7f50a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:10.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.407+0000 7f50beffd700 1 --2- 172.21.15.17:0/671512690 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f50a0066f30 0x7f50a00693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f50b8007fd0 tx=0x7f50b8007b20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:10.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.411+0000 7f50b6ffd700 1 -- 172.21.15.17:0/671512690 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f50b0053080 con 0x7f50c015a820 2023-10-06T04:44:10.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.684+0000 7f50c5268700 1 -- 172.21.15.17:0/671512690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f50c016ddb0 con 0x7f50c015a820 2023-10-06T04:44:10.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.687+0000 7f50b6ffd700 1 -- 172.21.15.17:0/671512690 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f50b0009420 con 0x7f50c015a820 2023-10-06T04:44:10.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.689+0000 7f50c5268700 1 -- 172.21.15.17:0/671512690 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f50a0066f30 msgr2=0x7f50a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:10.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.689+0000 7f50c5268700 1 --2- 172.21.15.17:0/671512690 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f50a0066f30 0x7f50a00693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f50b8007fd0 tx=0x7f50b8007b20 comp rx=0 tx=0).stop 2023-10-06T04:44:10.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.689+0000 7f50c5268700 1 -- 172.21.15.17:0/671512690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50c015a820 msgr2=0x7f50c00b1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:10.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.690+0000 7f50c5268700 1 --2- 172.21.15.17:0/671512690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50c015a820 0x7f50c00b1a80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f50c0088d80 tx=0x7f50b0017000 comp rx=0 tx=0).stop 2023-10-06T04:44:10.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.690+0000 7f50c5268700 1 -- 172.21.15.17:0/671512690 shutdown_connections 2023-10-06T04:44:10.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.690+0000 7f50c5268700 1 --2- 172.21.15.17:0/671512690 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f50a0066f30 0x7f50a00693e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:10.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.690+0000 7f50c5268700 1 --2- 172.21.15.17:0/671512690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50c015a820 0x7f50c00b1a80 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:10.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.690+0000 7f50c5268700 1 --2- 172.21.15.17:0/671512690 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f50c00b24f0 0x7f50c01530c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:10.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.690+0000 7f50c5268700 1 --2- 172.21.15.17:0/671512690 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50c0157170 0x7f50c00b1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:10.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.690+0000 7f50c5268700 1 -- 172.21.15.17:0/671512690 >> 172.21.15.17:0/671512690 conn(0x7f50c006c560 msgr2=0x7f50c00d0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:10.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.690+0000 7f50c5268700 1 -- 172.21.15.17:0/671512690 shutdown_connections 2023-10-06T04:44:10.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.690+0000 7f50c5268700 1 -- 172.21.15.17:0/671512690 wait complete. 2023-10-06T04:44:10.706 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-06T04:44:10.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.823+0000 7fc8b8367700 1 Processor -- start 2023-10-06T04:44:10.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.823+0000 7fc8b8367700 1 -- start start 2023-10-06T04:44:10.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.824+0000 7fc8b8367700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc8b015d610 0x7fc8b00cac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:10.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.824+0000 7fc8b8367700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc8b01509a0 0x7fc8b015b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:10.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.824+0000 7fc8b8367700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8b015aed0 con 0x7fc8b00cb1b0 2023-10-06T04:44:10.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.824+0000 7fc8b8367700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8b00cb680 con 0x7fc8b015d610 2023-10-06T04:44:10.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.824+0000 7fc8b8367700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8b00cb960 con 0x7fc8b01509a0 2023-10-06T04:44:10.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.824+0000 7fc8b6103700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc8b015d610 0x7fc8b00cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:10.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.824+0000 7fc8b5902700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fc8b00cb1b0 0x7fc8b0150290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:54058/0 (socket says 172.21.15.17:54058) 2023-10-06T04:44:10.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.824+0000 7fc8b5902700 1 -- 172.21.15.17:0/179142412 learned_addr learned my addr 172.21.15.17:0/179142412 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:10.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.824+0000 7fc8b6103700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc8b015d610 0x7fc8b00cac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47904/0 (socket says 172.21.15.17:47904) 2023-10-06T04:44:10.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.824+0000 7fc8b6904700 1 --2- 172.21.15.17:0/179142412 >> v2:172.21.15.136:3300/0 conn(0x7fc8b01509a0 0x7fc8b015b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:10.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.824+0000 7fc8b6103700 1 -- 172.21.15.17:0/179142412 >> v2:172.21.15.136:3300/0 conn(0x7fc8b01509a0 msgr2=0x7fc8b015b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:10.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.824+0000 7fc8b6103700 1 --2- 172.21.15.17:0/179142412 >> v2:172.21.15.136:3300/0 conn(0x7fc8b01509a0 0x7fc8b015b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:10.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.824+0000 7fc8b6103700 1 -- 172.21.15.17:0/179142412 >> v1:172.21.15.17:6789/0 conn(0x7fc8b00cb1b0 legacy=0x7fc8b0150290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:10.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.824+0000 7fc8b6103700 1 -- 172.21.15.17:0/179142412 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b00cbc40 con 0x7fc8b015d610 2023-10-06T04:44:10.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.824+0000 7fc8b5101700 1 -- 172.21.15.17:0/179142412 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3180299679 0 0) 0x7fc8b015aed0 con 0x7fc8b00cb1b0 2023-10-06T04:44:10.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.824+0000 7fc8b6904700 1 --2- 172.21.15.17:0/179142412 >> v2:172.21.15.136:3300/0 conn(0x7fc8b01509a0 0x7fc8b015b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:10.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.824+0000 7fc8b6103700 1 --2- 172.21.15.17:0/179142412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8b015d610 0x7fc8b00cac70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc8b015add0 tx=0x7fc8a8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8f911eeec2f4703 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:10.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.824+0000 7fc8b5101700 1 -- 172.21.15.17:0/179142412 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a8005c10 con 0x7fc8b015d610 2023-10-06T04:44:10.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.824+0000 7fc8b5101700 1 -- 172.21.15.17:0/179142412 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a8005d70 con 0x7fc8b015d610 2023-10-06T04:44:10.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.824+0000 7fc8b5101700 1 -- 172.21.15.17:0/179142412 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a8006260 con 0x7fc8b015d610 2023-10-06T04:44:10.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.825+0000 7fc8b8367700 1 -- 172.21.15.17:0/179142412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8b015d610 msgr2=0x7fc8b00cac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:10.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.825+0000 7fc8b8367700 1 --2- 172.21.15.17:0/179142412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8b015d610 0x7fc8b00cac70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc8b015add0 tx=0x7fc8a8009120 comp rx=0 tx=0).stop 2023-10-06T04:44:10.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.825+0000 7fc8b8367700 1 -- 172.21.15.17:0/179142412 shutdown_connections 2023-10-06T04:44:10.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.825+0000 7fc8b8367700 1 --2- 172.21.15.17:0/179142412 >> v2:172.21.15.136:3300/0 conn(0x7fc8b01509a0 0x7fc8b015b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:10.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.825+0000 7fc8b8367700 1 --2- 172.21.15.17:0/179142412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8b015d610 0x7fc8b00cac70 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:10.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.825+0000 7fc8b8367700 1 -- 172.21.15.17:0/179142412 >> 172.21.15.17:0/179142412 conn(0x7fc8b0099960 msgr2=0x7fc8b006cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:10.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.825+0000 7fc8b8367700 1 -- 172.21.15.17:0/179142412 shutdown_connections 2023-10-06T04:44:10.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.825+0000 7fc8b8367700 1 -- 172.21.15.17:0/179142412 wait complete. 2023-10-06T04:44:10.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.826+0000 7fc8b8367700 1 Processor -- start 2023-10-06T04:44:10.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.826+0000 7fc8b8367700 1 -- start start 2023-10-06T04:44:10.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.827+0000 7fc8b8367700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc8b00cb1b0 0x7fc8b00c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:10.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.827+0000 7fc8b8367700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8b01509a0 0x7fc8b00c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:10.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.827+0000 7fc8b8367700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc8b015d610 0x7fc8b016d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:10.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.827+0000 7fc8b8367700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b00c7290 con 0x7fc8b01509a0 2023-10-06T04:44:10.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.827+0000 7fc8b8367700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b00c3c80 con 0x7fc8b015d610 2023-10-06T04:44:10.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.827+0000 7fc8b8367700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b00c88e0 con 0x7fc8b00cb1b0 2023-10-06T04:44:10.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.827+0000 7fc8b5902700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8b01509a0 0x7fc8b00c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:10.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.827+0000 7fc8b5902700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8b01509a0 0x7fc8b00c63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47920/0 (socket says 172.21.15.17:47920) 2023-10-06T04:44:10.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.827+0000 7fc8b5902700 1 -- 172.21.15.17:0/2539292180 learned_addr learned my addr 172.21.15.17:0/2539292180 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:10.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.827+0000 7fc8b6904700 1 --2- 172.21.15.17:0/2539292180 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc8b015d610 0x7fc8b016d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:10.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.827+0000 7fc8b6103700 1 --2- 172.21.15.17:0/2539292180 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc8b00cb1b0 0x7fc8b00c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:10.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.827+0000 7fc8b5902700 1 -- 172.21.15.17:0/2539292180 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc8b00cb1b0 msgr2=0x7fc8b00c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:10.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.827+0000 7fc8b5902700 1 --2- 172.21.15.17:0/2539292180 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc8b00cb1b0 0x7fc8b00c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:10.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.827+0000 7fc8b5902700 1 -- 172.21.15.17:0/2539292180 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc8b015d610 msgr2=0x7fc8b016d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:10.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.827+0000 7fc8b5902700 1 --2- 172.21.15.17:0/2539292180 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc8b015d610 0x7fc8b016d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:10.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.827+0000 7fc8b5902700 1 -- 172.21.15.17:0/2539292180 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a80093c0 con 0x7fc8b01509a0 2023-10-06T04:44:10.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.827+0000 7fc8b6103700 1 --2- 172.21.15.17:0/2539292180 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc8b00cb1b0 0x7fc8b00c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:10.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.827+0000 7fc8b6904700 1 --2- 172.21.15.17:0/2539292180 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc8b015d610 0x7fc8b016d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:10.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.827+0000 7fc8b5902700 1 --2- 172.21.15.17:0/2539292180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8b01509a0 0x7fc8b00c63e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc8a400c810 tx=0x7fc8a4007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:10.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.828+0000 7fc8ae7fc700 1 -- 172.21.15.17:0/2539292180 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4005c00 con 0x7fc8b01509a0 2023-10-06T04:44:10.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.828+0000 7fc8ae7fc700 1 -- 172.21.15.17:0/2539292180 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a4005d60 con 0x7fc8b01509a0 2023-10-06T04:44:10.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.828+0000 7fc8b8367700 1 -- 172.21.15.17:0/2539292180 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8b00c69f0 con 0x7fc8b01509a0 2023-10-06T04:44:10.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.828+0000 7fc8ae7fc700 1 -- 172.21.15.17:0/2539292180 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4007320 con 0x7fc8b01509a0 2023-10-06T04:44:10.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.828+0000 7fc8b8367700 1 -- 172.21.15.17:0/2539292180 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8b00c6fb0 con 0x7fc8b01509a0 2023-10-06T04:44:10.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.829+0000 7fc8b8367700 1 -- 172.21.15.17:0/2539292180 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8b00c8a90 con 0x7fc8b01509a0 2023-10-06T04:44:10.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.829+0000 7fc8ae7fc700 1 -- 172.21.15.17:0/2539292180 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc8a4007690 con 0x7fc8b01509a0 2023-10-06T04:44:10.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.829+0000 7fc8ae7fc700 1 --2- 172.21.15.17:0/2539292180 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc89c066f30 0x7fc89c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:10.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.829+0000 7fc8ae7fc700 1 -- 172.21.15.17:0/2539292180 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fc8a4083dc0 con 0x7fc8b01509a0 2023-10-06T04:44:10.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.829+0000 7fc8b6103700 1 --2- 172.21.15.17:0/2539292180 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc89c066f30 0x7fc89c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:10.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.830+0000 7fc8b6103700 1 --2- 172.21.15.17:0/2539292180 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc89c066f30 0x7fc89c0693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8009160 tx=0x7fc8a8016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:10.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:10.834+0000 7fc8ae7fc700 1 -- 172.21.15.17:0/2539292180 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc8b00c8a90 con 0x7fc8b01509a0 2023-10-06T04:44:11.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.105+0000 7fc8b8367700 1 -- 172.21.15.17:0/2539292180 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fc8b00c8a50 con 0x7fc8b01509a0 2023-10-06T04:44:11.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.109+0000 7fc8ae7fc700 1 -- 172.21.15.17:0/2539292180 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc8a40512a0 con 0x7fc8b01509a0 2023-10-06T04:44:11.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.110+0000 7fc8b8367700 1 -- 172.21.15.17:0/2539292180 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc89c066f30 msgr2=0x7fc89c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:11.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.111+0000 7fc8b8367700 1 --2- 172.21.15.17:0/2539292180 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc89c066f30 0x7fc89c0693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8009160 tx=0x7fc8a8016000 comp rx=0 tx=0).stop 2023-10-06T04:44:11.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.111+0000 7fc8b8367700 1 -- 172.21.15.17:0/2539292180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8b01509a0 msgr2=0x7fc8b00c63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:11.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.111+0000 7fc8b8367700 1 --2- 172.21.15.17:0/2539292180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8b01509a0 0x7fc8b00c63e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc8a400c810 tx=0x7fc8a4007db0 comp rx=0 tx=0).stop 2023-10-06T04:44:11.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.111+0000 7fc8b8367700 1 -- 172.21.15.17:0/2539292180 shutdown_connections 2023-10-06T04:44:11.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.111+0000 7fc8b8367700 1 --2- 172.21.15.17:0/2539292180 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc89c066f30 0x7fc89c0693e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:11.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.111+0000 7fc8b8367700 1 --2- 172.21.15.17:0/2539292180 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc8b015d610 0x7fc8b016d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:11.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.111+0000 7fc8b8367700 1 --2- 172.21.15.17:0/2539292180 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc8b00cb1b0 0x7fc8b00c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:11.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.111+0000 7fc8b8367700 1 --2- 172.21.15.17:0/2539292180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8b01509a0 0x7fc8b00c63e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:11.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.111+0000 7fc8b8367700 1 -- 172.21.15.17:0/2539292180 >> 172.21.15.17:0/2539292180 conn(0x7fc8b0099960 msgr2=0x7fc8b015c210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:11.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.111+0000 7fc8b8367700 1 -- 172.21.15.17:0/2539292180 shutdown_connections 2023-10-06T04:44:11.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.111+0000 7fc8b8367700 1 -- 172.21.15.17:0/2539292180 wait complete. 2023-10-06T04:44:11.125 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-06T04:44:11.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.244+0000 7f696c9d2700 1 Processor -- start 2023-10-06T04:44:11.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.244+0000 7f696c9d2700 1 -- start start 2023-10-06T04:44:11.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.245+0000 7f696c9d2700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f69680b1800 0x7f69680b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:11.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.245+0000 7f696c9d2700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f69680b3b70 0x7f696806e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:11.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.245+0000 7f696c9d2700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f696806df10 con 0x7f696806a120 2023-10-06T04:44:11.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.245+0000 7f696c9d2700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69680b4030 con 0x7f69680b1800 2023-10-06T04:44:11.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.245+0000 7f696c9d2700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696806d8c0 con 0x7f69680b3b70 2023-10-06T04:44:11.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.245+0000 7f696659c700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f69680b1800 0x7f69680b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:11.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.245+0000 7f696659c700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f69680b1800 0x7f69680b3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47932/0 (socket says 172.21.15.17:47932) 2023-10-06T04:44:11.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.245+0000 7f696659c700 1 -- 172.21.15.17:0/515882524 learned_addr learned my addr 172.21.15.17:0/515882524 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:11.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.246+0000 7f696659c700 1 -- 172.21.15.17:0/515882524 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f69680b3b70 msgr2=0x7f696806e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:11.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.246+0000 7f6965d9b700 1 --2- 172.21.15.17:0/515882524 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f69680b3b70 0x7f696806e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:11.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.246+0000 7f696659c700 1 --2- 172.21.15.17:0/515882524 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f69680b3b70 0x7f696806e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:11.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.246+0000 7f696659c700 1 -- 172.21.15.17:0/515882524 >> v1:172.21.15.136:6789/0 conn(0x7f696806a120 legacy=0x7f696815d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:11.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.246+0000 7f696659c700 1 -- 172.21.15.17:0/515882524 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696806dba0 con 0x7f69680b1800 2023-10-06T04:44:11.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.246+0000 7f6965d9b700 1 --2- 172.21.15.17:0/515882524 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f69680b3b70 0x7f696806e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:11.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.246+0000 7f696659c700 1 --2- 172.21.15.17:0/515882524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69680b1800 0x7f69680b3630 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f69600099e0 tx=0x7f6960009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef2c60a0d87c1a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:11.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.246+0000 7f696559a700 1 -- 172.21.15.17:0/515882524 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696000b7e0 con 0x7f69680b1800 2023-10-06T04:44:11.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.246+0000 7f696559a700 1 -- 172.21.15.17:0/515882524 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696000b940 con 0x7f69680b1800 2023-10-06T04:44:11.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.246+0000 7f696559a700 1 -- 172.21.15.17:0/515882524 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696000bce0 con 0x7f69680b1800 2023-10-06T04:44:11.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.246+0000 7f696c9d2700 1 -- 172.21.15.17:0/515882524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69680b1800 msgr2=0x7f69680b3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:11.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.246+0000 7f696c9d2700 1 --2- 172.21.15.17:0/515882524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69680b1800 0x7f69680b3630 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f69600099e0 tx=0x7f6960009250 comp rx=0 tx=0).stop 2023-10-06T04:44:11.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.247+0000 7f696c9d2700 1 -- 172.21.15.17:0/515882524 shutdown_connections 2023-10-06T04:44:11.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.247+0000 7f696c9d2700 1 --2- 172.21.15.17:0/515882524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69680b1800 0x7f69680b3630 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:11.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.247+0000 7f696c9d2700 1 --2- 172.21.15.17:0/515882524 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f69680b3b70 0x7f696806e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:11.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.247+0000 7f696c9d2700 1 -- 172.21.15.17:0/515882524 >> 172.21.15.17:0/515882524 conn(0x7f6968067df0 msgr2=0x7f69680681f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:11.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.247+0000 7f696c9d2700 1 -- 172.21.15.17:0/515882524 shutdown_connections 2023-10-06T04:44:11.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.247+0000 7f696c9d2700 1 -- 172.21.15.17:0/515882524 wait complete. 2023-10-06T04:44:11.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.248+0000 7f696c9d2700 1 Processor -- start 2023-10-06T04:44:11.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.248+0000 7f696c9d2700 1 -- start start 2023-10-06T04:44:11.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.248+0000 7f696c9d2700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f696806a120 0x7f69680ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:11.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.248+0000 7f696c9d2700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69680b1800 0x7f69680ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:11.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.248+0000 7f696c9d2700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69680b3b70 0x7f696814a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:11.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.248+0000 7f696c9d2700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696815dee0 con 0x7f69680b1800 2023-10-06T04:44:11.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.248+0000 7f696c9d2700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69680cb730 con 0x7f69680b3b70 2023-10-06T04:44:11.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.248+0000 7f696c9d2700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6968156970 con 0x7f696806a120 2023-10-06T04:44:11.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.248+0000 7f6965d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69680b1800 0x7f69680ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:11.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.249+0000 7f6965d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69680b1800 0x7f69680ce5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47946/0 (socket says 172.21.15.17:47946) 2023-10-06T04:44:11.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.249+0000 7f6965d9b700 1 -- 172.21.15.17:0/13317920 learned_addr learned my addr 172.21.15.17:0/13317920 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:11.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.249+0000 7f696659c700 1 --2- 172.21.15.17:0/13317920 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f696806a120 0x7f69680ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:11.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.249+0000 7f6965d9b700 1 -- 172.21.15.17:0/13317920 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f696806a120 msgr2=0x7f69680ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:11.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.249+0000 7f6965d9b700 1 --2- 172.21.15.17:0/13317920 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f696806a120 0x7f69680ca010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:11.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.249+0000 7f6965d9b700 1 -- 172.21.15.17:0/13317920 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69680b3b70 msgr2=0x7f696814a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:11.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.249+0000 7f6966d9d700 1 --2- 172.21.15.17:0/13317920 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69680b3b70 0x7f696814a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:11.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.249+0000 7f6965d9b700 1 --2- 172.21.15.17:0/13317920 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69680b3b70 0x7f696814a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:11.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.249+0000 7f6965d9b700 1 -- 172.21.15.17:0/13317920 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69600094f0 con 0x7f69680b1800 2023-10-06T04:44:11.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.249+0000 7f6965d9b700 1 --2- 172.21.15.17:0/13317920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69680b1800 0x7f69680ce5c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f695000c800 tx=0x7f6950008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:11.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.249+0000 7f695e7fc700 1 -- 172.21.15.17:0/13317920 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6950011600 con 0x7f69680b1800 2023-10-06T04:44:11.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.249+0000 7f695e7fc700 1 -- 172.21.15.17:0/13317920 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6950011760 con 0x7f69680b1800 2023-10-06T04:44:11.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.249+0000 7f696c9d2700 1 -- 172.21.15.17:0/13317920 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69680cb9d0 con 0x7f69680b1800 2023-10-06T04:44:11.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.249+0000 7f695e7fc700 1 -- 172.21.15.17:0/13317920 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6950011ae0 con 0x7f69680b1800 2023-10-06T04:44:11.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.249+0000 7f696c9d2700 1 -- 172.21.15.17:0/13317920 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f696815db70 con 0x7f69680b1800 2023-10-06T04:44:11.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.250+0000 7f696c9d2700 1 -- 172.21.15.17:0/13317920 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f696806f540 con 0x7f69680b1800 2023-10-06T04:44:11.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.250+0000 7f695e7fc700 1 -- 172.21.15.17:0/13317920 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6950010350 con 0x7f69680b1800 2023-10-06T04:44:11.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.251+0000 7f695e7fc700 1 --2- 172.21.15.17:0/13317920 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6948066f30 0x7f69480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:11.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.251+0000 7f695e7fc700 1 -- 172.21.15.17:0/13317920 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f69500842f0 con 0x7f69680b1800 2023-10-06T04:44:11.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.251+0000 7f696659c700 1 --2- 172.21.15.17:0/13317920 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6948066f30 0x7f69480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:11.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.251+0000 7f696659c700 1 --2- 172.21.15.17:0/13317920 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6948066f30 0x7f69480693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f69600099e0 tx=0x7f6960016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:11.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.255+0000 7f695e7fc700 1 -- 172.21.15.17:0/13317920 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6950051750 con 0x7f69680b1800 2023-10-06T04:44:11.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.529+0000 7f696c9d2700 1 -- 172.21.15.17:0/13317920 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f6968063ff0 con 0x7f69680b1800 2023-10-06T04:44:11.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.532+0000 7f695e7fc700 1 -- 172.21.15.17:0/13317920 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f6950054d70 con 0x7f69680b1800 2023-10-06T04:44:11.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.534+0000 7f696c9d2700 1 -- 172.21.15.17:0/13317920 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6948066f30 msgr2=0x7f69480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:11.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.534+0000 7f696c9d2700 1 --2- 172.21.15.17:0/13317920 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6948066f30 0x7f69480693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f69600099e0 tx=0x7f6960016000 comp rx=0 tx=0).stop 2023-10-06T04:44:11.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.534+0000 7f696c9d2700 1 -- 172.21.15.17:0/13317920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69680b1800 msgr2=0x7f69680ce5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:11.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.534+0000 7f696c9d2700 1 --2- 172.21.15.17:0/13317920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69680b1800 0x7f69680ce5c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f695000c800 tx=0x7f6950008040 comp rx=0 tx=0).stop 2023-10-06T04:44:11.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.534+0000 7f696c9d2700 1 -- 172.21.15.17:0/13317920 shutdown_connections 2023-10-06T04:44:11.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.534+0000 7f696c9d2700 1 --2- 172.21.15.17:0/13317920 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6948066f30 0x7f69480693e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:11.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.534+0000 7f696c9d2700 1 --2- 172.21.15.17:0/13317920 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69680b3b70 0x7f696814a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:11.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.534+0000 7f696c9d2700 1 --2- 172.21.15.17:0/13317920 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f696806a120 0x7f69680ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:11.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.534+0000 7f696c9d2700 1 --2- 172.21.15.17:0/13317920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69680b1800 0x7f69680ce5c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:11.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.534+0000 7f696c9d2700 1 -- 172.21.15.17:0/13317920 >> 172.21.15.17:0/13317920 conn(0x7f6968067df0 msgr2=0x7f6968158290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:11.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.534+0000 7f696c9d2700 1 -- 172.21.15.17:0/13317920 shutdown_connections 2023-10-06T04:44:11.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.534+0000 7f696c9d2700 1 -- 172.21.15.17:0/13317920 wait complete. 2023-10-06T04:44:11.549 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:44:11.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.666+0000 7f86f0d4c700 1 Processor -- start 2023-10-06T04:44:11.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.666+0000 7f86f0d4c700 1 -- start start 2023-10-06T04:44:11.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.667+0000 7f86f0d4c700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f86ec0ccfc0 0x7f86ec0cc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:11.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.667+0000 7f86f0d4c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f86ec0cf3b0 0x7f86ec1594a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:11.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.667+0000 7f86f0d4c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86ec0cc750 0x7f86ec1599e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:11.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.667+0000 7f86f0d4c700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86ec0cbd80 con 0x7f86ec0ccfc0 2023-10-06T04:44:11.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.667+0000 7f86f0d4c700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86ec0af5f0 con 0x7f86ec0cf3b0 2023-10-06T04:44:11.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.667+0000 7f86f0d4c700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec0af8d0 con 0x7f86ec0cc750 2023-10-06T04:44:11.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.667+0000 7f86eb7fe700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f86ec0ccfc0 0x7f86ec0cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:11.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.667+0000 7f86eb7fe700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f86ec0ccfc0 0x7f86ec0cc210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47950/0 (socket says 172.21.15.17:47950) 2023-10-06T04:44:11.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.667+0000 7f86eb7fe700 1 -- 172.21.15.17:0/3924333862 learned_addr learned my addr 172.21.15.17:0/3924333862 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:11.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.667+0000 7f86ebfff700 1 --2- 172.21.15.17:0/3924333862 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86ec0cc750 0x7f86ec1599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:11.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.667+0000 7f86eaffd700 1 --2- 172.21.15.17:0/3924333862 >> v2:172.21.15.136:3300/0 conn(0x7f86ec0cf3b0 0x7f86ec1594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:11.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.667+0000 7f86eb7fe700 1 -- 172.21.15.17:0/3924333862 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86ec0cc750 msgr2=0x7f86ec1599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:11.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.667+0000 7f86eb7fe700 1 --2- 172.21.15.17:0/3924333862 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86ec0cc750 0x7f86ec1599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:11.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.667+0000 7f86eb7fe700 1 -- 172.21.15.17:0/3924333862 >> v2:172.21.15.136:3300/0 conn(0x7f86ec0cf3b0 msgr2=0x7f86ec1594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:11.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.667+0000 7f86eb7fe700 1 --2- 172.21.15.17:0/3924333862 >> v2:172.21.15.136:3300/0 conn(0x7f86ec0cf3b0 0x7f86ec1594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:11.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.667+0000 7f86eb7fe700 1 -- 172.21.15.17:0/3924333862 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ec0afbb0 con 0x7f86ec0ccfc0 2023-10-06T04:44:11.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.667+0000 7f86eaffd700 1 --2- 172.21.15.17:0/3924333862 >> v2:172.21.15.136:3300/0 conn(0x7f86ec0cf3b0 0x7f86ec1594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:11.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.667+0000 7f86ebfff700 1 --2- 172.21.15.17:0/3924333862 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86ec0cc750 0x7f86ec1599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:11.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.668+0000 7f86eb7fe700 1 --2- 172.21.15.17:0/3924333862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86ec0ccfc0 0x7f86ec0cc210 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f86dc0099b0 tx=0x7f86dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c986497a786e4c1d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:11.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.668+0000 7f86ea7fc700 1 -- 172.21.15.17:0/3924333862 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc00b820 con 0x7f86ec0ccfc0 2023-10-06T04:44:11.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.668+0000 7f86ea7fc700 1 -- 172.21.15.17:0/3924333862 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86dc00b980 con 0x7f86ec0ccfc0 2023-10-06T04:44:11.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.668+0000 7f86ea7fc700 1 -- 172.21.15.17:0/3924333862 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc00bd20 con 0x7f86ec0ccfc0 2023-10-06T04:44:11.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.668+0000 7f86f0d4c700 1 -- 172.21.15.17:0/3924333862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86ec0ccfc0 msgr2=0x7f86ec0cc210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:11.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.668+0000 7f86f0d4c700 1 --2- 172.21.15.17:0/3924333862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86ec0ccfc0 0x7f86ec0cc210 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f86dc0099b0 tx=0x7f86dc009250 comp rx=0 tx=0).stop 2023-10-06T04:44:11.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.668+0000 7f86f0d4c700 1 -- 172.21.15.17:0/3924333862 shutdown_connections 2023-10-06T04:44:11.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.668+0000 7f86f0d4c700 1 --2- 172.21.15.17:0/3924333862 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86ec0cc750 0x7f86ec1599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:11.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.668+0000 7f86f0d4c700 1 --2- 172.21.15.17:0/3924333862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86ec0ccfc0 0x7f86ec0cc210 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:11.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.668+0000 7f86f0d4c700 1 --2- 172.21.15.17:0/3924333862 >> v2:172.21.15.136:3300/0 conn(0x7f86ec0cf3b0 0x7f86ec1594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:11.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.668+0000 7f86f0d4c700 1 -- 172.21.15.17:0/3924333862 >> 172.21.15.17:0/3924333862 conn(0x7f86ec06cff0 msgr2=0x7f86ec06da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:11.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.668+0000 7f86f0d4c700 1 -- 172.21.15.17:0/3924333862 shutdown_connections 2023-10-06T04:44:11.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.668+0000 7f86f0d4c700 1 -- 172.21.15.17:0/3924333862 wait complete. 2023-10-06T04:44:11.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.670+0000 7f86f0d4c700 1 Processor -- start 2023-10-06T04:44:11.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.670+0000 7f86f0d4c700 1 -- start start 2023-10-06T04:44:11.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.670+0000 7f86f0d4c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86ec0cc750 0x7f86ec16aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:11.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.670+0000 7f86f0d4c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86ec0ccfc0 0x7f86ec1546d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:11.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.670+0000 7f86f0d4c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86ec0c75b0 0x7f86ec0c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:11.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.670+0000 7f86f0d4c700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec0b32a0 con 0x7f86ec0ccfc0 2023-10-06T04:44:11.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.670+0000 7f86f0d4c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec0b3e00 con 0x7f86ec0c75b0 2023-10-06T04:44:11.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.670+0000 7f86f0d4c700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec154c10 con 0x7f86ec0cc750 2023-10-06T04:44:11.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.670+0000 7f86eaffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86ec0ccfc0 0x7f86ec1546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:11.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.670+0000 7f86eaffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86ec0ccfc0 0x7f86ec1546d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47960/0 (socket says 172.21.15.17:47960) 2023-10-06T04:44:11.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.670+0000 7f86eaffd700 1 -- 172.21.15.17:0/1329108879 learned_addr learned my addr 172.21.15.17:0/1329108879 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:11.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.671+0000 7f86eb7fe700 1 --2- 172.21.15.17:0/1329108879 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86ec0cc750 0x7f86ec16aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:11.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.671+0000 7f86ebfff700 1 --2- 172.21.15.17:0/1329108879 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86ec0c75b0 0x7f86ec0c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:11.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.671+0000 7f86eaffd700 1 -- 172.21.15.17:0/1329108879 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86ec0cc750 msgr2=0x7f86ec16aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:11.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.671+0000 7f86eaffd700 1 --2- 172.21.15.17:0/1329108879 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86ec0cc750 0x7f86ec16aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:11.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.671+0000 7f86eaffd700 1 -- 172.21.15.17:0/1329108879 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86ec0c75b0 msgr2=0x7f86ec0c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:11.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.671+0000 7f86eaffd700 1 --2- 172.21.15.17:0/1329108879 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86ec0c75b0 0x7f86ec0c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:11.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.671+0000 7f86eaffd700 1 -- 172.21.15.17:0/1329108879 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86dc0094f0 con 0x7f86ec0ccfc0 2023-10-06T04:44:11.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.671+0000 7f86eaffd700 1 --2- 172.21.15.17:0/1329108879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86ec0ccfc0 0x7f86ec1546d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f86e000d8c0 tx=0x7f86e0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:11.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.671+0000 7f86d37fe700 1 -- 172.21.15.17:0/1329108879 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e00095b0 con 0x7f86ec0ccfc0 2023-10-06T04:44:11.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.671+0000 7f86d37fe700 1 -- 172.21.15.17:0/1329108879 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e0009730 con 0x7f86ec0ccfc0 2023-10-06T04:44:11.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.671+0000 7f86f0d4c700 1 -- 172.21.15.17:0/1329108879 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86ec0b34d0 con 0x7f86ec0ccfc0 2023-10-06T04:44:11.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.671+0000 7f86d37fe700 1 -- 172.21.15.17:0/1329108879 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e0009af0 con 0x7f86ec0ccfc0 2023-10-06T04:44:11.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.671+0000 7f86f0d4c700 1 -- 172.21.15.17:0/1329108879 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86ec0b3a90 con 0x7f86ec0ccfc0 2023-10-06T04:44:11.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.672+0000 7f86f0d4c700 1 -- 172.21.15.17:0/1329108879 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86ec0b3fb0 con 0x7f86ec0ccfc0 2023-10-06T04:44:11.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.672+0000 7f86d37fe700 1 -- 172.21.15.17:0/1329108879 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f86e0012420 con 0x7f86ec0ccfc0 2023-10-06T04:44:11.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.673+0000 7f86d37fe700 1 --2- 172.21.15.17:0/1329108879 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f86d8066f30 0x7f86d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:11.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.673+0000 7f86d37fe700 1 -- 172.21.15.17:0/1329108879 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f86e0084750 con 0x7f86ec0ccfc0 2023-10-06T04:44:11.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.673+0000 7f86eb7fe700 1 --2- 172.21.15.17:0/1329108879 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f86d8066f30 0x7f86d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:11.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.673+0000 7f86eb7fe700 1 --2- 172.21.15.17:0/1329108879 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f86d8066f30 0x7f86d80693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f86dc0099b0 tx=0x7f86dc017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:11.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.677+0000 7f86d37fe700 1 -- 172.21.15.17:0/1329108879 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f86ec0b3fb0 con 0x7f86ec0ccfc0 2023-10-06T04:44:11.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.871+0000 7f86f0d4c700 1 -- 172.21.15.17:0/1329108879 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86ec0b3fb0 con 0x7f86ec0ccfc0 2023-10-06T04:44:11.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.872+0000 7f86d37fe700 1 -- 172.21.15.17:0/1329108879 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+13650 (secure 0 0 0) 0x7f86ec0b3fb0 con 0x7f86ec0ccfc0 2023-10-06T04:44:11.874 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:11.875 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":28,"fsid":"780777c4-2b25-4d35-9058-c9f2d62e3ad9","created":"2023-10-06T04:43:10.578520+0000","modified":"2023-10-06T04:44:08.569089+0000","last_up_change":"2023-10-06T04:43:20.682958+0000","last_in_change":"2023-10-06T04:43:12.978917+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:43:21.795733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:43:22.389592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"84737b08-575c-46dd-9488-073ae8504494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6809","nonce":90656},{"type":"v1","addr":"172.21.15.17:6811","nonce":90656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":90656},{"type":"v1","addr":"172.21.15.17:6814","nonce":90656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":90656},{"type":"v1","addr":"172.21.15.17:6822","nonce":90656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":90656},{"type":"v1","addr":"172.21.15.17:6818","nonce":90656}]},"public_addr":"172.21.15.17:6811/90656","cluster_addr":"172.21.15.17:6814/90656","heartbeat_back_addr":"172.21.15.17:6822/90656","heartbeat_front_addr":"172.21.15.17:6818/90656","state":["exists","up"]},{"osd":1,"uuid":"dffeb740-58a2-4fd6-8ff1-a0a11a2cc709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":90655},{"type":"v1","addr":"172.21.15.17:6801","nonce":90655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":90655},{"type":"v1","addr":"172.21.15.17:6803","nonce":90655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":90655},{"type":"v1","addr":"172.21.15.17:6807","nonce":90655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":90655},{"type":"v1","addr":"172.21.15.17:6805","nonce":90655}]},"public_addr":"172.21.15.17:6801/90655","cluster_addr":"172.21.15.17:6803/90655","heartbeat_back_addr":"172.21.15.17:6807/90655","heartbeat_front_addr":"172.21.15.17:6805/90655","state":["exists","up"]},{"osd":2,"uuid":"48bd6831-763d-48c2-b515-e02c216d608b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":90657},{"type":"v1","addr":"172.21.15.17:6810","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":90657},{"type":"v1","addr":"172.21.15.17:6815","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":90657},{"type":"v1","addr":"172.21.15.17:6823","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":90657},{"type":"v1","addr":"172.21.15.17:6819","nonce":90657}]},"public_addr":"172.21.15.17:6810/90657","cluster_addr":"172.21.15.17:6815/90657","heartbeat_back_addr":"172.21.15.17:6823/90657","heartbeat_front_addr":"172.21.15.17:6819/90657","state":["exists","up"]},{"osd":3,"uuid":"ae7dbb23-abe7-4bd3-a4df-6f5963d6804c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":90688},{"type":"v1","addr":"172.21.15.17:6825","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":90688},{"type":"v1","addr":"172.21.15.17:6827","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":90688},{"type":"v1","addr":"172.21.15.17:6831","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":90688},{"type":"v1","addr":"172.21.15.17:6829","nonce":90688}]},"public_addr":"172.21.15.17:6825/90688","cluster_addr":"172.21.15.17:6827/90688","heartbeat_back_addr":"172.21.15.17:6831/90688","heartbeat_front_addr":"172.21.15.17:6829/90688","state":["exists","up"]},{"osd":4,"uuid":"29991fb4-1667-4ea3-aca0-d55db27f3bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":90902},{"type":"v1","addr":"172.21.15.136:6801","nonce":90902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":90902},{"type":"v1","addr":"172.21.15.136:6803","nonce":90902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":90902},{"type":"v1","addr":"172.21.15.136:6807","nonce":90902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":90902},{"type":"v1","addr":"172.21.15.136:6805","nonce":90902}]},"public_addr":"172.21.15.136:6801/90902","cluster_addr":"172.21.15.136:6803/90902","heartbeat_back_addr":"172.21.15.136:6807/90902","heartbeat_front_addr":"172.21.15.136:6805/90902","state":["exists","up"]},{"osd":5,"uuid":"398b4ff9-03fc-421f-882c-ba12aa088eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":90901},{"type":"v1","addr":"172.21.15.136:6809","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":90901},{"type":"v1","addr":"172.21.15.136:6811","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":90901},{"type":"v1","addr":"172.21.15.136:6815","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":90901},{"type":"v1","addr":"172.21.15.136:6813","nonce":90901}]},"public_addr":"172.21.15.136:6809/90901","cluster_addr":"172.21.15.136:6811/90901","heartbeat_back_addr":"172.21.15.136:6815/90901","heartbeat_front_addr":"172.21.15.136:6813/90901","state":["exists","up"]},{"osd":6,"uuid":"1bb91a72-4dab-4cdb-aa1d-2b8a9edf1ad0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":90927},{"type":"v1","addr":"172.21.15.136:6825","nonce":90927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":90927},{"type":"v1","addr":"172.21.15.136:6827","nonce":90927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":90927},{"type":"v1","addr":"172.21.15.136:6831","nonce":90927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":90927},{"type":"v1","addr":"172.21.15.136:6829","nonce":90927}]},"public_addr":"172.21.15.136:6825/90927","cluster_addr":"172.21.15.136:6827/90927","heartbeat_back_addr":"172.21.15.136:6831/90927","heartbeat_front_addr":"172.21.15.136:6829/90927","state":["exists","up"]},{"osd":7,"uuid":"719b654e-010d-4aa4-8c13-83fdde242b47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":90934},{"type":"v1","addr":"172.21.15.136:6817","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":90934},{"type":"v1","addr":"172.21.15.136:6819","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":90934},{"type":"v1","addr":"172.21.15.136:6824","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":90934},{"type":"v1","addr":"172.21.15.136:6821","nonce":90934}]},"public_addr":"172.21.15.136:6817/90934","cluster_addr":"172.21.15.136:6819/90934","heartbeat_back_addr":"172.21.15.136:6824/90934","heartbeat_front_addr":"172.21.15.136:6821/90934","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.157479+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.140520+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.190743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.231396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.156510+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.145822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.202888+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.139532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:44:11.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.874+0000 7f86f0d4c700 1 -- 172.21.15.17:0/1329108879 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f86d8066f30 msgr2=0x7f86d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:11.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.874+0000 7f86f0d4c700 1 --2- 172.21.15.17:0/1329108879 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f86d8066f30 0x7f86d80693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f86dc0099b0 tx=0x7f86dc017000 comp rx=0 tx=0).stop 2023-10-06T04:44:11.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.874+0000 7f86f0d4c700 1 -- 172.21.15.17:0/1329108879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86ec0ccfc0 msgr2=0x7f86ec1546d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:11.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.874+0000 7f86f0d4c700 1 --2- 172.21.15.17:0/1329108879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86ec0ccfc0 0x7f86ec1546d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f86e000d8c0 tx=0x7f86e0008040 comp rx=0 tx=0).stop 2023-10-06T04:44:11.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.874+0000 7f86f0d4c700 1 -- 172.21.15.17:0/1329108879 shutdown_connections 2023-10-06T04:44:11.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.874+0000 7f86f0d4c700 1 --2- 172.21.15.17:0/1329108879 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f86d8066f30 0x7f86d80693e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:11.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.874+0000 7f86f0d4c700 1 --2- 172.21.15.17:0/1329108879 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86ec0c75b0 0x7f86ec0c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:11.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.874+0000 7f86f0d4c700 1 --2- 172.21.15.17:0/1329108879 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86ec0cc750 0x7f86ec16aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:11.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.874+0000 7f86f0d4c700 1 --2- 172.21.15.17:0/1329108879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86ec0ccfc0 0x7f86ec1546d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:11.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.874+0000 7f86f0d4c700 1 -- 172.21.15.17:0/1329108879 >> 172.21.15.17:0/1329108879 conn(0x7f86ec06cff0 msgr2=0x7f86ec156460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:11.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.874+0000 7f86f0d4c700 1 -- 172.21.15.17:0/1329108879 shutdown_connections 2023-10-06T04:44:11.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:11.874+0000 7f86f0d4c700 1 -- 172.21.15.17:0/1329108879 wait complete. 2023-10-06T04:44:11.890 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:43:21.795733+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:43:22.389592+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T04:44:11.890 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:44:12.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.009+0000 7f37c3fff700 1 Processor -- start 2023-10-06T04:44:12.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.009+0000 7f37c3fff700 1 -- start start 2023-10-06T04:44:12.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.010+0000 7f37c3fff700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37c40af540 0x7f37c40af910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:12.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.010+0000 7f37c3fff700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f37c415a650 0x7f37c415d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:12.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.010+0000 7f37c3fff700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f37c40cced0 0x7f37c40cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:12.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.010+0000 7f37c3fff700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37c40cd890 con 0x7f37c415a650 2023-10-06T04:44:12.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.010+0000 7f37c3fff700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37c415d660 con 0x7f37c40cced0 2023-10-06T04:44:12.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.010+0000 7f37c3fff700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c40ce890 con 0x7f37c40af540 2023-10-06T04:44:12.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.010+0000 7f37c27fc700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f37c415a650 0x7f37c415d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:12.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.010+0000 7f37c27fc700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f37c415a650 0x7f37c415d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47966/0 (socket says 172.21.15.17:47966) 2023-10-06T04:44:12.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.010+0000 7f37c27fc700 1 -- 172.21.15.17:0/839051567 learned_addr learned my addr 172.21.15.17:0/839051567 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:12.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.010+0000 7f37c2ffd700 1 --2- 172.21.15.17:0/839051567 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37c40af540 0x7f37c40af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:12.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.010+0000 7f37c37fe700 1 --2- 172.21.15.17:0/839051567 >> v2:172.21.15.136:3300/0 conn(0x7f37c40cced0 0x7f37c40cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:12.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.010+0000 7f37c27fc700 1 -- 172.21.15.17:0/839051567 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37c40af540 msgr2=0x7f37c40af910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:12.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.010+0000 7f37c27fc700 1 --2- 172.21.15.17:0/839051567 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37c40af540 0x7f37c40af910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:12.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.010+0000 7f37c27fc700 1 -- 172.21.15.17:0/839051567 >> v2:172.21.15.136:3300/0 conn(0x7f37c40cced0 msgr2=0x7f37c40cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:12.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.011+0000 7f37c27fc700 1 --2- 172.21.15.17:0/839051567 >> v2:172.21.15.136:3300/0 conn(0x7f37c40cced0 0x7f37c40cd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:12.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.011+0000 7f37c27fc700 1 -- 172.21.15.17:0/839051567 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c415aac0 con 0x7f37c415a650 2023-10-06T04:44:12.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.011+0000 7f37c37fe700 1 --2- 172.21.15.17:0/839051567 >> v2:172.21.15.136:3300/0 conn(0x7f37c40cced0 0x7f37c40cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:12.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.011+0000 7f37c27fc700 1 --2- 172.21.15.17:0/839051567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37c415a650 0x7f37c415d120 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f37c40caac0 tx=0x7f37ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a90f236f9dd33f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:12.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.011+0000 7f37c1ffb700 1 -- 172.21.15.17:0/839051567 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac009ea0 con 0x7f37c415a650 2023-10-06T04:44:12.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.011+0000 7f37c1ffb700 1 -- 172.21.15.17:0/839051567 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37ac00b820 con 0x7f37c415a650 2023-10-06T04:44:12.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.011+0000 7f37c1ffb700 1 -- 172.21.15.17:0/839051567 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac00bbc0 con 0x7f37c415a650 2023-10-06T04:44:12.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.011+0000 7f37c3fff700 1 -- 172.21.15.17:0/839051567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37c415a650 msgr2=0x7f37c415d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:12.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.011+0000 7f37c3fff700 1 --2- 172.21.15.17:0/839051567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37c415a650 0x7f37c415d120 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f37c40caac0 tx=0x7f37ac009250 comp rx=0 tx=0).stop 2023-10-06T04:44:12.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.011+0000 7f37c3fff700 1 -- 172.21.15.17:0/839051567 shutdown_connections 2023-10-06T04:44:12.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.011+0000 7f37c3fff700 1 --2- 172.21.15.17:0/839051567 >> v2:172.21.15.136:3300/0 conn(0x7f37c40cced0 0x7f37c40cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:12.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.011+0000 7f37c3fff700 1 --2- 172.21.15.17:0/839051567 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37c40af540 0x7f37c40af910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:12.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.011+0000 7f37c3fff700 1 --2- 172.21.15.17:0/839051567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37c415a650 0x7f37c415d120 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:12.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.011+0000 7f37c3fff700 1 -- 172.21.15.17:0/839051567 >> 172.21.15.17:0/839051567 conn(0x7f37c406d9b0 msgr2=0x7f37c406ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:12.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.011+0000 7f37c3fff700 1 -- 172.21.15.17:0/839051567 shutdown_connections 2023-10-06T04:44:12.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.011+0000 7f37c3fff700 1 -- 172.21.15.17:0/839051567 wait complete. 2023-10-06T04:44:12.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.013+0000 7f37c3fff700 1 Processor -- start 2023-10-06T04:44:12.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.013+0000 7f37c3fff700 1 -- start start 2023-10-06T04:44:12.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.013+0000 7f37c3fff700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37c40af540 0x7f37c414c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:12.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.013+0000 7f37c3fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37c40cced0 0x7f37c40b3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:12.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.013+0000 7f37c3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37c415a650 0x7f37c4158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:12.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.013+0000 7f37c3fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c40c8c90 con 0x7f37c415a650 2023-10-06T04:44:12.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.013+0000 7f37c3fff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c40c7580 con 0x7f37c40cced0 2023-10-06T04:44:12.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.013+0000 7f37c3fff700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c40c7860 con 0x7f37c40af540 2023-10-06T04:44:12.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.013+0000 7f37c37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37c415a650 0x7f37c4158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:12.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.014+0000 7f37c37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37c415a650 0x7f37c4158b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47982/0 (socket says 172.21.15.17:47982) 2023-10-06T04:44:12.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.014+0000 7f37c37fe700 1 -- 172.21.15.17:0/1037732891 learned_addr learned my addr 172.21.15.17:0/1037732891 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:12.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.014+0000 7f37c2ffd700 1 --2- 172.21.15.17:0/1037732891 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37c40af540 0x7f37c414c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:12.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.014+0000 7f37c27fc700 1 --2- 172.21.15.17:0/1037732891 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37c40cced0 0x7f37c40b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:12.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.014+0000 7f37c37fe700 1 -- 172.21.15.17:0/1037732891 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37c40af540 msgr2=0x7f37c414c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:12.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.014+0000 7f37c37fe700 1 --2- 172.21.15.17:0/1037732891 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37c40af540 0x7f37c414c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:12.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.014+0000 7f37c37fe700 1 -- 172.21.15.17:0/1037732891 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37c40cced0 msgr2=0x7f37c40b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:12.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.014+0000 7f37c37fe700 1 --2- 172.21.15.17:0/1037732891 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37c40cced0 0x7f37c40b3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:12.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.014+0000 7f37c37fe700 1 -- 172.21.15.17:0/1037732891 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37ac0094f0 con 0x7f37c415a650 2023-10-06T04:44:12.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.014+0000 7f37c27fc700 1 --2- 172.21.15.17:0/1037732891 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37c40cced0 0x7f37c40b3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:12.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.014+0000 7f37c37fe700 1 --2- 172.21.15.17:0/1037732891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37c415a650 0x7f37c4158b70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f37b400e870 tx=0x7f37b4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:12.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.014+0000 7f37baffd700 1 -- 172.21.15.17:0/1037732891 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b400c430 con 0x7f37c415a650 2023-10-06T04:44:12.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.014+0000 7f37baffd700 1 -- 172.21.15.17:0/1037732891 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b400c590 con 0x7f37c415a650 2023-10-06T04:44:12.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.014+0000 7f37c3fff700 1 -- 172.21.15.17:0/1037732891 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c40c7b40 con 0x7f37c415a650 2023-10-06T04:44:12.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.014+0000 7f37baffd700 1 -- 172.21.15.17:0/1037732891 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b400c910 con 0x7f37c415a650 2023-10-06T04:44:12.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.014+0000 7f37c3fff700 1 -- 172.21.15.17:0/1037732891 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c40c8100 con 0x7f37c415a650 2023-10-06T04:44:12.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.015+0000 7f37c3fff700 1 -- 172.21.15.17:0/1037732891 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37c404c380 con 0x7f37c415a650 2023-10-06T04:44:12.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.015+0000 7f37baffd700 1 -- 172.21.15.17:0/1037732891 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f37b400ccc0 con 0x7f37c415a650 2023-10-06T04:44:12.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.016+0000 7f37baffd700 1 --2- 172.21.15.17:0/1037732891 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f37a4066f60 0x7f37a4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:12.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.016+0000 7f37baffd700 1 -- 172.21.15.17:0/1037732891 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f37b4084140 con 0x7f37c415a650 2023-10-06T04:44:12.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.016+0000 7f37c2ffd700 1 --2- 172.21.15.17:0/1037732891 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f37a4066f60 0x7f37a4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:12.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.016+0000 7f37c2ffd700 1 --2- 172.21.15.17:0/1037732891 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f37a4066f60 0x7f37a4069410 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f37bc007600 tx=0x7f37bc00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:12.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.020+0000 7f37baffd700 1 -- 172.21.15.17:0/1037732891 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f37b4055030 con 0x7f37c415a650 2023-10-06T04:44:12.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.211+0000 7f37c3fff700 1 -- 172.21.15.17:0/1037732891 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f37c415d890 con 0x7f37c415a650 2023-10-06T04:44:12.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.212+0000 7f37baffd700 1 -- 172.21.15.17:0/1037732891 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f37b4054bc0 con 0x7f37c415a650 2023-10-06T04:44:12.215 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-10-06T04:44:12.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.214+0000 7f37c3fff700 1 -- 172.21.15.17:0/1037732891 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f37a4066f60 msgr2=0x7f37a4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:12.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.214+0000 7f37c3fff700 1 --2- 172.21.15.17:0/1037732891 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f37a4066f60 0x7f37a4069410 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f37bc007600 tx=0x7f37bc00b040 comp rx=0 tx=0).stop 2023-10-06T04:44:12.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.214+0000 7f37c3fff700 1 -- 172.21.15.17:0/1037732891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37c415a650 msgr2=0x7f37c4158b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:12.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.214+0000 7f37c3fff700 1 --2- 172.21.15.17:0/1037732891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37c415a650 0x7f37c4158b70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f37b400e870 tx=0x7f37b4008040 comp rx=0 tx=0).stop 2023-10-06T04:44:12.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.214+0000 7f37c3fff700 1 -- 172.21.15.17:0/1037732891 shutdown_connections 2023-10-06T04:44:12.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.214+0000 7f37c3fff700 1 --2- 172.21.15.17:0/1037732891 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f37a4066f60 0x7f37a4069410 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:12.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.214+0000 7f37c3fff700 1 --2- 172.21.15.17:0/1037732891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37c415a650 0x7f37c4158b70 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:12.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.214+0000 7f37c3fff700 1 --2- 172.21.15.17:0/1037732891 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37c40af540 0x7f37c414c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:12.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.214+0000 7f37c3fff700 1 --2- 172.21.15.17:0/1037732891 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37c40cced0 0x7f37c40b3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:12.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.214+0000 7f37c3fff700 1 -- 172.21.15.17:0/1037732891 >> 172.21.15.17:0/1037732891 conn(0x7f37c406d9b0 msgr2=0x7f37c41581d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:12.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.214+0000 7f37c3fff700 1 -- 172.21.15.17:0/1037732891 shutdown_connections 2023-10-06T04:44:12.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.214+0000 7f37c3fff700 1 -- 172.21.15.17:0/1037732891 wait complete. 2023-10-06T04:44:12.229 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:44:12.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.349+0000 7f8f9ef52700 1 Processor -- start 2023-10-06T04:44:12.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.349+0000 7f8f9ef52700 1 -- start start 2023-10-06T04:44:12.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.350+0000 7f8f9ef52700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8f9806a520 0x7f8f980af830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:12.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.350+0000 7f8f9ef52700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8f98156560 0x7f8f980cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:12.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.350+0000 7f8f9ef52700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f98156980 con 0x7f8f9806a8f0 2023-10-06T04:44:12.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.350+0000 7f8f9ef52700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f9806c560 con 0x7f8f9806a520 2023-10-06T04:44:12.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.350+0000 7f8f9ef52700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f980aff30 con 0x7f8f98156560 2023-10-06T04:44:12.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.350+0000 7f8f9df50700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8f9806a520 0x7f8f980af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:12.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.350+0000 7f8f9df50700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8f9806a520 0x7f8f980af830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47998/0 (socket says 172.21.15.17:47998) 2023-10-06T04:44:12.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.350+0000 7f8f9df50700 1 -- 172.21.15.17:0/2614809975 learned_addr learned my addr 172.21.15.17:0/2614809975 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:12.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.351+0000 7f8f9e751700 1 --2- 172.21.15.17:0/2614809975 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8f98156560 0x7f8f980cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:12.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.351+0000 7f8f9df50700 1 -- 172.21.15.17:0/2614809975 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8f98156560 msgr2=0x7f8f980cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:12.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.351+0000 7f8f9df50700 1 --2- 172.21.15.17:0/2614809975 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8f98156560 0x7f8f980cc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:12.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.351+0000 7f8f9df50700 1 -- 172.21.15.17:0/2614809975 >> v1:172.21.15.136:6789/0 conn(0x7f8f9806a8f0 legacy=0x7f8f98155e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:12.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.351+0000 7f8f9df50700 1 -- 172.21.15.17:0/2614809975 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f980b0210 con 0x7f8f9806a520 2023-10-06T04:44:12.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.351+0000 7f8f9df50700 1 --2- 172.21.15.17:0/2614809975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f9806a520 0x7f8f980af830 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8f88009f20 tx=0x7f8f88009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38978a4ee795252f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:12.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.351+0000 7f8f9cf4e700 1 -- 172.21.15.17:0/2614809975 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8800e070 con 0x7f8f9806a520 2023-10-06T04:44:12.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.351+0000 7f8f9cf4e700 1 -- 172.21.15.17:0/2614809975 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8800ba80 con 0x7f8f9806a520 2023-10-06T04:44:12.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.351+0000 7f8f9cf4e700 1 -- 172.21.15.17:0/2614809975 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f880092e0 con 0x7f8f9806a520 2023-10-06T04:44:12.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.352+0000 7f8f9ef52700 1 -- 172.21.15.17:0/2614809975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f9806a520 msgr2=0x7f8f980af830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:12.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.352+0000 7f8f9ef52700 1 --2- 172.21.15.17:0/2614809975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f9806a520 0x7f8f980af830 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8f88009f20 tx=0x7f8f88009840 comp rx=0 tx=0).stop 2023-10-06T04:44:12.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.352+0000 7f8f9ef52700 1 -- 172.21.15.17:0/2614809975 shutdown_connections 2023-10-06T04:44:12.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.352+0000 7f8f9ef52700 1 --2- 172.21.15.17:0/2614809975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f9806a520 0x7f8f980af830 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:12.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.352+0000 7f8f9ef52700 1 --2- 172.21.15.17:0/2614809975 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8f98156560 0x7f8f980cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:12.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.352+0000 7f8f9ef52700 1 -- 172.21.15.17:0/2614809975 >> 172.21.15.17:0/2614809975 conn(0x7f8f9806ea70 msgr2=0x7f8f9806ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:12.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.352+0000 7f8f9ef52700 1 -- 172.21.15.17:0/2614809975 shutdown_connections 2023-10-06T04:44:12.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.352+0000 7f8f9ef52700 1 -- 172.21.15.17:0/2614809975 wait complete. 2023-10-06T04:44:12.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.353+0000 7f8f9ef52700 1 Processor -- start 2023-10-06T04:44:12.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.353+0000 7f8f9ef52700 1 -- start start 2023-10-06T04:44:12.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.353+0000 7f8f9ef52700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8f9806a520 0x7f8f9814e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:12.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.353+0000 7f8f9ef52700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f9806a8f0 0x7f8f980c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:12.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.353+0000 7f8f9ef52700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8f98156560 0x7f8f9814a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:12.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.354+0000 7f8f9ef52700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9814ec20 con 0x7f8f9806a8f0 2023-10-06T04:44:12.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.354+0000 7f8f9ef52700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9814b010 con 0x7f8f98156560 2023-10-06T04:44:12.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.354+0000 7f8f9ef52700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f98167fa0 con 0x7f8f9806a520 2023-10-06T04:44:12.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.354+0000 7f8f9d74f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f9806a8f0 0x7f8f980c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:12.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.354+0000 7f8f9d74f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f9806a8f0 0x7f8f980c8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48014/0 (socket says 172.21.15.17:48014) 2023-10-06T04:44:12.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.354+0000 7f8f9d74f700 1 -- 172.21.15.17:0/177400529 learned_addr learned my addr 172.21.15.17:0/177400529 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:12.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.354+0000 7f8f9df50700 1 --2- 172.21.15.17:0/177400529 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8f9806a520 0x7f8f9814e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:12.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.354+0000 7f8f9e751700 1 --2- 172.21.15.17:0/177400529 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8f98156560 0x7f8f9814a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:12.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.354+0000 7f8f9d74f700 1 -- 172.21.15.17:0/177400529 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8f9806a520 msgr2=0x7f8f9814e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:12.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.354+0000 7f8f9d74f700 1 --2- 172.21.15.17:0/177400529 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8f9806a520 0x7f8f9814e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:12.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.354+0000 7f8f9d74f700 1 -- 172.21.15.17:0/177400529 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8f98156560 msgr2=0x7f8f9814a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:12.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.354+0000 7f8f9d74f700 1 --2- 172.21.15.17:0/177400529 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8f98156560 0x7f8f9814a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:12.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.354+0000 7f8f9d74f700 1 -- 172.21.15.17:0/177400529 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f88009ae0 con 0x7f8f9806a8f0 2023-10-06T04:44:12.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.354+0000 7f8f9d74f700 1 --2- 172.21.15.17:0/177400529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f9806a8f0 0x7f8f980c8c30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c00c590 tx=0x7f8f8c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:12.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.354+0000 7f8f95ffb700 1 -- 172.21.15.17:0/177400529 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c011590 con 0x7f8f9806a8f0 2023-10-06T04:44:12.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.354+0000 7f8f95ffb700 1 -- 172.21.15.17:0/177400529 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8c0116f0 con 0x7f8f9806a8f0 2023-10-06T04:44:12.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.354+0000 7f8f9ef52700 1 -- 172.21.15.17:0/177400529 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f98168280 con 0x7f8f9806a8f0 2023-10-06T04:44:12.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.354+0000 7f8f95ffb700 1 -- 172.21.15.17:0/177400529 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c011ab0 con 0x7f8f9806a8f0 2023-10-06T04:44:12.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.355+0000 7f8f9ef52700 1 -- 172.21.15.17:0/177400529 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f98168840 con 0x7f8f9806a8f0 2023-10-06T04:44:12.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.355+0000 7f8f9ef52700 1 -- 172.21.15.17:0/177400529 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f9804c380 con 0x7f8f9806a8f0 2023-10-06T04:44:12.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.356+0000 7f8f95ffb700 1 -- 172.21.15.17:0/177400529 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8f8c01b3b0 con 0x7f8f9806a8f0 2023-10-06T04:44:12.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.356+0000 7f8f95ffb700 1 --2- 172.21.15.17:0/177400529 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8f84066f30 0x7f8f840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:12.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.356+0000 7f8f95ffb700 1 -- 172.21.15.17:0/177400529 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f8f8c083990 con 0x7f8f9806a8f0 2023-10-06T04:44:12.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.356+0000 7f8f9df50700 1 --2- 172.21.15.17:0/177400529 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8f84066f30 0x7f8f840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:12.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.357+0000 7f8f9df50700 1 --2- 172.21.15.17:0/177400529 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8f84066f30 0x7f8f840693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8f980687b0 tx=0x7f8f88018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:12.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.361+0000 7f8f95ffb700 1 -- 172.21.15.17:0/177400529 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8f8c050d50 con 0x7f8f9806a8f0 2023-10-06T04:44:12.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.554+0000 7f8f9ef52700 1 -- 172.21.15.17:0/177400529 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8f9806b090 con 0x7f8f9806a8f0 2023-10-06T04:44:12.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.555+0000 7f8f95ffb700 1 -- 172.21.15.17:0/177400529 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8f8c017020 con 0x7f8f9806a8f0 2023-10-06T04:44:12.558 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-10-06T04:44:12.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.557+0000 7f8f9ef52700 1 -- 172.21.15.17:0/177400529 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8f84066f30 msgr2=0x7f8f840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:12.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.557+0000 7f8f9ef52700 1 --2- 172.21.15.17:0/177400529 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8f84066f30 0x7f8f840693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8f980687b0 tx=0x7f8f88018000 comp rx=0 tx=0).stop 2023-10-06T04:44:12.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.557+0000 7f8f9ef52700 1 -- 172.21.15.17:0/177400529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f9806a8f0 msgr2=0x7f8f980c8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:12.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.557+0000 7f8f9ef52700 1 --2- 172.21.15.17:0/177400529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f9806a8f0 0x7f8f980c8c30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c00c590 tx=0x7f8f8c00c950 comp rx=0 tx=0).stop 2023-10-06T04:44:12.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.557+0000 7f8f9ef52700 1 -- 172.21.15.17:0/177400529 shutdown_connections 2023-10-06T04:44:12.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.557+0000 7f8f9ef52700 1 --2- 172.21.15.17:0/177400529 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8f84066f30 0x7f8f840693e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:12.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.557+0000 7f8f9ef52700 1 --2- 172.21.15.17:0/177400529 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8f98156560 0x7f8f9814a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:12.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.557+0000 7f8f9ef52700 1 --2- 172.21.15.17:0/177400529 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8f9806a520 0x7f8f9814e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:12.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.557+0000 7f8f9ef52700 1 --2- 172.21.15.17:0/177400529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f9806a8f0 0x7f8f980c8c30 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:12.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.557+0000 7f8f9ef52700 1 -- 172.21.15.17:0/177400529 >> 172.21.15.17:0/177400529 conn(0x7f8f9806ea70 msgr2=0x7f8f9814ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:12.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.557+0000 7f8f9ef52700 1 -- 172.21.15.17:0/177400529 shutdown_connections 2023-10-06T04:44:12.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.557+0000 7f8f9ef52700 1 -- 172.21.15.17:0/177400529 wait complete. 2023-10-06T04:44:12.572 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T04:44:12.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.688+0000 7f25eda15700 1 Processor -- start 2023-10-06T04:44:12.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.688+0000 7f25eda15700 1 -- start start 2023-10-06T04:44:12.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.689+0000 7f25eda15700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f25e80cf3b0 0x7f25e81594a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:12.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.689+0000 7f25eda15700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e80cbd80 con 0x7f25e80af0a0 2023-10-06T04:44:12.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.689+0000 7f25eda15700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e80af5f0 con 0x7f25e80ccfc0 2023-10-06T04:44:12.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.689+0000 7f25eda15700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25e80af8d0 con 0x7f25e80cf3b0 2023-10-06T04:44:12.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.689+0000 7f25ed214700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f25e80af0a0 0x7f25e80b0460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:54072/0 (socket says 172.21.15.17:54072) 2023-10-06T04:44:12.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.689+0000 7f25ed214700 1 -- 172.21.15.17:0/4232085631 learned_addr learned my addr 172.21.15.17:0/4232085631 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:12.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.689+0000 7f25e7fff700 1 --2- 172.21.15.17:0/4232085631 >> v2:172.21.15.136:3300/0 conn(0x7f25e80cf3b0 0x7f25e81594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:12.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.689+0000 7f25e77fe700 1 -- 172.21.15.17:0/4232085631 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4075034664 0 0) 0x7f25e80cbd80 con 0x7f25e80af0a0 2023-10-06T04:44:12.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.689+0000 7f25e77fe700 1 -- 172.21.15.17:0/4232085631 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25d8003570 con 0x7f25e80af0a0 2023-10-06T04:44:12.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.689+0000 7f25e77fe700 1 -- 172.21.15.17:0/4232085631 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3753521720 0 0) 0x7f25d8003570 con 0x7f25e80af0a0 2023-10-06T04:44:12.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.689+0000 7f25e77fe700 1 -- 172.21.15.17:0/4232085631 >> v2:172.21.15.136:3300/0 conn(0x7f25e80cf3b0 msgr2=0x7f25e81594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:12.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.689+0000 7f25e77fe700 1 --2- 172.21.15.17:0/4232085631 >> v2:172.21.15.136:3300/0 conn(0x7f25e80cf3b0 0x7f25e81594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:12.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.689+0000 7f25e77fe700 1 -- 172.21.15.17:0/4232085631 >> v1:172.21.15.136:6789/0 conn(0x7f25e80ccfc0 legacy=0x7f25e80cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:12.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.689+0000 7f25e77fe700 1 -- 172.21.15.17:0/4232085631 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e80afbb0 con 0x7f25e80af0a0 2023-10-06T04:44:12.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.690+0000 7f25e77fe700 1 -- 172.21.15.17:0/4232085631 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4268781140 0 0) 0x7f25e00017f0 con 0x7f25e80af0a0 2023-10-06T04:44:12.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.690+0000 7f25e77fe700 1 -- 172.21.15.17:0/4232085631 >> v1:172.21.15.17:6789/0 conn(0x7f25e80af0a0 legacy=0x7f25e80b0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:12.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.690+0000 7f25e77fe700 1 --2- 172.21.15.17:0/4232085631 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f25d8003a90 0x7f25d8003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:12.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.690+0000 7f25e77fe700 1 --2- 172.21.15.17:0/4232085631 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f25d8004810 0x7f25d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:12.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.690+0000 7f25e77fe700 1 --2- 172.21.15.17:0/4232085631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25d8005210 0x7f25d800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:12.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.690+0000 7f25e77fe700 1 -- 172.21.15.17:0/4232085631 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e80af8d0 con 0x7f25d8005210 2023-10-06T04:44:12.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.690+0000 7f25e77fe700 1 -- 172.21.15.17:0/4232085631 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d800c1b0 con 0x7f25d8003a90 2023-10-06T04:44:12.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.690+0000 7f25e77fe700 1 -- 172.21.15.17:0/4232085631 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d800c370 con 0x7f25d8004810 2023-10-06T04:44:12.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.690+0000 7f25e7fff700 1 --2- 172.21.15.17:0/4232085631 >> v2:172.21.15.136:3300/0 conn(0x7f25e80cf3b0 0x7f25e81594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:44:12.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.690+0000 7f25ed214700 1 --2- 172.21.15.17:0/4232085631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25d8005210 0x7f25d800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:12.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.690+0000 7f25eca13700 1 --2- 172.21.15.17:0/4232085631 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f25d8003a90 0x7f25d8003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:12.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.690+0000 7f25e7fff700 1 --2- 172.21.15.17:0/4232085631 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f25d8004810 0x7f25d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:12.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.690+0000 7f25ed214700 1 -- 172.21.15.17:0/4232085631 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f25d8004810 msgr2=0x7f25d8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:12.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.690+0000 7f25ed214700 1 --2- 172.21.15.17:0/4232085631 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f25d8004810 0x7f25d8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:12.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.690+0000 7f25ed214700 1 -- 172.21.15.17:0/4232085631 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f25d8003a90 msgr2=0x7f25d8003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:12.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.690+0000 7f25ed214700 1 --2- 172.21.15.17:0/4232085631 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f25d8003a90 0x7f25d8003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:12.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.690+0000 7f25ed214700 1 -- 172.21.15.17:0/4232085631 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d8003570 con 0x7f25d8005210 2023-10-06T04:44:12.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.690+0000 7f25e7fff700 1 --2- 172.21.15.17:0/4232085631 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f25d8004810 0x7f25d8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:12.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.690+0000 7f25ed214700 1 -- 172.21.15.17:0/4232085631 reap_dead start 2023-10-06T04:44:12.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.690+0000 7f25ed214700 1 --2- 172.21.15.17:0/4232085631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25d8005210 0x7f25d800ba60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f25e80af520 tx=0x7f25e00021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c288747d8f113ccf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:12.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.690+0000 7f25e77fe700 1 -- 172.21.15.17:0/4232085631 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e00070d0 con 0x7f25d8005210 2023-10-06T04:44:12.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.690+0000 7f25e77fe700 1 -- 172.21.15.17:0/4232085631 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e0007230 con 0x7f25d8005210 2023-10-06T04:44:12.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.690+0000 7f25e77fe700 1 -- 172.21.15.17:0/4232085631 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e00075f0 con 0x7f25d8005210 2023-10-06T04:44:12.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.691+0000 7f25eda15700 1 -- 172.21.15.17:0/4232085631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25d8005210 msgr2=0x7f25d800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:12.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.691+0000 7f25eda15700 1 --2- 172.21.15.17:0/4232085631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25d8005210 0x7f25d800ba60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f25e80af520 tx=0x7f25e00021d0 comp rx=0 tx=0).stop 2023-10-06T04:44:12.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.691+0000 7f25eda15700 1 -- 172.21.15.17:0/4232085631 shutdown_connections 2023-10-06T04:44:12.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.691+0000 7f25eda15700 1 --2- 172.21.15.17:0/4232085631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25d8005210 0x7f25d800ba60 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:12.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.691+0000 7f25eda15700 1 -- 172.21.15.17:0/4232085631 >> 172.21.15.17:0/4232085631 conn(0x7f25e806cff0 msgr2=0x7f25e806da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:12.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.691+0000 7f25eda15700 1 -- 172.21.15.17:0/4232085631 shutdown_connections 2023-10-06T04:44:12.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.691+0000 7f25eda15700 1 -- 172.21.15.17:0/4232085631 wait complete. 2023-10-06T04:44:12.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.692+0000 7f25eda15700 1 Processor -- start 2023-10-06T04:44:12.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.692+0000 7f25eda15700 1 -- start start 2023-10-06T04:44:12.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.693+0000 7f25eda15700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25d8005210 0x7f25e8154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:12.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.693+0000 7f25eda15700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f25e81454b0 0x7f25e8154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:12.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.693+0000 7f25eda15700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f25e8155430 0x7f25e816d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:12.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.693+0000 7f25eda15700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e81558a0 con 0x7f25d8005210 2023-10-06T04:44:12.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.693+0000 7f25eda15700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e80b0550 con 0x7f25e81454b0 2023-10-06T04:44:12.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.693+0000 7f25eda15700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e80c8180 con 0x7f25e8155430 2023-10-06T04:44:12.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.693+0000 7f25eca13700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25d8005210 0x7f25e8154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:12.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.693+0000 7f25eca13700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25d8005210 0x7f25e8154560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48028/0 (socket says 172.21.15.17:48028) 2023-10-06T04:44:12.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.693+0000 7f25eca13700 1 -- 172.21.15.17:0/1602676096 learned_addr learned my addr 172.21.15.17:0/1602676096 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:12.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.693+0000 7f25ed214700 1 --2- 172.21.15.17:0/1602676096 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f25e8155430 0x7f25e816d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:12.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.693+0000 7f25e7fff700 1 --2- 172.21.15.17:0/1602676096 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f25e81454b0 0x7f25e8154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:12.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.693+0000 7f25eca13700 1 -- 172.21.15.17:0/1602676096 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f25e8155430 msgr2=0x7f25e816d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:12.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.693+0000 7f25eca13700 1 --2- 172.21.15.17:0/1602676096 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f25e8155430 0x7f25e816d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:12.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.693+0000 7f25eca13700 1 -- 172.21.15.17:0/1602676096 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f25e81454b0 msgr2=0x7f25e8154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:12.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.693+0000 7f25eca13700 1 --2- 172.21.15.17:0/1602676096 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f25e81454b0 0x7f25e8154ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:12.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.693+0000 7f25eca13700 1 -- 172.21.15.17:0/1602676096 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e80c8420 con 0x7f25d8005210 2023-10-06T04:44:12.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.694+0000 7f25eca13700 1 --2- 172.21.15.17:0/1602676096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25d8005210 0x7f25e8154560 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f25dc002950 tx=0x7f25dc007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:12.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.694+0000 7f25e4ff9700 1 -- 172.21.15.17:0/1602676096 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc002e90 con 0x7f25d8005210 2023-10-06T04:44:12.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.694+0000 7f25e4ff9700 1 -- 172.21.15.17:0/1602676096 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25dc00f8d0 con 0x7f25d8005210 2023-10-06T04:44:12.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.694+0000 7f25eda15700 1 -- 172.21.15.17:0/1602676096 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e80c8700 con 0x7f25d8005210 2023-10-06T04:44:12.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.694+0000 7f25e4ff9700 1 -- 172.21.15.17:0/1602676096 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc00fc90 con 0x7f25d8005210 2023-10-06T04:44:12.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.694+0000 7f25eda15700 1 -- 172.21.15.17:0/1602676096 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e80c8cc0 con 0x7f25d8005210 2023-10-06T04:44:12.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.695+0000 7f25eda15700 1 -- 172.21.15.17:0/1602676096 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25e80b0830 con 0x7f25d8005210 2023-10-06T04:44:12.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.695+0000 7f25e4ff9700 1 -- 172.21.15.17:0/1602676096 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f25dc006820 con 0x7f25d8005210 2023-10-06T04:44:12.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.695+0000 7f25e4ff9700 1 --2- 172.21.15.17:0/1602676096 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f25cc066f30 0x7f25cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:12.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.696+0000 7f25e4ff9700 1 -- 172.21.15.17:0/1602676096 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f25dc0844c0 con 0x7f25d8005210 2023-10-06T04:44:12.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.696+0000 7f25e7fff700 1 --2- 172.21.15.17:0/1602676096 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f25cc066f30 0x7f25cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:12.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.696+0000 7f25e7fff700 1 --2- 172.21.15.17:0/1602676096 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f25cc066f30 0x7f25cc0693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f25e816d380 tx=0x7f25d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:12.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.700+0000 7f25e4ff9700 1 -- 172.21.15.17:0/1602676096 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f25dc051920 con 0x7f25d8005210 2023-10-06T04:44:12.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.894+0000 7f25eda15700 1 -- 172.21.15.17:0/1602676096 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f25e804c380 con 0x7f25d8005210 2023-10-06T04:44:12.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.894+0000 7f25e4ff9700 1 -- 172.21.15.17:0/1602676096 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) v1 ==== 84+0+126 (secure 0 0 0) 0x7f25dc054f40 con 0x7f25d8005210 2023-10-06T04:44:12.897 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:12.897 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2023-10-06T04:44:12.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:44:12.897 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2023-10-06T04:44:12.897 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": "rbd" 2023-10-06T04:44:12.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-06T04:44:12.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:44:12.898 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 2, 2023-10-06T04:44:12.898 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2023-10-06T04:44:12.898 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-06T04:44:12.898 INFO:teuthology.orchestra.run.smithi017.stdout:] 2023-10-06T04:44:12.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.896+0000 7f25eda15700 1 -- 172.21.15.17:0/1602676096 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f25cc066f30 msgr2=0x7f25cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:12.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.896+0000 7f25eda15700 1 --2- 172.21.15.17:0/1602676096 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f25cc066f30 0x7f25cc0693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f25e816d380 tx=0x7f25d4008040 comp rx=0 tx=0).stop 2023-10-06T04:44:12.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.896+0000 7f25eda15700 1 -- 172.21.15.17:0/1602676096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25d8005210 msgr2=0x7f25e8154560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:12.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.896+0000 7f25eda15700 1 --2- 172.21.15.17:0/1602676096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25d8005210 0x7f25e8154560 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f25dc002950 tx=0x7f25dc007d30 comp rx=0 tx=0).stop 2023-10-06T04:44:12.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.896+0000 7f25eda15700 1 -- 172.21.15.17:0/1602676096 shutdown_connections 2023-10-06T04:44:12.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.896+0000 7f25eda15700 1 --2- 172.21.15.17:0/1602676096 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f25cc066f30 0x7f25cc0693e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:12.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.896+0000 7f25eda15700 1 --2- 172.21.15.17:0/1602676096 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f25e8155430 0x7f25e816d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:12.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.896+0000 7f25eda15700 1 --2- 172.21.15.17:0/1602676096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25d8005210 0x7f25e8154560 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:12.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.896+0000 7f25eda15700 1 --2- 172.21.15.17:0/1602676096 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f25e81454b0 0x7f25e8154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:12.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.896+0000 7f25eda15700 1 -- 172.21.15.17:0/1602676096 >> 172.21.15.17:0/1602676096 conn(0x7f25e806cff0 msgr2=0x7f25e814ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:12.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.896+0000 7f25eda15700 1 -- 172.21.15.17:0/1602676096 shutdown_connections 2023-10-06T04:44:12.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:12.896+0000 7f25eda15700 1 -- 172.21.15.17:0/1602676096 wait complete. 2023-10-06T04:44:12.911 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T04:44:12.911 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T04:44:13.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.030+0000 7f86d6042700 1 Processor -- start 2023-10-06T04:44:13.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.030+0000 7f86d6042700 1 -- start start 2023-10-06T04:44:13.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.031+0000 7f86d6042700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86d00cb6b0 0x7f86d00cd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:13.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.031+0000 7f86d6042700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f86d00cbb30 0x7f86d00cd590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:13.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.031+0000 7f86d6042700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86d00cc050 con 0x7f86d0150360 2023-10-06T04:44:13.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.031+0000 7f86d6042700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86d00cc330 con 0x7f86d00cbb30 2023-10-06T04:44:13.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.031+0000 7f86d6042700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d00cdad0 con 0x7f86d00cb6b0 2023-10-06T04:44:13.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.031+0000 7f86cffff700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f86d00cbb30 0x7f86d00cd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:13.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.031+0000 7f86cf7fe700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f86d0150360 0x7f86d0150730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:54084/0 (socket says 172.21.15.17:54084) 2023-10-06T04:44:13.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.031+0000 7f86cffff700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f86d00cbb30 0x7f86d00cd590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48044/0 (socket says 172.21.15.17:48044) 2023-10-06T04:44:13.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.031+0000 7f86cf7fe700 1 -- 172.21.15.17:0/520190884 learned_addr learned my addr 172.21.15.17:0/520190884 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:13.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.032+0000 7f86ceffd700 1 --2- 172.21.15.17:0/520190884 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86d00cb6b0 0x7f86d00cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:13.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.032+0000 7f86cffff700 1 -- 172.21.15.17:0/520190884 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86d00cb6b0 msgr2=0x7f86d00cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:13.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.032+0000 7f86cffff700 1 --2- 172.21.15.17:0/520190884 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86d00cb6b0 0x7f86d00cd050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:13.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.032+0000 7f86cffff700 1 -- 172.21.15.17:0/520190884 >> v1:172.21.15.17:6789/0 conn(0x7f86d0150360 legacy=0x7f86d0150730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:13.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.032+0000 7f86cffff700 1 -- 172.21.15.17:0/520190884 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d015b130 con 0x7f86d00cbb30 2023-10-06T04:44:13.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.032+0000 7f86ce7fc700 1 -- 172.21.15.17:0/520190884 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4049028656 0 0) 0x7f86d00cc050 con 0x7f86d0150360 2023-10-06T04:44:13.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.032+0000 7f86cffff700 1 --2- 172.21.15.17:0/520190884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86d00cbb30 0x7f86d00cd590 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f86c8009e60 tx=0x7f86c8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=563842bd366ba251 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:13.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.032+0000 7f86ce7fc700 1 -- 172.21.15.17:0/520190884 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c800e070 con 0x7f86d00cbb30 2023-10-06T04:44:13.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.032+0000 7f86ce7fc700 1 -- 172.21.15.17:0/520190884 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c800bc30 con 0x7f86d00cbb30 2023-10-06T04:44:13.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.032+0000 7f86ce7fc700 1 -- 172.21.15.17:0/520190884 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c8012430 con 0x7f86d00cbb30 2023-10-06T04:44:13.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.033+0000 7f86d6042700 1 -- 172.21.15.17:0/520190884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86d00cbb30 msgr2=0x7f86d00cd590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:13.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.033+0000 7f86d6042700 1 --2- 172.21.15.17:0/520190884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86d00cbb30 0x7f86d00cd590 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f86c8009e60 tx=0x7f86c8009780 comp rx=0 tx=0).stop 2023-10-06T04:44:13.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.033+0000 7f86d6042700 1 -- 172.21.15.17:0/520190884 shutdown_connections 2023-10-06T04:44:13.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.033+0000 7f86d6042700 1 --2- 172.21.15.17:0/520190884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86d00cbb30 0x7f86d00cd590 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:13.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.033+0000 7f86d6042700 1 --2- 172.21.15.17:0/520190884 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86d00cb6b0 0x7f86d00cd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:13.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.033+0000 7f86d6042700 1 -- 172.21.15.17:0/520190884 >> 172.21.15.17:0/520190884 conn(0x7f86d008a180 msgr2=0x7f86d0099aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:13.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.033+0000 7f86d6042700 1 -- 172.21.15.17:0/520190884 shutdown_connections 2023-10-06T04:44:13.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.033+0000 7f86d6042700 1 -- 172.21.15.17:0/520190884 wait complete. 2023-10-06T04:44:13.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.034+0000 7f86d6042700 1 Processor -- start 2023-10-06T04:44:13.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.034+0000 7f86d6042700 1 -- start start 2023-10-06T04:44:13.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.035+0000 7f86d6042700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86d00cb6b0 0x7f86d0158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:13.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.035+0000 7f86d6042700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86d00cbb30 0x7f86d00b4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:13.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.035+0000 7f86d6042700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86d0150360 0x7f86d00b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:13.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.035+0000 7f86d6042700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d00b5fb0 con 0x7f86d0150360 2023-10-06T04:44:13.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.035+0000 7f86d6042700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d0158e20 con 0x7f86d00cbb30 2023-10-06T04:44:13.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.035+0000 7f86d6042700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d00b6440 con 0x7f86d00cb6b0 2023-10-06T04:44:13.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.035+0000 7f86cffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86d0150360 0x7f86d00b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:13.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.035+0000 7f86cffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86d0150360 0x7f86d00b4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48046/0 (socket says 172.21.15.17:48046) 2023-10-06T04:44:13.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.035+0000 7f86cffff700 1 -- 172.21.15.17:0/3618230706 learned_addr learned my addr 172.21.15.17:0/3618230706 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:13.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.035+0000 7f86cf7fe700 1 --2- 172.21.15.17:0/3618230706 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86d00cb6b0 0x7f86d0158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:13.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.035+0000 7f86ceffd700 1 --2- 172.21.15.17:0/3618230706 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86d00cbb30 0x7f86d00b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:13.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.035+0000 7f86cffff700 1 -- 172.21.15.17:0/3618230706 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86d00cb6b0 msgr2=0x7f86d0158100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:13.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.035+0000 7f86cffff700 1 --2- 172.21.15.17:0/3618230706 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86d00cb6b0 0x7f86d0158100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:13.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.035+0000 7f86cffff700 1 -- 172.21.15.17:0/3618230706 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86d00cbb30 msgr2=0x7f86d00b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:13.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.035+0000 7f86cffff700 1 --2- 172.21.15.17:0/3618230706 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86d00cbb30 0x7f86d00b4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:13.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.035+0000 7f86cffff700 1 -- 172.21.15.17:0/3618230706 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c8009a20 con 0x7f86d0150360 2023-10-06T04:44:13.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.035+0000 7f86cffff700 1 --2- 172.21.15.17:0/3618230706 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86d0150360 0x7f86d00b4cb0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f86d0088ed0 tx=0x7f86c8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:13.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.036+0000 7f86b77fe700 1 -- 172.21.15.17:0/3618230706 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c8027470 con 0x7f86d0150360 2023-10-06T04:44:13.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.036+0000 7f86b77fe700 1 -- 172.21.15.17:0/3618230706 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c80275f0 con 0x7f86d0150360 2023-10-06T04:44:13.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.036+0000 7f86b77fe700 1 -- 172.21.15.17:0/3618230706 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c80279b0 con 0x7f86d0150360 2023-10-06T04:44:13.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.036+0000 7f86d6042700 1 -- 172.21.15.17:0/3618230706 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86d00b53a0 con 0x7f86d0150360 2023-10-06T04:44:13.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.036+0000 7f86d6042700 1 -- 172.21.15.17:0/3618230706 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86d00b5960 con 0x7f86d0150360 2023-10-06T04:44:13.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.037+0000 7f86d6042700 1 -- 172.21.15.17:0/3618230706 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86d00b6160 con 0x7f86d0150360 2023-10-06T04:44:13.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.037+0000 7f86b77fe700 1 -- 172.21.15.17:0/3618230706 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f86c8024070 con 0x7f86d0150360 2023-10-06T04:44:13.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.038+0000 7f86b77fe700 1 --2- 172.21.15.17:0/3618230706 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f86bc066f30 0x7f86bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:13.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.038+0000 7f86b77fe700 1 -- 172.21.15.17:0/3618230706 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f86c8086bb0 con 0x7f86d0150360 2023-10-06T04:44:13.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.038+0000 7f86cf7fe700 1 --2- 172.21.15.17:0/3618230706 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f86bc066f30 0x7f86bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:13.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.038+0000 7f86cf7fe700 1 --2- 172.21.15.17:0/3618230706 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f86bc066f30 0x7f86bc0693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f86c0007160 tx=0x7f86c0007f50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:13.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.042+0000 7f86b77fe700 1 -- 172.21.15.17:0/3618230706 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f86d00b6160 con 0x7f86d0150360 2023-10-06T04:44:13.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.234+0000 7f86d6042700 1 -- 172.21.15.17:0/3618230706 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f86d00b6160 con 0x7f86d0150360 2023-10-06T04:44:13.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.574+0000 7f86b77fe700 1 -- 172.21.15.17:0/3618230706 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7f86d00b6160 con 0x7f86d0150360 2023-10-06T04:44:13.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.579+0000 7f86d6042700 1 -- 172.21.15.17:0/3618230706 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f86bc066f30 msgr2=0x7f86bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:13.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.579+0000 7f86d6042700 1 --2- 172.21.15.17:0/3618230706 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f86bc066f30 0x7f86bc0693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f86c0007160 tx=0x7f86c0007f50 comp rx=0 tx=0).stop 2023-10-06T04:44:13.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.579+0000 7f86d6042700 1 -- 172.21.15.17:0/3618230706 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86d0150360 msgr2=0x7f86d00b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:13.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.579+0000 7f86d6042700 1 --2- 172.21.15.17:0/3618230706 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86d0150360 0x7f86d00b4cb0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f86d0088ed0 tx=0x7f86c8019000 comp rx=0 tx=0).stop 2023-10-06T04:44:13.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.579+0000 7f86d6042700 1 -- 172.21.15.17:0/3618230706 shutdown_connections 2023-10-06T04:44:13.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.579+0000 7f86d6042700 1 --2- 172.21.15.17:0/3618230706 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f86bc066f30 0x7f86bc0693e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:13.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.579+0000 7f86d6042700 1 --2- 172.21.15.17:0/3618230706 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86d0150360 0x7f86d00b4cb0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:13.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.579+0000 7f86d6042700 1 --2- 172.21.15.17:0/3618230706 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86d00cb6b0 0x7f86d0158100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:13.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.579+0000 7f86d6042700 1 --2- 172.21.15.17:0/3618230706 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86d00cbb30 0x7f86d00b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:13.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.579+0000 7f86d6042700 1 -- 172.21.15.17:0/3618230706 >> 172.21.15.17:0/3618230706 conn(0x7f86d008a180 msgr2=0x7f86d006edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:13.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.580+0000 7f86d6042700 1 -- 172.21.15.17:0/3618230706 shutdown_connections 2023-10-06T04:44:13.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.580+0000 7f86d6042700 1 -- 172.21.15.17:0/3618230706 wait complete. 2023-10-06T04:44:13.584 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2023-10-06T04:44:13.596 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T04:44:13.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.722+0000 7fb4b6343700 1 Processor -- start 2023-10-06T04:44:13.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.722+0000 7fb4b6343700 1 -- start start 2023-10-06T04:44:13.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.723+0000 7fb4b6343700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb4b00cabf0 0x7fb4b00c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:13.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.723+0000 7fb4b6343700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb4b0159b10 0x7fb4b006f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:13.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.723+0000 7fb4b6343700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4b00d1120 con 0x7fb4b006d140 2023-10-06T04:44:13.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.723+0000 7fb4b6343700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4b00d1400 con 0x7fb4b00cabf0 2023-10-06T04:44:13.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.723+0000 7fb4b6343700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4b006e920 con 0x7fb4b0159b10 2023-10-06T04:44:13.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.723+0000 7fb4affff700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb4b00cabf0 0x7fb4b00c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:13.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.723+0000 7fb4affff700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb4b00cabf0 0x7fb4b00c7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48062/0 (socket says 172.21.15.17:48062) 2023-10-06T04:44:13.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.723+0000 7fb4affff700 1 -- 172.21.15.17:0/3735340335 learned_addr learned my addr 172.21.15.17:0/3735340335 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:13.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.723+0000 7fb4b48e0700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fb4b006d140 0x7fb4b006f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:54100/0 (socket says 172.21.15.17:54100) 2023-10-06T04:44:13.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.723+0000 7fb4af7fe700 1 --2- 172.21.15.17:0/3735340335 >> v2:172.21.15.136:3300/0 conn(0x7fb4b0159b10 0x7fb4b006f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:13.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.723+0000 7fb4affff700 1 -- 172.21.15.17:0/3735340335 >> v2:172.21.15.136:3300/0 conn(0x7fb4b0159b10 msgr2=0x7fb4b006f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:13.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.723+0000 7fb4affff700 1 --2- 172.21.15.17:0/3735340335 >> v2:172.21.15.136:3300/0 conn(0x7fb4b0159b10 0x7fb4b006f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:13.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.723+0000 7fb4affff700 1 -- 172.21.15.17:0/3735340335 >> v1:172.21.15.17:6789/0 conn(0x7fb4b006d140 legacy=0x7fb4b006f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:13.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.723+0000 7fb4aeffd700 1 -- 172.21.15.17:0/3735340335 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2741126518 0 0) 0x7fb4b00d1120 con 0x7fb4b006d140 2023-10-06T04:44:13.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.723+0000 7fb4affff700 1 -- 172.21.15.17:0/3735340335 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b006ec00 con 0x7fb4b00cabf0 2023-10-06T04:44:13.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.724+0000 7fb4affff700 1 --2- 172.21.15.17:0/3735340335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4b00cabf0 0x7fb4b00c7660 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb4b00cc490 tx=0x7fb498009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b41cfd84e63a4c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:13.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.724+0000 7fb4aeffd700 1 -- 172.21.15.17:0/3735340335 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb498005c10 con 0x7fb4b00cabf0 2023-10-06T04:44:13.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.724+0000 7fb4aeffd700 1 -- 172.21.15.17:0/3735340335 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb498005d70 con 0x7fb4b00cabf0 2023-10-06T04:44:13.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.724+0000 7fb4aeffd700 1 -- 172.21.15.17:0/3735340335 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb498006260 con 0x7fb4b00cabf0 2023-10-06T04:44:13.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.724+0000 7fb4b6343700 1 -- 172.21.15.17:0/3735340335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4b00cabf0 msgr2=0x7fb4b00c7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:13.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.724+0000 7fb4b6343700 1 --2- 172.21.15.17:0/3735340335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4b00cabf0 0x7fb4b00c7660 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb4b00cc490 tx=0x7fb498009220 comp rx=0 tx=0).stop 2023-10-06T04:44:13.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.724+0000 7fb4b6343700 1 -- 172.21.15.17:0/3735340335 shutdown_connections 2023-10-06T04:44:13.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.724+0000 7fb4b6343700 1 --2- 172.21.15.17:0/3735340335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4b00cabf0 0x7fb4b00c7660 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:13.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.724+0000 7fb4b6343700 1 --2- 172.21.15.17:0/3735340335 >> v2:172.21.15.136:3300/0 conn(0x7fb4b0159b10 0x7fb4b006f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:13.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.724+0000 7fb4b6343700 1 -- 172.21.15.17:0/3735340335 >> 172.21.15.17:0/3735340335 conn(0x7fb4b006cd40 msgr2=0x7fb4b00d0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:13.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.724+0000 7fb4b6343700 1 -- 172.21.15.17:0/3735340335 shutdown_connections 2023-10-06T04:44:13.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.724+0000 7fb4b6343700 1 -- 172.21.15.17:0/3735340335 wait complete. 2023-10-06T04:44:13.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.725+0000 7fb4b6343700 1 Processor -- start 2023-10-06T04:44:13.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.726+0000 7fb4b6343700 1 -- start start 2023-10-06T04:44:13.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.726+0000 7fb4b6343700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4b006d140 0x7fb4b00c6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:13.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.726+0000 7fb4b6343700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb4b00cabf0 0x7fb4b015bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:13.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.726+0000 7fb4b6343700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4b0159b10 0x7fb4b015c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:13.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.726+0000 7fb4b6343700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b00c55c0 con 0x7fb4b0159b10 2023-10-06T04:44:13.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.726+0000 7fb4b6343700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b00c58a0 con 0x7fb4b006d140 2023-10-06T04:44:13.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.726+0000 7fb4b6343700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b00c5b80 con 0x7fb4b00cabf0 2023-10-06T04:44:13.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.726+0000 7fb4b48e0700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4b0159b10 0x7fb4b015c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:13.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.727+0000 7fb4b48e0700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4b0159b10 0x7fb4b015c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48072/0 (socket says 172.21.15.17:48072) 2023-10-06T04:44:13.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.727+0000 7fb4b48e0700 1 -- 172.21.15.17:0/2493771249 learned_addr learned my addr 172.21.15.17:0/2493771249 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:13.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.727+0000 7fb4af7fe700 1 --2- 172.21.15.17:0/2493771249 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb4b00cabf0 0x7fb4b015bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:13.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.727+0000 7fb4affff700 1 --2- 172.21.15.17:0/2493771249 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4b006d140 0x7fb4b00c6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:13.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.727+0000 7fb4b48e0700 1 -- 172.21.15.17:0/2493771249 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb4b00cabf0 msgr2=0x7fb4b015bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:13.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.727+0000 7fb4b48e0700 1 --2- 172.21.15.17:0/2493771249 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb4b00cabf0 0x7fb4b015bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:13.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.727+0000 7fb4b48e0700 1 -- 172.21.15.17:0/2493771249 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4b006d140 msgr2=0x7fb4b00c6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:13.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.727+0000 7fb4b48e0700 1 --2- 172.21.15.17:0/2493771249 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4b006d140 0x7fb4b00c6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:13.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.727+0000 7fb4b48e0700 1 -- 172.21.15.17:0/2493771249 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb498009480 con 0x7fb4b0159b10 2023-10-06T04:44:13.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.727+0000 7fb4af7fe700 1 --2- 172.21.15.17:0/2493771249 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb4b00cabf0 0x7fb4b015bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:13.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.727+0000 7fb4affff700 1 --2- 172.21.15.17:0/2493771249 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4b006d140 0x7fb4b00c6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:13.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.727+0000 7fb4b48e0700 1 --2- 172.21.15.17:0/2493771249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4b0159b10 0x7fb4b015c4d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb4a800cd50 tx=0x7fb4a8001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:13.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.727+0000 7fb4a7fff700 1 -- 172.21.15.17:0/2493771249 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a8005df0 con 0x7fb4b0159b10 2023-10-06T04:44:13.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.727+0000 7fb4a7fff700 1 -- 172.21.15.17:0/2493771249 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a800a900 con 0x7fb4b0159b10 2023-10-06T04:44:13.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.727+0000 7fb4b6343700 1 -- 172.21.15.17:0/2493771249 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4b00c5e60 con 0x7fb4b0159b10 2023-10-06T04:44:13.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.727+0000 7fb4a7fff700 1 -- 172.21.15.17:0/2493771249 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a800acc0 con 0x7fb4b0159b10 2023-10-06T04:44:13.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.727+0000 7fb4b6343700 1 -- 172.21.15.17:0/2493771249 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4b00c5050 con 0x7fb4b0159b10 2023-10-06T04:44:13.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.728+0000 7fb4b6343700 1 -- 172.21.15.17:0/2493771249 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4b004c380 con 0x7fb4b0159b10 2023-10-06T04:44:13.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.729+0000 7fb4a7fff700 1 -- 172.21.15.17:0/2493771249 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb4a8007300 con 0x7fb4b0159b10 2023-10-06T04:44:13.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.729+0000 7fb4a7fff700 1 --2- 172.21.15.17:0/2493771249 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fb490066f30 0x7fb4900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:13.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.729+0000 7fb4a7fff700 1 -- 172.21.15.17:0/2493771249 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5576+0+0 (secure 0 0 0) 0x7fb4a80845c0 con 0x7fb4b0159b10 2023-10-06T04:44:13.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.729+0000 7fb4affff700 1 --2- 172.21.15.17:0/2493771249 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fb490066f30 0x7fb4900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:13.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.730+0000 7fb4affff700 1 --2- 172.21.15.17:0/2493771249 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fb490066f30 0x7fb4900693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb498009260 tx=0x7fb498016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:13.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.734+0000 7fb4a7fff700 1 -- 172.21.15.17:0/2493771249 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb4a8051930 con 0x7fb4b0159b10 2023-10-06T04:44:13.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:13.927+0000 7fb4b6343700 1 -- 172.21.15.17:0/2493771249 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb4b008a770 con 0x7fb4b0159b10 2023-10-06T04:44:14.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.580+0000 7fb4a7fff700 1 -- 172.21.15.17:0/2493771249 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb4a8054f50 con 0x7fb4b0159b10 2023-10-06T04:44:14.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.585+0000 7fb4b6343700 1 -- 172.21.15.17:0/2493771249 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fb490066f30 msgr2=0x7fb4900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:14.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.585+0000 7fb4b6343700 1 --2- 172.21.15.17:0/2493771249 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fb490066f30 0x7fb4900693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb498009260 tx=0x7fb498016000 comp rx=0 tx=0).stop 2023-10-06T04:44:14.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.585+0000 7fb4b6343700 1 -- 172.21.15.17:0/2493771249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4b0159b10 msgr2=0x7fb4b015c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:14.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.585+0000 7fb4b6343700 1 --2- 172.21.15.17:0/2493771249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4b0159b10 0x7fb4b015c4d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb4a800cd50 tx=0x7fb4a8001ae0 comp rx=0 tx=0).stop 2023-10-06T04:44:14.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.585+0000 7fb4b6343700 1 -- 172.21.15.17:0/2493771249 shutdown_connections 2023-10-06T04:44:14.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.585+0000 7fb4b6343700 1 --2- 172.21.15.17:0/2493771249 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fb490066f30 0x7fb4900693e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:14.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.585+0000 7fb4b6343700 1 --2- 172.21.15.17:0/2493771249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4b0159b10 0x7fb4b015c4d0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:14.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.585+0000 7fb4b6343700 1 --2- 172.21.15.17:0/2493771249 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4b006d140 0x7fb4b00c6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:14.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.585+0000 7fb4b6343700 1 --2- 172.21.15.17:0/2493771249 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb4b00cabf0 0x7fb4b015bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:14.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.585+0000 7fb4b6343700 1 -- 172.21.15.17:0/2493771249 >> 172.21.15.17:0/2493771249 conn(0x7fb4b006cd40 msgr2=0x7fb4b015b800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:14.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.586+0000 7fb4b6343700 1 -- 172.21.15.17:0/2493771249 shutdown_connections 2023-10-06T04:44:14.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.586+0000 7fb4b6343700 1 -- 172.21.15.17:0/2493771249 wait complete. 2023-10-06T04:44:14.602 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2023-10-06T04:44:14.615 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T04:44:14.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.737+0000 7fc5b98fd700 1 Processor -- start 2023-10-06T04:44:14.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.737+0000 7fc5b98fd700 1 -- start start 2023-10-06T04:44:14.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.738+0000 7fc5b98fd700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc5b40cabf0 0x7fc5b40c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:14.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.738+0000 7fc5b98fd700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc5b406d140 0x7fc5b406f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:14.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.738+0000 7fc5b98fd700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b40d1120 con 0x7fc5b4159b10 2023-10-06T04:44:14.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.738+0000 7fc5b98fd700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b40d1400 con 0x7fc5b406d140 2023-10-06T04:44:14.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.738+0000 7fc5b98fd700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b406e920 con 0x7fc5b40cabf0 2023-10-06T04:44:14.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.738+0000 7fc5b37fe700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc5b406d140 0x7fc5b406f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:14.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.738+0000 7fc5b37fe700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc5b406d140 0x7fc5b406f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48084/0 (socket says 172.21.15.17:48084) 2023-10-06T04:44:14.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.738+0000 7fc5b37fe700 1 -- 172.21.15.17:0/944185440 learned_addr learned my addr 172.21.15.17:0/944185440 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:14.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.739+0000 7fc5b2ffd700 1 --2- 172.21.15.17:0/944185440 >> v2:172.21.15.136:3300/0 conn(0x7fc5b40cabf0 0x7fc5b40c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:14.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.739+0000 7fc5b37fe700 1 -- 172.21.15.17:0/944185440 >> v2:172.21.15.136:3300/0 conn(0x7fc5b40cabf0 msgr2=0x7fc5b40c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:14.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.739+0000 7fc5b37fe700 1 --2- 172.21.15.17:0/944185440 >> v2:172.21.15.136:3300/0 conn(0x7fc5b40cabf0 0x7fc5b40c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:14.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.739+0000 7fc5b37fe700 1 -- 172.21.15.17:0/944185440 >> v1:172.21.15.136:6789/0 conn(0x7fc5b4159b10 legacy=0x7fc5b406f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:14.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.739+0000 7fc5b37fe700 1 -- 172.21.15.17:0/944185440 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b406ec00 con 0x7fc5b406d140 2023-10-06T04:44:14.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.739+0000 7fc5b2ffd700 1 --2- 172.21.15.17:0/944185440 >> v2:172.21.15.136:3300/0 conn(0x7fc5b40cabf0 0x7fc5b40c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:14.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.739+0000 7fc5b37fe700 1 --2- 172.21.15.17:0/944185440 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5b406d140 0x7fc5b406f830 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc5b40ce130 tx=0x7fc5a4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a9615ed9c9b8e22 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:14.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.739+0000 7fc5b1ffb700 1 -- 172.21.15.17:0/944185440 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a400e070 con 0x7fc5b406d140 2023-10-06T04:44:14.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.739+0000 7fc5b1ffb700 1 -- 172.21.15.17:0/944185440 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a400ba50 con 0x7fc5b406d140 2023-10-06T04:44:14.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.739+0000 7fc5b1ffb700 1 -- 172.21.15.17:0/944185440 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a40092e0 con 0x7fc5b406d140 2023-10-06T04:44:14.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.740+0000 7fc5b98fd700 1 -- 172.21.15.17:0/944185440 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5b406d140 msgr2=0x7fc5b406f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:14.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.740+0000 7fc5b98fd700 1 --2- 172.21.15.17:0/944185440 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5b406d140 0x7fc5b406f830 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc5b40ce130 tx=0x7fc5a4009840 comp rx=0 tx=0).stop 2023-10-06T04:44:14.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.740+0000 7fc5b98fd700 1 -- 172.21.15.17:0/944185440 shutdown_connections 2023-10-06T04:44:14.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.740+0000 7fc5b98fd700 1 --2- 172.21.15.17:0/944185440 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5b406d140 0x7fc5b406f830 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:14.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.740+0000 7fc5b98fd700 1 --2- 172.21.15.17:0/944185440 >> v2:172.21.15.136:3300/0 conn(0x7fc5b40cabf0 0x7fc5b40c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:14.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.740+0000 7fc5b98fd700 1 -- 172.21.15.17:0/944185440 >> 172.21.15.17:0/944185440 conn(0x7fc5b406cd40 msgr2=0x7fc5b40d0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:14.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.740+0000 7fc5b98fd700 1 -- 172.21.15.17:0/944185440 shutdown_connections 2023-10-06T04:44:14.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.740+0000 7fc5b98fd700 1 -- 172.21.15.17:0/944185440 wait complete. 2023-10-06T04:44:14.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.741+0000 7fc5b98fd700 1 Processor -- start 2023-10-06T04:44:14.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.741+0000 7fc5b98fd700 1 -- start start 2023-10-06T04:44:14.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.742+0000 7fc5b98fd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc5b406d140 0x7fc5b4156890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:14.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.742+0000 7fc5b98fd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5b40cabf0 0x7fc5b40c6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:14.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.742+0000 7fc5b98fd700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc5b4159b10 0x7fc5b409dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:14.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.742+0000 7fc5b98fd700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b409e1e0 con 0x7fc5b40cabf0 2023-10-06T04:44:14.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.742+0000 7fc5b98fd700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b40c6710 con 0x7fc5b406d140 2023-10-06T04:44:14.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.742+0000 7fc5b98fd700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b41574f0 con 0x7fc5b4159b10 2023-10-06T04:44:14.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.742+0000 7fc5b27fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5b40cabf0 0x7fc5b40c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:14.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.742+0000 7fc5b27fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5b40cabf0 0x7fc5b40c6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48090/0 (socket says 172.21.15.17:48090) 2023-10-06T04:44:14.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.742+0000 7fc5b27fc700 1 -- 172.21.15.17:0/100944599 learned_addr learned my addr 172.21.15.17:0/100944599 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:14.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.742+0000 7fc5b2ffd700 1 --2- 172.21.15.17:0/100944599 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc5b406d140 0x7fc5b4156890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:14.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.742+0000 7fc5b37fe700 1 --2- 172.21.15.17:0/100944599 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc5b4159b10 0x7fc5b409dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:14.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.742+0000 7fc5b27fc700 1 -- 172.21.15.17:0/100944599 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc5b4159b10 msgr2=0x7fc5b409dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:14.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.742+0000 7fc5b27fc700 1 --2- 172.21.15.17:0/100944599 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc5b4159b10 0x7fc5b409dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:14.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.742+0000 7fc5b27fc700 1 -- 172.21.15.17:0/100944599 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc5b406d140 msgr2=0x7fc5b4156890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:14.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.742+0000 7fc5b27fc700 1 --2- 172.21.15.17:0/100944599 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc5b406d140 0x7fc5b4156890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:14.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.742+0000 7fc5b27fc700 1 -- 172.21.15.17:0/100944599 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a4009ae0 con 0x7fc5b40cabf0 2023-10-06T04:44:14.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.742+0000 7fc5b27fc700 1 --2- 172.21.15.17:0/100944599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5b40cabf0 0x7fc5b40c6080 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc59c00c4e0 tx=0x7fc59c007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:14.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.743+0000 7fc5aaffd700 1 -- 172.21.15.17:0/100944599 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59c00ce90 con 0x7fc5b40cabf0 2023-10-06T04:44:14.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.743+0000 7fc5aaffd700 1 -- 172.21.15.17:0/100944599 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59c011590 con 0x7fc5b40cabf0 2023-10-06T04:44:14.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.743+0000 7fc5b98fd700 1 -- 172.21.15.17:0/100944599 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5b4157790 con 0x7fc5b40cabf0 2023-10-06T04:44:14.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.743+0000 7fc5aaffd700 1 -- 172.21.15.17:0/100944599 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59c011950 con 0x7fc5b40cabf0 2023-10-06T04:44:14.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.743+0000 7fc5b98fd700 1 -- 172.21.15.17:0/100944599 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5b4157d50 con 0x7fc5b40cabf0 2023-10-06T04:44:14.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.743+0000 7fc5b98fd700 1 -- 172.21.15.17:0/100944599 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5b4157f70 con 0x7fc5b40cabf0 2023-10-06T04:44:14.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.744+0000 7fc5aaffd700 1 -- 172.21.15.17:0/100944599 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc59c011d00 con 0x7fc5b40cabf0 2023-10-06T04:44:14.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.744+0000 7fc5aaffd700 1 --2- 172.21.15.17:0/100944599 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc594066f30 0x7fc5940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:14.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.745+0000 7fc5aaffd700 1 -- 172.21.15.17:0/100944599 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5958+0+0 (secure 0 0 0) 0x7fc59c083910 con 0x7fc5b40cabf0 2023-10-06T04:44:14.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.745+0000 7fc5b2ffd700 1 --2- 172.21.15.17:0/100944599 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc594066f30 0x7fc5940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:14.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.745+0000 7fc5b2ffd700 1 --2- 172.21.15.17:0/100944599 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc594066f30 0x7fc5940693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc5b40c6d20 tx=0x7fc5ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:14.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.749+0000 7fc5aaffd700 1 -- 172.21.15.17:0/100944599 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc59c050a80 con 0x7fc5b40cabf0 2023-10-06T04:44:14.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:14.986+0000 7fc5b98fd700 1 -- 172.21.15.17:0/100944599 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc5b40c6850 con 0x7fc5b40cabf0 2023-10-06T04:44:15.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.582+0000 7fc5aaffd700 1 -- 172.21.15.17:0/100944599 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7fc59c017070 con 0x7fc5b40cabf0 2023-10-06T04:44:15.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.586+0000 7fc5b98fd700 1 -- 172.21.15.17:0/100944599 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc594066f30 msgr2=0x7fc5940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:15.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.586+0000 7fc5b98fd700 1 --2- 172.21.15.17:0/100944599 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc594066f30 0x7fc5940693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc5b40c6d20 tx=0x7fc5ac008040 comp rx=0 tx=0).stop 2023-10-06T04:44:15.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.586+0000 7fc5b98fd700 1 -- 172.21.15.17:0/100944599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5b40cabf0 msgr2=0x7fc5b40c6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:15.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.586+0000 7fc5b98fd700 1 --2- 172.21.15.17:0/100944599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5b40cabf0 0x7fc5b40c6080 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc59c00c4e0 tx=0x7fc59c007f00 comp rx=0 tx=0).stop 2023-10-06T04:44:15.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.587+0000 7fc5b98fd700 1 -- 172.21.15.17:0/100944599 shutdown_connections 2023-10-06T04:44:15.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.587+0000 7fc5b98fd700 1 --2- 172.21.15.17:0/100944599 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc594066f30 0x7fc5940693e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:15.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.587+0000 7fc5b98fd700 1 --2- 172.21.15.17:0/100944599 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc5b4159b10 0x7fc5b409dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:15.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.587+0000 7fc5b98fd700 1 --2- 172.21.15.17:0/100944599 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc5b406d140 0x7fc5b4156890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:15.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.587+0000 7fc5b98fd700 1 --2- 172.21.15.17:0/100944599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5b40cabf0 0x7fc5b40c6080 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:15.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.587+0000 7fc5b98fd700 1 -- 172.21.15.17:0/100944599 >> 172.21.15.17:0/100944599 conn(0x7fc5b406cd40 msgr2=0x7fc5b4158cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:15.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.587+0000 7fc5b98fd700 1 -- 172.21.15.17:0/100944599 shutdown_connections 2023-10-06T04:44:15.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.587+0000 7fc5b98fd700 1 -- 172.21.15.17:0/100944599 wait complete. 2023-10-06T04:44:15.593 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 5 and data pool 6 2023-10-06T04:44:15.605 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:44:15.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.723+0000 7f8380f35700 1 Processor -- start 2023-10-06T04:44:15.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.723+0000 7f8380f35700 1 -- start start 2023-10-06T04:44:15.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.724+0000 7f8380f35700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f837c140d00 0x7f837c0cc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:15.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.724+0000 7f8380f35700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f837c0b0800 0x7f837c06c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:15.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.724+0000 7f8380f35700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f837c0cafa0 con 0x7f837c1410d0 2023-10-06T04:44:15.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.724+0000 7f8380f35700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f837c0cb280 con 0x7f837c0b0800 2023-10-06T04:44:15.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.724+0000 7f8380f35700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f837c0cb560 con 0x7f837c140d00 2023-10-06T04:44:15.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.724+0000 7f837ad9d700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f837c0b0800 0x7f837c06c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:15.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.724+0000 7f8379d9b700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f837c1410d0 0x7f837c0b00f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:54114/0 (socket says 172.21.15.17:54114) 2023-10-06T04:44:15.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.724+0000 7f8379d9b700 1 -- 172.21.15.17:0/2560258837 learned_addr learned my addr 172.21.15.17:0/2560258837 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:15.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.724+0000 7f837a59c700 1 --2- 172.21.15.17:0/2560258837 >> v2:172.21.15.136:3300/0 conn(0x7f837c140d00 0x7f837c0cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:15.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.724+0000 7f837ad9d700 1 -- 172.21.15.17:0/2560258837 >> v2:172.21.15.136:3300/0 conn(0x7f837c140d00 msgr2=0x7f837c0cc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:15.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.724+0000 7f837ad9d700 1 --2- 172.21.15.17:0/2560258837 >> v2:172.21.15.136:3300/0 conn(0x7f837c140d00 0x7f837c0cc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:15.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.725+0000 7f837ad9d700 1 -- 172.21.15.17:0/2560258837 >> v1:172.21.15.17:6789/0 conn(0x7f837c1410d0 legacy=0x7f837c0b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:15.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.725+0000 7f837ad9d700 1 -- 172.21.15.17:0/2560258837 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837c0cb840 con 0x7f837c0b0800 2023-10-06T04:44:15.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.725+0000 7f837959a700 1 -- 172.21.15.17:0/2560258837 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 715827470 0 0) 0x7f837c0cafa0 con 0x7f837c1410d0 2023-10-06T04:44:15.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.725+0000 7f837a59c700 1 --2- 172.21.15.17:0/2560258837 >> v2:172.21.15.136:3300/0 conn(0x7f837c140d00 0x7f837c0cc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:15.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.725+0000 7f837ad9d700 1 --2- 172.21.15.17:0/2560258837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f837c0b0800 0x7f837c06c560 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f83740098e0 tx=0x7f83740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c8ef8de0aaf41c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:15.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.725+0000 7f837959a700 1 -- 172.21.15.17:0/2560258837 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8374009e80 con 0x7f837c0b0800 2023-10-06T04:44:15.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.725+0000 7f837959a700 1 -- 172.21.15.17:0/2560258837 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837400b820 con 0x7f837c0b0800 2023-10-06T04:44:15.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.725+0000 7f837959a700 1 -- 172.21.15.17:0/2560258837 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837400bba0 con 0x7f837c0b0800 2023-10-06T04:44:15.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.725+0000 7f8380f35700 1 -- 172.21.15.17:0/2560258837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f837c0b0800 msgr2=0x7f837c06c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:15.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.725+0000 7f8380f35700 1 --2- 172.21.15.17:0/2560258837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f837c0b0800 0x7f837c06c560 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f83740098e0 tx=0x7f83740091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:15.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.725+0000 7f8380f35700 1 -- 172.21.15.17:0/2560258837 shutdown_connections 2023-10-06T04:44:15.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.725+0000 7f8380f35700 1 --2- 172.21.15.17:0/2560258837 >> v2:172.21.15.136:3300/0 conn(0x7f837c140d00 0x7f837c0cc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:15.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.725+0000 7f8380f35700 1 --2- 172.21.15.17:0/2560258837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f837c0b0800 0x7f837c06c560 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:15.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.725+0000 7f8380f35700 1 -- 172.21.15.17:0/2560258837 >> 172.21.15.17:0/2560258837 conn(0x7f837c06e140 msgr2=0x7f837c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:15.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.725+0000 7f8380f35700 1 -- 172.21.15.17:0/2560258837 shutdown_connections 2023-10-06T04:44:15.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.725+0000 7f8380f35700 1 -- 172.21.15.17:0/2560258837 wait complete. 2023-10-06T04:44:15.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.727+0000 7f8380f35700 1 Processor -- start 2023-10-06T04:44:15.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.727+0000 7f8380f35700 1 -- start start 2023-10-06T04:44:15.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.727+0000 7f8380f35700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f837c0b0800 0x7f837c157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:15.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.727+0000 7f8380f35700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f837c140d00 0x7f837c15a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:15.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.727+0000 7f8380f35700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f837c1410d0 0x7f837c16a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:15.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.727+0000 7f8380f35700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c158610 con 0x7f837c140d00 2023-10-06T04:44:15.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.727+0000 7f8380f35700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c15a860 con 0x7f837c0b0800 2023-10-06T04:44:15.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.727+0000 7f8380f35700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f837c1588b0 con 0x7f837c1410d0 2023-10-06T04:44:15.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.727+0000 7f8379d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f837c140d00 0x7f837c15a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:15.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.728+0000 7f8379d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f837c140d00 0x7f837c15a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48110/0 (socket says 172.21.15.17:48110) 2023-10-06T04:44:15.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.728+0000 7f8379d9b700 1 -- 172.21.15.17:0/884000423 learned_addr learned my addr 172.21.15.17:0/884000423 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:15.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.728+0000 7f837a59c700 1 --2- 172.21.15.17:0/884000423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f837c0b0800 0x7f837c157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:15.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.728+0000 7f8379d9b700 1 -- 172.21.15.17:0/884000423 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f837c1410d0 msgr2=0x7f837c16a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:15.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.728+0000 7f837ad9d700 1 --2- 172.21.15.17:0/884000423 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f837c1410d0 0x7f837c16a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:15.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.728+0000 7f8379d9b700 1 --2- 172.21.15.17:0/884000423 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f837c1410d0 0x7f837c16a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:15.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.728+0000 7f8379d9b700 1 -- 172.21.15.17:0/884000423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f837c0b0800 msgr2=0x7f837c157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:15.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.728+0000 7f8379d9b700 1 --2- 172.21.15.17:0/884000423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f837c0b0800 0x7f837c157ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:15.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.728+0000 7f8379d9b700 1 -- 172.21.15.17:0/884000423 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8374009420 con 0x7f837c140d00 2023-10-06T04:44:15.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.728+0000 7f837a59c700 1 --2- 172.21.15.17:0/884000423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f837c0b0800 0x7f837c157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:15.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.728+0000 7f837ad9d700 1 --2- 172.21.15.17:0/884000423 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f837c1410d0 0x7f837c16a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:15.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.728+0000 7f8379d9b700 1 --2- 172.21.15.17:0/884000423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f837c140d00 0x7f837c15a320 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f836400c5b0 tx=0x7f8364001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:15.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.728+0000 7f83727fc700 1 -- 172.21.15.17:0/884000423 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8364005b30 con 0x7f837c140d00 2023-10-06T04:44:15.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.728+0000 7f83727fc700 1 -- 172.21.15.17:0/884000423 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8364005c90 con 0x7f837c140d00 2023-10-06T04:44:15.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.728+0000 7f8380f35700 1 -- 172.21.15.17:0/884000423 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f837c158b90 con 0x7f837c140d00 2023-10-06T04:44:15.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.728+0000 7f83727fc700 1 -- 172.21.15.17:0/884000423 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8364007300 con 0x7f837c140d00 2023-10-06T04:44:15.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.728+0000 7f8380f35700 1 -- 172.21.15.17:0/884000423 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f837c16ac10 con 0x7f837c140d00 2023-10-06T04:44:15.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.729+0000 7f8380f35700 1 -- 172.21.15.17:0/884000423 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f837c063ff0 con 0x7f837c140d00 2023-10-06T04:44:15.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.730+0000 7f83727fc700 1 -- 172.21.15.17:0/884000423 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f836401b3b0 con 0x7f837c140d00 2023-10-06T04:44:15.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.730+0000 7f83727fc700 1 --2- 172.21.15.17:0/884000423 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f835c066f30 0x7f835c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:15.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.730+0000 7f83727fc700 1 -- 172.21.15.17:0/884000423 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8364083bc0 con 0x7f837c140d00 2023-10-06T04:44:15.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.730+0000 7f837a59c700 1 --2- 172.21.15.17:0/884000423 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f835c066f30 0x7f835c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:15.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.730+0000 7f837a59c700 1 --2- 172.21.15.17:0/884000423 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f835c066f30 0x7f835c0693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f836c0094d0 tx=0x7f836c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:15.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.734+0000 7f83727fc700 1 -- 172.21.15.17:0/884000423 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8364050cd0 con 0x7f837c140d00 2023-10-06T04:44:15.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.930+0000 7f8380f35700 1 -- 172.21.15.17:0/884000423 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f837c16ae30 con 0x7f837c140d00 2023-10-06T04:44:15.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.931+0000 7f83727fc700 1 -- 172.21.15.17:0/884000423 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16879 (secure 0 0 0) 0x7f8364017090 con 0x7f837c140d00 2023-10-06T04:44:15.934 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:15.934 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":31,"fsid":"780777c4-2b25-4d35-9058-c9f2d62e3ad9","created":"2023-10-06T04:43:10.578520+0000","modified":"2023-10-06T04:44:14.988581+0000","last_up_change":"2023-10-06T04:43:20.682958+0000","last_in_change":"2023-10-06T04:43:12.978917+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:43:21.795733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:43:22.389592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:44:13.266447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T04:44:13.958240+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"84737b08-575c-46dd-9488-073ae8504494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6809","nonce":90656},{"type":"v1","addr":"172.21.15.17:6811","nonce":90656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":90656},{"type":"v1","addr":"172.21.15.17:6814","nonce":90656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":90656},{"type":"v1","addr":"172.21.15.17:6822","nonce":90656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":90656},{"type":"v1","addr":"172.21.15.17:6818","nonce":90656}]},"public_addr":"172.21.15.17:6811/90656","cluster_addr":"172.21.15.17:6814/90656","heartbeat_back_addr":"172.21.15.17:6822/90656","heartbeat_front_addr":"172.21.15.17:6818/90656","state":["exists","up"]},{"osd":1,"uuid":"dffeb740-58a2-4fd6-8ff1-a0a11a2cc709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":90655},{"type":"v1","addr":"172.21.15.17:6801","nonce":90655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":90655},{"type":"v1","addr":"172.21.15.17:6803","nonce":90655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":90655},{"type":"v1","addr":"172.21.15.17:6807","nonce":90655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":90655},{"type":"v1","addr":"172.21.15.17:6805","nonce":90655}]},"public_addr":"172.21.15.17:6801/90655","cluster_addr":"172.21.15.17:6803/90655","heartbeat_back_addr":"172.21.15.17:6807/90655","heartbeat_front_addr":"172.21.15.17:6805/90655","state":["exists","up"]},{"osd":2,"uuid":"48bd6831-763d-48c2-b515-e02c216d608b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":90657},{"type":"v1","addr":"172.21.15.17:6810","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":90657},{"type":"v1","addr":"172.21.15.17:6815","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":90657},{"type":"v1","addr":"172.21.15.17:6823","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":90657},{"type":"v1","addr":"172.21.15.17:6819","nonce":90657}]},"public_addr":"172.21.15.17:6810/90657","cluster_addr":"172.21.15.17:6815/90657","heartbeat_back_addr":"172.21.15.17:6823/90657","heartbeat_front_addr":"172.21.15.17:6819/90657","state":["exists","up"]},{"osd":3,"uuid":"ae7dbb23-abe7-4bd3-a4df-6f5963d6804c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":90688},{"type":"v1","addr":"172.21.15.17:6825","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":90688},{"type":"v1","addr":"172.21.15.17:6827","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":90688},{"type":"v1","addr":"172.21.15.17:6831","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":90688},{"type":"v1","addr":"172.21.15.17:6829","nonce":90688}]},"public_addr":"172.21.15.17:6825/90688","cluster_addr":"172.21.15.17:6827/90688","heartbeat_back_addr":"172.21.15.17:6831/90688","heartbeat_front_addr":"172.21.15.17:6829/90688","state":["exists","up"]},{"osd":4,"uuid":"29991fb4-1667-4ea3-aca0-d55db27f3bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":90902},{"type":"v1","addr":"172.21.15.136:6801","nonce":90902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":90902},{"type":"v1","addr":"172.21.15.136:6803","nonce":90902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":90902},{"type":"v1","addr":"172.21.15.136:6807","nonce":90902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":90902},{"type":"v1","addr":"172.21.15.136:6805","nonce":90902}]},"public_addr":"172.21.15.136:6801/90902","cluster_addr":"172.21.15.136:6803/90902","heartbeat_back_addr":"172.21.15.136:6807/90902","heartbeat_front_addr":"172.21.15.136:6805/90902","state":["exists","up"]},{"osd":5,"uuid":"398b4ff9-03fc-421f-882c-ba12aa088eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":90901},{"type":"v1","addr":"172.21.15.136:6809","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":90901},{"type":"v1","addr":"172.21.15.136:6811","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":90901},{"type":"v1","addr":"172.21.15.136:6815","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":90901},{"type":"v1","addr":"172.21.15.136:6813","nonce":90901}]},"public_addr":"172.21.15.136:6809/90901","cluster_addr":"172.21.15.136:6811/90901","heartbeat_back_addr":"172.21.15.136:6815/90901","heartbeat_front_addr":"172.21.15.136:6813/90901","state":["exists","up"]},{"osd":6,"uuid":"1bb91a72-4dab-4cdb-aa1d-2b8a9edf1ad0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":90927},{"type":"v1","addr":"172.21.15.136:6825","nonce":90927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":90927},{"type":"v1","addr":"172.21.15.136:6827","nonce":90927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":90927},{"type":"v1","addr":"172.21.15.136:6831","nonce":90927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":90927},{"type":"v1","addr":"172.21.15.136:6829","nonce":90927}]},"public_addr":"172.21.15.136:6825/90927","cluster_addr":"172.21.15.136:6827/90927","heartbeat_back_addr":"172.21.15.136:6831/90927","heartbeat_front_addr":"172.21.15.136:6829/90927","state":["exists","up"]},{"osd":7,"uuid":"719b654e-010d-4aa4-8c13-83fdde242b47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":90934},{"type":"v1","addr":"172.21.15.136:6817","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":90934},{"type":"v1","addr":"172.21.15.136:6819","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":90934},{"type":"v1","addr":"172.21.15.136:6824","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":90934},{"type":"v1","addr":"172.21.15.136:6821","nonce":90934}]},"public_addr":"172.21.15.136:6817/90934","cluster_addr":"172.21.15.136:6819/90934","heartbeat_back_addr":"172.21.15.136:6824/90934","heartbeat_front_addr":"172.21.15.136:6821/90934","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.157479+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.140520+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.190743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.231396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.156510+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.145822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.202888+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.139532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:44:15.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.933+0000 7f8380f35700 1 -- 172.21.15.17:0/884000423 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f835c066f30 msgr2=0x7f835c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:15.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.933+0000 7f8380f35700 1 --2- 172.21.15.17:0/884000423 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f835c066f30 0x7f835c0693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f836c0094d0 tx=0x7f836c00b040 comp rx=0 tx=0).stop 2023-10-06T04:44:15.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.933+0000 7f8380f35700 1 -- 172.21.15.17:0/884000423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f837c140d00 msgr2=0x7f837c15a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:15.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.933+0000 7f8380f35700 1 --2- 172.21.15.17:0/884000423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f837c140d00 0x7f837c15a320 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f836400c5b0 tx=0x7f8364001070 comp rx=0 tx=0).stop 2023-10-06T04:44:15.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.933+0000 7f8380f35700 1 -- 172.21.15.17:0/884000423 shutdown_connections 2023-10-06T04:44:15.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.933+0000 7f8380f35700 1 --2- 172.21.15.17:0/884000423 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f835c066f30 0x7f835c0693e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:15.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.933+0000 7f8380f35700 1 --2- 172.21.15.17:0/884000423 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f837c1410d0 0x7f837c16a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:15.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.933+0000 7f8380f35700 1 --2- 172.21.15.17:0/884000423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f837c0b0800 0x7f837c157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:15.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.933+0000 7f8380f35700 1 --2- 172.21.15.17:0/884000423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f837c140d00 0x7f837c15a320 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:15.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.933+0000 7f8380f35700 1 -- 172.21.15.17:0/884000423 >> 172.21.15.17:0/884000423 conn(0x7f837c06e140 msgr2=0x7f837c0677d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:15.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.933+0000 7f8380f35700 1 -- 172.21.15.17:0/884000423 shutdown_connections 2023-10-06T04:44:15.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:15.933+0000 7f8380f35700 1 -- 172.21.15.17:0/884000423 wait complete. 2023-10-06T04:44:15.948 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:44:16.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.064+0000 7f6264a30700 1 Processor -- start 2023-10-06T04:44:16.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.064+0000 7f6264a30700 1 -- start start 2023-10-06T04:44:16.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.065+0000 7f6264a30700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f62600cd640 0x7f62600b0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:16.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.065+0000 7f6264a30700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62600b14b0 con 0x7f62600cda10 2023-10-06T04:44:16.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.065+0000 7f6264a30700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62600b08a0 con 0x7f62600b1e50 2023-10-06T04:44:16.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.065+0000 7f6264a30700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62600b0b80 con 0x7f62600cd640 2023-10-06T04:44:16.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.065+0000 7f625f7fe700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f62600cd640 0x7f62600b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:16.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.065+0000 7f625f7fe700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f62600cd640 0x7f62600b0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48112/0 (socket says 172.21.15.17:48112) 2023-10-06T04:44:16.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.065+0000 7f625effd700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f62600cda10 0x7f62600b1740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:54120/0 (socket says 172.21.15.17:54120) 2023-10-06T04:44:16.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.065+0000 7f625f7fe700 1 -- 172.21.15.17:0/3387926842 learned_addr learned my addr 172.21.15.17:0/3387926842 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:16.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.065+0000 7f625f7fe700 1 -- 172.21.15.17:0/3387926842 >> v1:172.21.15.136:6789/0 conn(0x7f62600b1e50 legacy=0x7f62600ca5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:16.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.065+0000 7f625f7fe700 1 -- 172.21.15.17:0/3387926842 >> v1:172.21.15.17:6789/0 conn(0x7f62600cda10 legacy=0x7f62600b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:16.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.065+0000 7f625f7fe700 1 -- 172.21.15.17:0/3387926842 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62600b0e60 con 0x7f62600cd640 2023-10-06T04:44:16.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.066+0000 7f625f7fe700 1 --2- 172.21.15.17:0/3387926842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62600cd640 0x7f62600b0050 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f62500099e0 tx=0x7f6250009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d05e2d906c8d837e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:16.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.066+0000 7f625e7fc700 1 -- 172.21.15.17:0/3387926842 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625000b7e0 con 0x7f62600cd640 2023-10-06T04:44:16.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.066+0000 7f625e7fc700 1 -- 172.21.15.17:0/3387926842 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625000b940 con 0x7f62600cd640 2023-10-06T04:44:16.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.066+0000 7f625e7fc700 1 -- 172.21.15.17:0/3387926842 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625000bce0 con 0x7f62600cd640 2023-10-06T04:44:16.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.066+0000 7f6264a30700 1 -- 172.21.15.17:0/3387926842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62600cd640 msgr2=0x7f62600b0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:16.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.066+0000 7f6264a30700 1 --2- 172.21.15.17:0/3387926842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62600cd640 0x7f62600b0050 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f62500099e0 tx=0x7f6250009250 comp rx=0 tx=0).stop 2023-10-06T04:44:16.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.066+0000 7f6264a30700 1 -- 172.21.15.17:0/3387926842 shutdown_connections 2023-10-06T04:44:16.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.066+0000 7f6264a30700 1 --2- 172.21.15.17:0/3387926842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62600cd640 0x7f62600b0050 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:16.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.066+0000 7f6264a30700 1 -- 172.21.15.17:0/3387926842 >> 172.21.15.17:0/3387926842 conn(0x7f626006e0f0 msgr2=0x7f62600675f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:16.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.066+0000 7f6264a30700 1 -- 172.21.15.17:0/3387926842 shutdown_connections 2023-10-06T04:44:16.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.066+0000 7f6264a30700 1 -- 172.21.15.17:0/3387926842 wait complete. 2023-10-06T04:44:16.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.068+0000 7f6264a30700 1 Processor -- start 2023-10-06T04:44:16.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.068+0000 7f6264a30700 1 -- start start 2023-10-06T04:44:16.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.068+0000 7f6264a30700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62600b1e50 0x7f6260168b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:16.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.068+0000 7f6264a30700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f62600cd640 0x7f62601448c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:16.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.068+0000 7f6264a30700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f62600cda10 0x7f626016b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:16.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.068+0000 7f6264a30700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62601686e0 con 0x7f62600b1e50 2023-10-06T04:44:16.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.068+0000 7f6264a30700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62600a9190 con 0x7f62600cda10 2023-10-06T04:44:16.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.068+0000 7f6264a30700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f626016c0b0 con 0x7f62600cd640 2023-10-06T04:44:16.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.069+0000 7f625f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62600b1e50 0x7f6260168b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:16.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.069+0000 7f625f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62600b1e50 0x7f6260168b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48124/0 (socket says 172.21.15.17:48124) 2023-10-06T04:44:16.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.069+0000 7f625f7fe700 1 -- 172.21.15.17:0/408329 learned_addr learned my addr 172.21.15.17:0/408329 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:16.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.069+0000 7f625ffff700 1 --2- 172.21.15.17:0/408329 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f62600cda10 0x7f626016b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:16.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.069+0000 7f625f7fe700 1 -- 172.21.15.17:0/408329 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f62600cd640 msgr2=0x7f62601448c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:16.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.069+0000 7f625effd700 1 --2- 172.21.15.17:0/408329 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f62600cd640 0x7f62601448c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:16.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.069+0000 7f625f7fe700 1 --2- 172.21.15.17:0/408329 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f62600cd640 0x7f62601448c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:16.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.069+0000 7f625f7fe700 1 -- 172.21.15.17:0/408329 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f62600cda10 msgr2=0x7f626016b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:16.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.069+0000 7f625f7fe700 1 --2- 172.21.15.17:0/408329 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f62600cda10 0x7f626016b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:16.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.069+0000 7f625f7fe700 1 -- 172.21.15.17:0/408329 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62500094f0 con 0x7f62600b1e50 2023-10-06T04:44:16.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.069+0000 7f625ffff700 1 --2- 172.21.15.17:0/408329 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f62600cda10 0x7f626016b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:16.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.069+0000 7f625effd700 1 --2- 172.21.15.17:0/408329 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f62600cd640 0x7f62601448c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:16.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.069+0000 7f625f7fe700 1 --2- 172.21.15.17:0/408329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62600b1e50 0x7f6260168b70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f62500099b0 tx=0x7f6250016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:16.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.069+0000 7f62477fe700 1 -- 172.21.15.17:0/408329 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625001b450 con 0x7f62600b1e50 2023-10-06T04:44:16.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.069+0000 7f62477fe700 1 -- 172.21.15.17:0/408329 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6250020070 con 0x7f62600b1e50 2023-10-06T04:44:16.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.069+0000 7f6264a30700 1 -- 172.21.15.17:0/408329 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f626016c390 con 0x7f62600b1e50 2023-10-06T04:44:16.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.069+0000 7f62477fe700 1 -- 172.21.15.17:0/408329 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625001b820 con 0x7f62600b1e50 2023-10-06T04:44:16.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.069+0000 7f6264a30700 1 -- 172.21.15.17:0/408329 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6260168370 con 0x7f62600b1e50 2023-10-06T04:44:16.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.070+0000 7f6264a30700 1 -- 172.21.15.17:0/408329 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62601689c0 con 0x7f62600b1e50 2023-10-06T04:44:16.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.071+0000 7f62477fe700 1 -- 172.21.15.17:0/408329 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6250022030 con 0x7f62600b1e50 2023-10-06T04:44:16.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.071+0000 7f62477fe700 1 --2- 172.21.15.17:0/408329 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f624c066fb0 0x7f624c069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:16.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.071+0000 7f62477fe700 1 -- 172.21.15.17:0/408329 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6250086680 con 0x7f62600b1e50 2023-10-06T04:44:16.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.071+0000 7f625effd700 1 --2- 172.21.15.17:0/408329 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f624c066fb0 0x7f624c069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:16.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.072+0000 7f625effd700 1 --2- 172.21.15.17:0/408329 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f624c066fb0 0x7f624c069460 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f62600cde60 tx=0x7f6254009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:16.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.076+0000 7f62477fe700 1 -- 172.21.15.17:0/408329 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f62500536f0 con 0x7f62600b1e50 2023-10-06T04:44:16.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.269+0000 7f6264a30700 1 -- 172.21.15.17:0/408329 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f62601689c0 con 0x7f62600b1e50 2023-10-06T04:44:16.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.270+0000 7f62477fe700 1 -- 172.21.15.17:0/408329 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16879 (secure 0 0 0) 0x7f6250056d10 con 0x7f62600b1e50 2023-10-06T04:44:16.274 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:16.274 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":31,"fsid":"780777c4-2b25-4d35-9058-c9f2d62e3ad9","created":"2023-10-06T04:43:10.578520+0000","modified":"2023-10-06T04:44:14.988581+0000","last_up_change":"2023-10-06T04:43:20.682958+0000","last_in_change":"2023-10-06T04:43:12.978917+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:43:21.795733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:43:22.389592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:44:13.266447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T04:44:13.958240+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"84737b08-575c-46dd-9488-073ae8504494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6809","nonce":90656},{"type":"v1","addr":"172.21.15.17:6811","nonce":90656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":90656},{"type":"v1","addr":"172.21.15.17:6814","nonce":90656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":90656},{"type":"v1","addr":"172.21.15.17:6822","nonce":90656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":90656},{"type":"v1","addr":"172.21.15.17:6818","nonce":90656}]},"public_addr":"172.21.15.17:6811/90656","cluster_addr":"172.21.15.17:6814/90656","heartbeat_back_addr":"172.21.15.17:6822/90656","heartbeat_front_addr":"172.21.15.17:6818/90656","state":["exists","up"]},{"osd":1,"uuid":"dffeb740-58a2-4fd6-8ff1-a0a11a2cc709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":90655},{"type":"v1","addr":"172.21.15.17:6801","nonce":90655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":90655},{"type":"v1","addr":"172.21.15.17:6803","nonce":90655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":90655},{"type":"v1","addr":"172.21.15.17:6807","nonce":90655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":90655},{"type":"v1","addr":"172.21.15.17:6805","nonce":90655}]},"public_addr":"172.21.15.17:6801/90655","cluster_addr":"172.21.15.17:6803/90655","heartbeat_back_addr":"172.21.15.17:6807/90655","heartbeat_front_addr":"172.21.15.17:6805/90655","state":["exists","up"]},{"osd":2,"uuid":"48bd6831-763d-48c2-b515-e02c216d608b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":90657},{"type":"v1","addr":"172.21.15.17:6810","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":90657},{"type":"v1","addr":"172.21.15.17:6815","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":90657},{"type":"v1","addr":"172.21.15.17:6823","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":90657},{"type":"v1","addr":"172.21.15.17:6819","nonce":90657}]},"public_addr":"172.21.15.17:6810/90657","cluster_addr":"172.21.15.17:6815/90657","heartbeat_back_addr":"172.21.15.17:6823/90657","heartbeat_front_addr":"172.21.15.17:6819/90657","state":["exists","up"]},{"osd":3,"uuid":"ae7dbb23-abe7-4bd3-a4df-6f5963d6804c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":90688},{"type":"v1","addr":"172.21.15.17:6825","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":90688},{"type":"v1","addr":"172.21.15.17:6827","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":90688},{"type":"v1","addr":"172.21.15.17:6831","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":90688},{"type":"v1","addr":"172.21.15.17:6829","nonce":90688}]},"public_addr":"172.21.15.17:6825/90688","cluster_addr":"172.21.15.17:6827/90688","heartbeat_back_addr":"172.21.15.17:6831/90688","heartbeat_front_addr":"172.21.15.17:6829/90688","state":["exists","up"]},{"osd":4,"uuid":"29991fb4-1667-4ea3-aca0-d55db27f3bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":90902},{"type":"v1","addr":"172.21.15.136:6801","nonce":90902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":90902},{"type":"v1","addr":"172.21.15.136:6803","nonce":90902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":90902},{"type":"v1","addr":"172.21.15.136:6807","nonce":90902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":90902},{"type":"v1","addr":"172.21.15.136:6805","nonce":90902}]},"public_addr":"172.21.15.136:6801/90902","cluster_addr":"172.21.15.136:6803/90902","heartbeat_back_addr":"172.21.15.136:6807/90902","heartbeat_front_addr":"172.21.15.136:6805/90902","state":["exists","up"]},{"osd":5,"uuid":"398b4ff9-03fc-421f-882c-ba12aa088eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":90901},{"type":"v1","addr":"172.21.15.136:6809","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":90901},{"type":"v1","addr":"172.21.15.136:6811","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":90901},{"type":"v1","addr":"172.21.15.136:6815","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":90901},{"type":"v1","addr":"172.21.15.136:6813","nonce":90901}]},"public_addr":"172.21.15.136:6809/90901","cluster_addr":"172.21.15.136:6811/90901","heartbeat_back_addr":"172.21.15.136:6815/90901","heartbeat_front_addr":"172.21.15.136:6813/90901","state":["exists","up"]},{"osd":6,"uuid":"1bb91a72-4dab-4cdb-aa1d-2b8a9edf1ad0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":90927},{"type":"v1","addr":"172.21.15.136:6825","nonce":90927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":90927},{"type":"v1","addr":"172.21.15.136:6827","nonce":90927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":90927},{"type":"v1","addr":"172.21.15.136:6831","nonce":90927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":90927},{"type":"v1","addr":"172.21.15.136:6829","nonce":90927}]},"public_addr":"172.21.15.136:6825/90927","cluster_addr":"172.21.15.136:6827/90927","heartbeat_back_addr":"172.21.15.136:6831/90927","heartbeat_front_addr":"172.21.15.136:6829/90927","state":["exists","up"]},{"osd":7,"uuid":"719b654e-010d-4aa4-8c13-83fdde242b47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":90934},{"type":"v1","addr":"172.21.15.136:6817","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":90934},{"type":"v1","addr":"172.21.15.136:6819","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":90934},{"type":"v1","addr":"172.21.15.136:6824","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":90934},{"type":"v1","addr":"172.21.15.136:6821","nonce":90934}]},"public_addr":"172.21.15.136:6817/90934","cluster_addr":"172.21.15.136:6819/90934","heartbeat_back_addr":"172.21.15.136:6824/90934","heartbeat_front_addr":"172.21.15.136:6821/90934","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.157479+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.140520+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.190743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.231396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.156510+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.145822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.202888+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.139532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:44:16.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.272+0000 7f6264a30700 1 -- 172.21.15.17:0/408329 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f624c066fb0 msgr2=0x7f624c069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:16.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.272+0000 7f6264a30700 1 --2- 172.21.15.17:0/408329 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f624c066fb0 0x7f624c069460 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f62600cde60 tx=0x7f6254009040 comp rx=0 tx=0).stop 2023-10-06T04:44:16.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.272+0000 7f6264a30700 1 -- 172.21.15.17:0/408329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62600b1e50 msgr2=0x7f6260168b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:16.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.272+0000 7f6264a30700 1 --2- 172.21.15.17:0/408329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62600b1e50 0x7f6260168b70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f62500099b0 tx=0x7f6250016000 comp rx=0 tx=0).stop 2023-10-06T04:44:16.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.272+0000 7f6264a30700 1 -- 172.21.15.17:0/408329 shutdown_connections 2023-10-06T04:44:16.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.272+0000 7f6264a30700 1 --2- 172.21.15.17:0/408329 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f624c066fb0 0x7f624c069460 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:16.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.272+0000 7f6264a30700 1 --2- 172.21.15.17:0/408329 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f62600cda10 0x7f626016b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:16.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.272+0000 7f6264a30700 1 --2- 172.21.15.17:0/408329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62600b1e50 0x7f6260168b70 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:16.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.272+0000 7f6264a30700 1 --2- 172.21.15.17:0/408329 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f62600cd640 0x7f62601448c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:16.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.272+0000 7f6264a30700 1 -- 172.21.15.17:0/408329 >> 172.21.15.17:0/408329 conn(0x7f626006e0f0 msgr2=0x7f6260158b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:16.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.272+0000 7f6264a30700 1 -- 172.21.15.17:0/408329 shutdown_connections 2023-10-06T04:44:16.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.272+0000 7f6264a30700 1 -- 172.21.15.17:0/408329 wait complete. 2023-10-06T04:44:16.288 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T04:44:16.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.414+0000 7f47e9de7700 1 Processor -- start 2023-10-06T04:44:16.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.414+0000 7f47e9de7700 1 -- start start 2023-10-06T04:44:16.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.415+0000 7f47e9de7700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f47e406c7b0 0x7f47e4067fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:16.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.415+0000 7f47e9de7700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f47e40aff90 0x7f47e40a9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:16.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.415+0000 7f47e9de7700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f47e406cb80 0x7f47e415d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:16.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.415+0000 7f47e9de7700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e415d3a0 con 0x7f47e40aff90 2023-10-06T04:44:16.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.415+0000 7f47e9de7700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e40b0470 con 0x7f47e406c7b0 2023-10-06T04:44:16.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.415+0000 7f47e9de7700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e40b0750 con 0x7f47e406cb80 2023-10-06T04:44:16.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.415+0000 7f47e3fff700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f47e40aff90 0x7f47e40a9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:16.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.415+0000 7f47e3fff700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f47e40aff90 0x7f47e40a9890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48130/0 (socket says 172.21.15.17:48130) 2023-10-06T04:44:16.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.415+0000 7f47e3fff700 1 -- 172.21.15.17:0/2391917961 learned_addr learned my addr 172.21.15.17:0/2391917961 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:16.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.415+0000 7f47e95e6700 1 --2- 172.21.15.17:0/2391917961 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f47e406cb80 0x7f47e415d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:16.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.415+0000 7f47e8de5700 1 --2- 172.21.15.17:0/2391917961 >> v2:172.21.15.136:3300/0 conn(0x7f47e406c7b0 0x7f47e4067fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:16.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.415+0000 7f47e3fff700 1 -- 172.21.15.17:0/2391917961 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f47e406cb80 msgr2=0x7f47e415d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:16.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.415+0000 7f47e3fff700 1 --2- 172.21.15.17:0/2391917961 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f47e406cb80 0x7f47e415d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:16.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.415+0000 7f47e3fff700 1 -- 172.21.15.17:0/2391917961 >> v2:172.21.15.136:3300/0 conn(0x7f47e406c7b0 msgr2=0x7f47e4067fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:16.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.415+0000 7f47e3fff700 1 --2- 172.21.15.17:0/2391917961 >> v2:172.21.15.136:3300/0 conn(0x7f47e406c7b0 0x7f47e4067fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:16.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.415+0000 7f47e3fff700 1 -- 172.21.15.17:0/2391917961 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e40b0a30 con 0x7f47e40aff90 2023-10-06T04:44:16.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.416+0000 7f47e3fff700 1 --2- 172.21.15.17:0/2391917961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47e40aff90 0x7f47e40a9890 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f47e40afc10 tx=0x7f47d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2a8a4dcf12089ed server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:16.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.416+0000 7f47e37fe700 1 -- 172.21.15.17:0/2391917961 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d000b640 con 0x7f47e40aff90 2023-10-06T04:44:16.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.416+0000 7f47e37fe700 1 -- 172.21.15.17:0/2391917961 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d000b7a0 con 0x7f47e40aff90 2023-10-06T04:44:16.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.416+0000 7f47e37fe700 1 -- 172.21.15.17:0/2391917961 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d000bb60 con 0x7f47e40aff90 2023-10-06T04:44:16.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.416+0000 7f47e9de7700 1 -- 172.21.15.17:0/2391917961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47e40aff90 msgr2=0x7f47e40a9890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:16.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.416+0000 7f47e9de7700 1 --2- 172.21.15.17:0/2391917961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47e40aff90 0x7f47e40a9890 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f47e40afc10 tx=0x7f47d0009250 comp rx=0 tx=0).stop 2023-10-06T04:44:16.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.416+0000 7f47e9de7700 1 -- 172.21.15.17:0/2391917961 shutdown_connections 2023-10-06T04:44:16.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.416+0000 7f47e9de7700 1 --2- 172.21.15.17:0/2391917961 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f47e406cb80 0x7f47e415d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:16.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.416+0000 7f47e9de7700 1 --2- 172.21.15.17:0/2391917961 >> v2:172.21.15.136:3300/0 conn(0x7f47e406c7b0 0x7f47e4067fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:16.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.416+0000 7f47e9de7700 1 --2- 172.21.15.17:0/2391917961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47e40aff90 0x7f47e40a9890 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:16.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.416+0000 7f47e9de7700 1 -- 172.21.15.17:0/2391917961 >> 172.21.15.17:0/2391917961 conn(0x7f47e406d670 msgr2=0x7f47e406da70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:16.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.417+0000 7f47e9de7700 1 -- 172.21.15.17:0/2391917961 shutdown_connections 2023-10-06T04:44:16.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.417+0000 7f47e9de7700 1 -- 172.21.15.17:0/2391917961 wait complete. 2023-10-06T04:44:16.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.418+0000 7f47e9de7700 1 Processor -- start 2023-10-06T04:44:16.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.418+0000 7f47e9de7700 1 -- start start 2023-10-06T04:44:16.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.419+0000 7f47e9de7700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47e406c7b0 0x7f47e4142e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:16.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.419+0000 7f47e9de7700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47e406cb80 0x7f47e41591d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:16.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.419+0000 7f47e9de7700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f47e40aff90 0x7f47e415aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:16.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.419+0000 7f47e9de7700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e415a810 con 0x7f47e406cb80 2023-10-06T04:44:16.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.419+0000 7f47e9de7700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e41433a0 con 0x7f47e406c7b0 2023-10-06T04:44:16.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.419+0000 7f47e9de7700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e4159c00 con 0x7f47e40aff90 2023-10-06T04:44:16.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.419+0000 7f47e3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47e406cb80 0x7f47e41591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:16.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.419+0000 7f47e3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47e406cb80 0x7f47e41591d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48142/0 (socket says 172.21.15.17:48142) 2023-10-06T04:44:16.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.419+0000 7f47e3fff700 1 -- 172.21.15.17:0/15069788 learned_addr learned my addr 172.21.15.17:0/15069788 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:16.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.419+0000 7f47e8de5700 1 --2- 172.21.15.17:0/15069788 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47e406c7b0 0x7f47e4142e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:16.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.419+0000 7f47e95e6700 1 --2- 172.21.15.17:0/15069788 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f47e40aff90 0x7f47e415aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:16.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.419+0000 7f47e3fff700 1 -- 172.21.15.17:0/15069788 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f47e40aff90 msgr2=0x7f47e415aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:16.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.419+0000 7f47e3fff700 1 --2- 172.21.15.17:0/15069788 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f47e40aff90 0x7f47e415aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:16.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.419+0000 7f47e3fff700 1 -- 172.21.15.17:0/15069788 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47e406c7b0 msgr2=0x7f47e4142e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:16.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.419+0000 7f47e3fff700 1 --2- 172.21.15.17:0/15069788 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47e406c7b0 0x7f47e4142e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:16.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.419+0000 7f47e3fff700 1 -- 172.21.15.17:0/15069788 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d00094f0 con 0x7f47e406cb80 2023-10-06T04:44:16.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.419+0000 7f47e3fff700 1 --2- 172.21.15.17:0/15069788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47e406cb80 0x7f47e41591d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f47e406f2c0 tx=0x7f47d0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:16.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.419+0000 7f47e0ff9700 1 -- 172.21.15.17:0/15069788 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d0000d10 con 0x7f47e406cb80 2023-10-06T04:44:16.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.419+0000 7f47e0ff9700 1 -- 172.21.15.17:0/15069788 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d000bb20 con 0x7f47e406cb80 2023-10-06T04:44:16.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.419+0000 7f47e9de7700 1 -- 172.21.15.17:0/15069788 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e4159ee0 con 0x7f47e406cb80 2023-10-06T04:44:16.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.419+0000 7f47e0ff9700 1 -- 172.21.15.17:0/15069788 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d0011670 con 0x7f47e406cb80 2023-10-06T04:44:16.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.419+0000 7f47e9de7700 1 -- 172.21.15.17:0/15069788 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e415a4a0 con 0x7f47e406cb80 2023-10-06T04:44:16.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.420+0000 7f47e9de7700 1 -- 172.21.15.17:0/15069788 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e4067ea0 con 0x7f47e406cb80 2023-10-06T04:44:16.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.421+0000 7f47e0ff9700 1 -- 172.21.15.17:0/15069788 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f47d00119e0 con 0x7f47e406cb80 2023-10-06T04:44:16.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.421+0000 7f47e0ff9700 1 --2- 172.21.15.17:0/15069788 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f47c8066f30 0x7f47c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:16.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.421+0000 7f47e0ff9700 1 -- 172.21.15.17:0/15069788 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f47d0085e90 con 0x7f47e406cb80 2023-10-06T04:44:16.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.421+0000 7f47e8de5700 1 --2- 172.21.15.17:0/15069788 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f47c8066f30 0x7f47c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:16.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.422+0000 7f47e8de5700 1 --2- 172.21.15.17:0/15069788 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f47c8066f30 0x7f47c80693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f47d8009390 tx=0x7f47d8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:16.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.425+0000 7f47e0ff9700 1 -- 172.21.15.17:0/15069788 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f47d0052fa0 con 0x7f47e406cb80 2023-10-06T04:44:16.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:16.665+0000 7f47e9de7700 1 -- 172.21.15.17:0/15069788 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f47e404c380 con 0x7f47e406cb80 2023-10-06T04:44:17.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.597+0000 7f47e0ff9700 1 -- 172.21.15.17:0/15069788 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f47d00565c0 con 0x7f47e406cb80 2023-10-06T04:44:17.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.600+0000 7f47e9de7700 1 -- 172.21.15.17:0/15069788 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f47c8066f30 msgr2=0x7f47c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:17.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.600+0000 7f47e9de7700 1 --2- 172.21.15.17:0/15069788 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f47c8066f30 0x7f47c80693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f47d8009390 tx=0x7f47d8008040 comp rx=0 tx=0).stop 2023-10-06T04:44:17.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.600+0000 7f47e9de7700 1 -- 172.21.15.17:0/15069788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47e406cb80 msgr2=0x7f47e41591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:17.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.600+0000 7f47e9de7700 1 --2- 172.21.15.17:0/15069788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47e406cb80 0x7f47e41591d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f47e406f2c0 tx=0x7f47d0017000 comp rx=0 tx=0).stop 2023-10-06T04:44:17.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.600+0000 7f47e9de7700 1 -- 172.21.15.17:0/15069788 shutdown_connections 2023-10-06T04:44:17.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.600+0000 7f47e9de7700 1 --2- 172.21.15.17:0/15069788 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f47c8066f30 0x7f47c80693e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:17.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.600+0000 7f47e9de7700 1 --2- 172.21.15.17:0/15069788 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f47e40aff90 0x7f47e415aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:17.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.600+0000 7f47e9de7700 1 --2- 172.21.15.17:0/15069788 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47e406c7b0 0x7f47e4142e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:17.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.600+0000 7f47e9de7700 1 --2- 172.21.15.17:0/15069788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47e406cb80 0x7f47e41591d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:17.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.600+0000 7f47e9de7700 1 -- 172.21.15.17:0/15069788 >> 172.21.15.17:0/15069788 conn(0x7f47e406d670 msgr2=0x7f47e40af340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:17.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.600+0000 7f47e9de7700 1 -- 172.21.15.17:0/15069788 shutdown_connections 2023-10-06T04:44:17.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.600+0000 7f47e9de7700 1 -- 172.21.15.17:0/15069788 wait complete. 2023-10-06T04:44:17.617 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T04:44:17.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.744+0000 7f212e369700 1 Processor -- start 2023-10-06T04:44:17.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.744+0000 7f212e369700 1 -- start start 2023-10-06T04:44:17.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.745+0000 7f212e369700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f21280cabf0 0x7f21280c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:17.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.745+0000 7f212e369700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f212806d140 0x7f212806f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:17.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.745+0000 7f212e369700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21280d1120 con 0x7f2128159b10 2023-10-06T04:44:17.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.745+0000 7f212e369700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21280d1400 con 0x7f212806d140 2023-10-06T04:44:17.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.745+0000 7f212e369700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f212806e920 con 0x7f21280cabf0 2023-10-06T04:44:17.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.745+0000 7f212c906700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f212806d140 0x7f212806f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:17.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.745+0000 7f212c906700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f212806d140 0x7f212806f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48146/0 (socket says 172.21.15.17:48146) 2023-10-06T04:44:17.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.745+0000 7f212c906700 1 -- 172.21.15.17:0/4088084943 learned_addr learned my addr 172.21.15.17:0/4088084943 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:17.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.745+0000 7f2127fff700 1 --2- 172.21.15.17:0/4088084943 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f21280cabf0 0x7f21280c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:17.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.745+0000 7f212c906700 1 -- 172.21.15.17:0/4088084943 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f21280cabf0 msgr2=0x7f21280c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:17.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.745+0000 7f212c906700 1 --2- 172.21.15.17:0/4088084943 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f21280cabf0 0x7f21280c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:17.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.745+0000 7f212c906700 1 -- 172.21.15.17:0/4088084943 >> v1:172.21.15.136:6789/0 conn(0x7f2128159b10 legacy=0x7f212806f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:17.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.745+0000 7f212c906700 1 -- 172.21.15.17:0/4088084943 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212806ec00 con 0x7f212806d140 2023-10-06T04:44:17.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.745+0000 7f2127fff700 1 --2- 172.21.15.17:0/4088084943 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f21280cabf0 0x7f21280c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:17.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.745+0000 7f212c906700 1 --2- 172.21.15.17:0/4088084943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f212806d140 0x7f212806f830 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2120009f20 tx=0x7f2120009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2200c004b67a74fa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:17.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.746+0000 7f2126ffd700 1 -- 172.21.15.17:0/4088084943 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212000e070 con 0x7f212806d140 2023-10-06T04:44:17.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.746+0000 7f2126ffd700 1 -- 172.21.15.17:0/4088084943 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212000ba80 con 0x7f212806d140 2023-10-06T04:44:17.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.746+0000 7f2126ffd700 1 -- 172.21.15.17:0/4088084943 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21200092e0 con 0x7f212806d140 2023-10-06T04:44:17.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.746+0000 7f212e369700 1 -- 172.21.15.17:0/4088084943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f212806d140 msgr2=0x7f212806f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:17.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.746+0000 7f212e369700 1 --2- 172.21.15.17:0/4088084943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f212806d140 0x7f212806f830 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2120009f20 tx=0x7f2120009840 comp rx=0 tx=0).stop 2023-10-06T04:44:17.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.746+0000 7f212e369700 1 -- 172.21.15.17:0/4088084943 shutdown_connections 2023-10-06T04:44:17.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.746+0000 7f212e369700 1 --2- 172.21.15.17:0/4088084943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f212806d140 0x7f212806f830 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:17.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.746+0000 7f212e369700 1 --2- 172.21.15.17:0/4088084943 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f21280cabf0 0x7f21280c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:17.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.746+0000 7f212e369700 1 -- 172.21.15.17:0/4088084943 >> 172.21.15.17:0/4088084943 conn(0x7f212806cd40 msgr2=0x7f21280d0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:17.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.746+0000 7f212e369700 1 -- 172.21.15.17:0/4088084943 shutdown_connections 2023-10-06T04:44:17.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.746+0000 7f212e369700 1 -- 172.21.15.17:0/4088084943 wait complete. 2023-10-06T04:44:17.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.747+0000 7f212e369700 1 Processor -- start 2023-10-06T04:44:17.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.747+0000 7f212e369700 1 -- start start 2023-10-06T04:44:17.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.748+0000 7f212e369700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f212806d140 0x7f2128156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:17.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.748+0000 7f212e369700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f21280cabf0 0x7f21280b4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:17.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.748+0000 7f212e369700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2128159b10 0x7f21280b4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:17.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.748+0000 7f212e369700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21280c4a60 con 0x7f212806d140 2023-10-06T04:44:17.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.748+0000 7f212e369700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21280b4fa0 con 0x7f2128159b10 2023-10-06T04:44:17.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.748+0000 7f212e369700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21280c8f70 con 0x7f21280cabf0 2023-10-06T04:44:17.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.748+0000 7f2127fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f212806d140 0x7f2128156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:17.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.748+0000 7f2127fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f212806d140 0x7f2128156c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48152/0 (socket says 172.21.15.17:48152) 2023-10-06T04:44:17.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.748+0000 7f2127fff700 1 -- 172.21.15.17:0/3159671007 learned_addr learned my addr 172.21.15.17:0/3159671007 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:17.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.748+0000 7f21277fe700 1 --2- 172.21.15.17:0/3159671007 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f21280cabf0 0x7f21280b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:17.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.748+0000 7f212c906700 1 --2- 172.21.15.17:0/3159671007 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2128159b10 0x7f21280b4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:17.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.749+0000 7f2127fff700 1 -- 172.21.15.17:0/3159671007 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f21280cabf0 msgr2=0x7f21280b4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:17.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.749+0000 7f2127fff700 1 --2- 172.21.15.17:0/3159671007 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f21280cabf0 0x7f21280b4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:17.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.749+0000 7f2127fff700 1 -- 172.21.15.17:0/3159671007 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2128159b10 msgr2=0x7f21280b4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:17.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.749+0000 7f2127fff700 1 --2- 172.21.15.17:0/3159671007 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2128159b10 0x7f21280b4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:17.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.749+0000 7f2127fff700 1 -- 172.21.15.17:0/3159671007 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2120009ae0 con 0x7f212806d140 2023-10-06T04:44:17.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.749+0000 7f212c906700 1 --2- 172.21.15.17:0/3159671007 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2128159b10 0x7f21280b4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:17.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.749+0000 7f2127fff700 1 --2- 172.21.15.17:0/3159671007 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f212806d140 0x7f2128156c50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f211800e920 tx=0x7f2118008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:17.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.749+0000 7f211ffff700 1 -- 172.21.15.17:0/3159671007 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2118005a00 con 0x7f212806d140 2023-10-06T04:44:17.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.749+0000 7f211ffff700 1 -- 172.21.15.17:0/3159671007 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2118005b60 con 0x7f212806d140 2023-10-06T04:44:17.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.749+0000 7f212e369700 1 -- 172.21.15.17:0/3159671007 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21280c4130 con 0x7f212806d140 2023-10-06T04:44:17.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.749+0000 7f211ffff700 1 -- 172.21.15.17:0/3159671007 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2118006020 con 0x7f212806d140 2023-10-06T04:44:17.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.749+0000 7f212e369700 1 -- 172.21.15.17:0/3159671007 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21280c46f0 con 0x7f212806d140 2023-10-06T04:44:17.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.750+0000 7f212e369700 1 -- 172.21.15.17:0/3159671007 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f212804c380 con 0x7f212806d140 2023-10-06T04:44:17.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.750+0000 7f211ffff700 1 -- 172.21.15.17:0/3159671007 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21180063d0 con 0x7f212806d140 2023-10-06T04:44:17.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.751+0000 7f211ffff700 1 --2- 172.21.15.17:0/3159671007 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2108066f30 0x7f21080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:17.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.751+0000 7f211ffff700 1 -- 172.21.15.17:0/3159671007 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2118084720 con 0x7f212806d140 2023-10-06T04:44:17.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.751+0000 7f21277fe700 1 --2- 172.21.15.17:0/3159671007 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2108066f30 0x7f21080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:17.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.751+0000 7f21277fe700 1 --2- 172.21.15.17:0/3159671007 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2108066f30 0x7f21080693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f212809e420 tx=0x7f2110007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:17.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.755+0000 7f211ffff700 1 -- 172.21.15.17:0/3159671007 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2118051830 con 0x7f212806d140 2023-10-06T04:44:17.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:17.993+0000 7f212e369700 1 -- 172.21.15.17:0/3159671007 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2128071310 con 0x7f212806d140 2023-10-06T04:44:18.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.602+0000 7f211ffff700 1 -- 172.21.15.17:0/3159671007 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2118054e50 con 0x7f212806d140 2023-10-06T04:44:18.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.604+0000 7f212e369700 1 -- 172.21.15.17:0/3159671007 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2108066f30 msgr2=0x7f21080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:18.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.604+0000 7f212e369700 1 --2- 172.21.15.17:0/3159671007 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2108066f30 0x7f21080693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f212809e420 tx=0x7f2110007ec0 comp rx=0 tx=0).stop 2023-10-06T04:44:18.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.604+0000 7f212e369700 1 -- 172.21.15.17:0/3159671007 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f212806d140 msgr2=0x7f2128156c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:18.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.604+0000 7f212e369700 1 --2- 172.21.15.17:0/3159671007 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f212806d140 0x7f2128156c50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f211800e920 tx=0x7f2118008040 comp rx=0 tx=0).stop 2023-10-06T04:44:18.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.604+0000 7f212e369700 1 -- 172.21.15.17:0/3159671007 shutdown_connections 2023-10-06T04:44:18.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.604+0000 7f212e369700 1 --2- 172.21.15.17:0/3159671007 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2108066f30 0x7f21080693e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:18.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.605+0000 7f212e369700 1 --2- 172.21.15.17:0/3159671007 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2128159b10 0x7f21280b4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:18.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.605+0000 7f212e369700 1 --2- 172.21.15.17:0/3159671007 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f212806d140 0x7f2128156c50 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:18.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.605+0000 7f212e369700 1 --2- 172.21.15.17:0/3159671007 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f21280cabf0 0x7f21280b4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:18.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.605+0000 7f212e369700 1 -- 172.21.15.17:0/3159671007 >> 172.21.15.17:0/3159671007 conn(0x7f212806cd40 msgr2=0x7f2128158be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:18.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.605+0000 7f212e369700 1 -- 172.21.15.17:0/3159671007 shutdown_connections 2023-10-06T04:44:18.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.605+0000 7f212e369700 1 -- 172.21.15.17:0/3159671007 wait complete. 2023-10-06T04:44:18.621 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:44:18.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.744+0000 7fed2c89f700 1 Processor -- start 2023-10-06T04:44:18.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.744+0000 7fed2c89f700 1 -- start start 2023-10-06T04:44:18.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.745+0000 7fed2c89f700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fed28159630 0x7fed280cd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:18.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.745+0000 7fed2c89f700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fed280cea10 0x7fed280b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:18.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.745+0000 7fed2c89f700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed280cda00 con 0x7fed280cd590 2023-10-06T04:44:18.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.745+0000 7fed2c89f700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed280cee90 con 0x7fed28159630 2023-10-06T04:44:18.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.745+0000 7fed2c89f700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed280cfc80 con 0x7fed280cea10 2023-10-06T04:44:18.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.745+0000 7fed2659c700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fed28159630 0x7fed280cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:18.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.745+0000 7fed2659c700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fed28159630 0x7fed280cd050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48168/0 (socket says 172.21.15.17:48168) 2023-10-06T04:44:18.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.745+0000 7fed2659c700 1 -- 172.21.15.17:0/4145079346 learned_addr learned my addr 172.21.15.17:0/4145079346 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:18.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.746+0000 7fed26d9d700 1 --2- 172.21.15.17:0/4145079346 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fed280cea10 0x7fed280b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:18.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.746+0000 7fed2659c700 1 -- 172.21.15.17:0/4145079346 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fed280cea10 msgr2=0x7fed280b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:18.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.746+0000 7fed2659c700 1 --2- 172.21.15.17:0/4145079346 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fed280cea10 0x7fed280b02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:18.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.746+0000 7fed2659c700 1 -- 172.21.15.17:0/4145079346 >> v1:172.21.15.136:6789/0 conn(0x7fed280cd590 legacy=0x7fed280ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:18.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.746+0000 7fed2659c700 1 -- 172.21.15.17:0/4145079346 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed280cf070 con 0x7fed28159630 2023-10-06T04:44:18.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.746+0000 7fed2659c700 1 --2- 172.21.15.17:0/4145079346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed28159630 0x7fed280cd050 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fed200099b0 tx=0x7fed20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43f836dda9d480d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:18.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.746+0000 7fed2559a700 1 -- 172.21.15.17:0/4145079346 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2000b860 con 0x7fed28159630 2023-10-06T04:44:18.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.746+0000 7fed2559a700 1 -- 172.21.15.17:0/4145079346 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed2000b9c0 con 0x7fed28159630 2023-10-06T04:44:18.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.746+0000 7fed2559a700 1 -- 172.21.15.17:0/4145079346 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2000bd60 con 0x7fed28159630 2023-10-06T04:44:18.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.747+0000 7fed2c89f700 1 -- 172.21.15.17:0/4145079346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed28159630 msgr2=0x7fed280cd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:18.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.747+0000 7fed2c89f700 1 --2- 172.21.15.17:0/4145079346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed28159630 0x7fed280cd050 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fed200099b0 tx=0x7fed20009250 comp rx=0 tx=0).stop 2023-10-06T04:44:18.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.747+0000 7fed2c89f700 1 -- 172.21.15.17:0/4145079346 shutdown_connections 2023-10-06T04:44:18.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.747+0000 7fed2c89f700 1 --2- 172.21.15.17:0/4145079346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed28159630 0x7fed280cd050 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:18.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.747+0000 7fed2c89f700 1 --2- 172.21.15.17:0/4145079346 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fed280cea10 0x7fed280b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:18.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.747+0000 7fed2c89f700 1 -- 172.21.15.17:0/4145079346 >> 172.21.15.17:0/4145079346 conn(0x7fed2806cff0 msgr2=0x7fed2806d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:18.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.747+0000 7fed2c89f700 1 -- 172.21.15.17:0/4145079346 shutdown_connections 2023-10-06T04:44:18.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.747+0000 7fed2c89f700 1 -- 172.21.15.17:0/4145079346 wait complete. 2023-10-06T04:44:18.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.748+0000 7fed2c89f700 1 Processor -- start 2023-10-06T04:44:18.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.748+0000 7fed2c89f700 1 -- start start 2023-10-06T04:44:18.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.749+0000 7fed2c89f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fed280cd590 0x7fed28159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:18.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.749+0000 7fed2c89f700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fed280cea10 0x7fed280b4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:18.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.749+0000 7fed2c89f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed28159630 0x7fed280b4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:18.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.749+0000 7fed2c89f700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2815b0b0 con 0x7fed28159630 2023-10-06T04:44:18.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.749+0000 7fed2c89f700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2815a200 con 0x7fed280cd590 2023-10-06T04:44:18.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.749+0000 7fed2c89f700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed2815a4a0 con 0x7fed280cea10 2023-10-06T04:44:18.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.749+0000 7fed26d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed28159630 0x7fed280b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:18.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.749+0000 7fed2659c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fed280cd590 0x7fed28159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:18.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.749+0000 7fed26d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed28159630 0x7fed280b4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48172/0 (socket says 172.21.15.17:48172) 2023-10-06T04:44:18.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.749+0000 7fed26d9d700 1 -- 172.21.15.17:0/1532154501 learned_addr learned my addr 172.21.15.17:0/1532154501 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:18.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.749+0000 7fed25d9b700 1 --2- 172.21.15.17:0/1532154501 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fed280cea10 0x7fed280b4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:18.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.749+0000 7fed26d9d700 1 -- 172.21.15.17:0/1532154501 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fed280cea10 msgr2=0x7fed280b4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:18.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.749+0000 7fed26d9d700 1 --2- 172.21.15.17:0/1532154501 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fed280cea10 0x7fed280b4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:18.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.749+0000 7fed26d9d700 1 -- 172.21.15.17:0/1532154501 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fed280cd590 msgr2=0x7fed28159cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:18.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.749+0000 7fed26d9d700 1 --2- 172.21.15.17:0/1532154501 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fed280cd590 0x7fed28159cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:18.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.749+0000 7fed26d9d700 1 -- 172.21.15.17:0/1532154501 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed200094f0 con 0x7fed28159630 2023-10-06T04:44:18.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.749+0000 7fed25d9b700 1 --2- 172.21.15.17:0/1532154501 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fed280cea10 0x7fed280b4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:18.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.749+0000 7fed26d9d700 1 --2- 172.21.15.17:0/1532154501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed28159630 0x7fed280b4770 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fed18009fa0 tx=0x7fed18009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:18.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.749+0000 7fed1e7fc700 1 -- 172.21.15.17:0/1532154501 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1800ec70 con 0x7fed28159630 2023-10-06T04:44:18.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.749+0000 7fed1e7fc700 1 -- 172.21.15.17:0/1532154501 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1800edd0 con 0x7fed28159630 2023-10-06T04:44:18.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.749+0000 7fed2c89f700 1 -- 172.21.15.17:0/1532154501 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed2815a780 con 0x7fed28159630 2023-10-06T04:44:18.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.749+0000 7fed1e7fc700 1 -- 172.21.15.17:0/1532154501 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed18014670 con 0x7fed28159630 2023-10-06T04:44:18.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.749+0000 7fed2c89f700 1 -- 172.21.15.17:0/1532154501 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed2815ad40 con 0x7fed28159630 2023-10-06T04:44:18.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.750+0000 7fed2c89f700 1 -- 172.21.15.17:0/1532154501 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed28063ff0 con 0x7fed28159630 2023-10-06T04:44:18.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.751+0000 7fed1e7fc700 1 -- 172.21.15.17:0/1532154501 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fed180149e0 con 0x7fed28159630 2023-10-06T04:44:18.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.751+0000 7fed1e7fc700 1 --2- 172.21.15.17:0/1532154501 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fed08066f30 0x7fed080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:18.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.751+0000 7fed1e7fc700 1 -- 172.21.15.17:0/1532154501 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fed18084d70 con 0x7fed28159630 2023-10-06T04:44:18.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.751+0000 7fed2659c700 1 --2- 172.21.15.17:0/1532154501 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fed08066f30 0x7fed080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:18.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.752+0000 7fed2659c700 1 --2- 172.21.15.17:0/1532154501 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fed08066f30 0x7fed080693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fed200099b0 tx=0x7fed20017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:18.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.756+0000 7fed1e7fc700 1 -- 172.21.15.17:0/1532154501 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fed18051e80 con 0x7fed28159630 2023-10-06T04:44:18.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.992+0000 7fed2c89f700 1 -- 172.21.15.17:0/1532154501 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed2815b1f0 con 0x7fed28159630 2023-10-06T04:44:18.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.993+0000 7fed1e7fc700 1 -- 172.21.15.17:0/1532154501 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4597 (secure 0 0 0) 0x7fed180554a0 con 0x7fed28159630 2023-10-06T04:44:18.996 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:18.996 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6834/3741747962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3741747962},{"type":"v1","addr":"172.21.15.136:6834","nonce":3741747962}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4688,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/264192509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6833","nonce":264192509},{"type":"v1","addr":"172.21.15.136:6835","nonce":264192509}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4909,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6836/1154731767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1154731767},{"type":"v1","addr":"172.21.15.17:6836","nonce":1154731767}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:44:14.988901+0000","modified":"2023-10-06T04:44:18.598280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4971":{"gid":4971,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6837/460551791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6835","nonce":460551791},{"type":"v1","addr":"172.21.15.17:6837","nonce":460551791}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:44:18.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.995+0000 7fed2c89f700 1 -- 172.21.15.17:0/1532154501 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fed08066f30 msgr2=0x7fed080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:18.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.995+0000 7fed2c89f700 1 --2- 172.21.15.17:0/1532154501 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fed08066f30 0x7fed080693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fed200099b0 tx=0x7fed20017000 comp rx=0 tx=0).stop 2023-10-06T04:44:18.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.995+0000 7fed2c89f700 1 -- 172.21.15.17:0/1532154501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed28159630 msgr2=0x7fed280b4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:18.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.995+0000 7fed2c89f700 1 --2- 172.21.15.17:0/1532154501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed28159630 0x7fed280b4770 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fed18009fa0 tx=0x7fed18009900 comp rx=0 tx=0).stop 2023-10-06T04:44:18.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.995+0000 7fed2c89f700 1 -- 172.21.15.17:0/1532154501 shutdown_connections 2023-10-06T04:44:18.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.995+0000 7fed2c89f700 1 --2- 172.21.15.17:0/1532154501 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fed08066f30 0x7fed080693e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:18.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.995+0000 7fed2c89f700 1 --2- 172.21.15.17:0/1532154501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed28159630 0x7fed280b4770 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:18.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.995+0000 7fed2c89f700 1 --2- 172.21.15.17:0/1532154501 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fed280cd590 0x7fed28159cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:18.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.995+0000 7fed2c89f700 1 --2- 172.21.15.17:0/1532154501 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fed280cea10 0x7fed280b4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:18.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.995+0000 7fed2c89f700 1 -- 172.21.15.17:0/1532154501 >> 172.21.15.17:0/1532154501 conn(0x7fed2806cff0 msgr2=0x7fed280b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:18.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.995+0000 7fed2c89f700 1 -- 172.21.15.17:0/1532154501 shutdown_connections 2023-10-06T04:44:18.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:18.995+0000 7fed2c89f700 1 -- 172.21.15.17:0/1532154501 wait complete. 2023-10-06T04:44:18.999 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 16 2023-10-06T04:44:19.010 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:44:19.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.126+0000 7f7cc2b95700 1 Processor -- start 2023-10-06T04:44:19.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.126+0000 7f7cc2b95700 1 -- start start 2023-10-06T04:44:19.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.127+0000 7f7cc2b95700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7cbc0cd760 0x7f7cbc0ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:19.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.127+0000 7f7cc2b95700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7cbc0ce840 0x7f7cbc0b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:19.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.127+0000 7f7cc2b95700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cbc0cfc80 con 0x7f7cbc159630 2023-10-06T04:44:19.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.127+0000 7f7cc2b95700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cbc0cf070 con 0x7f7cbc0cd760 2023-10-06T04:44:19.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.127+0000 7f7cc2b95700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cbc0cf350 con 0x7f7cbc0ce840 2023-10-06T04:44:19.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.127+0000 7f7cbbfff700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7cbc0cd760 0x7f7cbc0ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:19.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.127+0000 7f7cbbfff700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7cbc0cd760 0x7f7cbc0ce300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48184/0 (socket says 172.21.15.17:48184) 2023-10-06T04:44:19.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.127+0000 7f7cc0931700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f7cbc159630 0x7f7cbc0cd050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:54130/0 (socket says 172.21.15.17:54130) 2023-10-06T04:44:19.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.127+0000 7f7cbbfff700 1 -- 172.21.15.17:0/4153612136 learned_addr learned my addr 172.21.15.17:0/4153612136 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:19.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.127+0000 7f7cc1132700 1 --2- 172.21.15.17:0/4153612136 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7cbc0ce840 0x7f7cbc0b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:19.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.127+0000 7f7cbbfff700 1 -- 172.21.15.17:0/4153612136 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7cbc0ce840 msgr2=0x7f7cbc0b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:19.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.127+0000 7f7cbbfff700 1 --2- 172.21.15.17:0/4153612136 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7cbc0ce840 0x7f7cbc0b02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:19.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.127+0000 7f7cbbfff700 1 -- 172.21.15.17:0/4153612136 >> v1:172.21.15.17:6789/0 conn(0x7f7cbc159630 legacy=0x7f7cbc0cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:19.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.127+0000 7f7cbb7fe700 1 -- 172.21.15.17:0/4153612136 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3205928095 0 0) 0x7f7cbc0cfc80 con 0x7f7cbc159630 2023-10-06T04:44:19.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.127+0000 7f7cbbfff700 1 -- 172.21.15.17:0/4153612136 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cbc0cf630 con 0x7f7cbc0cd760 2023-10-06T04:44:19.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.127+0000 7f7cbbfff700 1 --2- 172.21.15.17:0/4153612136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cbc0cd760 0x7f7cbc0ce300 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7cac0099b0 tx=0x7f7cac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3068c7119c5307d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:19.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.127+0000 7f7cbb7fe700 1 -- 172.21.15.17:0/4153612136 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac00b860 con 0x7f7cbc0cd760 2023-10-06T04:44:19.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.127+0000 7f7cbb7fe700 1 -- 172.21.15.17:0/4153612136 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cac00b9c0 con 0x7f7cbc0cd760 2023-10-06T04:44:19.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.127+0000 7f7cbb7fe700 1 -- 172.21.15.17:0/4153612136 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac00bd60 con 0x7f7cbc0cd760 2023-10-06T04:44:19.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.128+0000 7f7cc2b95700 1 -- 172.21.15.17:0/4153612136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cbc0cd760 msgr2=0x7f7cbc0ce300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:19.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.128+0000 7f7cc2b95700 1 --2- 172.21.15.17:0/4153612136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cbc0cd760 0x7f7cbc0ce300 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7cac0099b0 tx=0x7f7cac009250 comp rx=0 tx=0).stop 2023-10-06T04:44:19.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.128+0000 7f7cc2b95700 1 -- 172.21.15.17:0/4153612136 shutdown_connections 2023-10-06T04:44:19.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.128+0000 7f7cc2b95700 1 --2- 172.21.15.17:0/4153612136 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7cbc0ce840 0x7f7cbc0b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:19.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.128+0000 7f7cc2b95700 1 --2- 172.21.15.17:0/4153612136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cbc0cd760 0x7f7cbc0ce300 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:19.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.128+0000 7f7cc2b95700 1 -- 172.21.15.17:0/4153612136 >> 172.21.15.17:0/4153612136 conn(0x7f7cbc06cff0 msgr2=0x7f7cbc06d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:19.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.128+0000 7f7cc2b95700 1 -- 172.21.15.17:0/4153612136 shutdown_connections 2023-10-06T04:44:19.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.128+0000 7f7cc2b95700 1 -- 172.21.15.17:0/4153612136 wait complete. 2023-10-06T04:44:19.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.129+0000 7f7cc2b95700 1 Processor -- start 2023-10-06T04:44:19.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.129+0000 7f7cc2b95700 1 -- start start 2023-10-06T04:44:19.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.130+0000 7f7cc2b95700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cbc0cd760 0x7f7cbc15cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:19.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.130+0000 7f7cc2b95700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7cbc0ce840 0x7f7cbc14e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:19.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.130+0000 7f7cc2b95700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7cbc159630 0x7f7cbc15e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:19.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.130+0000 7f7cc2b95700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cbc15c860 con 0x7f7cbc0cd760 2023-10-06T04:44:19.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.130+0000 7f7cc2b95700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cbc14e790 con 0x7f7cbc159630 2023-10-06T04:44:19.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.130+0000 7f7cc2b95700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cbc0c8cf0 con 0x7f7cbc0ce840 2023-10-06T04:44:19.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.130+0000 7f7cc0931700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cbc0cd760 0x7f7cbc15cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:19.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.130+0000 7f7cc0931700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cbc0cd760 0x7f7cbc15cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48188/0 (socket says 172.21.15.17:48188) 2023-10-06T04:44:19.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.130+0000 7f7cc0931700 1 -- 172.21.15.17:0/2160890210 learned_addr learned my addr 172.21.15.17:0/2160890210 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:19.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.130+0000 7f7cbbfff700 1 --2- 172.21.15.17:0/2160890210 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7cbc0ce840 0x7f7cbc14e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:19.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.130+0000 7f7cc1132700 1 --2- 172.21.15.17:0/2160890210 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7cbc159630 0x7f7cbc15e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:19.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.130+0000 7f7cc0931700 1 -- 172.21.15.17:0/2160890210 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7cbc0ce840 msgr2=0x7f7cbc14e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:19.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.130+0000 7f7cc0931700 1 --2- 172.21.15.17:0/2160890210 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7cbc0ce840 0x7f7cbc14e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:19.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.130+0000 7f7cc0931700 1 -- 172.21.15.17:0/2160890210 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7cbc159630 msgr2=0x7f7cbc15e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:19.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.130+0000 7f7cc0931700 1 --2- 172.21.15.17:0/2160890210 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7cbc159630 0x7f7cbc15e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:19.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.130+0000 7f7cc0931700 1 -- 172.21.15.17:0/2160890210 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cac0094f0 con 0x7f7cbc0cd760 2023-10-06T04:44:19.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.130+0000 7f7cc1132700 1 --2- 172.21.15.17:0/2160890210 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7cbc159630 0x7f7cbc15e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:19.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.131+0000 7f7cc0931700 1 --2- 172.21.15.17:0/2160890210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cbc0cd760 0x7f7cbc15cc90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7cb400cd30 tx=0x7f7cb4001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:19.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.131+0000 7f7cb8ff9700 1 -- 172.21.15.17:0/2160890210 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb400ce90 con 0x7f7cbc0cd760 2023-10-06T04:44:19.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.131+0000 7f7cb8ff9700 1 -- 172.21.15.17:0/2160890210 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb4005df0 con 0x7f7cbc0cd760 2023-10-06T04:44:19.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.131+0000 7f7cc2b95700 1 -- 172.21.15.17:0/2160890210 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cbc0c8fd0 con 0x7f7cbc0cd760 2023-10-06T04:44:19.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.131+0000 7f7cb8ff9700 1 -- 172.21.15.17:0/2160890210 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb400abb0 con 0x7f7cbc0cd760 2023-10-06T04:44:19.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.131+0000 7f7cc2b95700 1 -- 172.21.15.17:0/2160890210 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cbc0c9590 con 0x7f7cbc0cd760 2023-10-06T04:44:19.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.132+0000 7f7cc2b95700 1 -- 172.21.15.17:0/2160890210 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cbc063ff0 con 0x7f7cbc0cd760 2023-10-06T04:44:19.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.132+0000 7f7cb8ff9700 1 -- 172.21.15.17:0/2160890210 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7cb40070f0 con 0x7f7cbc0cd760 2023-10-06T04:44:19.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.133+0000 7f7cb8ff9700 1 --2- 172.21.15.17:0/2160890210 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7c9c066f30 0x7f7c9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:19.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.133+0000 7f7cbbfff700 1 --2- 172.21.15.17:0/2160890210 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7c9c066f30 0x7f7c9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:19.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.133+0000 7f7cb8ff9700 1 -- 172.21.15.17:0/2160890210 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7cb40847b0 con 0x7f7cbc0cd760 2023-10-06T04:44:19.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.133+0000 7f7cbbfff700 1 --2- 172.21.15.17:0/2160890210 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7c9c066f30 0x7f7c9c0693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7cac0099b0 tx=0x7f7cac017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:19.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.137+0000 7f7cb8ff9700 1 -- 172.21.15.17:0/2160890210 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7cb4051940 con 0x7f7cbc0cd760 2023-10-06T04:44:19.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.333+0000 7f7cc2b95700 1 -- 172.21.15.17:0/2160890210 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7cbc0cdea0 con 0x7f7cbc0cd760 2023-10-06T04:44:19.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.334+0000 7f7cb8ff9700 1 -- 172.21.15.17:0/2160890210 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f7cb4054f60 con 0x7f7cbc0cd760 2023-10-06T04:44:19.337 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:19.337 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":32,"fsid":"780777c4-2b25-4d35-9058-c9f2d62e3ad9","created":"2023-10-06T04:43:10.578520+0000","modified":"2023-10-06T04:44:16.313359+0000","last_up_change":"2023-10-06T04:43:20.682958+0000","last_in_change":"2023-10-06T04:43:12.978917+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:43:21.795733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:43:22.389592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:44:13.266447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T04:44:13.958240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"84737b08-575c-46dd-9488-073ae8504494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6809","nonce":90656},{"type":"v1","addr":"172.21.15.17:6811","nonce":90656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":90656},{"type":"v1","addr":"172.21.15.17:6814","nonce":90656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":90656},{"type":"v1","addr":"172.21.15.17:6822","nonce":90656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":90656},{"type":"v1","addr":"172.21.15.17:6818","nonce":90656}]},"public_addr":"172.21.15.17:6811/90656","cluster_addr":"172.21.15.17:6814/90656","heartbeat_back_addr":"172.21.15.17:6822/90656","heartbeat_front_addr":"172.21.15.17:6818/90656","state":["exists","up"]},{"osd":1,"uuid":"dffeb740-58a2-4fd6-8ff1-a0a11a2cc709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":90655},{"type":"v1","addr":"172.21.15.17:6801","nonce":90655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":90655},{"type":"v1","addr":"172.21.15.17:6803","nonce":90655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":90655},{"type":"v1","addr":"172.21.15.17:6807","nonce":90655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":90655},{"type":"v1","addr":"172.21.15.17:6805","nonce":90655}]},"public_addr":"172.21.15.17:6801/90655","cluster_addr":"172.21.15.17:6803/90655","heartbeat_back_addr":"172.21.15.17:6807/90655","heartbeat_front_addr":"172.21.15.17:6805/90655","state":["exists","up"]},{"osd":2,"uuid":"48bd6831-763d-48c2-b515-e02c216d608b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":90657},{"type":"v1","addr":"172.21.15.17:6810","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":90657},{"type":"v1","addr":"172.21.15.17:6815","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":90657},{"type":"v1","addr":"172.21.15.17:6823","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":90657},{"type":"v1","addr":"172.21.15.17:6819","nonce":90657}]},"public_addr":"172.21.15.17:6810/90657","cluster_addr":"172.21.15.17:6815/90657","heartbeat_back_addr":"172.21.15.17:6823/90657","heartbeat_front_addr":"172.21.15.17:6819/90657","state":["exists","up"]},{"osd":3,"uuid":"ae7dbb23-abe7-4bd3-a4df-6f5963d6804c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":90688},{"type":"v1","addr":"172.21.15.17:6825","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":90688},{"type":"v1","addr":"172.21.15.17:6827","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":90688},{"type":"v1","addr":"172.21.15.17:6831","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":90688},{"type":"v1","addr":"172.21.15.17:6829","nonce":90688}]},"public_addr":"172.21.15.17:6825/90688","cluster_addr":"172.21.15.17:6827/90688","heartbeat_back_addr":"172.21.15.17:6831/90688","heartbeat_front_addr":"172.21.15.17:6829/90688","state":["exists","up"]},{"osd":4,"uuid":"29991fb4-1667-4ea3-aca0-d55db27f3bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":90902},{"type":"v1","addr":"172.21.15.136:6801","nonce":90902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":90902},{"type":"v1","addr":"172.21.15.136:6803","nonce":90902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":90902},{"type":"v1","addr":"172.21.15.136:6807","nonce":90902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":90902},{"type":"v1","addr":"172.21.15.136:6805","nonce":90902}]},"public_addr":"172.21.15.136:6801/90902","cluster_addr":"172.21.15.136:6803/90902","heartbeat_back_addr":"172.21.15.136:6807/90902","heartbeat_front_addr":"172.21.15.136:6805/90902","state":["exists","up"]},{"osd":5,"uuid":"398b4ff9-03fc-421f-882c-ba12aa088eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":90901},{"type":"v1","addr":"172.21.15.136:6809","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":90901},{"type":"v1","addr":"172.21.15.136:6811","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":90901},{"type":"v1","addr":"172.21.15.136:6815","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":90901},{"type":"v1","addr":"172.21.15.136:6813","nonce":90901}]},"public_addr":"172.21.15.136:6809/90901","cluster_addr":"172.21.15.136:6811/90901","heartbeat_back_addr":"172.21.15.136:6815/90901","heartbeat_front_addr":"172.21.15.136:6813/90901","state":["exists","up"]},{"osd":6,"uuid":"1bb91a72-4dab-4cdb-aa1d-2b8a9edf1ad0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":90927},{"type":"v1","addr":"172.21.15.136:6825","nonce":90927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":90927},{"type":"v1","addr":"172.21.15.136:6827","nonce":90927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":90927},{"type":"v1","addr":"172.21.15.136:6831","nonce":90927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":90927},{"type":"v1","addr":"172.21.15.136:6829","nonce":90927}]},"public_addr":"172.21.15.136:6825/90927","cluster_addr":"172.21.15.136:6827/90927","heartbeat_back_addr":"172.21.15.136:6831/90927","heartbeat_front_addr":"172.21.15.136:6829/90927","state":["exists","up"]},{"osd":7,"uuid":"719b654e-010d-4aa4-8c13-83fdde242b47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":90934},{"type":"v1","addr":"172.21.15.136:6817","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":90934},{"type":"v1","addr":"172.21.15.136:6819","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":90934},{"type":"v1","addr":"172.21.15.136:6824","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":90934},{"type":"v1","addr":"172.21.15.136:6821","nonce":90934}]},"public_addr":"172.21.15.136:6817/90934","cluster_addr":"172.21.15.136:6819/90934","heartbeat_back_addr":"172.21.15.136:6824/90934","heartbeat_front_addr":"172.21.15.136:6821/90934","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.157479+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.140520+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.190743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.231396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.156510+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.145822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.202888+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.139532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:44:19.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.335+0000 7f7cc2b95700 1 -- 172.21.15.17:0/2160890210 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7c9c066f30 msgr2=0x7f7c9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:19.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.336+0000 7f7cc2b95700 1 --2- 172.21.15.17:0/2160890210 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7c9c066f30 0x7f7c9c0693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7cac0099b0 tx=0x7f7cac017000 comp rx=0 tx=0).stop 2023-10-06T04:44:19.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.336+0000 7f7cc2b95700 1 -- 172.21.15.17:0/2160890210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cbc0cd760 msgr2=0x7f7cbc15cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:19.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.336+0000 7f7cc2b95700 1 --2- 172.21.15.17:0/2160890210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cbc0cd760 0x7f7cbc15cc90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7cb400cd30 tx=0x7f7cb4001af0 comp rx=0 tx=0).stop 2023-10-06T04:44:19.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.336+0000 7f7cc2b95700 1 -- 172.21.15.17:0/2160890210 shutdown_connections 2023-10-06T04:44:19.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.336+0000 7f7cc2b95700 1 --2- 172.21.15.17:0/2160890210 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7c9c066f30 0x7f7c9c0693e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:19.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.336+0000 7f7cc2b95700 1 --2- 172.21.15.17:0/2160890210 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7cbc159630 0x7f7cbc15e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:19.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.336+0000 7f7cc2b95700 1 --2- 172.21.15.17:0/2160890210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cbc0cd760 0x7f7cbc15cc90 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:19.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.336+0000 7f7cc2b95700 1 --2- 172.21.15.17:0/2160890210 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7cbc0ce840 0x7f7cbc14e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:19.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.336+0000 7f7cc2b95700 1 -- 172.21.15.17:0/2160890210 >> 172.21.15.17:0/2160890210 conn(0x7f7cbc06cff0 msgr2=0x7f7cbc0b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:19.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.336+0000 7f7cc2b95700 1 -- 172.21.15.17:0/2160890210 shutdown_connections 2023-10-06T04:44:19.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.336+0000 7f7cc2b95700 1 -- 172.21.15.17:0/2160890210 wait complete. 2023-10-06T04:44:19.352 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T04:44:19.352 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:44:19.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.468+0000 7f17451c2700 1 Processor -- start 2023-10-06T04:44:19.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.468+0000 7f17451c2700 1 -- start start 2023-10-06T04:44:19.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.469+0000 7f17451c2700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1740159630 0x7f17400cd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:19.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.469+0000 7f17451c2700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f17400cd590 0x7f17400ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:19.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.469+0000 7f17451c2700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17400cda00 con 0x7f17400ce840 2023-10-06T04:44:19.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.469+0000 7f17451c2700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17400cfc80 con 0x7f1740159630 2023-10-06T04:44:19.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.469+0000 7f17451c2700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17400cf070 con 0x7f17400cd590 2023-10-06T04:44:19.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.469+0000 7f173ed9d700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1740159630 0x7f17400cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:19.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.469+0000 7f173f59e700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f17400ce840 0x7f174015d2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:54138/0 (socket says 172.21.15.17:54138) 2023-10-06T04:44:19.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.469+0000 7f173ed9d700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1740159630 0x7f17400cd050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48204/0 (socket says 172.21.15.17:48204) 2023-10-06T04:44:19.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.469+0000 7f173f59e700 1 -- 172.21.15.17:0/2798810397 learned_addr learned my addr 172.21.15.17:0/2798810397 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:19.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.469+0000 7f173ed9d700 1 -- 172.21.15.17:0/2798810397 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f17400cd590 msgr2=0x7f17400ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:19.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.469+0000 7f173e59c700 1 --2- 172.21.15.17:0/2798810397 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f17400cd590 0x7f17400ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:19.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.469+0000 7f173ed9d700 1 --2- 172.21.15.17:0/2798810397 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f17400cd590 0x7f17400ce300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:19.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.469+0000 7f173dd9b700 1 -- 172.21.15.17:0/2798810397 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2791036372 0 0) 0x7f17400cda00 con 0x7f17400ce840 2023-10-06T04:44:19.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.469+0000 7f173ed9d700 1 -- 172.21.15.17:0/2798810397 >> v1:172.21.15.17:6789/0 conn(0x7f17400ce840 legacy=0x7f174015d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:19.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.469+0000 7f173ed9d700 1 -- 172.21.15.17:0/2798810397 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17400cf350 con 0x7f1740159630 2023-10-06T04:44:19.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.470+0000 7f173ed9d700 1 --2- 172.21.15.17:0/2798810397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1740159630 0x7f17400cd050 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f17300098e0 tx=0x7f17300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3be4a58850cd73b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:19.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.470+0000 7f173dd9b700 1 -- 172.21.15.17:0/2798810397 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1730009e80 con 0x7f1740159630 2023-10-06T04:44:19.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.470+0000 7f173dd9b700 1 -- 172.21.15.17:0/2798810397 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f173000b860 con 0x7f1740159630 2023-10-06T04:44:19.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.470+0000 7f173dd9b700 1 -- 172.21.15.17:0/2798810397 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173000bbe0 con 0x7f1740159630 2023-10-06T04:44:19.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.470+0000 7f17451c2700 1 -- 172.21.15.17:0/2798810397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1740159630 msgr2=0x7f17400cd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:19.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.470+0000 7f17451c2700 1 --2- 172.21.15.17:0/2798810397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1740159630 0x7f17400cd050 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f17300098e0 tx=0x7f17300091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:19.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.470+0000 7f17451c2700 1 -- 172.21.15.17:0/2798810397 shutdown_connections 2023-10-06T04:44:19.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.470+0000 7f17451c2700 1 --2- 172.21.15.17:0/2798810397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1740159630 0x7f17400cd050 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:19.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.470+0000 7f17451c2700 1 --2- 172.21.15.17:0/2798810397 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f17400cd590 0x7f17400ce300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:19.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.470+0000 7f17451c2700 1 -- 172.21.15.17:0/2798810397 >> 172.21.15.17:0/2798810397 conn(0x7f174006cff0 msgr2=0x7f174006d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:19.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.470+0000 7f17451c2700 1 -- 172.21.15.17:0/2798810397 shutdown_connections 2023-10-06T04:44:19.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.470+0000 7f17451c2700 1 -- 172.21.15.17:0/2798810397 wait complete. 2023-10-06T04:44:19.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.472+0000 7f17451c2700 1 Processor -- start 2023-10-06T04:44:19.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.472+0000 7f17451c2700 1 -- start start 2023-10-06T04:44:19.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.472+0000 7f17451c2700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17400cd590 0x7f17400b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:19.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.472+0000 7f17451c2700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17400ce840 0x7f17400b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:19.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.472+0000 7f17451c2700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1740159630 0x7f174014d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:19.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.472+0000 7f17451c2700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17400b4900 con 0x7f17400cd590 2023-10-06T04:44:19.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.472+0000 7f17451c2700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17400b3cf0 con 0x7f17400ce840 2023-10-06T04:44:19.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.472+0000 7f17451c2700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17400b3fd0 con 0x7f1740159630 2023-10-06T04:44:19.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.472+0000 7f173ed9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17400cd590 0x7f17400b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:19.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.473+0000 7f173ed9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17400cd590 0x7f17400b4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48208/0 (socket says 172.21.15.17:48208) 2023-10-06T04:44:19.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.473+0000 7f173ed9d700 1 -- 172.21.15.17:0/3122256600 learned_addr learned my addr 172.21.15.17:0/3122256600 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:19.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.473+0000 7f173e59c700 1 --2- 172.21.15.17:0/3122256600 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17400ce840 0x7f17400b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:19.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.473+0000 7f173f59e700 1 --2- 172.21.15.17:0/3122256600 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1740159630 0x7f174014d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:19.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.473+0000 7f173ed9d700 1 -- 172.21.15.17:0/3122256600 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1740159630 msgr2=0x7f174014d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:19.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.473+0000 7f173ed9d700 1 --2- 172.21.15.17:0/3122256600 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1740159630 0x7f174014d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:19.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.473+0000 7f173ed9d700 1 -- 172.21.15.17:0/3122256600 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17400ce840 msgr2=0x7f17400b33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:19.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.473+0000 7f173ed9d700 1 --2- 172.21.15.17:0/3122256600 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17400ce840 0x7f17400b33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:19.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.473+0000 7f173ed9d700 1 -- 172.21.15.17:0/3122256600 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1730009420 con 0x7f17400cd590 2023-10-06T04:44:19.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.473+0000 7f173e59c700 1 --2- 172.21.15.17:0/3122256600 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17400ce840 0x7f17400b33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:19.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.473+0000 7f173ed9d700 1 --2- 172.21.15.17:0/3122256600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17400cd590 0x7f17400b4d90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f17400d16b0 tx=0x7f1730017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:19.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.473+0000 7f1736ffd700 1 -- 172.21.15.17:0/3122256600 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173000bbe0 con 0x7f17400cd590 2023-10-06T04:44:19.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.473+0000 7f1736ffd700 1 -- 172.21.15.17:0/3122256600 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1730011420 con 0x7f17400cd590 2023-10-06T04:44:19.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.473+0000 7f17451c2700 1 -- 172.21.15.17:0/3122256600 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17400b42b0 con 0x7f17400cd590 2023-10-06T04:44:19.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.473+0000 7f1736ffd700 1 -- 172.21.15.17:0/3122256600 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17300117e0 con 0x7f17400cd590 2023-10-06T04:44:19.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.473+0000 7f17451c2700 1 -- 172.21.15.17:0/3122256600 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17400b3930 con 0x7f17400cd590 2023-10-06T04:44:19.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.474+0000 7f17451c2700 1 -- 172.21.15.17:0/3122256600 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1740063ff0 con 0x7f17400cd590 2023-10-06T04:44:19.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.475+0000 7f1736ffd700 1 -- 172.21.15.17:0/3122256600 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1730011bd0 con 0x7f17400cd590 2023-10-06T04:44:19.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.475+0000 7f1736ffd700 1 --2- 172.21.15.17:0/3122256600 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1720066f30 0x7f17200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:19.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.475+0000 7f1736ffd700 1 -- 172.21.15.17:0/3122256600 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f17300861a0 con 0x7f17400cd590 2023-10-06T04:44:19.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.475+0000 7f173e59c700 1 --2- 172.21.15.17:0/3122256600 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1720066f30 0x7f17200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:19.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.476+0000 7f173e59c700 1 --2- 172.21.15.17:0/3122256600 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1720066f30 0x7f17200693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f17400c9ee0 tx=0x7f1728008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:19.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.480+0000 7f1736ffd700 1 -- 172.21.15.17:0/3122256600 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f17300532b0 con 0x7f17400cd590 2023-10-06T04:44:19.569 INFO:tasks.ceph.mds.a.smithi017.stderr:2023-10-06T04:44:19.566+0000 7fc571176700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T04:44:19.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.668+0000 7f17451c2700 1 -- 172.21.15.17:0/3122256600 --> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f17400b4a40 con 0x7f1720066f30 2023-10-06T04:44:19.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.677+0000 7f1736ffd700 1 -- 172.21.15.17:0/3122256600 <== mgr.4104 v2:172.21.15.17:6832/90424 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286904 (secure 0 0 0) 0x7f172800f6b0 con 0x7f1720066f30 2023-10-06T04:44:19.683 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:19.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.680+0000 7f17451c2700 1 -- 172.21.15.17:0/3122256600 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1720066f30 msgr2=0x7f17200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:19.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.680+0000 7f17451c2700 1 --2- 172.21.15.17:0/3122256600 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1720066f30 0x7f17200693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f17400c9ee0 tx=0x7f1728008040 comp rx=0 tx=0).stop 2023-10-06T04:44:19.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.680+0000 7f17451c2700 1 -- 172.21.15.17:0/3122256600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17400cd590 msgr2=0x7f17400b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:19.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.680+0000 7f17451c2700 1 --2- 172.21.15.17:0/3122256600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17400cd590 0x7f17400b4d90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f17400d16b0 tx=0x7f1730017000 comp rx=0 tx=0).stop 2023-10-06T04:44:19.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.680+0000 7f17451c2700 1 -- 172.21.15.17:0/3122256600 shutdown_connections 2023-10-06T04:44:19.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.680+0000 7f17451c2700 1 --2- 172.21.15.17:0/3122256600 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1720066f30 0x7f17200693e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:19.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.680+0000 7f17451c2700 1 --2- 172.21.15.17:0/3122256600 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1740159630 0x7f174014d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:19.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.680+0000 7f17451c2700 1 --2- 172.21.15.17:0/3122256600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17400cd590 0x7f17400b4d90 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:19.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.680+0000 7f17451c2700 1 --2- 172.21.15.17:0/3122256600 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17400ce840 0x7f17400b33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:19.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.680+0000 7f17451c2700 1 -- 172.21.15.17:0/3122256600 >> 172.21.15.17:0/3122256600 conn(0x7f174006cff0 msgr2=0x7f17400b2970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:19.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.680+0000 7f17451c2700 1 -- 172.21.15.17:0/3122256600 shutdown_connections 2023-10-06T04:44:19.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.680+0000 7f17451c2700 1 -- 172.21.15.17:0/3122256600 wait complete. 2023-10-06T04:44:19.686 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-06T04:44:19.695 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2023-10-06T04:44:18.345454+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":109,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382248,"kb_used_data":3944,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592472,"statfs":{"total":773094113280,"available":770654691328,"internally_reserved":0,"allocated":4038656,"data_stored":2298572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.770497"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.326263+0000","last_change":"2023-10-06T04:44:15.324530+0000","last_active":"2023-10-06T04:44:15.326263+0000","last_peered":"2023-10-06T04:44:15.326263+0000","last_clean":"2023-10-06T04:44:15.326263+0000","last_became_active":"2023-10-06T04:44:15.324257+0000","last_became_peered":"2023-10-06T04:44:15.324257+0000","last_unstale":"2023-10-06T04:44:15.326263+0000","last_undegraded":"2023-10-06T04:44:15.326263+0000","last_fullsized":"2023-10-06T04:44:15.326263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:36:00.020421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.328830+0000","last_change":"2023-10-06T04:44:15.327016+0000","last_active":"2023-10-06T04:44:15.328830+0000","last_peered":"2023-10-06T04:44:15.328830+0000","last_clean":"2023-10-06T04:44:15.328830+0000","last_became_active":"2023-10-06T04:44:15.326720+0000","last_became_peered":"2023-10-06T04:44:15.326720+0000","last_unstale":"2023-10-06T04:44:15.328830+0000","last_undegraded":"2023-10-06T04:44:15.328830+0000","last_fullsized":"2023-10-06T04:44:15.328830+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:59:32.879433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.333281+0000","last_change":"2023-10-06T04:44:15.333281+0000","last_active":"2023-10-06T04:44:15.333281+0000","last_peered":"2023-10-06T04:44:15.333281+0000","last_clean":"2023-10-06T04:44:15.333281+0000","last_became_active":"2023-10-06T04:44:15.332954+0000","last_became_peered":"2023-10-06T04:44:15.332954+0000","last_unstale":"2023-10-06T04:44:15.333281+0000","last_undegraded":"2023-10-06T04:44:15.333281+0000","last_fullsized":"2023-10-06T04:44:15.333281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:40:28.919122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.330821+0000","last_change":"2023-10-06T04:44:15.330821+0000","last_active":"2023-10-06T04:44:15.330821+0000","last_peered":"2023-10-06T04:44:15.330821+0000","last_clean":"2023-10-06T04:44:15.330821+0000","last_became_active":"2023-10-06T04:44:15.330442+0000","last_became_peered":"2023-10-06T04:44:15.330442+0000","last_unstale":"2023-10-06T04:44:15.330821+0000","last_undegraded":"2023-10-06T04:44:15.330821+0000","last_fullsized":"2023-10-06T04:44:15.330821+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:43.481551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.329192+0000","last_change":"2023-10-06T04:44:15.329192+0000","last_active":"2023-10-06T04:44:15.329192+0000","last_peered":"2023-10-06T04:44:15.329192+0000","last_clean":"2023-10-06T04:44:15.329192+0000","last_became_active":"2023-10-06T04:44:15.328907+0000","last_became_peered":"2023-10-06T04:44:15.328907+0000","last_unstale":"2023-10-06T04:44:15.329192+0000","last_undegraded":"2023-10-06T04:44:15.329192+0000","last_fullsized":"2023-10-06T04:44:15.329192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:42:47.516611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.326138+0000","last_change":"2023-10-06T04:44:15.326138+0000","last_active":"2023-10-06T04:44:15.326138+0000","last_peered":"2023-10-06T04:44:15.326138+0000","last_clean":"2023-10-06T04:44:15.326138+0000","last_became_active":"2023-10-06T04:44:15.325882+0000","last_became_peered":"2023-10-06T04:44:15.325882+0000","last_unstale":"2023-10-06T04:44:15.326138+0000","last_undegraded":"2023-10-06T04:44:15.326138+0000","last_fullsized":"2023-10-06T04:44:15.326138+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:39.916832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.335601+0000","last_change":"2023-10-06T04:44:15.331653+0000","last_active":"2023-10-06T04:44:15.335601+0000","last_peered":"2023-10-06T04:44:15.335601+0000","last_clean":"2023-10-06T04:44:15.335601+0000","last_became_active":"2023-10-06T04:44:15.331371+0000","last_became_peered":"2023-10-06T04:44:15.331371+0000","last_unstale":"2023-10-06T04:44:15.335601+0000","last_undegraded":"2023-10-06T04:44:15.335601+0000","last_fullsized":"2023-10-06T04:44:15.335601+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:09.704873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.332592+0000","last_change":"2023-10-06T04:44:15.331675+0000","last_active":"2023-10-06T04:44:15.332592+0000","last_peered":"2023-10-06T04:44:15.332592+0000","last_clean":"2023-10-06T04:44:15.332592+0000","last_became_active":"2023-10-06T04:44:15.331445+0000","last_became_peered":"2023-10-06T04:44:15.331445+0000","last_unstale":"2023-10-06T04:44:15.332592+0000","last_undegraded":"2023-10-06T04:44:15.332592+0000","last_fullsized":"2023-10-06T04:44:15.332592+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:31.629240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.331164+0000","last_change":"2023-10-06T04:44:15.331164+0000","last_active":"2023-10-06T04:44:15.331164+0000","last_peered":"2023-10-06T04:44:15.331164+0000","last_clean":"2023-10-06T04:44:15.331164+0000","last_became_active":"2023-10-06T04:44:15.330884+0000","last_became_peered":"2023-10-06T04:44:15.330884+0000","last_unstale":"2023-10-06T04:44:15.331164+0000","last_undegraded":"2023-10-06T04:44:15.331164+0000","last_fullsized":"2023-10-06T04:44:15.331164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:36.154075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.340832+0000","last_change":"2023-10-06T04:44:15.337634+0000","last_active":"2023-10-06T04:44:15.340832+0000","last_peered":"2023-10-06T04:44:15.340832+0000","last_clean":"2023-10-06T04:44:15.340832+0000","last_became_active":"2023-10-06T04:44:15.337319+0000","last_became_peered":"2023-10-06T04:44:15.337319+0000","last_unstale":"2023-10-06T04:44:15.340832+0000","last_undegraded":"2023-10-06T04:44:15.340832+0000","last_fullsized":"2023-10-06T04:44:15.340832+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:55.263496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.338176+0000","last_change":"2023-10-06T04:44:15.336202+0000","last_active":"2023-10-06T04:44:15.338176+0000","last_peered":"2023-10-06T04:44:15.338176+0000","last_clean":"2023-10-06T04:44:15.338176+0000","last_became_active":"2023-10-06T04:44:15.335806+0000","last_became_peered":"2023-10-06T04:44:15.335806+0000","last_unstale":"2023-10-06T04:44:15.338176+0000","last_undegraded":"2023-10-06T04:44:15.338176+0000","last_fullsized":"2023-10-06T04:44:15.338176+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:20:22.767127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.326202+0000","last_change":"2023-10-06T04:44:15.326202+0000","last_active":"2023-10-06T04:44:15.326202+0000","last_peered":"2023-10-06T04:44:15.326202+0000","last_clean":"2023-10-06T04:44:15.326202+0000","last_became_active":"2023-10-06T04:44:15.325948+0000","last_became_peered":"2023-10-06T04:44:15.325948+0000","last_unstale":"2023-10-06T04:44:15.326202+0000","last_undegraded":"2023-10-06T04:44:15.326202+0000","last_fullsized":"2023-10-06T04:44:15.326202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:30.849219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.340916+0000","last_change":"2023-10-06T04:44:15.337631+0000","last_active":"2023-10-06T04:44:15.340916+0000","last_peered":"2023-10-06T04:44:15.340916+0000","last_clean":"2023-10-06T04:44:15.340916+0000","last_became_active":"2023-10-06T04:44:15.337305+0000","last_became_peered":"2023-10-06T04:44:15.337305+0000","last_unstale":"2023-10-06T04:44:15.340916+0000","last_undegraded":"2023-10-06T04:44:15.340916+0000","last_fullsized":"2023-10-06T04:44:15.340916+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:36.154075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.335457+0000","last_change":"2023-10-06T04:44:15.328351+0000","last_active":"2023-10-06T04:44:15.335457+0000","last_peered":"2023-10-06T04:44:15.335457+0000","last_clean":"2023-10-06T04:44:15.335457+0000","last_became_active":"2023-10-06T04:44:15.328067+0000","last_became_peered":"2023-10-06T04:44:15.328067+0000","last_unstale":"2023-10-06T04:44:15.335457+0000","last_undegraded":"2023-10-06T04:44:15.335457+0000","last_fullsized":"2023-10-06T04:44:15.335457+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:59:32.879433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.335622+0000","last_change":"2023-10-06T04:44:15.331791+0000","last_active":"2023-10-06T04:44:15.335622+0000","last_peered":"2023-10-06T04:44:15.335622+0000","last_clean":"2023-10-06T04:44:15.335622+0000","last_became_active":"2023-10-06T04:44:15.331529+0000","last_became_peered":"2023-10-06T04:44:15.331529+0000","last_unstale":"2023-10-06T04:44:15.335622+0000","last_undegraded":"2023-10-06T04:44:15.335622+0000","last_fullsized":"2023-10-06T04:44:15.335622+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:48.514352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.340800+0000","last_change":"2023-10-06T04:44:15.332802+0000","last_active":"2023-10-06T04:44:15.340800+0000","last_peered":"2023-10-06T04:44:15.340800+0000","last_clean":"2023-10-06T04:44:15.340800+0000","last_became_active":"2023-10-06T04:44:15.332259+0000","last_became_peered":"2023-10-06T04:44:15.332259+0000","last_unstale":"2023-10-06T04:44:15.340800+0000","last_undegraded":"2023-10-06T04:44:15.340800+0000","last_fullsized":"2023-10-06T04:44:15.340800+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:48.514352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.336850+0000","last_change":"2023-10-06T04:44:15.329266+0000","last_active":"2023-10-06T04:44:15.336850+0000","last_peered":"2023-10-06T04:44:15.336850+0000","last_clean":"2023-10-06T04:44:15.336850+0000","last_became_active":"2023-10-06T04:44:15.328399+0000","last_became_peered":"2023-10-06T04:44:15.328399+0000","last_unstale":"2023-10-06T04:44:15.336850+0000","last_undegraded":"2023-10-06T04:44:15.336850+0000","last_fullsized":"2023-10-06T04:44:15.336850+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:09.704873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.330299+0000","last_change":"2023-10-06T04:44:15.330299+0000","last_active":"2023-10-06T04:44:15.330299+0000","last_peered":"2023-10-06T04:44:15.330299+0000","last_clean":"2023-10-06T04:44:15.330299+0000","last_became_active":"2023-10-06T04:44:15.329733+0000","last_became_peered":"2023-10-06T04:44:15.329733+0000","last_unstale":"2023-10-06T04:44:15.330299+0000","last_undegraded":"2023-10-06T04:44:15.330299+0000","last_fullsized":"2023-10-06T04:44:15.330299+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:55:02.543898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.323997+0000","last_change":"2023-10-06T04:44:15.323997+0000","last_active":"2023-10-06T04:44:15.323997+0000","last_peered":"2023-10-06T04:44:15.323997+0000","last_clean":"2023-10-06T04:44:15.323997+0000","last_became_active":"2023-10-06T04:44:15.323740+0000","last_became_peered":"2023-10-06T04:44:15.323740+0000","last_unstale":"2023-10-06T04:44:15.323997+0000","last_undegraded":"2023-10-06T04:44:15.323997+0000","last_fullsized":"2023-10-06T04:44:15.323997+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:39:18.770771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.330170+0000","last_change":"2023-10-06T04:44:15.330170+0000","last_active":"2023-10-06T04:44:15.330170+0000","last_peered":"2023-10-06T04:44:15.330170+0000","last_clean":"2023-10-06T04:44:15.330170+0000","last_became_active":"2023-10-06T04:44:15.329875+0000","last_became_peered":"2023-10-06T04:44:15.329875+0000","last_unstale":"2023-10-06T04:44:15.330170+0000","last_undegraded":"2023-10-06T04:44:15.330170+0000","last_fullsized":"2023-10-06T04:44:15.330170+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:07.781940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.336362+0000","last_change":"2023-10-06T04:44:15.333111+0000","last_active":"2023-10-06T04:44:15.336362+0000","last_peered":"2023-10-06T04:44:15.336362+0000","last_clean":"2023-10-06T04:44:15.336362+0000","last_became_active":"2023-10-06T04:44:15.332860+0000","last_became_peered":"2023-10-06T04:44:15.332860+0000","last_unstale":"2023-10-06T04:44:15.336362+0000","last_undegraded":"2023-10-06T04:44:15.336362+0000","last_fullsized":"2023-10-06T04:44:15.336362+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:30.849219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.337830+0000","last_change":"2023-10-06T04:44:15.333804+0000","last_active":"2023-10-06T04:44:15.337830+0000","last_peered":"2023-10-06T04:44:15.337830+0000","last_clean":"2023-10-06T04:44:15.337830+0000","last_became_active":"2023-10-06T04:44:15.330776+0000","last_became_peered":"2023-10-06T04:44:15.330776+0000","last_unstale":"2023-10-06T04:44:15.337830+0000","last_undegraded":"2023-10-06T04:44:15.337830+0000","last_fullsized":"2023-10-06T04:44:15.337830+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:28.204817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.340729+0000","last_change":"2023-10-06T04:44:15.331330+0000","last_active":"2023-10-06T04:44:15.340729+0000","last_peered":"2023-10-06T04:44:15.340729+0000","last_clean":"2023-10-06T04:44:15.340729+0000","last_became_active":"2023-10-06T04:44:15.330819+0000","last_became_peered":"2023-10-06T04:44:15.330819+0000","last_unstale":"2023-10-06T04:44:15.340729+0000","last_undegraded":"2023-10-06T04:44:15.340729+0000","last_fullsized":"2023-10-06T04:44:15.340729+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:31:38.404466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.331371+0000","last_change":"2023-10-06T04:44:15.331371+0000","last_active":"2023-10-06T04:44:15.331371+0000","last_peered":"2023-10-06T04:44:15.331371+0000","last_clean":"2023-10-06T04:44:15.331371+0000","last_became_active":"2023-10-06T04:44:15.331126+0000","last_became_peered":"2023-10-06T04:44:15.331126+0000","last_unstale":"2023-10-06T04:44:15.331371+0000","last_undegraded":"2023-10-06T04:44:15.331371+0000","last_fullsized":"2023-10-06T04:44:15.331371+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:58:59.463833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.327280+0000","last_change":"2023-10-06T04:44:15.327280+0000","last_active":"2023-10-06T04:44:15.327280+0000","last_peered":"2023-10-06T04:44:15.327280+0000","last_clean":"2023-10-06T04:44:15.327280+0000","last_became_active":"2023-10-06T04:44:15.326971+0000","last_became_peered":"2023-10-06T04:44:15.326971+0000","last_unstale":"2023-10-06T04:44:15.327280+0000","last_undegraded":"2023-10-06T04:44:15.327280+0000","last_fullsized":"2023-10-06T04:44:15.327280+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:50.666516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.327813+0000","last_change":"2023-10-06T04:44:15.327813+0000","last_active":"2023-10-06T04:44:15.327813+0000","last_peered":"2023-10-06T04:44:15.327813+0000","last_clean":"2023-10-06T04:44:15.327813+0000","last_became_active":"2023-10-06T04:44:15.327529+0000","last_became_peered":"2023-10-06T04:44:15.327529+0000","last_unstale":"2023-10-06T04:44:15.327813+0000","last_undegraded":"2023-10-06T04:44:15.327813+0000","last_fullsized":"2023-10-06T04:44:15.327813+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:38.199449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.330607+0000","last_change":"2023-10-06T04:44:15.330607+0000","last_active":"2023-10-06T04:44:15.330607+0000","last_peered":"2023-10-06T04:44:15.330607+0000","last_clean":"2023-10-06T04:44:15.330607+0000","last_became_active":"2023-10-06T04:44:15.330072+0000","last_became_peered":"2023-10-06T04:44:15.330072+0000","last_unstale":"2023-10-06T04:44:15.330607+0000","last_undegraded":"2023-10-06T04:44:15.330607+0000","last_fullsized":"2023-10-06T04:44:15.330607+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:34.361305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.335629+0000","last_change":"2023-10-06T04:44:15.331915+0000","last_active":"2023-10-06T04:44:15.335629+0000","last_peered":"2023-10-06T04:44:15.335629+0000","last_clean":"2023-10-06T04:44:15.335629+0000","last_became_active":"2023-10-06T04:44:15.331198+0000","last_became_peered":"2023-10-06T04:44:15.331198+0000","last_unstale":"2023-10-06T04:44:15.335629+0000","last_undegraded":"2023-10-06T04:44:15.335629+0000","last_fullsized":"2023-10-06T04:44:15.335629+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:38.557345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.327254+0000","last_change":"2023-10-06T04:44:15.327254+0000","last_active":"2023-10-06T04:44:15.327254+0000","last_peered":"2023-10-06T04:44:15.327254+0000","last_clean":"2023-10-06T04:44:15.327254+0000","last_became_active":"2023-10-06T04:44:15.326876+0000","last_became_peered":"2023-10-06T04:44:15.326876+0000","last_unstale":"2023-10-06T04:44:15.327254+0000","last_undegraded":"2023-10-06T04:44:15.327254+0000","last_fullsized":"2023-10-06T04:44:15.327254+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:58:04.714908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.326080+0000","last_change":"2023-10-06T04:44:15.326080+0000","last_active":"2023-10-06T04:44:15.326080+0000","last_peered":"2023-10-06T04:44:15.326080+0000","last_clean":"2023-10-06T04:44:15.326080+0000","last_became_active":"2023-10-06T04:44:15.325785+0000","last_became_peered":"2023-10-06T04:44:15.325785+0000","last_unstale":"2023-10-06T04:44:15.326080+0000","last_undegraded":"2023-10-06T04:44:15.326080+0000","last_fullsized":"2023-10-06T04:44:15.326080+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:20.271217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.340751+0000","last_change":"2023-10-06T04:44:15.331402+0000","last_active":"2023-10-06T04:44:15.340751+0000","last_peered":"2023-10-06T04:44:15.340751+0000","last_clean":"2023-10-06T04:44:15.340751+0000","last_became_active":"2023-10-06T04:44:15.331052+0000","last_became_peered":"2023-10-06T04:44:15.331052+0000","last_unstale":"2023-10-06T04:44:15.340751+0000","last_undegraded":"2023-10-06T04:44:15.340751+0000","last_fullsized":"2023-10-06T04:44:15.340751+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:30.849219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.329648+0000","last_change":"2023-10-06T04:44:15.329648+0000","last_active":"2023-10-06T04:44:15.329648+0000","last_peered":"2023-10-06T04:44:15.329648+0000","last_clean":"2023-10-06T04:44:15.329648+0000","last_became_active":"2023-10-06T04:44:15.329347+0000","last_became_peered":"2023-10-06T04:44:15.329347+0000","last_unstale":"2023-10-06T04:44:15.329648+0000","last_undegraded":"2023-10-06T04:44:15.329648+0000","last_fullsized":"2023-10-06T04:44:15.329648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:50.666516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.340834+0000","last_change":"2023-10-06T04:44:15.333026+0000","last_active":"2023-10-06T04:44:15.340834+0000","last_peered":"2023-10-06T04:44:15.340834+0000","last_clean":"2023-10-06T04:44:15.340834+0000","last_became_active":"2023-10-06T04:44:15.332700+0000","last_became_peered":"2023-10-06T04:44:15.332700+0000","last_unstale":"2023-10-06T04:44:15.340834+0000","last_undegraded":"2023-10-06T04:44:15.340834+0000","last_fullsized":"2023-10-06T04:44:15.340834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:36.154075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"31'4","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.593060+0000","last_change":"2023-10-06T04:44:14.599962+0000","last_active":"2023-10-06T04:44:15.593060+0000","last_peered":"2023-10-06T04:44:15.593060+0000","last_clean":"2023-10-06T04:44:15.593060+0000","last_became_active":"2023-10-06T04:44:14.599687+0000","last_became_peered":"2023-10-06T04:44:14.599687+0000","last_unstale":"2023-10-06T04:44:15.593060+0000","last_undegraded":"2023-10-06T04:44:15.593060+0000","last_fullsized":"2023-10-06T04:44:15.593060+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:06:30.276537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.333238+0000","last_change":"2023-10-06T04:44:15.333238+0000","last_active":"2023-10-06T04:44:15.333238+0000","last_peered":"2023-10-06T04:44:15.333238+0000","last_clean":"2023-10-06T04:44:15.333238+0000","last_became_active":"2023-10-06T04:44:15.332987+0000","last_became_peered":"2023-10-06T04:44:15.332987+0000","last_unstale":"2023-10-06T04:44:15.333238+0000","last_undegraded":"2023-10-06T04:44:15.333238+0000","last_fullsized":"2023-10-06T04:44:15.333238+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:35:05.857781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.315483+0000","last_change":"2023-10-06T04:44:14.590731+0000","last_active":"2023-10-06T04:44:15.315483+0000","last_peered":"2023-10-06T04:44:15.315483+0000","last_clean":"2023-10-06T04:44:15.315483+0000","last_became_active":"2023-10-06T04:44:14.590432+0000","last_became_peered":"2023-10-06T04:44:14.590432+0000","last_unstale":"2023-10-06T04:44:15.315483+0000","last_undegraded":"2023-10-06T04:44:15.315483+0000","last_fullsized":"2023-10-06T04:44:15.315483+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:33.356420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.334328+0000","last_change":"2023-10-06T04:44:15.327022+0000","last_active":"2023-10-06T04:44:15.334328+0000","last_peered":"2023-10-06T04:44:15.334328+0000","last_clean":"2023-10-06T04:44:15.334328+0000","last_became_active":"2023-10-06T04:44:15.326748+0000","last_became_peered":"2023-10-06T04:44:15.326748+0000","last_unstale":"2023-10-06T04:44:15.334328+0000","last_undegraded":"2023-10-06T04:44:15.334328+0000","last_fullsized":"2023-10-06T04:44:15.334328+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:36:00.020421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.592563+0000","last_change":"2023-10-06T04:44:14.597097+0000","last_active":"2023-10-06T04:44:15.592563+0000","last_peered":"2023-10-06T04:44:15.592563+0000","last_clean":"2023-10-06T04:44:15.592563+0000","last_became_active":"2023-10-06T04:44:14.596707+0000","last_became_peered":"2023-10-06T04:44:14.596707+0000","last_unstale":"2023-10-06T04:44:15.592563+0000","last_undegraded":"2023-10-06T04:44:15.592563+0000","last_fullsized":"2023-10-06T04:44:15.592563+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:39:17.765886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.331929+0000","last_change":"2023-10-06T04:44:15.329375+0000","last_active":"2023-10-06T04:44:15.331929+0000","last_peered":"2023-10-06T04:44:15.331929+0000","last_clean":"2023-10-06T04:44:15.331929+0000","last_became_active":"2023-10-06T04:44:15.329091+0000","last_became_peered":"2023-10-06T04:44:15.329091+0000","last_unstale":"2023-10-06T04:44:15.331929+0000","last_undegraded":"2023-10-06T04:44:15.331929+0000","last_fullsized":"2023-10-06T04:44:15.331929+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:20:22.767127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.592161+0000","last_change":"2023-10-06T04:44:14.600147+0000","last_active":"2023-10-06T04:44:15.592161+0000","last_peered":"2023-10-06T04:44:15.592161+0000","last_clean":"2023-10-06T04:44:15.592161+0000","last_became_active":"2023-10-06T04:44:14.599830+0000","last_became_peered":"2023-10-06T04:44:14.599830+0000","last_unstale":"2023-10-06T04:44:15.592161+0000","last_undegraded":"2023-10-06T04:44:15.592161+0000","last_fullsized":"2023-10-06T04:44:15.592161+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:38.164396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.322250+0000","last_change":"2023-10-06T04:44:15.322250+0000","last_active":"2023-10-06T04:44:15.322250+0000","last_peered":"2023-10-06T04:44:15.322250+0000","last_clean":"2023-10-06T04:44:15.322250+0000","last_became_active":"2023-10-06T04:44:15.321976+0000","last_became_peered":"2023-10-06T04:44:15.321976+0000","last_unstale":"2023-10-06T04:44:15.322250+0000","last_undegraded":"2023-10-06T04:44:15.322250+0000","last_fullsized":"2023-10-06T04:44:15.322250+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:39.169281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.593486+0000","last_change":"2023-10-06T04:44:14.597555+0000","last_active":"2023-10-06T04:44:15.593486+0000","last_peered":"2023-10-06T04:44:15.593486+0000","last_clean":"2023-10-06T04:44:15.593486+0000","last_became_active":"2023-10-06T04:44:14.597258+0000","last_became_peered":"2023-10-06T04:44:14.597258+0000","last_unstale":"2023-10-06T04:44:15.593486+0000","last_undegraded":"2023-10-06T04:44:15.593486+0000","last_fullsized":"2023-10-06T04:44:15.593486+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:19.266332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.337023+0000","last_change":"2023-10-06T04:44:15.335508+0000","last_active":"2023-10-06T04:44:15.337023+0000","last_peered":"2023-10-06T04:44:15.337023+0000","last_clean":"2023-10-06T04:44:15.337023+0000","last_became_active":"2023-10-06T04:44:15.335006+0000","last_became_peered":"2023-10-06T04:44:15.335006+0000","last_unstale":"2023-10-06T04:44:15.337023+0000","last_undegraded":"2023-10-06T04:44:15.337023+0000","last_fullsized":"2023-10-06T04:44:15.337023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:40:28.919122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.592190+0000","last_change":"2023-10-06T04:44:14.595033+0000","last_active":"2023-10-06T04:44:15.592190+0000","last_peered":"2023-10-06T04:44:15.592190+0000","last_clean":"2023-10-06T04:44:15.592190+0000","last_became_active":"2023-10-06T04:44:14.594409+0000","last_became_peered":"2023-10-06T04:44:14.594409+0000","last_unstale":"2023-10-06T04:44:15.592190+0000","last_undegraded":"2023-10-06T04:44:15.592190+0000","last_fullsized":"2023-10-06T04:44:15.592190+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:41.961566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.340687+0000","last_change":"2023-10-06T04:44:15.336332+0000","last_active":"2023-10-06T04:44:15.340687+0000","last_peered":"2023-10-06T04:44:15.340687+0000","last_clean":"2023-10-06T04:44:15.340687+0000","last_became_active":"2023-10-06T04:44:15.335985+0000","last_became_peered":"2023-10-06T04:44:15.335985+0000","last_unstale":"2023-10-06T04:44:15.340687+0000","last_undegraded":"2023-10-06T04:44:15.340687+0000","last_fullsized":"2023-10-06T04:44:15.340687+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:23:39.740653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:44:14.598383+0000","last_change":"2023-10-06T04:44:14.594343+0000","last_active":"2023-10-06T04:44:14.598383+0000","last_peered":"2023-10-06T04:44:14.598383+0000","last_clean":"2023-10-06T04:44:14.598383+0000","last_became_active":"2023-10-06T04:44:14.594060+0000","last_became_peered":"2023-10-06T04:44:14.594060+0000","last_unstale":"2023-10-06T04:44:14.598383+0000","last_undegraded":"2023-10-06T04:44:14.598383+0000","last_fullsized":"2023-10-06T04:44:14.598383+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:42.476666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.334472+0000","last_change":"2023-10-06T04:44:15.332515+0000","last_active":"2023-10-06T04:44:15.334472+0000","last_peered":"2023-10-06T04:44:15.334472+0000","last_clean":"2023-10-06T04:44:15.334472+0000","last_became_active":"2023-10-06T04:44:15.332264+0000","last_became_peered":"2023-10-06T04:44:15.332264+0000","last_unstale":"2023-10-06T04:44:15.334472+0000","last_undegraded":"2023-10-06T04:44:15.334472+0000","last_fullsized":"2023-10-06T04:44:15.334472+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:08:13.093379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.317113+0000","last_change":"2023-10-06T04:44:14.597540+0000","last_active":"2023-10-06T04:44:15.317113+0000","last_peered":"2023-10-06T04:44:15.317113+0000","last_clean":"2023-10-06T04:44:15.317113+0000","last_became_active":"2023-10-06T04:44:14.597258+0000","last_became_peered":"2023-10-06T04:44:14.597258+0000","last_unstale":"2023-10-06T04:44:15.317113+0000","last_undegraded":"2023-10-06T04:44:15.317113+0000","last_fullsized":"2023-10-06T04:44:15.317113+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:29.844334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.330662+0000","last_change":"2023-10-06T04:44:15.330662+0000","last_active":"2023-10-06T04:44:15.330662+0000","last_peered":"2023-10-06T04:44:15.330662+0000","last_clean":"2023-10-06T04:44:15.330662+0000","last_became_active":"2023-10-06T04:44:15.330116+0000","last_became_peered":"2023-10-06T04:44:15.330116+0000","last_unstale":"2023-10-06T04:44:15.330662+0000","last_undegraded":"2023-10-06T04:44:15.330662+0000","last_fullsized":"2023-10-06T04:44:15.330662+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:52:27.353316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.318564+0000","last_change":"2023-10-06T04:44:14.599089+0000","last_active":"2023-10-06T04:44:15.318564+0000","last_peered":"2023-10-06T04:44:15.318564+0000","last_clean":"2023-10-06T04:44:15.318564+0000","last_became_active":"2023-10-06T04:44:14.598707+0000","last_became_peered":"2023-10-06T04:44:14.598707+0000","last_unstale":"2023-10-06T04:44:15.318564+0000","last_undegraded":"2023-10-06T04:44:15.318564+0000","last_fullsized":"2023-10-06T04:44:15.318564+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:35:04.852896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.336964+0000","last_change":"2023-10-06T04:44:15.328794+0000","last_active":"2023-10-06T04:44:15.336964+0000","last_peered":"2023-10-06T04:44:15.336964+0000","last_clean":"2023-10-06T04:44:15.336964+0000","last_became_active":"2023-10-06T04:44:15.328502+0000","last_became_peered":"2023-10-06T04:44:15.328502+0000","last_unstale":"2023-10-06T04:44:15.336964+0000","last_undegraded":"2023-10-06T04:44:15.336964+0000","last_fullsized":"2023-10-06T04:44:15.336964+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:55.263496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.326684+0000","last_change":"2023-10-06T04:44:14.599071+0000","last_active":"2023-10-06T04:44:15.326684+0000","last_peered":"2023-10-06T04:44:15.326684+0000","last_clean":"2023-10-06T04:44:15.326684+0000","last_became_active":"2023-10-06T04:44:14.598872+0000","last_became_peered":"2023-10-06T04:44:14.598872+0000","last_unstale":"2023-10-06T04:44:15.326684+0000","last_undegraded":"2023-10-06T04:44:15.326684+0000","last_fullsized":"2023-10-06T04:44:15.326684+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:41.961566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.328019+0000","last_change":"2023-10-06T04:44:15.328019+0000","last_active":"2023-10-06T04:44:15.328019+0000","last_peered":"2023-10-06T04:44:15.328019+0000","last_clean":"2023-10-06T04:44:15.328019+0000","last_became_active":"2023-10-06T04:44:15.327719+0000","last_became_peered":"2023-10-06T04:44:15.327719+0000","last_unstale":"2023-10-06T04:44:15.328019+0000","last_undegraded":"2023-10-06T04:44:15.328019+0000","last_fullsized":"2023-10-06T04:44:15.328019+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:31:38.404466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"31'3","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.593652+0000","last_change":"2023-10-06T04:44:14.600337+0000","last_active":"2023-10-06T04:44:15.593652+0000","last_peered":"2023-10-06T04:44:15.593652+0000","last_clean":"2023-10-06T04:44:15.593652+0000","last_became_active":"2023-10-06T04:44:14.600035+0000","last_became_peered":"2023-10-06T04:44:14.600035+0000","last_unstale":"2023-10-06T04:44:15.593652+0000","last_undegraded":"2023-10-06T04:44:15.593652+0000","last_fullsized":"2023-10-06T04:44:15.593652+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:49.661632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.335486+0000","last_change":"2023-10-06T04:44:15.328047+0000","last_active":"2023-10-06T04:44:15.335486+0000","last_peered":"2023-10-06T04:44:15.335486+0000","last_clean":"2023-10-06T04:44:15.335486+0000","last_became_active":"2023-10-06T04:44:15.327728+0000","last_became_peered":"2023-10-06T04:44:15.327728+0000","last_unstale":"2023-10-06T04:44:15.335486+0000","last_undegraded":"2023-10-06T04:44:15.335486+0000","last_fullsized":"2023-10-06T04:44:15.335486+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:35.545173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"31'6","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.595348+0000","last_change":"2023-10-06T04:44:14.600313+0000","last_active":"2023-10-06T04:44:15.595348+0000","last_peered":"2023-10-06T04:44:15.595348+0000","last_clean":"2023-10-06T04:44:15.595348+0000","last_became_active":"2023-10-06T04:44:14.600042+0000","last_became_peered":"2023-10-06T04:44:14.600042+0000","last_unstale":"2023-10-06T04:44:15.595348+0000","last_undegraded":"2023-10-06T04:44:15.595348+0000","last_fullsized":"2023-10-06T04:44:15.595348+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:40:39.358544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.331154+0000","last_change":"2023-10-06T04:44:15.331154+0000","last_active":"2023-10-06T04:44:15.331154+0000","last_peered":"2023-10-06T04:44:15.331154+0000","last_clean":"2023-10-06T04:44:15.331154+0000","last_became_active":"2023-10-06T04:44:15.330803+0000","last_became_peered":"2023-10-06T04:44:15.330803+0000","last_unstale":"2023-10-06T04:44:15.331154+0000","last_undegraded":"2023-10-06T04:44:15.331154+0000","last_fullsized":"2023-10-06T04:44:15.331154+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:38.557345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.591966+0000","last_change":"2023-10-06T04:44:14.597965+0000","last_active":"2023-10-06T04:44:15.591966+0000","last_peered":"2023-10-06T04:44:15.591966+0000","last_clean":"2023-10-06T04:44:15.591966+0000","last_became_active":"2023-10-06T04:44:14.597239+0000","last_became_peered":"2023-10-06T04:44:14.597239+0000","last_unstale":"2023-10-06T04:44:15.591966+0000","last_undegraded":"2023-10-06T04:44:15.591966+0000","last_fullsized":"2023-10-06T04:44:15.591966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:38.911947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.326738+0000","last_change":"2023-10-06T04:44:15.324435+0000","last_active":"2023-10-06T04:44:15.326738+0000","last_peered":"2023-10-06T04:44:15.326738+0000","last_clean":"2023-10-06T04:44:15.326738+0000","last_became_active":"2023-10-06T04:44:15.324181+0000","last_became_peered":"2023-10-06T04:44:15.324181+0000","last_unstale":"2023-10-06T04:44:15.326738+0000","last_undegraded":"2023-10-06T04:44:15.326738+0000","last_fullsized":"2023-10-06T04:44:15.326738+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:42:02.722960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:44:14.599797+0000","last_change":"2023-10-06T04:44:14.597092+0000","last_active":"2023-10-06T04:44:14.599797+0000","last_peered":"2023-10-06T04:44:14.599797+0000","last_clean":"2023-10-06T04:44:14.599797+0000","last_became_active":"2023-10-06T04:44:14.596792+0000","last_became_peered":"2023-10-06T04:44:14.596792+0000","last_unstale":"2023-10-06T04:44:14.599797+0000","last_undegraded":"2023-10-06T04:44:14.599797+0000","last_fullsized":"2023-10-06T04:44:14.599797+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:52:26.348431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.340780+0000","last_change":"2023-10-06T04:44:15.331995+0000","last_active":"2023-10-06T04:44:15.340780+0000","last_peered":"2023-10-06T04:44:15.340780+0000","last_clean":"2023-10-06T04:44:15.340780+0000","last_became_active":"2023-10-06T04:44:15.331716+0000","last_became_peered":"2023-10-06T04:44:15.331716+0000","last_unstale":"2023-10-06T04:44:15.340780+0000","last_undegraded":"2023-10-06T04:44:15.340780+0000","last_fullsized":"2023-10-06T04:44:15.340780+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:38.557345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:44:14.607249+0000","last_change":"2023-10-06T04:44:14.606617+0000","last_active":"2023-10-06T04:44:14.607249+0000","last_peered":"2023-10-06T04:44:14.607249+0000","last_clean":"2023-10-06T04:44:14.607249+0000","last_became_active":"2023-10-06T04:44:14.606306+0000","last_became_peered":"2023-10-06T04:44:14.606306+0000","last_unstale":"2023-10-06T04:44:14.607249+0000","last_undegraded":"2023-10-06T04:44:14.607249+0000","last_fullsized":"2023-10-06T04:44:14.607249+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:47.121204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.328143+0000","last_change":"2023-10-06T04:44:15.325273+0000","last_active":"2023-10-06T04:44:15.328143+0000","last_peered":"2023-10-06T04:44:15.328143+0000","last_clean":"2023-10-06T04:44:15.328143+0000","last_became_active":"2023-10-06T04:44:15.324988+0000","last_became_peered":"2023-10-06T04:44:15.324988+0000","last_unstale":"2023-10-06T04:44:15.328143+0000","last_undegraded":"2023-10-06T04:44:15.328143+0000","last_fullsized":"2023-10-06T04:44:15.328143+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:55.263496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"31'8","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.593674+0000","last_change":"2023-10-06T04:44:14.593338+0000","last_active":"2023-10-06T04:44:15.593674+0000","last_peered":"2023-10-06T04:44:15.593674+0000","last_clean":"2023-10-06T04:44:15.593674+0000","last_became_active":"2023-10-06T04:44:14.593047+0000","last_became_peered":"2023-10-06T04:44:14.593047+0000","last_unstale":"2023-10-06T04:44:15.593674+0000","last_undegraded":"2023-10-06T04:44:15.593674+0000","last_fullsized":"2023-10-06T04:44:15.593674+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:33.356420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.332185+0000","last_change":"2023-10-06T04:44:15.329825+0000","last_active":"2023-10-06T04:44:15.332185+0000","last_peered":"2023-10-06T04:44:15.332185+0000","last_clean":"2023-10-06T04:44:15.332185+0000","last_became_active":"2023-10-06T04:44:15.329473+0000","last_became_peered":"2023-10-06T04:44:15.329473+0000","last_unstale":"2023-10-06T04:44:15.332185+0000","last_undegraded":"2023-10-06T04:44:15.332185+0000","last_fullsized":"2023-10-06T04:44:15.332185+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:28.204817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.593678+0000","last_change":"2023-10-06T04:44:14.599483+0000","last_active":"2023-10-06T04:44:15.593678+0000","last_peered":"2023-10-06T04:44:15.593678+0000","last_clean":"2023-10-06T04:44:15.593678+0000","last_became_active":"2023-10-06T04:44:14.599188+0000","last_became_peered":"2023-10-06T04:44:14.599188+0000","last_unstale":"2023-10-06T04:44:15.593678+0000","last_undegraded":"2023-10-06T04:44:15.593678+0000","last_fullsized":"2023-10-06T04:44:15.593678+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:33.356420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.338153+0000","last_change":"2023-10-06T04:44:15.336029+0000","last_active":"2023-10-06T04:44:15.338153+0000","last_peered":"2023-10-06T04:44:15.338153+0000","last_clean":"2023-10-06T04:44:15.338153+0000","last_became_active":"2023-10-06T04:44:15.334891+0000","last_became_peered":"2023-10-06T04:44:15.334891+0000","last_unstale":"2023-10-06T04:44:15.338153+0000","last_undegraded":"2023-10-06T04:44:15.338153+0000","last_fullsized":"2023-10-06T04:44:15.338153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:35.545173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.594035+0000","last_change":"2023-10-06T04:44:14.596981+0000","last_active":"2023-10-06T04:44:15.594035+0000","last_peered":"2023-10-06T04:44:15.594035+0000","last_clean":"2023-10-06T04:44:15.594035+0000","last_became_active":"2023-10-06T04:44:14.596664+0000","last_became_peered":"2023-10-06T04:44:14.596664+0000","last_unstale":"2023-10-06T04:44:15.594035+0000","last_undegraded":"2023-10-06T04:44:15.594035+0000","last_fullsized":"2023-10-06T04:44:15.594035+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:31:37.399581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.328458+0000","last_change":"2023-10-06T04:44:15.324047+0000","last_active":"2023-10-06T04:44:15.328458+0000","last_peered":"2023-10-06T04:44:15.328458+0000","last_clean":"2023-10-06T04:44:15.328458+0000","last_became_active":"2023-10-06T04:44:15.323792+0000","last_became_peered":"2023-10-06T04:44:15.323792+0000","last_unstale":"2023-10-06T04:44:15.328458+0000","last_undegraded":"2023-10-06T04:44:15.328458+0000","last_fullsized":"2023-10-06T04:44:15.328458+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:31.629240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.317984+0000","last_change":"2023-10-06T04:44:14.593022+0000","last_active":"2023-10-06T04:44:15.317984+0000","last_peered":"2023-10-06T04:44:15.317984+0000","last_clean":"2023-10-06T04:44:15.317984+0000","last_became_active":"2023-10-06T04:44:14.592726+0000","last_became_peered":"2023-10-06T04:44:14.592726+0000","last_unstale":"2023-10-06T04:44:15.317984+0000","last_undegraded":"2023-10-06T04:44:15.317984+0000","last_fullsized":"2023-10-06T04:44:15.317984+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:57.183976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.325902+0000","last_change":"2023-10-06T04:44:15.325902+0000","last_active":"2023-10-06T04:44:15.325902+0000","last_peered":"2023-10-06T04:44:15.325902+0000","last_clean":"2023-10-06T04:44:15.325902+0000","last_became_active":"2023-10-06T04:44:15.325624+0000","last_became_peered":"2023-10-06T04:44:15.325624+0000","last_unstale":"2023-10-06T04:44:15.325902+0000","last_undegraded":"2023-10-06T04:44:15.325902+0000","last_fullsized":"2023-10-06T04:44:15.325902+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:42.966451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:44:14.602749+0000","last_change":"2023-10-06T04:44:14.598685+0000","last_active":"2023-10-06T04:44:14.602749+0000","last_peered":"2023-10-06T04:44:14.602749+0000","last_clean":"2023-10-06T04:44:14.602749+0000","last_became_active":"2023-10-06T04:44:14.598415+0000","last_became_peered":"2023-10-06T04:44:14.598415+0000","last_unstale":"2023-10-06T04:44:14.602749+0000","last_undegraded":"2023-10-06T04:44:14.602749+0000","last_fullsized":"2023-10-06T04:44:14.602749+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:58:58.458948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.340886+0000","last_change":"2023-10-06T04:44:15.333333+0000","last_active":"2023-10-06T04:44:15.340886+0000","last_peered":"2023-10-06T04:44:15.340886+0000","last_clean":"2023-10-06T04:44:15.340886+0000","last_became_active":"2023-10-06T04:44:15.332814+0000","last_became_peered":"2023-10-06T04:44:15.332814+0000","last_unstale":"2023-10-06T04:44:15.340886+0000","last_undegraded":"2023-10-06T04:44:15.340886+0000","last_fullsized":"2023-10-06T04:44:15.340886+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:39.169281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.589446+0000","last_change":"2023-10-06T04:44:14.594220+0000","last_active":"2023-10-06T04:44:15.589446+0000","last_peered":"2023-10-06T04:44:15.589446+0000","last_clean":"2023-10-06T04:44:15.589446+0000","last_became_active":"2023-10-06T04:44:14.593919+0000","last_became_peered":"2023-10-06T04:44:14.593919+0000","last_unstale":"2023-10-06T04:44:15.589446+0000","last_undegraded":"2023-10-06T04:44:15.589446+0000","last_fullsized":"2023-10-06T04:44:15.589446+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:32.259155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.329518+0000","last_change":"2023-10-06T04:44:15.329518+0000","last_active":"2023-10-06T04:44:15.329518+0000","last_peered":"2023-10-06T04:44:15.329518+0000","last_clean":"2023-10-06T04:44:15.329518+0000","last_became_active":"2023-10-06T04:44:15.329264+0000","last_became_peered":"2023-10-06T04:44:15.329264+0000","last_unstale":"2023-10-06T04:44:15.329518+0000","last_undegraded":"2023-10-06T04:44:15.329518+0000","last_fullsized":"2023-10-06T04:44:15.329518+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:42.382412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:44:14.601149+0000","last_change":"2023-10-06T04:44:14.595336+0000","last_active":"2023-10-06T04:44:14.601149+0000","last_peered":"2023-10-06T04:44:14.601149+0000","last_clean":"2023-10-06T04:44:14.601149+0000","last_became_active":"2023-10-06T04:44:14.595027+0000","last_became_peered":"2023-10-06T04:44:14.595027+0000","last_unstale":"2023-10-06T04:44:14.601149+0000","last_undegraded":"2023-10-06T04:44:14.601149+0000","last_fullsized":"2023-10-06T04:44:14.601149+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:10.357255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.335967+0000","last_change":"2023-10-06T04:44:15.334485+0000","last_active":"2023-10-06T04:44:15.335967+0000","last_peered":"2023-10-06T04:44:15.335967+0000","last_clean":"2023-10-06T04:44:15.335967+0000","last_became_active":"2023-10-06T04:44:15.334203+0000","last_became_peered":"2023-10-06T04:44:15.334203+0000","last_unstale":"2023-10-06T04:44:15.335967+0000","last_undegraded":"2023-10-06T04:44:15.335967+0000","last_fullsized":"2023-10-06T04:44:15.335967+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:42:02.722960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.320855+0000","last_change":"2023-10-06T04:44:14.598980+0000","last_active":"2023-10-06T04:44:15.320855+0000","last_peered":"2023-10-06T04:44:15.320855+0000","last_clean":"2023-10-06T04:44:15.320855+0000","last_became_active":"2023-10-06T04:44:14.598478+0000","last_became_peered":"2023-10-06T04:44:14.598478+0000","last_unstale":"2023-10-06T04:44:15.320855+0000","last_undegraded":"2023-10-06T04:44:15.320855+0000","last_fullsized":"2023-10-06T04:44:15.320855+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:19.266332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.334494+0000","last_change":"2023-10-06T04:44:15.332546+0000","last_active":"2023-10-06T04:44:15.334494+0000","last_peered":"2023-10-06T04:44:15.334494+0000","last_clean":"2023-10-06T04:44:15.334494+0000","last_became_active":"2023-10-06T04:44:15.332290+0000","last_became_peered":"2023-10-06T04:44:15.332290+0000","last_unstale":"2023-10-06T04:44:15.334494+0000","last_undegraded":"2023-10-06T04:44:15.334494+0000","last_fullsized":"2023-10-06T04:44:15.334494+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:23:39.740653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:44:14.601667+0000","last_change":"2023-10-06T04:44:14.599883+0000","last_active":"2023-10-06T04:44:14.601667+0000","last_peered":"2023-10-06T04:44:14.601667+0000","last_clean":"2023-10-06T04:44:14.601667+0000","last_became_active":"2023-10-06T04:44:14.599468+0000","last_became_peered":"2023-10-06T04:44:14.599468+0000","last_unstale":"2023-10-06T04:44:14.601667+0000","last_undegraded":"2023-10-06T04:44:14.601667+0000","last_fullsized":"2023-10-06T04:44:14.601667+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:07:54.948233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.328448+0000","last_change":"2023-10-06T04:44:15.321789+0000","last_active":"2023-10-06T04:44:15.328448+0000","last_peered":"2023-10-06T04:44:15.328448+0000","last_clean":"2023-10-06T04:44:15.328448+0000","last_became_active":"2023-10-06T04:44:15.321443+0000","last_became_peered":"2023-10-06T04:44:15.321443+0000","last_unstale":"2023-10-06T04:44:15.328448+0000","last_undegraded":"2023-10-06T04:44:15.328448+0000","last_fullsized":"2023-10-06T04:44:15.328448+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:08:13.093379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.317481+0000","last_change":"2023-10-06T04:44:14.600044+0000","last_active":"2023-10-06T04:44:15.317481+0000","last_peered":"2023-10-06T04:44:15.317481+0000","last_clean":"2023-10-06T04:44:15.317481+0000","last_became_active":"2023-10-06T04:44:14.599763+0000","last_became_peered":"2023-10-06T04:44:14.599763+0000","last_unstale":"2023-10-06T04:44:15.317481+0000","last_undegraded":"2023-10-06T04:44:15.317481+0000","last_fullsized":"2023-10-06T04:44:15.317481+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:50:48.466487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.317334+0000","last_change":"2023-10-06T04:43:24.001927+0000","last_active":"2023-10-06T04:44:15.317334+0000","last_peered":"2023-10-06T04:44:15.317334+0000","last_clean":"2023-10-06T04:44:15.317334+0000","last_became_active":"2023-10-06T04:43:24.001591+0000","last_became_peered":"2023-10-06T04:43:24.001591+0000","last_unstale":"2023-10-06T04:44:15.317334+0000","last_undegraded":"2023-10-06T04:44:15.317334+0000","last_fullsized":"2023-10-06T04:44:15.317334+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:47.262845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.336897+0000","last_change":"2023-10-06T04:44:15.329470+0000","last_active":"2023-10-06T04:44:15.336897+0000","last_peered":"2023-10-06T04:44:15.336897+0000","last_clean":"2023-10-06T04:44:15.336897+0000","last_became_active":"2023-10-06T04:44:15.329011+0000","last_became_peered":"2023-10-06T04:44:15.329011+0000","last_unstale":"2023-10-06T04:44:15.336897+0000","last_undegraded":"2023-10-06T04:44:15.336897+0000","last_fullsized":"2023-10-06T04:44:15.336897+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:40:28.919122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.318465+0000","last_change":"2023-10-06T04:44:14.599072+0000","last_active":"2023-10-06T04:44:15.318465+0000","last_peered":"2023-10-06T04:44:15.318465+0000","last_clean":"2023-10-06T04:44:15.318465+0000","last_became_active":"2023-10-06T04:44:14.598788+0000","last_became_peered":"2023-10-06T04:44:14.598788+0000","last_unstale":"2023-10-06T04:44:15.318465+0000","last_undegraded":"2023-10-06T04:44:15.318465+0000","last_fullsized":"2023-10-06T04:44:15.318465+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:37.194565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.321006+0000","last_change":"2023-10-06T04:43:23.708597+0000","last_active":"2023-10-06T04:44:15.321006+0000","last_peered":"2023-10-06T04:44:15.321006+0000","last_clean":"2023-10-06T04:44:15.321006+0000","last_became_active":"2023-10-06T04:43:23.708317+0000","last_became_peered":"2023-10-06T04:43:23.708317+0000","last_unstale":"2023-10-06T04:44:15.321006+0000","last_undegraded":"2023-10-06T04:44:15.321006+0000","last_fullsized":"2023-10-06T04:44:15.321006+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:56.213068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.330979+0000","last_change":"2023-10-06T04:44:15.330979+0000","last_active":"2023-10-06T04:44:15.330979+0000","last_peered":"2023-10-06T04:44:15.330979+0000","last_clean":"2023-10-06T04:44:15.330979+0000","last_became_active":"2023-10-06T04:44:15.330758+0000","last_became_peered":"2023-10-06T04:44:15.330758+0000","last_unstale":"2023-10-06T04:44:15.330979+0000","last_undegraded":"2023-10-06T04:44:15.330979+0000","last_fullsized":"2023-10-06T04:44:15.330979+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:40:40.363429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.593600+0000","last_change":"2023-10-06T04:44:14.599219+0000","last_active":"2023-10-06T04:44:15.593600+0000","last_peered":"2023-10-06T04:44:15.593600+0000","last_clean":"2023-10-06T04:44:15.593600+0000","last_became_active":"2023-10-06T04:44:14.598833+0000","last_became_peered":"2023-10-06T04:44:14.598833+0000","last_unstale":"2023-10-06T04:44:15.593600+0000","last_undegraded":"2023-10-06T04:44:15.593600+0000","last_fullsized":"2023-10-06T04:44:15.593600+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:06.777056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:44:14.591363+0000","last_change":"2023-10-06T04:43:23.708753+0000","last_active":"2023-10-06T04:44:14.591363+0000","last_peered":"2023-10-06T04:44:14.591363+0000","last_clean":"2023-10-06T04:44:14.591363+0000","last_became_active":"2023-10-06T04:43:23.708483+0000","last_became_peered":"2023-10-06T04:43:23.708483+0000","last_unstale":"2023-10-06T04:44:14.591363+0000","last_undegraded":"2023-10-06T04:44:14.591363+0000","last_fullsized":"2023-10-06T04:44:14.591363+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:47.262845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.319699+0000","last_change":"2023-10-06T04:43:23.706116+0000","last_active":"2023-10-06T04:44:15.319699+0000","last_peered":"2023-10-06T04:44:15.319699+0000","last_clean":"2023-10-06T04:44:15.319699+0000","last_became_active":"2023-10-06T04:43:23.705090+0000","last_became_peered":"2023-10-06T04:43:23.705090+0000","last_unstale":"2023-10-06T04:44:15.319699+0000","last_undegraded":"2023-10-06T04:44:15.319699+0000","last_fullsized":"2023-10-06T04:44:15.319699+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:29.869173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.336984+0000","last_change":"2023-10-06T04:44:15.329322+0000","last_active":"2023-10-06T04:44:15.336984+0000","last_peered":"2023-10-06T04:44:15.336984+0000","last_clean":"2023-10-06T04:44:15.336984+0000","last_became_active":"2023-10-06T04:44:15.328983+0000","last_became_peered":"2023-10-06T04:44:15.328983+0000","last_unstale":"2023-10-06T04:44:15.336984+0000","last_undegraded":"2023-10-06T04:44:15.336984+0000","last_fullsized":"2023-10-06T04:44:15.336984+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:50:49.471372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:44:14.602527+0000","last_change":"2023-10-06T04:44:14.600013+0000","last_active":"2023-10-06T04:44:14.602527+0000","last_peered":"2023-10-06T04:44:14.602527+0000","last_clean":"2023-10-06T04:44:14.602527+0000","last_became_active":"2023-10-06T04:44:14.599739+0000","last_became_peered":"2023-10-06T04:44:14.599739+0000","last_unstale":"2023-10-06T04:44:14.602527+0000","last_undegraded":"2023-10-06T04:44:14.602527+0000","last_fullsized":"2023-10-06T04:44:14.602527+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:50:23.680252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.318325+0000","last_change":"2023-10-06T04:43:24.002162+0000","last_active":"2023-10-06T04:44:15.318325+0000","last_peered":"2023-10-06T04:44:15.318325+0000","last_clean":"2023-10-06T04:44:15.318325+0000","last_became_active":"2023-10-06T04:43:24.001883+0000","last_became_peered":"2023-10-06T04:43:24.001883+0000","last_unstale":"2023-10-06T04:44:15.318325+0000","last_undegraded":"2023-10-06T04:44:15.318325+0000","last_fullsized":"2023-10-06T04:44:15.318325+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:51:11.168258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.331797+0000","last_change":"2023-10-06T04:44:15.328259+0000","last_active":"2023-10-06T04:44:15.331797+0000","last_peered":"2023-10-06T04:44:15.331797+0000","last_clean":"2023-10-06T04:44:15.331797+0000","last_became_active":"2023-10-06T04:44:15.327984+0000","last_became_peered":"2023-10-06T04:44:15.327984+0000","last_unstale":"2023-10-06T04:44:15.331797+0000","last_undegraded":"2023-10-06T04:44:15.331797+0000","last_fullsized":"2023-10-06T04:44:15.331797+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:28.204817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.318870+0000","last_change":"2023-10-06T04:44:14.593481+0000","last_active":"2023-10-06T04:44:15.318870+0000","last_peered":"2023-10-06T04:44:15.318870+0000","last_clean":"2023-10-06T04:44:15.318870+0000","last_became_active":"2023-10-06T04:44:14.592979+0000","last_became_peered":"2023-10-06T04:44:14.592979+0000","last_unstale":"2023-10-06T04:44:15.318870+0000","last_undegraded":"2023-10-06T04:44:15.318870+0000","last_fullsized":"2023-10-06T04:44:15.318870+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:42.476666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.319647+0000","last_change":"2023-10-06T04:43:24.002057+0000","last_active":"2023-10-06T04:44:15.319647+0000","last_peered":"2023-10-06T04:44:15.319647+0000","last_clean":"2023-10-06T04:44:15.319647+0000","last_became_active":"2023-10-06T04:43:24.001809+0000","last_became_peered":"2023-10-06T04:43:24.001809+0000","last_unstale":"2023-10-06T04:44:15.319647+0000","last_undegraded":"2023-10-06T04:44:15.319647+0000","last_fullsized":"2023-10-06T04:44:15.319647+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:49.693980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.328848+0000","last_change":"2023-10-06T04:44:15.327121+0000","last_active":"2023-10-06T04:44:15.328848+0000","last_peered":"2023-10-06T04:44:15.328848+0000","last_clean":"2023-10-06T04:44:15.328848+0000","last_became_active":"2023-10-06T04:44:15.326865+0000","last_became_peered":"2023-10-06T04:44:15.326865+0000","last_unstale":"2023-10-06T04:44:15.328848+0000","last_undegraded":"2023-10-06T04:44:15.328848+0000","last_fullsized":"2023-10-06T04:44:15.328848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:35.545173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:44:14.595868+0000","last_change":"2023-10-06T04:44:14.594752+0000","last_active":"2023-10-06T04:44:14.595868+0000","last_peered":"2023-10-06T04:44:14.595868+0000","last_clean":"2023-10-06T04:44:14.595868+0000","last_became_active":"2023-10-06T04:44:14.593365+0000","last_became_peered":"2023-10-06T04:44:14.593365+0000","last_unstale":"2023-10-06T04:44:14.595868+0000","last_undegraded":"2023-10-06T04:44:14.595868+0000","last_fullsized":"2023-10-06T04:44:14.595868+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:19.266332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.326151+0000","last_change":"2023-10-06T04:43:24.002394+0000","last_active":"2023-10-06T04:44:15.326151+0000","last_peered":"2023-10-06T04:44:15.326151+0000","last_clean":"2023-10-06T04:44:15.326151+0000","last_became_active":"2023-10-06T04:43:24.001915+0000","last_became_peered":"2023-10-06T04:43:24.001915+0000","last_unstale":"2023-10-06T04:44:15.326151+0000","last_undegraded":"2023-10-06T04:44:15.326151+0000","last_fullsized":"2023-10-06T04:44:15.326151+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:45.031820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.328750+0000","last_change":"2023-10-06T04:44:15.328750+0000","last_active":"2023-10-06T04:44:15.328750+0000","last_peered":"2023-10-06T04:44:15.328750+0000","last_clean":"2023-10-06T04:44:15.328750+0000","last_became_active":"2023-10-06T04:44:15.328508+0000","last_became_peered":"2023-10-06T04:44:15.328508+0000","last_unstale":"2023-10-06T04:44:15.328750+0000","last_undegraded":"2023-10-06T04:44:15.328750+0000","last_fullsized":"2023-10-06T04:44:15.328750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:19.715717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:44:14.600773+0000","last_change":"2023-10-06T04:44:14.597116+0000","last_active":"2023-10-06T04:44:14.600773+0000","last_peered":"2023-10-06T04:44:14.600773+0000","last_clean":"2023-10-06T04:44:14.600773+0000","last_became_active":"2023-10-06T04:44:14.596762+0000","last_became_peered":"2023-10-06T04:44:14.596762+0000","last_unstale":"2023-10-06T04:44:14.600773+0000","last_undegraded":"2023-10-06T04:44:14.600773+0000","last_fullsized":"2023-10-06T04:44:14.600773+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:53.975155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:44:14.597485+0000","last_change":"2023-10-06T04:43:24.002424+0000","last_active":"2023-10-06T04:44:14.597485+0000","last_peered":"2023-10-06T04:44:14.597485+0000","last_clean":"2023-10-06T04:44:14.597485+0000","last_became_active":"2023-10-06T04:43:24.002147+0000","last_became_peered":"2023-10-06T04:43:24.002147+0000","last_unstale":"2023-10-06T04:44:14.597485+0000","last_undegraded":"2023-10-06T04:44:14.597485+0000","last_fullsized":"2023-10-06T04:44:14.597485+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:45.031820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.321192+0000","last_change":"2023-10-06T04:44:15.321192+0000","last_active":"2023-10-06T04:44:15.321192+0000","last_peered":"2023-10-06T04:44:15.321192+0000","last_clean":"2023-10-06T04:44:15.321192+0000","last_became_active":"2023-10-06T04:44:15.320400+0000","last_became_peered":"2023-10-06T04:44:15.320400+0000","last_unstale":"2023-10-06T04:44:15.321192+0000","last_undegraded":"2023-10-06T04:44:15.321192+0000","last_fullsized":"2023-10-06T04:44:15.321192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:48.514352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:44:14.600057+0000","last_change":"2023-10-06T04:44:14.598064+0000","last_active":"2023-10-06T04:44:14.600057+0000","last_peered":"2023-10-06T04:44:14.600057+0000","last_clean":"2023-10-06T04:44:14.600057+0000","last_became_active":"2023-10-06T04:44:14.597541+0000","last_became_peered":"2023-10-06T04:44:14.597541+0000","last_unstale":"2023-10-06T04:44:14.600057+0000","last_undegraded":"2023-10-06T04:44:14.600057+0000","last_fullsized":"2023-10-06T04:44:14.600057+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:06.777056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:44:14.597593+0000","last_change":"2023-10-06T04:43:23.707408+0000","last_active":"2023-10-06T04:44:14.597593+0000","last_peered":"2023-10-06T04:44:14.597593+0000","last_clean":"2023-10-06T04:44:14.597593+0000","last_became_active":"2023-10-06T04:43:23.707115+0000","last_became_peered":"2023-10-06T04:43:23.707115+0000","last_unstale":"2023-10-06T04:44:14.597593+0000","last_undegraded":"2023-10-06T04:44:14.597593+0000","last_fullsized":"2023-10-06T04:44:14.597593+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:56.213068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073616,"statfs":{"total":96636764160,"available":96331382784,"internally_reserved":0,"allocated":958464,"data_stored":731127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297632,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074208,"statfs":{"total":96636764160,"available":96331988992,"internally_reserved":0,"allocated":352256,"data_stored":139707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298212,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073628,"statfs":{"total":96636764160,"available":96331395072,"internally_reserved":0,"allocated":946176,"data_stored":729611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297632,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074208,"statfs":{"total":96636764160,"available":96331988992,"internally_reserved":0,"allocated":352256,"data_stored":139187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297632,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074208,"statfs":{"total":96636764160,"available":96331988992,"internally_reserved":0,"allocated":352256,"data_stored":139223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074196,"statfs":{"total":96636764160,"available":96331976704,"internally_reserved":0,"allocated":364544,"data_stored":140723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297636,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074204,"statfs":{"total":96636764160,"available":96331984896,"internally_reserved":0,"allocated":356352,"data_stored":139729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297636,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074204,"statfs":{"total":96636764160,"available":96331984896,"internally_reserved":0,"allocated":356352,"data_stored":139265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:44:19.708 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:44:19.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.852+0000 7f1f15591700 1 Processor -- start 2023-10-06T04:44:19.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.852+0000 7f1f15591700 1 -- start start 2023-10-06T04:44:19.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.853+0000 7f1f15591700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f100ccaa0 0x7f1f1015de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:19.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.853+0000 7f1f15591700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1f100b52c0 0x7f1f100b5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:19.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.853+0000 7f1f15591700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f1015d370 con 0x7f1f100cce70 2023-10-06T04:44:19.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.853+0000 7f1f15591700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f100b0b70 con 0x7f1f100b52c0 2023-10-06T04:44:19.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.853+0000 7f1f15591700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f100b0e50 con 0x7f1f100ccaa0 2023-10-06T04:44:19.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.853+0000 7f1f0e7fc700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f1f100cce70 0x7f1f100b00b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:54142/0 (socket says 172.21.15.17:54142) 2023-10-06T04:44:19.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.853+0000 7f1f0e7fc700 1 -- 172.21.15.17:0/712426924 learned_addr learned my addr 172.21.15.17:0/712426924 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:19.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.853+0000 7f1f0f7fe700 1 --2- 172.21.15.17:0/712426924 >> v2:172.21.15.136:3300/0 conn(0x7f1f100b52c0 0x7f1f100b5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:19.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.853+0000 7f1f0dffb700 1 -- 172.21.15.17:0/712426924 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1617505491 0 0) 0x7f1f1015d370 con 0x7f1f100cce70 2023-10-06T04:44:19.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.853+0000 7f1f0effd700 1 --2- 172.21.15.17:0/712426924 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f100ccaa0 0x7f1f1015de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:19.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.853+0000 7f1f0dffb700 1 -- 172.21.15.17:0/712426924 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1efc003570 con 0x7f1f100cce70 2023-10-06T04:44:19.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.854+0000 7f1f0dffb700 1 -- 172.21.15.17:0/712426924 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 22591641 0 0) 0x7f1efc003570 con 0x7f1f100cce70 2023-10-06T04:44:19.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.854+0000 7f1f0dffb700 1 -- 172.21.15.17:0/712426924 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f100ccaa0 msgr2=0x7f1f1015de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:19.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.854+0000 7f1f0dffb700 1 --2- 172.21.15.17:0/712426924 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f100ccaa0 0x7f1f1015de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:19.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.854+0000 7f1f0dffb700 1 -- 172.21.15.17:0/712426924 >> v2:172.21.15.136:3300/0 conn(0x7f1f100b52c0 msgr2=0x7f1f100b5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:19.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.854+0000 7f1f0dffb700 1 --2- 172.21.15.17:0/712426924 >> v2:172.21.15.136:3300/0 conn(0x7f1f100b52c0 0x7f1f100b5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:19.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.854+0000 7f1f0dffb700 1 -- 172.21.15.17:0/712426924 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f1015d630 con 0x7f1f100cce70 2023-10-06T04:44:19.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.854+0000 7f1f0dffb700 1 -- 172.21.15.17:0/712426924 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4268781140 0 0) 0x7f1ef8001470 con 0x7f1f100cce70 2023-10-06T04:44:19.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.854+0000 7f1f0dffb700 1 -- 172.21.15.17:0/712426924 >> v1:172.21.15.17:6789/0 conn(0x7f1f100cce70 legacy=0x7f1f100b00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:19.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.854+0000 7f1f0dffb700 1 --2- 172.21.15.17:0/712426924 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f100ccaa0 0x7f1efc003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:19.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.854+0000 7f1f0dffb700 1 --2- 172.21.15.17:0/712426924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1efc003fe0 0x7f1efc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:19.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.854+0000 7f1f0dffb700 1 --2- 172.21.15.17:0/712426924 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1efc004d50 0x7f1efc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:19.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.854+0000 7f1f0dffb700 1 -- 172.21.15.17:0/712426924 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f100b0b70 con 0x7f1efc003fe0 2023-10-06T04:44:19.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.854+0000 7f1f0dffb700 1 -- 172.21.15.17:0/712426924 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f100b0e50 con 0x7f1efc004d50 2023-10-06T04:44:19.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.854+0000 7f1f0dffb700 1 -- 172.21.15.17:0/712426924 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc00ba90 con 0x7f1f100ccaa0 2023-10-06T04:44:19.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.854+0000 7f1f0e7fc700 1 --2- 172.21.15.17:0/712426924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1efc003fe0 0x7f1efc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:19.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.854+0000 7f1f0effd700 1 --2- 172.21.15.17:0/712426924 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f100ccaa0 0x7f1efc003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:19.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.854+0000 7f1f0f7fe700 1 --2- 172.21.15.17:0/712426924 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1efc004d50 0x7f1efc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:19.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.854+0000 7f1f0e7fc700 1 -- 172.21.15.17:0/712426924 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f100ccaa0 msgr2=0x7f1efc003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:19.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.854+0000 7f1f0e7fc700 1 --2- 172.21.15.17:0/712426924 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f100ccaa0 0x7f1efc003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:19.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.854+0000 7f1f0e7fc700 1 -- 172.21.15.17:0/712426924 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1efc004d50 msgr2=0x7f1efc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:19.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.854+0000 7f1f0e7fc700 1 --2- 172.21.15.17:0/712426924 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1efc004d50 0x7f1efc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:19.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.854+0000 7f1f0e7fc700 1 -- 172.21.15.17:0/712426924 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1efc003570 con 0x7f1efc003fe0 2023-10-06T04:44:19.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.854+0000 7f1f0f7fe700 1 --2- 172.21.15.17:0/712426924 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1efc004d50 0x7f1efc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:19.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.854+0000 7f1f0e7fc700 1 --2- 172.21.15.17:0/712426924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1efc003fe0 0x7f1efc004810 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1ef800c3c0 tx=0x7f1ef8001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ec1aea900999c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:19.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.854+0000 7f1f0dffb700 1 -- 172.21.15.17:0/712426924 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef800cc30 con 0x7f1efc003fe0 2023-10-06T04:44:19.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.855+0000 7f1f0dffb700 1 -- 172.21.15.17:0/712426924 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef800cdb0 con 0x7f1efc003fe0 2023-10-06T04:44:19.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.855+0000 7f1f0dffb700 1 -- 172.21.15.17:0/712426924 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef8005b70 con 0x7f1efc003fe0 2023-10-06T04:44:19.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.855+0000 7f1f15591700 1 -- 172.21.15.17:0/712426924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1efc003fe0 msgr2=0x7f1efc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:19.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.855+0000 7f1f15591700 1 --2- 172.21.15.17:0/712426924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1efc003fe0 0x7f1efc004810 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1ef800c3c0 tx=0x7f1ef8001e90 comp rx=0 tx=0).stop 2023-10-06T04:44:19.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.855+0000 7f1f0f7fe700 1 -- 172.21.15.17:0/712426924 reap_dead start 2023-10-06T04:44:19.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.855+0000 7f1f15591700 1 -- 172.21.15.17:0/712426924 shutdown_connections 2023-10-06T04:44:19.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.855+0000 7f1f15591700 1 -- 172.21.15.17:0/712426924 >> 172.21.15.17:0/712426924 conn(0x7f1f1006da00 msgr2=0x7f1f1006ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:19.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.855+0000 7f1f15591700 1 -- 172.21.15.17:0/712426924 shutdown_connections 2023-10-06T04:44:19.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.855+0000 7f1f15591700 1 -- 172.21.15.17:0/712426924 wait complete. 2023-10-06T04:44:19.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.856+0000 7f1f15591700 1 Processor -- start 2023-10-06T04:44:19.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.856+0000 7f1f15591700 1 -- start start 2023-10-06T04:44:19.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.857+0000 7f1f15591700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1efc003fe0 0x7f1f10155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:19.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.857+0000 7f1f15591700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f100cf040 0x7f1f10158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:19.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.857+0000 7f1f15591700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f100c7ac0 0x7f1f100cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:19.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.857+0000 7f1f15591700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f101589a0 con 0x7f1efc003fe0 2023-10-06T04:44:19.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.857+0000 7f1f15591700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f100c5be0 con 0x7f1f100c7ac0 2023-10-06T04:44:19.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.857+0000 7f1f15591700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f100c4fd0 con 0x7f1f100cf040 2023-10-06T04:44:19.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.857+0000 7f1f0effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1efc003fe0 0x7f1f10155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:19.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.857+0000 7f1f0effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1efc003fe0 0x7f1f10155770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48220/0 (socket says 172.21.15.17:48220) 2023-10-06T04:44:19.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.857+0000 7f1f0effd700 1 -- 172.21.15.17:0/4066009531 learned_addr learned my addr 172.21.15.17:0/4066009531 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:19.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.857+0000 7f1f0f7fe700 1 --2- 172.21.15.17:0/4066009531 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f100c7ac0 0x7f1f100cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:19.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.857+0000 7f1f0e7fc700 1 --2- 172.21.15.17:0/4066009531 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f100cf040 0x7f1f10158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:19.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.857+0000 7f1f0effd700 1 -- 172.21.15.17:0/4066009531 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f100cf040 msgr2=0x7f1f10158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:19.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.857+0000 7f1f0effd700 1 --2- 172.21.15.17:0/4066009531 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f100cf040 0x7f1f10158460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:19.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.857+0000 7f1f0effd700 1 -- 172.21.15.17:0/4066009531 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f100c7ac0 msgr2=0x7f1f100cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:19.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.857+0000 7f1f0effd700 1 --2- 172.21.15.17:0/4066009531 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f100c7ac0 0x7f1f100cb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:19.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.857+0000 7f1f0effd700 1 -- 172.21.15.17:0/4066009531 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f100c52b0 con 0x7f1efc003fe0 2023-10-06T04:44:19.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.857+0000 7f1f0e7fc700 1 --2- 172.21.15.17:0/4066009531 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f100cf040 0x7f1f10158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:19.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.858+0000 7f1f0effd700 1 --2- 172.21.15.17:0/4066009531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1efc003fe0 0x7f1f10155770 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1f0800f1b0 tx=0x7f1f0800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:19.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.858+0000 7f1f06ffd700 1 -- 172.21.15.17:0/4066009531 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0800e040 con 0x7f1efc003fe0 2023-10-06T04:44:19.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.858+0000 7f1f06ffd700 1 -- 172.21.15.17:0/4066009531 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f0800f040 con 0x7f1efc003fe0 2023-10-06T04:44:19.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.858+0000 7f1f15591700 1 -- 172.21.15.17:0/4066009531 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f100c5590 con 0x7f1efc003fe0 2023-10-06T04:44:19.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.858+0000 7f1f06ffd700 1 -- 172.21.15.17:0/4066009531 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f08015430 con 0x7f1efc003fe0 2023-10-06T04:44:19.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.858+0000 7f1f15591700 1 -- 172.21.15.17:0/4066009531 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f100c7f60 con 0x7f1efc003fe0 2023-10-06T04:44:19.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.859+0000 7f1f15591700 1 -- 172.21.15.17:0/4066009531 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f1004c380 con 0x7f1efc003fe0 2023-10-06T04:44:19.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.859+0000 7f1f06ffd700 1 -- 172.21.15.17:0/4066009531 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1f080157a0 con 0x7f1efc003fe0 2023-10-06T04:44:19.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.859+0000 7f1f06ffd700 1 --2- 172.21.15.17:0/4066009531 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1ef0066f30 0x7f1ef00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:19.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.860+0000 7f1f06ffd700 1 -- 172.21.15.17:0/4066009531 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1f080852a0 con 0x7f1efc003fe0 2023-10-06T04:44:19.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.860+0000 7f1f0e7fc700 1 --2- 172.21.15.17:0/4066009531 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1ef0066f30 0x7f1ef00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:19.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.860+0000 7f1f0e7fc700 1 --2- 172.21.15.17:0/4066009531 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1ef0066f30 0x7f1ef00693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8001ed0 tx=0x7f1ef8015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:19.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:19.864+0000 7f1f06ffd700 1 -- 172.21.15.17:0/4066009531 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1f08055e40 con 0x7f1efc003fe0 2023-10-06T04:44:20.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.050+0000 7f1f15591700 1 -- 172.21.15.17:0/4066009531 --> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1f100c5d20 con 0x7f1ef0066f30 2023-10-06T04:44:20.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.058+0000 7f1f06ffd700 1 -- 172.21.15.17:0/4066009531 <== mgr.4104 v2:172.21.15.17:6832/90424 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286904 (secure 0 0 0) 0x7f1ef8023070 con 0x7f1ef0066f30 2023-10-06T04:44:20.064 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:20.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.062+0000 7f1f15591700 1 -- 172.21.15.17:0/4066009531 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1ef0066f30 msgr2=0x7f1ef00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:20.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.062+0000 7f1f15591700 1 --2- 172.21.15.17:0/4066009531 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1ef0066f30 0x7f1ef00693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8001ed0 tx=0x7f1ef8015000 comp rx=0 tx=0).stop 2023-10-06T04:44:20.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.062+0000 7f1f15591700 1 -- 172.21.15.17:0/4066009531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1efc003fe0 msgr2=0x7f1f10155770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:20.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.062+0000 7f1f15591700 1 --2- 172.21.15.17:0/4066009531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1efc003fe0 0x7f1f10155770 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1f0800f1b0 tx=0x7f1f0800b040 comp rx=0 tx=0).stop 2023-10-06T04:44:20.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.062+0000 7f1f15591700 1 -- 172.21.15.17:0/4066009531 shutdown_connections 2023-10-06T04:44:20.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.062+0000 7f1f15591700 1 --2- 172.21.15.17:0/4066009531 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1ef0066f30 0x7f1ef00693e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:20.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.062+0000 7f1f15591700 1 --2- 172.21.15.17:0/4066009531 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f100c7ac0 0x7f1f100cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:20.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.062+0000 7f1f15591700 1 --2- 172.21.15.17:0/4066009531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1efc003fe0 0x7f1f10155770 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:20.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.062+0000 7f1f15591700 1 --2- 172.21.15.17:0/4066009531 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f100cf040 0x7f1f10158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:20.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.062+0000 7f1f15591700 1 -- 172.21.15.17:0/4066009531 >> 172.21.15.17:0/4066009531 conn(0x7f1f1006da00 msgr2=0x7f1f100b5690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:20.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.062+0000 7f1f15591700 1 -- 172.21.15.17:0/4066009531 shutdown_connections 2023-10-06T04:44:20.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.062+0000 7f1f15591700 1 -- 172.21.15.17:0/4066009531 wait complete. 2023-10-06T04:44:20.067 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-06T04:44:20.077 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2023-10-06T04:44:18.345454+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":109,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382248,"kb_used_data":3944,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592472,"statfs":{"total":773094113280,"available":770654691328,"internally_reserved":0,"allocated":4038656,"data_stored":2298572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.770497"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.326263+0000","last_change":"2023-10-06T04:44:15.324530+0000","last_active":"2023-10-06T04:44:15.326263+0000","last_peered":"2023-10-06T04:44:15.326263+0000","last_clean":"2023-10-06T04:44:15.326263+0000","last_became_active":"2023-10-06T04:44:15.324257+0000","last_became_peered":"2023-10-06T04:44:15.324257+0000","last_unstale":"2023-10-06T04:44:15.326263+0000","last_undegraded":"2023-10-06T04:44:15.326263+0000","last_fullsized":"2023-10-06T04:44:15.326263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:36:00.020421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.328830+0000","last_change":"2023-10-06T04:44:15.327016+0000","last_active":"2023-10-06T04:44:15.328830+0000","last_peered":"2023-10-06T04:44:15.328830+0000","last_clean":"2023-10-06T04:44:15.328830+0000","last_became_active":"2023-10-06T04:44:15.326720+0000","last_became_peered":"2023-10-06T04:44:15.326720+0000","last_unstale":"2023-10-06T04:44:15.328830+0000","last_undegraded":"2023-10-06T04:44:15.328830+0000","last_fullsized":"2023-10-06T04:44:15.328830+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:59:32.879433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.333281+0000","last_change":"2023-10-06T04:44:15.333281+0000","last_active":"2023-10-06T04:44:15.333281+0000","last_peered":"2023-10-06T04:44:15.333281+0000","last_clean":"2023-10-06T04:44:15.333281+0000","last_became_active":"2023-10-06T04:44:15.332954+0000","last_became_peered":"2023-10-06T04:44:15.332954+0000","last_unstale":"2023-10-06T04:44:15.333281+0000","last_undegraded":"2023-10-06T04:44:15.333281+0000","last_fullsized":"2023-10-06T04:44:15.333281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:40:28.919122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.330821+0000","last_change":"2023-10-06T04:44:15.330821+0000","last_active":"2023-10-06T04:44:15.330821+0000","last_peered":"2023-10-06T04:44:15.330821+0000","last_clean":"2023-10-06T04:44:15.330821+0000","last_became_active":"2023-10-06T04:44:15.330442+0000","last_became_peered":"2023-10-06T04:44:15.330442+0000","last_unstale":"2023-10-06T04:44:15.330821+0000","last_undegraded":"2023-10-06T04:44:15.330821+0000","last_fullsized":"2023-10-06T04:44:15.330821+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:43.481551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.329192+0000","last_change":"2023-10-06T04:44:15.329192+0000","last_active":"2023-10-06T04:44:15.329192+0000","last_peered":"2023-10-06T04:44:15.329192+0000","last_clean":"2023-10-06T04:44:15.329192+0000","last_became_active":"2023-10-06T04:44:15.328907+0000","last_became_peered":"2023-10-06T04:44:15.328907+0000","last_unstale":"2023-10-06T04:44:15.329192+0000","last_undegraded":"2023-10-06T04:44:15.329192+0000","last_fullsized":"2023-10-06T04:44:15.329192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:42:47.516611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.326138+0000","last_change":"2023-10-06T04:44:15.326138+0000","last_active":"2023-10-06T04:44:15.326138+0000","last_peered":"2023-10-06T04:44:15.326138+0000","last_clean":"2023-10-06T04:44:15.326138+0000","last_became_active":"2023-10-06T04:44:15.325882+0000","last_became_peered":"2023-10-06T04:44:15.325882+0000","last_unstale":"2023-10-06T04:44:15.326138+0000","last_undegraded":"2023-10-06T04:44:15.326138+0000","last_fullsized":"2023-10-06T04:44:15.326138+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:39.916832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.335601+0000","last_change":"2023-10-06T04:44:15.331653+0000","last_active":"2023-10-06T04:44:15.335601+0000","last_peered":"2023-10-06T04:44:15.335601+0000","last_clean":"2023-10-06T04:44:15.335601+0000","last_became_active":"2023-10-06T04:44:15.331371+0000","last_became_peered":"2023-10-06T04:44:15.331371+0000","last_unstale":"2023-10-06T04:44:15.335601+0000","last_undegraded":"2023-10-06T04:44:15.335601+0000","last_fullsized":"2023-10-06T04:44:15.335601+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:09.704873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.332592+0000","last_change":"2023-10-06T04:44:15.331675+0000","last_active":"2023-10-06T04:44:15.332592+0000","last_peered":"2023-10-06T04:44:15.332592+0000","last_clean":"2023-10-06T04:44:15.332592+0000","last_became_active":"2023-10-06T04:44:15.331445+0000","last_became_peered":"2023-10-06T04:44:15.331445+0000","last_unstale":"2023-10-06T04:44:15.332592+0000","last_undegraded":"2023-10-06T04:44:15.332592+0000","last_fullsized":"2023-10-06T04:44:15.332592+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:31.629240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.331164+0000","last_change":"2023-10-06T04:44:15.331164+0000","last_active":"2023-10-06T04:44:15.331164+0000","last_peered":"2023-10-06T04:44:15.331164+0000","last_clean":"2023-10-06T04:44:15.331164+0000","last_became_active":"2023-10-06T04:44:15.330884+0000","last_became_peered":"2023-10-06T04:44:15.330884+0000","last_unstale":"2023-10-06T04:44:15.331164+0000","last_undegraded":"2023-10-06T04:44:15.331164+0000","last_fullsized":"2023-10-06T04:44:15.331164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:36.154075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.340832+0000","last_change":"2023-10-06T04:44:15.337634+0000","last_active":"2023-10-06T04:44:15.340832+0000","last_peered":"2023-10-06T04:44:15.340832+0000","last_clean":"2023-10-06T04:44:15.340832+0000","last_became_active":"2023-10-06T04:44:15.337319+0000","last_became_peered":"2023-10-06T04:44:15.337319+0000","last_unstale":"2023-10-06T04:44:15.340832+0000","last_undegraded":"2023-10-06T04:44:15.340832+0000","last_fullsized":"2023-10-06T04:44:15.340832+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:55.263496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.338176+0000","last_change":"2023-10-06T04:44:15.336202+0000","last_active":"2023-10-06T04:44:15.338176+0000","last_peered":"2023-10-06T04:44:15.338176+0000","last_clean":"2023-10-06T04:44:15.338176+0000","last_became_active":"2023-10-06T04:44:15.335806+0000","last_became_peered":"2023-10-06T04:44:15.335806+0000","last_unstale":"2023-10-06T04:44:15.338176+0000","last_undegraded":"2023-10-06T04:44:15.338176+0000","last_fullsized":"2023-10-06T04:44:15.338176+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:20:22.767127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.326202+0000","last_change":"2023-10-06T04:44:15.326202+0000","last_active":"2023-10-06T04:44:15.326202+0000","last_peered":"2023-10-06T04:44:15.326202+0000","last_clean":"2023-10-06T04:44:15.326202+0000","last_became_active":"2023-10-06T04:44:15.325948+0000","last_became_peered":"2023-10-06T04:44:15.325948+0000","last_unstale":"2023-10-06T04:44:15.326202+0000","last_undegraded":"2023-10-06T04:44:15.326202+0000","last_fullsized":"2023-10-06T04:44:15.326202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:30.849219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.340916+0000","last_change":"2023-10-06T04:44:15.337631+0000","last_active":"2023-10-06T04:44:15.340916+0000","last_peered":"2023-10-06T04:44:15.340916+0000","last_clean":"2023-10-06T04:44:15.340916+0000","last_became_active":"2023-10-06T04:44:15.337305+0000","last_became_peered":"2023-10-06T04:44:15.337305+0000","last_unstale":"2023-10-06T04:44:15.340916+0000","last_undegraded":"2023-10-06T04:44:15.340916+0000","last_fullsized":"2023-10-06T04:44:15.340916+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:36.154075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.335457+0000","last_change":"2023-10-06T04:44:15.328351+0000","last_active":"2023-10-06T04:44:15.335457+0000","last_peered":"2023-10-06T04:44:15.335457+0000","last_clean":"2023-10-06T04:44:15.335457+0000","last_became_active":"2023-10-06T04:44:15.328067+0000","last_became_peered":"2023-10-06T04:44:15.328067+0000","last_unstale":"2023-10-06T04:44:15.335457+0000","last_undegraded":"2023-10-06T04:44:15.335457+0000","last_fullsized":"2023-10-06T04:44:15.335457+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:59:32.879433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.335622+0000","last_change":"2023-10-06T04:44:15.331791+0000","last_active":"2023-10-06T04:44:15.335622+0000","last_peered":"2023-10-06T04:44:15.335622+0000","last_clean":"2023-10-06T04:44:15.335622+0000","last_became_active":"2023-10-06T04:44:15.331529+0000","last_became_peered":"2023-10-06T04:44:15.331529+0000","last_unstale":"2023-10-06T04:44:15.335622+0000","last_undegraded":"2023-10-06T04:44:15.335622+0000","last_fullsized":"2023-10-06T04:44:15.335622+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:48.514352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.340800+0000","last_change":"2023-10-06T04:44:15.332802+0000","last_active":"2023-10-06T04:44:15.340800+0000","last_peered":"2023-10-06T04:44:15.340800+0000","last_clean":"2023-10-06T04:44:15.340800+0000","last_became_active":"2023-10-06T04:44:15.332259+0000","last_became_peered":"2023-10-06T04:44:15.332259+0000","last_unstale":"2023-10-06T04:44:15.340800+0000","last_undegraded":"2023-10-06T04:44:15.340800+0000","last_fullsized":"2023-10-06T04:44:15.340800+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:48.514352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.336850+0000","last_change":"2023-10-06T04:44:15.329266+0000","last_active":"2023-10-06T04:44:15.336850+0000","last_peered":"2023-10-06T04:44:15.336850+0000","last_clean":"2023-10-06T04:44:15.336850+0000","last_became_active":"2023-10-06T04:44:15.328399+0000","last_became_peered":"2023-10-06T04:44:15.328399+0000","last_unstale":"2023-10-06T04:44:15.336850+0000","last_undegraded":"2023-10-06T04:44:15.336850+0000","last_fullsized":"2023-10-06T04:44:15.336850+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:09.704873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.330299+0000","last_change":"2023-10-06T04:44:15.330299+0000","last_active":"2023-10-06T04:44:15.330299+0000","last_peered":"2023-10-06T04:44:15.330299+0000","last_clean":"2023-10-06T04:44:15.330299+0000","last_became_active":"2023-10-06T04:44:15.329733+0000","last_became_peered":"2023-10-06T04:44:15.329733+0000","last_unstale":"2023-10-06T04:44:15.330299+0000","last_undegraded":"2023-10-06T04:44:15.330299+0000","last_fullsized":"2023-10-06T04:44:15.330299+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:55:02.543898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.323997+0000","last_change":"2023-10-06T04:44:15.323997+0000","last_active":"2023-10-06T04:44:15.323997+0000","last_peered":"2023-10-06T04:44:15.323997+0000","last_clean":"2023-10-06T04:44:15.323997+0000","last_became_active":"2023-10-06T04:44:15.323740+0000","last_became_peered":"2023-10-06T04:44:15.323740+0000","last_unstale":"2023-10-06T04:44:15.323997+0000","last_undegraded":"2023-10-06T04:44:15.323997+0000","last_fullsized":"2023-10-06T04:44:15.323997+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:39:18.770771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.330170+0000","last_change":"2023-10-06T04:44:15.330170+0000","last_active":"2023-10-06T04:44:15.330170+0000","last_peered":"2023-10-06T04:44:15.330170+0000","last_clean":"2023-10-06T04:44:15.330170+0000","last_became_active":"2023-10-06T04:44:15.329875+0000","last_became_peered":"2023-10-06T04:44:15.329875+0000","last_unstale":"2023-10-06T04:44:15.330170+0000","last_undegraded":"2023-10-06T04:44:15.330170+0000","last_fullsized":"2023-10-06T04:44:15.330170+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:07.781940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.336362+0000","last_change":"2023-10-06T04:44:15.333111+0000","last_active":"2023-10-06T04:44:15.336362+0000","last_peered":"2023-10-06T04:44:15.336362+0000","last_clean":"2023-10-06T04:44:15.336362+0000","last_became_active":"2023-10-06T04:44:15.332860+0000","last_became_peered":"2023-10-06T04:44:15.332860+0000","last_unstale":"2023-10-06T04:44:15.336362+0000","last_undegraded":"2023-10-06T04:44:15.336362+0000","last_fullsized":"2023-10-06T04:44:15.336362+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:30.849219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.337830+0000","last_change":"2023-10-06T04:44:15.333804+0000","last_active":"2023-10-06T04:44:15.337830+0000","last_peered":"2023-10-06T04:44:15.337830+0000","last_clean":"2023-10-06T04:44:15.337830+0000","last_became_active":"2023-10-06T04:44:15.330776+0000","last_became_peered":"2023-10-06T04:44:15.330776+0000","last_unstale":"2023-10-06T04:44:15.337830+0000","last_undegraded":"2023-10-06T04:44:15.337830+0000","last_fullsized":"2023-10-06T04:44:15.337830+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:28.204817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.340729+0000","last_change":"2023-10-06T04:44:15.331330+0000","last_active":"2023-10-06T04:44:15.340729+0000","last_peered":"2023-10-06T04:44:15.340729+0000","last_clean":"2023-10-06T04:44:15.340729+0000","last_became_active":"2023-10-06T04:44:15.330819+0000","last_became_peered":"2023-10-06T04:44:15.330819+0000","last_unstale":"2023-10-06T04:44:15.340729+0000","last_undegraded":"2023-10-06T04:44:15.340729+0000","last_fullsized":"2023-10-06T04:44:15.340729+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:31:38.404466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.331371+0000","last_change":"2023-10-06T04:44:15.331371+0000","last_active":"2023-10-06T04:44:15.331371+0000","last_peered":"2023-10-06T04:44:15.331371+0000","last_clean":"2023-10-06T04:44:15.331371+0000","last_became_active":"2023-10-06T04:44:15.331126+0000","last_became_peered":"2023-10-06T04:44:15.331126+0000","last_unstale":"2023-10-06T04:44:15.331371+0000","last_undegraded":"2023-10-06T04:44:15.331371+0000","last_fullsized":"2023-10-06T04:44:15.331371+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:58:59.463833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.327280+0000","last_change":"2023-10-06T04:44:15.327280+0000","last_active":"2023-10-06T04:44:15.327280+0000","last_peered":"2023-10-06T04:44:15.327280+0000","last_clean":"2023-10-06T04:44:15.327280+0000","last_became_active":"2023-10-06T04:44:15.326971+0000","last_became_peered":"2023-10-06T04:44:15.326971+0000","last_unstale":"2023-10-06T04:44:15.327280+0000","last_undegraded":"2023-10-06T04:44:15.327280+0000","last_fullsized":"2023-10-06T04:44:15.327280+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:50.666516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.327813+0000","last_change":"2023-10-06T04:44:15.327813+0000","last_active":"2023-10-06T04:44:15.327813+0000","last_peered":"2023-10-06T04:44:15.327813+0000","last_clean":"2023-10-06T04:44:15.327813+0000","last_became_active":"2023-10-06T04:44:15.327529+0000","last_became_peered":"2023-10-06T04:44:15.327529+0000","last_unstale":"2023-10-06T04:44:15.327813+0000","last_undegraded":"2023-10-06T04:44:15.327813+0000","last_fullsized":"2023-10-06T04:44:15.327813+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:38.199449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.330607+0000","last_change":"2023-10-06T04:44:15.330607+0000","last_active":"2023-10-06T04:44:15.330607+0000","last_peered":"2023-10-06T04:44:15.330607+0000","last_clean":"2023-10-06T04:44:15.330607+0000","last_became_active":"2023-10-06T04:44:15.330072+0000","last_became_peered":"2023-10-06T04:44:15.330072+0000","last_unstale":"2023-10-06T04:44:15.330607+0000","last_undegraded":"2023-10-06T04:44:15.330607+0000","last_fullsized":"2023-10-06T04:44:15.330607+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:34.361305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.335629+0000","last_change":"2023-10-06T04:44:15.331915+0000","last_active":"2023-10-06T04:44:15.335629+0000","last_peered":"2023-10-06T04:44:15.335629+0000","last_clean":"2023-10-06T04:44:15.335629+0000","last_became_active":"2023-10-06T04:44:15.331198+0000","last_became_peered":"2023-10-06T04:44:15.331198+0000","last_unstale":"2023-10-06T04:44:15.335629+0000","last_undegraded":"2023-10-06T04:44:15.335629+0000","last_fullsized":"2023-10-06T04:44:15.335629+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:38.557345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.327254+0000","last_change":"2023-10-06T04:44:15.327254+0000","last_active":"2023-10-06T04:44:15.327254+0000","last_peered":"2023-10-06T04:44:15.327254+0000","last_clean":"2023-10-06T04:44:15.327254+0000","last_became_active":"2023-10-06T04:44:15.326876+0000","last_became_peered":"2023-10-06T04:44:15.326876+0000","last_unstale":"2023-10-06T04:44:15.327254+0000","last_undegraded":"2023-10-06T04:44:15.327254+0000","last_fullsized":"2023-10-06T04:44:15.327254+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:58:04.714908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.326080+0000","last_change":"2023-10-06T04:44:15.326080+0000","last_active":"2023-10-06T04:44:15.326080+0000","last_peered":"2023-10-06T04:44:15.326080+0000","last_clean":"2023-10-06T04:44:15.326080+0000","last_became_active":"2023-10-06T04:44:15.325785+0000","last_became_peered":"2023-10-06T04:44:15.325785+0000","last_unstale":"2023-10-06T04:44:15.326080+0000","last_undegraded":"2023-10-06T04:44:15.326080+0000","last_fullsized":"2023-10-06T04:44:15.326080+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:20.271217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.340751+0000","last_change":"2023-10-06T04:44:15.331402+0000","last_active":"2023-10-06T04:44:15.340751+0000","last_peered":"2023-10-06T04:44:15.340751+0000","last_clean":"2023-10-06T04:44:15.340751+0000","last_became_active":"2023-10-06T04:44:15.331052+0000","last_became_peered":"2023-10-06T04:44:15.331052+0000","last_unstale":"2023-10-06T04:44:15.340751+0000","last_undegraded":"2023-10-06T04:44:15.340751+0000","last_fullsized":"2023-10-06T04:44:15.340751+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:30.849219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.329648+0000","last_change":"2023-10-06T04:44:15.329648+0000","last_active":"2023-10-06T04:44:15.329648+0000","last_peered":"2023-10-06T04:44:15.329648+0000","last_clean":"2023-10-06T04:44:15.329648+0000","last_became_active":"2023-10-06T04:44:15.329347+0000","last_became_peered":"2023-10-06T04:44:15.329347+0000","last_unstale":"2023-10-06T04:44:15.329648+0000","last_undegraded":"2023-10-06T04:44:15.329648+0000","last_fullsized":"2023-10-06T04:44:15.329648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:50.666516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.340834+0000","last_change":"2023-10-06T04:44:15.333026+0000","last_active":"2023-10-06T04:44:15.340834+0000","last_peered":"2023-10-06T04:44:15.340834+0000","last_clean":"2023-10-06T04:44:15.340834+0000","last_became_active":"2023-10-06T04:44:15.332700+0000","last_became_peered":"2023-10-06T04:44:15.332700+0000","last_unstale":"2023-10-06T04:44:15.340834+0000","last_undegraded":"2023-10-06T04:44:15.340834+0000","last_fullsized":"2023-10-06T04:44:15.340834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:43:36.154075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"31'4","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.593060+0000","last_change":"2023-10-06T04:44:14.599962+0000","last_active":"2023-10-06T04:44:15.593060+0000","last_peered":"2023-10-06T04:44:15.593060+0000","last_clean":"2023-10-06T04:44:15.593060+0000","last_became_active":"2023-10-06T04:44:14.599687+0000","last_became_peered":"2023-10-06T04:44:14.599687+0000","last_unstale":"2023-10-06T04:44:15.593060+0000","last_undegraded":"2023-10-06T04:44:15.593060+0000","last_fullsized":"2023-10-06T04:44:15.593060+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:06:30.276537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.333238+0000","last_change":"2023-10-06T04:44:15.333238+0000","last_active":"2023-10-06T04:44:15.333238+0000","last_peered":"2023-10-06T04:44:15.333238+0000","last_clean":"2023-10-06T04:44:15.333238+0000","last_became_active":"2023-10-06T04:44:15.332987+0000","last_became_peered":"2023-10-06T04:44:15.332987+0000","last_unstale":"2023-10-06T04:44:15.333238+0000","last_undegraded":"2023-10-06T04:44:15.333238+0000","last_fullsized":"2023-10-06T04:44:15.333238+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:35:05.857781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.315483+0000","last_change":"2023-10-06T04:44:14.590731+0000","last_active":"2023-10-06T04:44:15.315483+0000","last_peered":"2023-10-06T04:44:15.315483+0000","last_clean":"2023-10-06T04:44:15.315483+0000","last_became_active":"2023-10-06T04:44:14.590432+0000","last_became_peered":"2023-10-06T04:44:14.590432+0000","last_unstale":"2023-10-06T04:44:15.315483+0000","last_undegraded":"2023-10-06T04:44:15.315483+0000","last_fullsized":"2023-10-06T04:44:15.315483+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:33.356420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.334328+0000","last_change":"2023-10-06T04:44:15.327022+0000","last_active":"2023-10-06T04:44:15.334328+0000","last_peered":"2023-10-06T04:44:15.334328+0000","last_clean":"2023-10-06T04:44:15.334328+0000","last_became_active":"2023-10-06T04:44:15.326748+0000","last_became_peered":"2023-10-06T04:44:15.326748+0000","last_unstale":"2023-10-06T04:44:15.334328+0000","last_undegraded":"2023-10-06T04:44:15.334328+0000","last_fullsized":"2023-10-06T04:44:15.334328+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:36:00.020421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.592563+0000","last_change":"2023-10-06T04:44:14.597097+0000","last_active":"2023-10-06T04:44:15.592563+0000","last_peered":"2023-10-06T04:44:15.592563+0000","last_clean":"2023-10-06T04:44:15.592563+0000","last_became_active":"2023-10-06T04:44:14.596707+0000","last_became_peered":"2023-10-06T04:44:14.596707+0000","last_unstale":"2023-10-06T04:44:15.592563+0000","last_undegraded":"2023-10-06T04:44:15.592563+0000","last_fullsized":"2023-10-06T04:44:15.592563+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:39:17.765886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.331929+0000","last_change":"2023-10-06T04:44:15.329375+0000","last_active":"2023-10-06T04:44:15.331929+0000","last_peered":"2023-10-06T04:44:15.331929+0000","last_clean":"2023-10-06T04:44:15.331929+0000","last_became_active":"2023-10-06T04:44:15.329091+0000","last_became_peered":"2023-10-06T04:44:15.329091+0000","last_unstale":"2023-10-06T04:44:15.331929+0000","last_undegraded":"2023-10-06T04:44:15.331929+0000","last_fullsized":"2023-10-06T04:44:15.331929+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:20:22.767127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.592161+0000","last_change":"2023-10-06T04:44:14.600147+0000","last_active":"2023-10-06T04:44:15.592161+0000","last_peered":"2023-10-06T04:44:15.592161+0000","last_clean":"2023-10-06T04:44:15.592161+0000","last_became_active":"2023-10-06T04:44:14.599830+0000","last_became_peered":"2023-10-06T04:44:14.599830+0000","last_unstale":"2023-10-06T04:44:15.592161+0000","last_undegraded":"2023-10-06T04:44:15.592161+0000","last_fullsized":"2023-10-06T04:44:15.592161+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:38.164396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.322250+0000","last_change":"2023-10-06T04:44:15.322250+0000","last_active":"2023-10-06T04:44:15.322250+0000","last_peered":"2023-10-06T04:44:15.322250+0000","last_clean":"2023-10-06T04:44:15.322250+0000","last_became_active":"2023-10-06T04:44:15.321976+0000","last_became_peered":"2023-10-06T04:44:15.321976+0000","last_unstale":"2023-10-06T04:44:15.322250+0000","last_undegraded":"2023-10-06T04:44:15.322250+0000","last_fullsized":"2023-10-06T04:44:15.322250+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:39.169281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.593486+0000","last_change":"2023-10-06T04:44:14.597555+0000","last_active":"2023-10-06T04:44:15.593486+0000","last_peered":"2023-10-06T04:44:15.593486+0000","last_clean":"2023-10-06T04:44:15.593486+0000","last_became_active":"2023-10-06T04:44:14.597258+0000","last_became_peered":"2023-10-06T04:44:14.597258+0000","last_unstale":"2023-10-06T04:44:15.593486+0000","last_undegraded":"2023-10-06T04:44:15.593486+0000","last_fullsized":"2023-10-06T04:44:15.593486+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:19.266332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.337023+0000","last_change":"2023-10-06T04:44:15.335508+0000","last_active":"2023-10-06T04:44:15.337023+0000","last_peered":"2023-10-06T04:44:15.337023+0000","last_clean":"2023-10-06T04:44:15.337023+0000","last_became_active":"2023-10-06T04:44:15.335006+0000","last_became_peered":"2023-10-06T04:44:15.335006+0000","last_unstale":"2023-10-06T04:44:15.337023+0000","last_undegraded":"2023-10-06T04:44:15.337023+0000","last_fullsized":"2023-10-06T04:44:15.337023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:40:28.919122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.592190+0000","last_change":"2023-10-06T04:44:14.595033+0000","last_active":"2023-10-06T04:44:15.592190+0000","last_peered":"2023-10-06T04:44:15.592190+0000","last_clean":"2023-10-06T04:44:15.592190+0000","last_became_active":"2023-10-06T04:44:14.594409+0000","last_became_peered":"2023-10-06T04:44:14.594409+0000","last_unstale":"2023-10-06T04:44:15.592190+0000","last_undegraded":"2023-10-06T04:44:15.592190+0000","last_fullsized":"2023-10-06T04:44:15.592190+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:41.961566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.340687+0000","last_change":"2023-10-06T04:44:15.336332+0000","last_active":"2023-10-06T04:44:15.340687+0000","last_peered":"2023-10-06T04:44:15.340687+0000","last_clean":"2023-10-06T04:44:15.340687+0000","last_became_active":"2023-10-06T04:44:15.335985+0000","last_became_peered":"2023-10-06T04:44:15.335985+0000","last_unstale":"2023-10-06T04:44:15.340687+0000","last_undegraded":"2023-10-06T04:44:15.340687+0000","last_fullsized":"2023-10-06T04:44:15.340687+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:23:39.740653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:44:14.598383+0000","last_change":"2023-10-06T04:44:14.594343+0000","last_active":"2023-10-06T04:44:14.598383+0000","last_peered":"2023-10-06T04:44:14.598383+0000","last_clean":"2023-10-06T04:44:14.598383+0000","last_became_active":"2023-10-06T04:44:14.594060+0000","last_became_peered":"2023-10-06T04:44:14.594060+0000","last_unstale":"2023-10-06T04:44:14.598383+0000","last_undegraded":"2023-10-06T04:44:14.598383+0000","last_fullsized":"2023-10-06T04:44:14.598383+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:42.476666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.334472+0000","last_change":"2023-10-06T04:44:15.332515+0000","last_active":"2023-10-06T04:44:15.334472+0000","last_peered":"2023-10-06T04:44:15.334472+0000","last_clean":"2023-10-06T04:44:15.334472+0000","last_became_active":"2023-10-06T04:44:15.332264+0000","last_became_peered":"2023-10-06T04:44:15.332264+0000","last_unstale":"2023-10-06T04:44:15.334472+0000","last_undegraded":"2023-10-06T04:44:15.334472+0000","last_fullsized":"2023-10-06T04:44:15.334472+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:08:13.093379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.317113+0000","last_change":"2023-10-06T04:44:14.597540+0000","last_active":"2023-10-06T04:44:15.317113+0000","last_peered":"2023-10-06T04:44:15.317113+0000","last_clean":"2023-10-06T04:44:15.317113+0000","last_became_active":"2023-10-06T04:44:14.597258+0000","last_became_peered":"2023-10-06T04:44:14.597258+0000","last_unstale":"2023-10-06T04:44:15.317113+0000","last_undegraded":"2023-10-06T04:44:15.317113+0000","last_fullsized":"2023-10-06T04:44:15.317113+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:29.844334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.330662+0000","last_change":"2023-10-06T04:44:15.330662+0000","last_active":"2023-10-06T04:44:15.330662+0000","last_peered":"2023-10-06T04:44:15.330662+0000","last_clean":"2023-10-06T04:44:15.330662+0000","last_became_active":"2023-10-06T04:44:15.330116+0000","last_became_peered":"2023-10-06T04:44:15.330116+0000","last_unstale":"2023-10-06T04:44:15.330662+0000","last_undegraded":"2023-10-06T04:44:15.330662+0000","last_fullsized":"2023-10-06T04:44:15.330662+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:52:27.353316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.318564+0000","last_change":"2023-10-06T04:44:14.599089+0000","last_active":"2023-10-06T04:44:15.318564+0000","last_peered":"2023-10-06T04:44:15.318564+0000","last_clean":"2023-10-06T04:44:15.318564+0000","last_became_active":"2023-10-06T04:44:14.598707+0000","last_became_peered":"2023-10-06T04:44:14.598707+0000","last_unstale":"2023-10-06T04:44:15.318564+0000","last_undegraded":"2023-10-06T04:44:15.318564+0000","last_fullsized":"2023-10-06T04:44:15.318564+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:35:04.852896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.336964+0000","last_change":"2023-10-06T04:44:15.328794+0000","last_active":"2023-10-06T04:44:15.336964+0000","last_peered":"2023-10-06T04:44:15.336964+0000","last_clean":"2023-10-06T04:44:15.336964+0000","last_became_active":"2023-10-06T04:44:15.328502+0000","last_became_peered":"2023-10-06T04:44:15.328502+0000","last_unstale":"2023-10-06T04:44:15.336964+0000","last_undegraded":"2023-10-06T04:44:15.336964+0000","last_fullsized":"2023-10-06T04:44:15.336964+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:55.263496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.326684+0000","last_change":"2023-10-06T04:44:14.599071+0000","last_active":"2023-10-06T04:44:15.326684+0000","last_peered":"2023-10-06T04:44:15.326684+0000","last_clean":"2023-10-06T04:44:15.326684+0000","last_became_active":"2023-10-06T04:44:14.598872+0000","last_became_peered":"2023-10-06T04:44:14.598872+0000","last_unstale":"2023-10-06T04:44:15.326684+0000","last_undegraded":"2023-10-06T04:44:15.326684+0000","last_fullsized":"2023-10-06T04:44:15.326684+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:41.961566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.328019+0000","last_change":"2023-10-06T04:44:15.328019+0000","last_active":"2023-10-06T04:44:15.328019+0000","last_peered":"2023-10-06T04:44:15.328019+0000","last_clean":"2023-10-06T04:44:15.328019+0000","last_became_active":"2023-10-06T04:44:15.327719+0000","last_became_peered":"2023-10-06T04:44:15.327719+0000","last_unstale":"2023-10-06T04:44:15.328019+0000","last_undegraded":"2023-10-06T04:44:15.328019+0000","last_fullsized":"2023-10-06T04:44:15.328019+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:31:38.404466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"31'3","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.593652+0000","last_change":"2023-10-06T04:44:14.600337+0000","last_active":"2023-10-06T04:44:15.593652+0000","last_peered":"2023-10-06T04:44:15.593652+0000","last_clean":"2023-10-06T04:44:15.593652+0000","last_became_active":"2023-10-06T04:44:14.600035+0000","last_became_peered":"2023-10-06T04:44:14.600035+0000","last_unstale":"2023-10-06T04:44:15.593652+0000","last_undegraded":"2023-10-06T04:44:15.593652+0000","last_fullsized":"2023-10-06T04:44:15.593652+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:49.661632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.335486+0000","last_change":"2023-10-06T04:44:15.328047+0000","last_active":"2023-10-06T04:44:15.335486+0000","last_peered":"2023-10-06T04:44:15.335486+0000","last_clean":"2023-10-06T04:44:15.335486+0000","last_became_active":"2023-10-06T04:44:15.327728+0000","last_became_peered":"2023-10-06T04:44:15.327728+0000","last_unstale":"2023-10-06T04:44:15.335486+0000","last_undegraded":"2023-10-06T04:44:15.335486+0000","last_fullsized":"2023-10-06T04:44:15.335486+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:35.545173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"31'6","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.595348+0000","last_change":"2023-10-06T04:44:14.600313+0000","last_active":"2023-10-06T04:44:15.595348+0000","last_peered":"2023-10-06T04:44:15.595348+0000","last_clean":"2023-10-06T04:44:15.595348+0000","last_became_active":"2023-10-06T04:44:14.600042+0000","last_became_peered":"2023-10-06T04:44:14.600042+0000","last_unstale":"2023-10-06T04:44:15.595348+0000","last_undegraded":"2023-10-06T04:44:15.595348+0000","last_fullsized":"2023-10-06T04:44:15.595348+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:40:39.358544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.331154+0000","last_change":"2023-10-06T04:44:15.331154+0000","last_active":"2023-10-06T04:44:15.331154+0000","last_peered":"2023-10-06T04:44:15.331154+0000","last_clean":"2023-10-06T04:44:15.331154+0000","last_became_active":"2023-10-06T04:44:15.330803+0000","last_became_peered":"2023-10-06T04:44:15.330803+0000","last_unstale":"2023-10-06T04:44:15.331154+0000","last_undegraded":"2023-10-06T04:44:15.331154+0000","last_fullsized":"2023-10-06T04:44:15.331154+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:38.557345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.591966+0000","last_change":"2023-10-06T04:44:14.597965+0000","last_active":"2023-10-06T04:44:15.591966+0000","last_peered":"2023-10-06T04:44:15.591966+0000","last_clean":"2023-10-06T04:44:15.591966+0000","last_became_active":"2023-10-06T04:44:14.597239+0000","last_became_peered":"2023-10-06T04:44:14.597239+0000","last_unstale":"2023-10-06T04:44:15.591966+0000","last_undegraded":"2023-10-06T04:44:15.591966+0000","last_fullsized":"2023-10-06T04:44:15.591966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:38.911947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.326738+0000","last_change":"2023-10-06T04:44:15.324435+0000","last_active":"2023-10-06T04:44:15.326738+0000","last_peered":"2023-10-06T04:44:15.326738+0000","last_clean":"2023-10-06T04:44:15.326738+0000","last_became_active":"2023-10-06T04:44:15.324181+0000","last_became_peered":"2023-10-06T04:44:15.324181+0000","last_unstale":"2023-10-06T04:44:15.326738+0000","last_undegraded":"2023-10-06T04:44:15.326738+0000","last_fullsized":"2023-10-06T04:44:15.326738+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:42:02.722960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:44:14.599797+0000","last_change":"2023-10-06T04:44:14.597092+0000","last_active":"2023-10-06T04:44:14.599797+0000","last_peered":"2023-10-06T04:44:14.599797+0000","last_clean":"2023-10-06T04:44:14.599797+0000","last_became_active":"2023-10-06T04:44:14.596792+0000","last_became_peered":"2023-10-06T04:44:14.596792+0000","last_unstale":"2023-10-06T04:44:14.599797+0000","last_undegraded":"2023-10-06T04:44:14.599797+0000","last_fullsized":"2023-10-06T04:44:14.599797+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:52:26.348431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.340780+0000","last_change":"2023-10-06T04:44:15.331995+0000","last_active":"2023-10-06T04:44:15.340780+0000","last_peered":"2023-10-06T04:44:15.340780+0000","last_clean":"2023-10-06T04:44:15.340780+0000","last_became_active":"2023-10-06T04:44:15.331716+0000","last_became_peered":"2023-10-06T04:44:15.331716+0000","last_unstale":"2023-10-06T04:44:15.340780+0000","last_undegraded":"2023-10-06T04:44:15.340780+0000","last_fullsized":"2023-10-06T04:44:15.340780+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:38.557345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:44:14.607249+0000","last_change":"2023-10-06T04:44:14.606617+0000","last_active":"2023-10-06T04:44:14.607249+0000","last_peered":"2023-10-06T04:44:14.607249+0000","last_clean":"2023-10-06T04:44:14.607249+0000","last_became_active":"2023-10-06T04:44:14.606306+0000","last_became_peered":"2023-10-06T04:44:14.606306+0000","last_unstale":"2023-10-06T04:44:14.607249+0000","last_undegraded":"2023-10-06T04:44:14.607249+0000","last_fullsized":"2023-10-06T04:44:14.607249+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:47.121204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.328143+0000","last_change":"2023-10-06T04:44:15.325273+0000","last_active":"2023-10-06T04:44:15.328143+0000","last_peered":"2023-10-06T04:44:15.328143+0000","last_clean":"2023-10-06T04:44:15.328143+0000","last_became_active":"2023-10-06T04:44:15.324988+0000","last_became_peered":"2023-10-06T04:44:15.324988+0000","last_unstale":"2023-10-06T04:44:15.328143+0000","last_undegraded":"2023-10-06T04:44:15.328143+0000","last_fullsized":"2023-10-06T04:44:15.328143+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:55.263496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"31'8","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.593674+0000","last_change":"2023-10-06T04:44:14.593338+0000","last_active":"2023-10-06T04:44:15.593674+0000","last_peered":"2023-10-06T04:44:15.593674+0000","last_clean":"2023-10-06T04:44:15.593674+0000","last_became_active":"2023-10-06T04:44:14.593047+0000","last_became_peered":"2023-10-06T04:44:14.593047+0000","last_unstale":"2023-10-06T04:44:15.593674+0000","last_undegraded":"2023-10-06T04:44:15.593674+0000","last_fullsized":"2023-10-06T04:44:15.593674+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:33.356420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.332185+0000","last_change":"2023-10-06T04:44:15.329825+0000","last_active":"2023-10-06T04:44:15.332185+0000","last_peered":"2023-10-06T04:44:15.332185+0000","last_clean":"2023-10-06T04:44:15.332185+0000","last_became_active":"2023-10-06T04:44:15.329473+0000","last_became_peered":"2023-10-06T04:44:15.329473+0000","last_unstale":"2023-10-06T04:44:15.332185+0000","last_undegraded":"2023-10-06T04:44:15.332185+0000","last_fullsized":"2023-10-06T04:44:15.332185+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:28.204817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.593678+0000","last_change":"2023-10-06T04:44:14.599483+0000","last_active":"2023-10-06T04:44:15.593678+0000","last_peered":"2023-10-06T04:44:15.593678+0000","last_clean":"2023-10-06T04:44:15.593678+0000","last_became_active":"2023-10-06T04:44:14.599188+0000","last_became_peered":"2023-10-06T04:44:14.599188+0000","last_unstale":"2023-10-06T04:44:15.593678+0000","last_undegraded":"2023-10-06T04:44:15.593678+0000","last_fullsized":"2023-10-06T04:44:15.593678+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:33.356420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.338153+0000","last_change":"2023-10-06T04:44:15.336029+0000","last_active":"2023-10-06T04:44:15.338153+0000","last_peered":"2023-10-06T04:44:15.338153+0000","last_clean":"2023-10-06T04:44:15.338153+0000","last_became_active":"2023-10-06T04:44:15.334891+0000","last_became_peered":"2023-10-06T04:44:15.334891+0000","last_unstale":"2023-10-06T04:44:15.338153+0000","last_undegraded":"2023-10-06T04:44:15.338153+0000","last_fullsized":"2023-10-06T04:44:15.338153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:35.545173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.594035+0000","last_change":"2023-10-06T04:44:14.596981+0000","last_active":"2023-10-06T04:44:15.594035+0000","last_peered":"2023-10-06T04:44:15.594035+0000","last_clean":"2023-10-06T04:44:15.594035+0000","last_became_active":"2023-10-06T04:44:14.596664+0000","last_became_peered":"2023-10-06T04:44:14.596664+0000","last_unstale":"2023-10-06T04:44:15.594035+0000","last_undegraded":"2023-10-06T04:44:15.594035+0000","last_fullsized":"2023-10-06T04:44:15.594035+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:31:37.399581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.328458+0000","last_change":"2023-10-06T04:44:15.324047+0000","last_active":"2023-10-06T04:44:15.328458+0000","last_peered":"2023-10-06T04:44:15.328458+0000","last_clean":"2023-10-06T04:44:15.328458+0000","last_became_active":"2023-10-06T04:44:15.323792+0000","last_became_peered":"2023-10-06T04:44:15.323792+0000","last_unstale":"2023-10-06T04:44:15.328458+0000","last_undegraded":"2023-10-06T04:44:15.328458+0000","last_fullsized":"2023-10-06T04:44:15.328458+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:31.629240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.317984+0000","last_change":"2023-10-06T04:44:14.593022+0000","last_active":"2023-10-06T04:44:15.317984+0000","last_peered":"2023-10-06T04:44:15.317984+0000","last_clean":"2023-10-06T04:44:15.317984+0000","last_became_active":"2023-10-06T04:44:14.592726+0000","last_became_peered":"2023-10-06T04:44:14.592726+0000","last_unstale":"2023-10-06T04:44:15.317984+0000","last_undegraded":"2023-10-06T04:44:15.317984+0000","last_fullsized":"2023-10-06T04:44:15.317984+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:57.183976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.325902+0000","last_change":"2023-10-06T04:44:15.325902+0000","last_active":"2023-10-06T04:44:15.325902+0000","last_peered":"2023-10-06T04:44:15.325902+0000","last_clean":"2023-10-06T04:44:15.325902+0000","last_became_active":"2023-10-06T04:44:15.325624+0000","last_became_peered":"2023-10-06T04:44:15.325624+0000","last_unstale":"2023-10-06T04:44:15.325902+0000","last_undegraded":"2023-10-06T04:44:15.325902+0000","last_fullsized":"2023-10-06T04:44:15.325902+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:53:42.966451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:44:14.602749+0000","last_change":"2023-10-06T04:44:14.598685+0000","last_active":"2023-10-06T04:44:14.602749+0000","last_peered":"2023-10-06T04:44:14.602749+0000","last_clean":"2023-10-06T04:44:14.602749+0000","last_became_active":"2023-10-06T04:44:14.598415+0000","last_became_peered":"2023-10-06T04:44:14.598415+0000","last_unstale":"2023-10-06T04:44:14.602749+0000","last_undegraded":"2023-10-06T04:44:14.602749+0000","last_fullsized":"2023-10-06T04:44:14.602749+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:58:58.458948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.340886+0000","last_change":"2023-10-06T04:44:15.333333+0000","last_active":"2023-10-06T04:44:15.340886+0000","last_peered":"2023-10-06T04:44:15.340886+0000","last_clean":"2023-10-06T04:44:15.340886+0000","last_became_active":"2023-10-06T04:44:15.332814+0000","last_became_peered":"2023-10-06T04:44:15.332814+0000","last_unstale":"2023-10-06T04:44:15.340886+0000","last_undegraded":"2023-10-06T04:44:15.340886+0000","last_fullsized":"2023-10-06T04:44:15.340886+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:39.169281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.589446+0000","last_change":"2023-10-06T04:44:14.594220+0000","last_active":"2023-10-06T04:44:15.589446+0000","last_peered":"2023-10-06T04:44:15.589446+0000","last_clean":"2023-10-06T04:44:15.589446+0000","last_became_active":"2023-10-06T04:44:14.593919+0000","last_became_peered":"2023-10-06T04:44:14.593919+0000","last_unstale":"2023-10-06T04:44:15.589446+0000","last_undegraded":"2023-10-06T04:44:15.589446+0000","last_fullsized":"2023-10-06T04:44:15.589446+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:32.259155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.329518+0000","last_change":"2023-10-06T04:44:15.329518+0000","last_active":"2023-10-06T04:44:15.329518+0000","last_peered":"2023-10-06T04:44:15.329518+0000","last_clean":"2023-10-06T04:44:15.329518+0000","last_became_active":"2023-10-06T04:44:15.329264+0000","last_became_peered":"2023-10-06T04:44:15.329264+0000","last_unstale":"2023-10-06T04:44:15.329518+0000","last_undegraded":"2023-10-06T04:44:15.329518+0000","last_fullsized":"2023-10-06T04:44:15.329518+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:42.382412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:44:14.601149+0000","last_change":"2023-10-06T04:44:14.595336+0000","last_active":"2023-10-06T04:44:14.601149+0000","last_peered":"2023-10-06T04:44:14.601149+0000","last_clean":"2023-10-06T04:44:14.601149+0000","last_became_active":"2023-10-06T04:44:14.595027+0000","last_became_peered":"2023-10-06T04:44:14.595027+0000","last_unstale":"2023-10-06T04:44:14.601149+0000","last_undegraded":"2023-10-06T04:44:14.601149+0000","last_fullsized":"2023-10-06T04:44:14.601149+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:10.357255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.335967+0000","last_change":"2023-10-06T04:44:15.334485+0000","last_active":"2023-10-06T04:44:15.335967+0000","last_peered":"2023-10-06T04:44:15.335967+0000","last_clean":"2023-10-06T04:44:15.335967+0000","last_became_active":"2023-10-06T04:44:15.334203+0000","last_became_peered":"2023-10-06T04:44:15.334203+0000","last_unstale":"2023-10-06T04:44:15.335967+0000","last_undegraded":"2023-10-06T04:44:15.335967+0000","last_fullsized":"2023-10-06T04:44:15.335967+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:42:02.722960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.320855+0000","last_change":"2023-10-06T04:44:14.598980+0000","last_active":"2023-10-06T04:44:15.320855+0000","last_peered":"2023-10-06T04:44:15.320855+0000","last_clean":"2023-10-06T04:44:15.320855+0000","last_became_active":"2023-10-06T04:44:14.598478+0000","last_became_peered":"2023-10-06T04:44:14.598478+0000","last_unstale":"2023-10-06T04:44:15.320855+0000","last_undegraded":"2023-10-06T04:44:15.320855+0000","last_fullsized":"2023-10-06T04:44:15.320855+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:19.266332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.334494+0000","last_change":"2023-10-06T04:44:15.332546+0000","last_active":"2023-10-06T04:44:15.334494+0000","last_peered":"2023-10-06T04:44:15.334494+0000","last_clean":"2023-10-06T04:44:15.334494+0000","last_became_active":"2023-10-06T04:44:15.332290+0000","last_became_peered":"2023-10-06T04:44:15.332290+0000","last_unstale":"2023-10-06T04:44:15.334494+0000","last_undegraded":"2023-10-06T04:44:15.334494+0000","last_fullsized":"2023-10-06T04:44:15.334494+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:23:39.740653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:44:14.601667+0000","last_change":"2023-10-06T04:44:14.599883+0000","last_active":"2023-10-06T04:44:14.601667+0000","last_peered":"2023-10-06T04:44:14.601667+0000","last_clean":"2023-10-06T04:44:14.601667+0000","last_became_active":"2023-10-06T04:44:14.599468+0000","last_became_peered":"2023-10-06T04:44:14.599468+0000","last_unstale":"2023-10-06T04:44:14.601667+0000","last_undegraded":"2023-10-06T04:44:14.601667+0000","last_fullsized":"2023-10-06T04:44:14.601667+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:07:54.948233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.328448+0000","last_change":"2023-10-06T04:44:15.321789+0000","last_active":"2023-10-06T04:44:15.328448+0000","last_peered":"2023-10-06T04:44:15.328448+0000","last_clean":"2023-10-06T04:44:15.328448+0000","last_became_active":"2023-10-06T04:44:15.321443+0000","last_became_peered":"2023-10-06T04:44:15.321443+0000","last_unstale":"2023-10-06T04:44:15.328448+0000","last_undegraded":"2023-10-06T04:44:15.328448+0000","last_fullsized":"2023-10-06T04:44:15.328448+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:08:13.093379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.317481+0000","last_change":"2023-10-06T04:44:14.600044+0000","last_active":"2023-10-06T04:44:15.317481+0000","last_peered":"2023-10-06T04:44:15.317481+0000","last_clean":"2023-10-06T04:44:15.317481+0000","last_became_active":"2023-10-06T04:44:14.599763+0000","last_became_peered":"2023-10-06T04:44:14.599763+0000","last_unstale":"2023-10-06T04:44:15.317481+0000","last_undegraded":"2023-10-06T04:44:15.317481+0000","last_fullsized":"2023-10-06T04:44:15.317481+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:50:48.466487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.317334+0000","last_change":"2023-10-06T04:43:24.001927+0000","last_active":"2023-10-06T04:44:15.317334+0000","last_peered":"2023-10-06T04:44:15.317334+0000","last_clean":"2023-10-06T04:44:15.317334+0000","last_became_active":"2023-10-06T04:43:24.001591+0000","last_became_peered":"2023-10-06T04:43:24.001591+0000","last_unstale":"2023-10-06T04:44:15.317334+0000","last_undegraded":"2023-10-06T04:44:15.317334+0000","last_fullsized":"2023-10-06T04:44:15.317334+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:47.262845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.336897+0000","last_change":"2023-10-06T04:44:15.329470+0000","last_active":"2023-10-06T04:44:15.336897+0000","last_peered":"2023-10-06T04:44:15.336897+0000","last_clean":"2023-10-06T04:44:15.336897+0000","last_became_active":"2023-10-06T04:44:15.329011+0000","last_became_peered":"2023-10-06T04:44:15.329011+0000","last_unstale":"2023-10-06T04:44:15.336897+0000","last_undegraded":"2023-10-06T04:44:15.336897+0000","last_fullsized":"2023-10-06T04:44:15.336897+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:40:28.919122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.318465+0000","last_change":"2023-10-06T04:44:14.599072+0000","last_active":"2023-10-06T04:44:15.318465+0000","last_peered":"2023-10-06T04:44:15.318465+0000","last_clean":"2023-10-06T04:44:15.318465+0000","last_became_active":"2023-10-06T04:44:14.598788+0000","last_became_peered":"2023-10-06T04:44:14.598788+0000","last_unstale":"2023-10-06T04:44:15.318465+0000","last_undegraded":"2023-10-06T04:44:15.318465+0000","last_fullsized":"2023-10-06T04:44:15.318465+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:37.194565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.321006+0000","last_change":"2023-10-06T04:43:23.708597+0000","last_active":"2023-10-06T04:44:15.321006+0000","last_peered":"2023-10-06T04:44:15.321006+0000","last_clean":"2023-10-06T04:44:15.321006+0000","last_became_active":"2023-10-06T04:43:23.708317+0000","last_became_peered":"2023-10-06T04:43:23.708317+0000","last_unstale":"2023-10-06T04:44:15.321006+0000","last_undegraded":"2023-10-06T04:44:15.321006+0000","last_fullsized":"2023-10-06T04:44:15.321006+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:56.213068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.330979+0000","last_change":"2023-10-06T04:44:15.330979+0000","last_active":"2023-10-06T04:44:15.330979+0000","last_peered":"2023-10-06T04:44:15.330979+0000","last_clean":"2023-10-06T04:44:15.330979+0000","last_became_active":"2023-10-06T04:44:15.330758+0000","last_became_peered":"2023-10-06T04:44:15.330758+0000","last_unstale":"2023-10-06T04:44:15.330979+0000","last_undegraded":"2023-10-06T04:44:15.330979+0000","last_fullsized":"2023-10-06T04:44:15.330979+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:40:40.363429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.593600+0000","last_change":"2023-10-06T04:44:14.599219+0000","last_active":"2023-10-06T04:44:15.593600+0000","last_peered":"2023-10-06T04:44:15.593600+0000","last_clean":"2023-10-06T04:44:15.593600+0000","last_became_active":"2023-10-06T04:44:14.598833+0000","last_became_peered":"2023-10-06T04:44:14.598833+0000","last_unstale":"2023-10-06T04:44:15.593600+0000","last_undegraded":"2023-10-06T04:44:15.593600+0000","last_fullsized":"2023-10-06T04:44:15.593600+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:06.777056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:44:14.591363+0000","last_change":"2023-10-06T04:43:23.708753+0000","last_active":"2023-10-06T04:44:14.591363+0000","last_peered":"2023-10-06T04:44:14.591363+0000","last_clean":"2023-10-06T04:44:14.591363+0000","last_became_active":"2023-10-06T04:43:23.708483+0000","last_became_peered":"2023-10-06T04:43:23.708483+0000","last_unstale":"2023-10-06T04:44:14.591363+0000","last_undegraded":"2023-10-06T04:44:14.591363+0000","last_fullsized":"2023-10-06T04:44:14.591363+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:47.262845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.319699+0000","last_change":"2023-10-06T04:43:23.706116+0000","last_active":"2023-10-06T04:44:15.319699+0000","last_peered":"2023-10-06T04:44:15.319699+0000","last_clean":"2023-10-06T04:44:15.319699+0000","last_became_active":"2023-10-06T04:43:23.705090+0000","last_became_peered":"2023-10-06T04:43:23.705090+0000","last_unstale":"2023-10-06T04:44:15.319699+0000","last_undegraded":"2023-10-06T04:44:15.319699+0000","last_fullsized":"2023-10-06T04:44:15.319699+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:29.869173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.336984+0000","last_change":"2023-10-06T04:44:15.329322+0000","last_active":"2023-10-06T04:44:15.336984+0000","last_peered":"2023-10-06T04:44:15.336984+0000","last_clean":"2023-10-06T04:44:15.336984+0000","last_became_active":"2023-10-06T04:44:15.328983+0000","last_became_peered":"2023-10-06T04:44:15.328983+0000","last_unstale":"2023-10-06T04:44:15.336984+0000","last_undegraded":"2023-10-06T04:44:15.336984+0000","last_fullsized":"2023-10-06T04:44:15.336984+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:50:49.471372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:44:14.602527+0000","last_change":"2023-10-06T04:44:14.600013+0000","last_active":"2023-10-06T04:44:14.602527+0000","last_peered":"2023-10-06T04:44:14.602527+0000","last_clean":"2023-10-06T04:44:14.602527+0000","last_became_active":"2023-10-06T04:44:14.599739+0000","last_became_peered":"2023-10-06T04:44:14.599739+0000","last_unstale":"2023-10-06T04:44:14.602527+0000","last_undegraded":"2023-10-06T04:44:14.602527+0000","last_fullsized":"2023-10-06T04:44:14.602527+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:50:23.680252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.318325+0000","last_change":"2023-10-06T04:43:24.002162+0000","last_active":"2023-10-06T04:44:15.318325+0000","last_peered":"2023-10-06T04:44:15.318325+0000","last_clean":"2023-10-06T04:44:15.318325+0000","last_became_active":"2023-10-06T04:43:24.001883+0000","last_became_peered":"2023-10-06T04:43:24.001883+0000","last_unstale":"2023-10-06T04:44:15.318325+0000","last_undegraded":"2023-10-06T04:44:15.318325+0000","last_fullsized":"2023-10-06T04:44:15.318325+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:51:11.168258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.331797+0000","last_change":"2023-10-06T04:44:15.328259+0000","last_active":"2023-10-06T04:44:15.331797+0000","last_peered":"2023-10-06T04:44:15.331797+0000","last_clean":"2023-10-06T04:44:15.331797+0000","last_became_active":"2023-10-06T04:44:15.327984+0000","last_became_peered":"2023-10-06T04:44:15.327984+0000","last_unstale":"2023-10-06T04:44:15.331797+0000","last_undegraded":"2023-10-06T04:44:15.331797+0000","last_fullsized":"2023-10-06T04:44:15.331797+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:28.204817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.318870+0000","last_change":"2023-10-06T04:44:14.593481+0000","last_active":"2023-10-06T04:44:15.318870+0000","last_peered":"2023-10-06T04:44:15.318870+0000","last_clean":"2023-10-06T04:44:15.318870+0000","last_became_active":"2023-10-06T04:44:14.592979+0000","last_became_peered":"2023-10-06T04:44:14.592979+0000","last_unstale":"2023-10-06T04:44:15.318870+0000","last_undegraded":"2023-10-06T04:44:15.318870+0000","last_fullsized":"2023-10-06T04:44:15.318870+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:42.476666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.319647+0000","last_change":"2023-10-06T04:43:24.002057+0000","last_active":"2023-10-06T04:44:15.319647+0000","last_peered":"2023-10-06T04:44:15.319647+0000","last_clean":"2023-10-06T04:44:15.319647+0000","last_became_active":"2023-10-06T04:43:24.001809+0000","last_became_peered":"2023-10-06T04:43:24.001809+0000","last_unstale":"2023-10-06T04:44:15.319647+0000","last_undegraded":"2023-10-06T04:44:15.319647+0000","last_fullsized":"2023-10-06T04:44:15.319647+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:49.693980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.328848+0000","last_change":"2023-10-06T04:44:15.327121+0000","last_active":"2023-10-06T04:44:15.328848+0000","last_peered":"2023-10-06T04:44:15.328848+0000","last_clean":"2023-10-06T04:44:15.328848+0000","last_became_active":"2023-10-06T04:44:15.326865+0000","last_became_peered":"2023-10-06T04:44:15.326865+0000","last_unstale":"2023-10-06T04:44:15.328848+0000","last_undegraded":"2023-10-06T04:44:15.328848+0000","last_fullsized":"2023-10-06T04:44:15.328848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:35.545173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:44:14.595868+0000","last_change":"2023-10-06T04:44:14.594752+0000","last_active":"2023-10-06T04:44:14.595868+0000","last_peered":"2023-10-06T04:44:14.595868+0000","last_clean":"2023-10-06T04:44:14.595868+0000","last_became_active":"2023-10-06T04:44:14.593365+0000","last_became_peered":"2023-10-06T04:44:14.593365+0000","last_unstale":"2023-10-06T04:44:14.595868+0000","last_undegraded":"2023-10-06T04:44:14.595868+0000","last_fullsized":"2023-10-06T04:44:14.595868+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:19.266332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.326151+0000","last_change":"2023-10-06T04:43:24.002394+0000","last_active":"2023-10-06T04:44:15.326151+0000","last_peered":"2023-10-06T04:44:15.326151+0000","last_clean":"2023-10-06T04:44:15.326151+0000","last_became_active":"2023-10-06T04:43:24.001915+0000","last_became_peered":"2023-10-06T04:43:24.001915+0000","last_unstale":"2023-10-06T04:44:15.326151+0000","last_undegraded":"2023-10-06T04:44:15.326151+0000","last_fullsized":"2023-10-06T04:44:15.326151+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:45.031820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.328750+0000","last_change":"2023-10-06T04:44:15.328750+0000","last_active":"2023-10-06T04:44:15.328750+0000","last_peered":"2023-10-06T04:44:15.328750+0000","last_clean":"2023-10-06T04:44:15.328750+0000","last_became_active":"2023-10-06T04:44:15.328508+0000","last_became_peered":"2023-10-06T04:44:15.328508+0000","last_unstale":"2023-10-06T04:44:15.328750+0000","last_undegraded":"2023-10-06T04:44:15.328750+0000","last_fullsized":"2023-10-06T04:44:15.328750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:19.715717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:44:14.600773+0000","last_change":"2023-10-06T04:44:14.597116+0000","last_active":"2023-10-06T04:44:14.600773+0000","last_peered":"2023-10-06T04:44:14.600773+0000","last_clean":"2023-10-06T04:44:14.600773+0000","last_became_active":"2023-10-06T04:44:14.596762+0000","last_became_peered":"2023-10-06T04:44:14.596762+0000","last_unstale":"2023-10-06T04:44:14.600773+0000","last_undegraded":"2023-10-06T04:44:14.600773+0000","last_fullsized":"2023-10-06T04:44:14.600773+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:53.975155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:44:14.597485+0000","last_change":"2023-10-06T04:43:24.002424+0000","last_active":"2023-10-06T04:44:14.597485+0000","last_peered":"2023-10-06T04:44:14.597485+0000","last_clean":"2023-10-06T04:44:14.597485+0000","last_became_active":"2023-10-06T04:43:24.002147+0000","last_became_peered":"2023-10-06T04:43:24.002147+0000","last_unstale":"2023-10-06T04:44:14.597485+0000","last_undegraded":"2023-10-06T04:44:14.597485+0000","last_fullsized":"2023-10-06T04:44:14.597485+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:45.031820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T04:44:15.321192+0000","last_change":"2023-10-06T04:44:15.321192+0000","last_active":"2023-10-06T04:44:15.321192+0000","last_peered":"2023-10-06T04:44:15.321192+0000","last_clean":"2023-10-06T04:44:15.321192+0000","last_became_active":"2023-10-06T04:44:15.320400+0000","last_became_peered":"2023-10-06T04:44:15.320400+0000","last_unstale":"2023-10-06T04:44:15.321192+0000","last_undegraded":"2023-10-06T04:44:15.321192+0000","last_fullsized":"2023-10-06T04:44:15.321192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:14.575271+0000","last_clean_scrub_stamp":"2023-10-06T04:44:14.575271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:48.514352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:44:14.600057+0000","last_change":"2023-10-06T04:44:14.598064+0000","last_active":"2023-10-06T04:44:14.600057+0000","last_peered":"2023-10-06T04:44:14.600057+0000","last_clean":"2023-10-06T04:44:14.600057+0000","last_became_active":"2023-10-06T04:44:14.597541+0000","last_became_peered":"2023-10-06T04:44:14.597541+0000","last_unstale":"2023-10-06T04:44:14.600057+0000","last_undegraded":"2023-10-06T04:44:14.600057+0000","last_fullsized":"2023-10-06T04:44:14.600057+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:13.570386+0000","last_clean_scrub_stamp":"2023-10-06T04:44:13.570386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:06.777056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T04:44:14.597593+0000","last_change":"2023-10-06T04:43:23.707408+0000","last_active":"2023-10-06T04:44:14.597593+0000","last_peered":"2023-10-06T04:44:14.597593+0000","last_clean":"2023-10-06T04:44:14.597593+0000","last_became_active":"2023-10-06T04:43:23.707115+0000","last_became_peered":"2023-10-06T04:43:23.707115+0000","last_unstale":"2023-10-06T04:44:14.597593+0000","last_undegraded":"2023-10-06T04:44:14.597593+0000","last_fullsized":"2023-10-06T04:44:14.597593+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:56.213068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073616,"statfs":{"total":96636764160,"available":96331382784,"internally_reserved":0,"allocated":958464,"data_stored":731127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297632,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074208,"statfs":{"total":96636764160,"available":96331988992,"internally_reserved":0,"allocated":352256,"data_stored":139707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298212,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073628,"statfs":{"total":96636764160,"available":96331395072,"internally_reserved":0,"allocated":946176,"data_stored":729611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297632,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074208,"statfs":{"total":96636764160,"available":96331988992,"internally_reserved":0,"allocated":352256,"data_stored":139187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297632,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074208,"statfs":{"total":96636764160,"available":96331988992,"internally_reserved":0,"allocated":352256,"data_stored":139223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074196,"statfs":{"total":96636764160,"available":96331976704,"internally_reserved":0,"allocated":364544,"data_stored":140723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297636,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074204,"statfs":{"total":96636764160,"available":96331984896,"internally_reserved":0,"allocated":356352,"data_stored":139729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297636,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074204,"statfs":{"total":96636764160,"available":96331984896,"internally_reserved":0,"allocated":356352,"data_stored":139265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:44:20.083 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T04:44:20.083 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T04:44:20.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.241+0000 7feabc332700 1 Processor -- start 2023-10-06T04:44:20.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.241+0000 7feabc332700 1 -- start start 2023-10-06T04:44:20.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.242+0000 7feabc332700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7feab40af0c0 0x7feab406b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:20.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.242+0000 7feabc332700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7feab40b1140 0x7feab406b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:20.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.242+0000 7feabc332700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feab40aec30 con 0x7feab4159800 2023-10-06T04:44:20.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.242+0000 7feabc332700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feab40afc30 con 0x7feab40af0c0 2023-10-06T04:44:20.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.242+0000 7feabc332700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab40ae300 con 0x7feab40b1140 2023-10-06T04:44:20.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.242+0000 7feab98cd700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7feab40af0c0 0x7feab406b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:20.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.242+0000 7feab98cd700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7feab40af0c0 0x7feab406b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48224/0 (socket says 172.21.15.17:48224) 2023-10-06T04:44:20.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.242+0000 7feab98cd700 1 -- 172.21.15.17:0/3201643178 learned_addr learned my addr 172.21.15.17:0/3201643178 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:20.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.242+0000 7feaba8cf700 1 --2- 172.21.15.17:0/3201643178 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7feab40b1140 0x7feab406b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:20.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.242+0000 7feab98cd700 1 -- 172.21.15.17:0/3201643178 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7feab40b1140 msgr2=0x7feab406b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:20.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.242+0000 7feab98cd700 1 --2- 172.21.15.17:0/3201643178 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7feab40b1140 0x7feab406b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:20.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.242+0000 7feab98cd700 1 -- 172.21.15.17:0/3201643178 >> v1:172.21.15.136:6789/0 conn(0x7feab4159800 legacy=0x7feab40af520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:20.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.242+0000 7feab98cd700 1 -- 172.21.15.17:0/3201643178 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab40ae5e0 con 0x7feab40af0c0 2023-10-06T04:44:20.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.242+0000 7feab98cd700 1 --2- 172.21.15.17:0/3201643178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feab40af0c0 0x7feab406b450 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7feaa80099b0 tx=0x7feaa8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41ff291e25cd86f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:20.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.242+0000 7feab90cc700 1 -- 172.21.15.17:0/3201643178 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa800b860 con 0x7feab40af0c0 2023-10-06T04:44:20.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.242+0000 7feab90cc700 1 -- 172.21.15.17:0/3201643178 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa800b9c0 con 0x7feab40af0c0 2023-10-06T04:44:20.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.242+0000 7feab90cc700 1 -- 172.21.15.17:0/3201643178 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa800bd60 con 0x7feab40af0c0 2023-10-06T04:44:20.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.243+0000 7feabc332700 1 -- 172.21.15.17:0/3201643178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feab40af0c0 msgr2=0x7feab406b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:20.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.243+0000 7feabc332700 1 --2- 172.21.15.17:0/3201643178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feab40af0c0 0x7feab406b450 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7feaa80099b0 tx=0x7feaa8009250 comp rx=0 tx=0).stop 2023-10-06T04:44:20.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.243+0000 7feabc332700 1 -- 172.21.15.17:0/3201643178 shutdown_connections 2023-10-06T04:44:20.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.243+0000 7feabc332700 1 --2- 172.21.15.17:0/3201643178 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7feab40b1140 0x7feab406b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:20.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.243+0000 7feabc332700 1 --2- 172.21.15.17:0/3201643178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feab40af0c0 0x7feab406b450 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:20.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.243+0000 7feabc332700 1 -- 172.21.15.17:0/3201643178 >> 172.21.15.17:0/3201643178 conn(0x7feab40cde20 msgr2=0x7feab406ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:20.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.243+0000 7feabc332700 1 -- 172.21.15.17:0/3201643178 shutdown_connections 2023-10-06T04:44:20.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.243+0000 7feabc332700 1 -- 172.21.15.17:0/3201643178 wait complete. 2023-10-06T04:44:20.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.244+0000 7feabc332700 1 Processor -- start 2023-10-06T04:44:20.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.244+0000 7feabc332700 1 -- start start 2023-10-06T04:44:20.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.245+0000 7feabc332700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7feab40af0c0 0x7feab4152b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:20.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.245+0000 7feabc332700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feab40b1140 0x7feab4157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:20.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.245+0000 7feabc332700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feab4159800 0x7feab4158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:20.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.245+0000 7feabc332700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab415bc90 con 0x7feab4159800 2023-10-06T04:44:20.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.245+0000 7feabc332700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab415b080 con 0x7feab40b1140 2023-10-06T04:44:20.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.245+0000 7feabc332700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab415b360 con 0x7feab40af0c0 2023-10-06T04:44:20.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.245+0000 7feaba8cf700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feab4159800 0x7feab4158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:20.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.245+0000 7feaba8cf700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feab4159800 0x7feab4158350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48230/0 (socket says 172.21.15.17:48230) 2023-10-06T04:44:20.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.245+0000 7feaba8cf700 1 -- 172.21.15.17:0/3719742938 learned_addr learned my addr 172.21.15.17:0/3719742938 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:20.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.245+0000 7feab98cd700 1 --2- 172.21.15.17:0/3719742938 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feab40b1140 0x7feab4157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:20.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.245+0000 7feaba0ce700 1 --2- 172.21.15.17:0/3719742938 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7feab40af0c0 0x7feab4152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:20.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.245+0000 7feaba8cf700 1 -- 172.21.15.17:0/3719742938 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7feab40af0c0 msgr2=0x7feab4152b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:20.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.245+0000 7feaba8cf700 1 --2- 172.21.15.17:0/3719742938 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7feab40af0c0 0x7feab4152b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:20.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.245+0000 7feaba8cf700 1 -- 172.21.15.17:0/3719742938 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feab40b1140 msgr2=0x7feab4157e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:20.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.245+0000 7feaba8cf700 1 --2- 172.21.15.17:0/3719742938 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feab40b1140 0x7feab4157e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:20.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.245+0000 7feaba8cf700 1 -- 172.21.15.17:0/3719742938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa80094f0 con 0x7feab4159800 2023-10-06T04:44:20.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.245+0000 7feaba0ce700 1 --2- 172.21.15.17:0/3719742938 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7feab40af0c0 0x7feab4152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:20.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.245+0000 7feab98cd700 1 --2- 172.21.15.17:0/3719742938 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feab40b1140 0x7feab4157e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:20.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.245+0000 7feaba8cf700 1 --2- 172.21.15.17:0/3719742938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feab4159800 0x7feab4158350 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7feaa4009fa0 tx=0x7feaa4009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:20.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.245+0000 7feab27fc700 1 -- 172.21.15.17:0/3719742938 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa400ed20 con 0x7feab4159800 2023-10-06T04:44:20.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.245+0000 7feab27fc700 1 -- 172.21.15.17:0/3719742938 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa400ee80 con 0x7feab4159800 2023-10-06T04:44:20.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.245+0000 7feabc332700 1 -- 172.21.15.17:0/3719742938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feab415b640 con 0x7feab4159800 2023-10-06T04:44:20.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.246+0000 7feab27fc700 1 -- 172.21.15.17:0/3719742938 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa4014670 con 0x7feab4159800 2023-10-06T04:44:20.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.246+0000 7feabc332700 1 -- 172.21.15.17:0/3719742938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab41530d0 con 0x7feab4159800 2023-10-06T04:44:20.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.246+0000 7feabc332700 1 -- 172.21.15.17:0/3719742938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feab415be00 con 0x7feab4159800 2023-10-06T04:44:20.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.247+0000 7feab27fc700 1 -- 172.21.15.17:0/3719742938 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feaa40149e0 con 0x7feab4159800 2023-10-06T04:44:20.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.247+0000 7feab27fc700 1 --2- 172.21.15.17:0/3719742938 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7feaa0066f30 0x7feaa00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:20.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.247+0000 7feab27fc700 1 -- 172.21.15.17:0/3719742938 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6058+0+0 (secure 0 0 0) 0x7feaa4084e80 con 0x7feab4159800 2023-10-06T04:44:20.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.247+0000 7feaba0ce700 1 --2- 172.21.15.17:0/3719742938 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7feaa0066f30 0x7feaa00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:20.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.248+0000 7feaba0ce700 1 --2- 172.21.15.17:0/3719742938 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7feaa0066f30 0x7feaa00693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7feaac007fd0 tx=0x7feaac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:20.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.252+0000 7feab27fc700 1 -- 172.21.15.17:0/3719742938 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feaa4051f90 con 0x7feab4159800 2023-10-06T04:44:20.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.524+0000 7feabc332700 1 -- 172.21.15.17:0/3719742938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7feab404c380 con 0x7feab4159800 2023-10-06T04:44:20.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.528+0000 7feab27fc700 1 -- 172.21.15.17:0/3719742938 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7feaa40555b0 con 0x7feab4159800 2023-10-06T04:44:20.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.530+0000 7feabc332700 1 -- 172.21.15.17:0/3719742938 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7feaa0066f30 msgr2=0x7feaa00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:20.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.530+0000 7feabc332700 1 --2- 172.21.15.17:0/3719742938 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7feaa0066f30 0x7feaa00693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7feaac007fd0 tx=0x7feaac009040 comp rx=0 tx=0).stop 2023-10-06T04:44:20.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.530+0000 7feabc332700 1 -- 172.21.15.17:0/3719742938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feab4159800 msgr2=0x7feab4158350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:20.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.530+0000 7feabc332700 1 --2- 172.21.15.17:0/3719742938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feab4159800 0x7feab4158350 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7feaa4009fa0 tx=0x7feaa4009900 comp rx=0 tx=0).stop 2023-10-06T04:44:20.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.530+0000 7feabc332700 1 -- 172.21.15.17:0/3719742938 shutdown_connections 2023-10-06T04:44:20.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.530+0000 7feabc332700 1 --2- 172.21.15.17:0/3719742938 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7feaa0066f30 0x7feaa00693e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:20.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.530+0000 7feabc332700 1 --2- 172.21.15.17:0/3719742938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feab4159800 0x7feab4158350 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:20.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.530+0000 7feabc332700 1 --2- 172.21.15.17:0/3719742938 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7feab40af0c0 0x7feab4152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:20.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.530+0000 7feabc332700 1 --2- 172.21.15.17:0/3719742938 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feab40b1140 0x7feab4157e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:20.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.530+0000 7feabc332700 1 -- 172.21.15.17:0/3719742938 >> 172.21.15.17:0/3719742938 conn(0x7feab40cde20 msgr2=0x7feab406b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:20.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.530+0000 7feabc332700 1 -- 172.21.15.17:0/3719742938 shutdown_connections 2023-10-06T04:44:20.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.530+0000 7feabc332700 1 -- 172.21.15.17:0/3719742938 wait complete. 2023-10-06T04:44:20.534 INFO:teuthology.orchestra.run.smithi017.stderr:updated caps for client.0 2023-10-06T04:44:20.544 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:44:20.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.660+0000 7f187857b700 1 Processor -- start 2023-10-06T04:44:20.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.660+0000 7f187857b700 1 -- start start 2023-10-06T04:44:20.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.661+0000 7f187857b700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18701572e0 0x7f18701576b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:20.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.661+0000 7f187857b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f18700b1d90 0x7f18700ac130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:20.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.661+0000 7f187857b700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18700ac670 con 0x7f187015b1c0 2023-10-06T04:44:20.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.661+0000 7f187857b700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18700b2210 con 0x7f18700b1d90 2023-10-06T04:44:20.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.661+0000 7f187857b700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18700b3000 con 0x7f18701572e0 2023-10-06T04:44:20.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.661+0000 7f1875b16700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f187015b1c0 0x7f18700b1680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:44612/0 (socket says 172.21.15.17:44612) 2023-10-06T04:44:20.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.662+0000 7f1875b16700 1 -- 172.21.15.17:0/3528594965 learned_addr learned my addr 172.21.15.17:0/3528594965 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:20.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.662+0000 7f1876317700 1 --2- 172.21.15.17:0/3528594965 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18701572e0 0x7f18701576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:20.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.662+0000 7f1876b18700 1 --2- 172.21.15.17:0/3528594965 >> v2:172.21.15.136:3300/0 conn(0x7f18700b1d90 0x7f18700ac130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:20.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.662+0000 7f1875315700 1 -- 172.21.15.17:0/3528594965 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2284109628 0 0) 0x7f18700ac670 con 0x7f187015b1c0 2023-10-06T04:44:20.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.662+0000 7f1875315700 1 -- 172.21.15.17:0/3528594965 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1858003570 con 0x7f187015b1c0 2023-10-06T04:44:20.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.662+0000 7f1875315700 1 -- 172.21.15.17:0/3528594965 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4041444602 0 0) 0x7f1858003570 con 0x7f187015b1c0 2023-10-06T04:44:20.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.662+0000 7f1875315700 1 -- 172.21.15.17:0/3528594965 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18701572e0 msgr2=0x7f18701576b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:20.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.662+0000 7f1875315700 1 --2- 172.21.15.17:0/3528594965 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18701572e0 0x7f18701576b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:20.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.662+0000 7f1875315700 1 -- 172.21.15.17:0/3528594965 >> v2:172.21.15.136:3300/0 conn(0x7f18700b1d90 msgr2=0x7f18700ac130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:20.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.662+0000 7f1875315700 1 --2- 172.21.15.17:0/3528594965 >> v2:172.21.15.136:3300/0 conn(0x7f18700b1d90 0x7f18700ac130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:20.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.662+0000 7f1875315700 1 -- 172.21.15.17:0/3528594965 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18700b23f0 con 0x7f187015b1c0 2023-10-06T04:44:20.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.662+0000 7f1875315700 1 -- 172.21.15.17:0/3528594965 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4268781140 0 0) 0x7f1864001470 con 0x7f187015b1c0 2023-10-06T04:44:20.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.662+0000 7f1875315700 1 -- 172.21.15.17:0/3528594965 >> v1:172.21.15.17:6789/0 conn(0x7f187015b1c0 legacy=0x7f18700b1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:20.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.662+0000 7f1875315700 1 --2- 172.21.15.17:0/3528594965 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1858003a60 0x7f1858003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:20.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.662+0000 7f1875315700 1 --2- 172.21.15.17:0/3528594965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1858004810 0x7f1858004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:20.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.662+0000 7f1875315700 1 --2- 172.21.15.17:0/3528594965 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18701572e0 0x7f18580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:20.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.662+0000 7f1875315700 1 -- 172.21.15.17:0/3528594965 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18700b2210 con 0x7f1858004810 2023-10-06T04:44:20.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.662+0000 7f1875315700 1 -- 172.21.15.17:0/3528594965 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18700b3000 con 0x7f1858003a60 2023-10-06T04:44:20.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.662+0000 7f1875315700 1 -- 172.21.15.17:0/3528594965 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185800ba60 con 0x7f18701572e0 2023-10-06T04:44:20.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.662+0000 7f1875b16700 1 --2- 172.21.15.17:0/3528594965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1858004810 0x7f1858004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:20.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.662+0000 7f1876317700 1 --2- 172.21.15.17:0/3528594965 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1858003a60 0x7f1858003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:20.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.662+0000 7f1876b18700 1 --2- 172.21.15.17:0/3528594965 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18701572e0 0x7f18580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:20.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.663+0000 7f1875b16700 1 -- 172.21.15.17:0/3528594965 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18701572e0 msgr2=0x7f18580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:20.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.663+0000 7f1875b16700 1 --2- 172.21.15.17:0/3528594965 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18701572e0 0x7f18580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:20.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.663+0000 7f1875b16700 1 -- 172.21.15.17:0/3528594965 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1858003a60 msgr2=0x7f1858003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:20.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.663+0000 7f1875b16700 1 --2- 172.21.15.17:0/3528594965 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1858003a60 0x7f1858003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:20.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.663+0000 7f1875b16700 1 -- 172.21.15.17:0/3528594965 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1858003570 con 0x7f1858004810 2023-10-06T04:44:20.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.663+0000 7f1875b16700 1 --2- 172.21.15.17:0/3528594965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1858004810 0x7f1858004c80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f186400c3f0 tx=0x7f1864001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac2f0c3fd904f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:20.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.663+0000 7f1875315700 1 -- 172.21.15.17:0/3528594965 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186400cc80 con 0x7f1858004810 2023-10-06T04:44:20.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.663+0000 7f1875315700 1 -- 172.21.15.17:0/3528594965 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186400ce00 con 0x7f1858004810 2023-10-06T04:44:20.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.663+0000 7f1875315700 1 -- 172.21.15.17:0/3528594965 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1864005b70 con 0x7f1858004810 2023-10-06T04:44:20.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.663+0000 7f187857b700 1 -- 172.21.15.17:0/3528594965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1858004810 msgr2=0x7f1858004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:20.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.663+0000 7f187857b700 1 --2- 172.21.15.17:0/3528594965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1858004810 0x7f1858004c80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f186400c3f0 tx=0x7f1864001e90 comp rx=0 tx=0).stop 2023-10-06T04:44:20.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.663+0000 7f1876b18700 1 -- 172.21.15.17:0/3528594965 reap_dead start 2023-10-06T04:44:20.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.664+0000 7f187857b700 1 -- 172.21.15.17:0/3528594965 shutdown_connections 2023-10-06T04:44:20.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.664+0000 7f187857b700 1 -- 172.21.15.17:0/3528594965 >> 172.21.15.17:0/3528594965 conn(0x7f187006cd40 msgr2=0x7f1870087fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:20.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.664+0000 7f187857b700 1 -- 172.21.15.17:0/3528594965 shutdown_connections 2023-10-06T04:44:20.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.664+0000 7f187857b700 1 -- 172.21.15.17:0/3528594965 wait complete. 2023-10-06T04:44:20.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.665+0000 7f187857b700 1 Processor -- start 2023-10-06T04:44:20.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.665+0000 7f187857b700 1 -- start start 2023-10-06T04:44:20.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.665+0000 7f187857b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1858004810 0x7f187016e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:20.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.666+0000 7f187857b700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18701578b0 0x7f187016a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:20.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.666+0000 7f187857b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f18700cdc30 0x7f18700691f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:20.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.666+0000 7f187857b700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187016dea0 con 0x7f1858004810 2023-10-06T04:44:20.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.666+0000 7f187857b700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187016ad10 con 0x7f18700cdc30 2023-10-06T04:44:20.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.666+0000 7f187857b700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f187016aff0 con 0x7f18701578b0 2023-10-06T04:44:20.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.666+0000 7f1876317700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1858004810 0x7f187016e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:20.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.666+0000 7f1876317700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1858004810 0x7f187016e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60558/0 (socket says 172.21.15.17:60558) 2023-10-06T04:44:20.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.666+0000 7f1876317700 1 -- 172.21.15.17:0/2341867783 learned_addr learned my addr 172.21.15.17:0/2341867783 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:20.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.666+0000 7f1875b16700 1 --2- 172.21.15.17:0/2341867783 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18701578b0 0x7f187016a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:20.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.666+0000 7f1876b18700 1 --2- 172.21.15.17:0/2341867783 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f18700cdc30 0x7f18700691f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:20.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.666+0000 7f1876317700 1 -- 172.21.15.17:0/2341867783 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18701578b0 msgr2=0x7f187016a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:20.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.666+0000 7f1876317700 1 --2- 172.21.15.17:0/2341867783 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18701578b0 0x7f187016a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:20.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.666+0000 7f1876317700 1 -- 172.21.15.17:0/2341867783 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f18700cdc30 msgr2=0x7f18700691f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:20.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.666+0000 7f1876317700 1 --2- 172.21.15.17:0/2341867783 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f18700cdc30 0x7f18700691f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:20.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.666+0000 7f1876317700 1 -- 172.21.15.17:0/2341867783 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f187016db30 con 0x7f1858004810 2023-10-06T04:44:20.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.666+0000 7f1876317700 1 --2- 172.21.15.17:0/2341867783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1858004810 0x7f187016e330 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1868011d40 tx=0x7f18680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:20.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.666+0000 7f186e7fc700 1 -- 172.21.15.17:0/2341867783 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186800fa40 con 0x7f1858004810 2023-10-06T04:44:20.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.666+0000 7f186e7fc700 1 -- 172.21.15.17:0/2341867783 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186800fba0 con 0x7f1858004810 2023-10-06T04:44:20.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.666+0000 7f187857b700 1 -- 172.21.15.17:0/2341867783 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f187016e870 con 0x7f1858004810 2023-10-06T04:44:20.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.666+0000 7f186e7fc700 1 -- 172.21.15.17:0/2341867783 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1868014440 con 0x7f1858004810 2023-10-06T04:44:20.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.666+0000 7f187857b700 1 -- 172.21.15.17:0/2341867783 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f187016b2d0 con 0x7f1858004810 2023-10-06T04:44:20.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.667+0000 7f187857b700 1 -- 172.21.15.17:0/2341867783 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f187016e180 con 0x7f1858004810 2023-10-06T04:44:20.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.668+0000 7f186e7fc700 1 -- 172.21.15.17:0/2341867783 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1868014870 con 0x7f1858004810 2023-10-06T04:44:20.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.668+0000 7f186e7fc700 1 --2- 172.21.15.17:0/2341867783 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f185c066f30 0x7f185c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:20.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.668+0000 7f186e7fc700 1 -- 172.21.15.17:0/2341867783 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1868018030 con 0x7f1858004810 2023-10-06T04:44:20.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.668+0000 7f1875b16700 1 --2- 172.21.15.17:0/2341867783 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f185c066f30 0x7f185c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:20.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.669+0000 7f1875b16700 1 --2- 172.21.15.17:0/2341867783 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f185c066f30 0x7f185c0693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1864001ed0 tx=0x7f1864015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:20.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.673+0000 7f186e7fc700 1 -- 172.21.15.17:0/2341867783 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1868052210 con 0x7f1858004810 2023-10-06T04:44:20.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.911+0000 7f187857b700 1 -- 172.21.15.17:0/2341867783 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1870063ff0 con 0x7f1858004810 2023-10-06T04:44:20.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.912+0000 7f186e7fc700 1 -- 172.21.15.17:0/2341867783 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f1868059e60 con 0x7f1858004810 2023-10-06T04:44:20.915 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:20.915 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6834/3741747962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3741747962},{"type":"v1","addr":"172.21.15.136:6834","nonce":3741747962}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4688,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/264192509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6833","nonce":264192509},{"type":"v1","addr":"172.21.15.136:6835","nonce":264192509}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4909,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6836/1154731767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1154731767},{"type":"v1","addr":"172.21.15.17:6836","nonce":1154731767}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:44:14.988901+0000","modified":"2023-10-06T04:44:18.598280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4971":{"gid":4971,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6837/460551791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6835","nonce":460551791},{"type":"v1","addr":"172.21.15.17:6837","nonce":460551791}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:44:20.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.914+0000 7f187857b700 1 -- 172.21.15.17:0/2341867783 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f185c066f30 msgr2=0x7f185c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:20.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.914+0000 7f187857b700 1 --2- 172.21.15.17:0/2341867783 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f185c066f30 0x7f185c0693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1864001ed0 tx=0x7f1864015000 comp rx=0 tx=0).stop 2023-10-06T04:44:20.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.914+0000 7f187857b700 1 -- 172.21.15.17:0/2341867783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1858004810 msgr2=0x7f187016e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:20.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.914+0000 7f187857b700 1 --2- 172.21.15.17:0/2341867783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1858004810 0x7f187016e330 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1868011d40 tx=0x7f18680091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:20.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.914+0000 7f187857b700 1 -- 172.21.15.17:0/2341867783 shutdown_connections 2023-10-06T04:44:20.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.914+0000 7f187857b700 1 --2- 172.21.15.17:0/2341867783 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f185c066f30 0x7f185c0693e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:20.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.914+0000 7f187857b700 1 --2- 172.21.15.17:0/2341867783 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f18700cdc30 0x7f18700691f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:20.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.914+0000 7f187857b700 1 --2- 172.21.15.17:0/2341867783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1858004810 0x7f187016e330 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:20.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.914+0000 7f187857b700 1 --2- 172.21.15.17:0/2341867783 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18701578b0 0x7f187016a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:20.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.914+0000 7f187857b700 1 -- 172.21.15.17:0/2341867783 >> 172.21.15.17:0/2341867783 conn(0x7f187006cd40 msgr2=0x7f187015b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:20.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.914+0000 7f187857b700 1 -- 172.21.15.17:0/2341867783 shutdown_connections 2023-10-06T04:44:20.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:20.914+0000 7f187857b700 1 -- 172.21.15.17:0/2341867783 wait complete. 2023-10-06T04:44:20.918 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 16 2023-10-06T04:44:21.331 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T04:44:14.988901+0000', 'modified': '2023-10-06T04:44:18.598280+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4971}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4971': {'gid': 4971, 'name': 'a', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.17:6837/460551791', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6835', 'nonce': 460551791}, {'type': 'v1', 'addr': '172.21.15.17:6837', 'nonce': 460551791}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T04:44:21.332 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T04:44:21.332 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T04:44:21.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.454+0000 7fa8aad4f700 1 Processor -- start 2023-10-06T04:44:21.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.454+0000 7fa8aad4f700 1 -- start start 2023-10-06T04:44:21.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.454+0000 7fa8aad4f700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa8a415d610 0x7fa8a40cac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:21.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.455+0000 7fa8aad4f700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa8a41509a0 0x7fa8a415b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:21.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.455+0000 7fa8aad4f700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a415aed0 con 0x7fa8a40cb1b0 2023-10-06T04:44:21.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.455+0000 7fa8aad4f700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8a40cb680 con 0x7fa8a415d610 2023-10-06T04:44:21.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.455+0000 7fa8aad4f700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a40cb960 con 0x7fa8a41509a0 2023-10-06T04:44:21.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.455+0000 7fa8a8aeb700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa8a415d610 0x7fa8a40cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:21.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.455+0000 7fa8a92ec700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa8a41509a0 0x7fa8a415b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:21.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.455+0000 7fa8a3fff700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fa8a40cb1b0 0x7fa8a4150290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.17:57490/0 (socket says 172.21.15.17:57490) 2023-10-06T04:44:21.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.455+0000 7fa8a3fff700 1 -- 172.21.15.17:0/34373829 learned_addr learned my addr 172.21.15.17:0/34373829 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:21.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.455+0000 7fa8a92ec700 1 -- 172.21.15.17:0/34373829 >> v2:172.21.15.136:3300/0 conn(0x7fa8a415d610 msgr2=0x7fa8a40cac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:21.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.455+0000 7fa8a92ec700 1 --2- 172.21.15.17:0/34373829 >> v2:172.21.15.136:3300/0 conn(0x7fa8a415d610 0x7fa8a40cac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.455+0000 7fa8a92ec700 1 -- 172.21.15.17:0/34373829 >> v1:172.21.15.136:6789/0 conn(0x7fa8a40cb1b0 legacy=0x7fa8a4150290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:21.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.455+0000 7fa8a92ec700 1 -- 172.21.15.17:0/34373829 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a40cbc40 con 0x7fa8a41509a0 2023-10-06T04:44:21.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.456+0000 7fa8a92ec700 1 --2- 172.21.15.17:0/34373829 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa8a41509a0 0x7fa8a415b380 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa88c0098e0 tx=0x7fa88c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=714ea1087d23a26d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:21.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.456+0000 7fa8a37fe700 1 -- 172.21.15.17:0/34373829 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c00b640 con 0x7fa8a41509a0 2023-10-06T04:44:21.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.456+0000 7fa8a37fe700 1 -- 172.21.15.17:0/34373829 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88c00b7a0 con 0x7fa8a41509a0 2023-10-06T04:44:21.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.456+0000 7fa8a37fe700 1 -- 172.21.15.17:0/34373829 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c00bb40 con 0x7fa8a41509a0 2023-10-06T04:44:21.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.456+0000 7fa8aad4f700 1 -- 172.21.15.17:0/34373829 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa8a41509a0 msgr2=0x7fa8a415b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:21.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.456+0000 7fa8aad4f700 1 --2- 172.21.15.17:0/34373829 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa8a41509a0 0x7fa8a415b380 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa88c0098e0 tx=0x7fa88c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.456+0000 7fa8aad4f700 1 -- 172.21.15.17:0/34373829 shutdown_connections 2023-10-06T04:44:21.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.456+0000 7fa8aad4f700 1 --2- 172.21.15.17:0/34373829 >> v2:172.21.15.136:3300/0 conn(0x7fa8a415d610 0x7fa8a40cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.456+0000 7fa8aad4f700 1 --2- 172.21.15.17:0/34373829 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa8a41509a0 0x7fa8a415b380 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.456+0000 7fa8aad4f700 1 -- 172.21.15.17:0/34373829 >> 172.21.15.17:0/34373829 conn(0x7fa8a4099960 msgr2=0x7fa8a406cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:21.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.456+0000 7fa8aad4f700 1 -- 172.21.15.17:0/34373829 shutdown_connections 2023-10-06T04:44:21.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.456+0000 7fa8aad4f700 1 -- 172.21.15.17:0/34373829 wait complete. 2023-10-06T04:44:21.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.457+0000 7fa8aad4f700 1 Processor -- start 2023-10-06T04:44:21.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.458+0000 7fa8aad4f700 1 -- start start 2023-10-06T04:44:21.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.458+0000 7fa8aad4f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa8a40cb1b0 0x7fa8a40ce200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:21.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.458+0000 7fa8aad4f700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa8a41509a0 0x7fa8a40b5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:21.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.458+0000 7fa8aad4f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8a415d610 0x7fa8a40c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:21.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.458+0000 7fa8aad4f700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a40c76e0 con 0x7fa8a415d610 2023-10-06T04:44:21.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.458+0000 7fa8aad4f700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a416a4a0 con 0x7fa8a40cb1b0 2023-10-06T04:44:21.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.458+0000 7fa8aad4f700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a416a780 con 0x7fa8a41509a0 2023-10-06T04:44:21.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.458+0000 7fa8a92ec700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8a415d610 0x7fa8a40c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:21.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.458+0000 7fa8a92ec700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8a415d610 0x7fa8a40c7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60566/0 (socket says 172.21.15.17:60566) 2023-10-06T04:44:21.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.458+0000 7fa8a92ec700 1 -- 172.21.15.17:0/3410066460 learned_addr learned my addr 172.21.15.17:0/3410066460 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:21.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.459+0000 7fa8a3fff700 1 --2- 172.21.15.17:0/3410066460 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa8a41509a0 0x7fa8a40b5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:21.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.459+0000 7fa8a8aeb700 1 --2- 172.21.15.17:0/3410066460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa8a40cb1b0 0x7fa8a40ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:21.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.459+0000 7fa8a92ec700 1 -- 172.21.15.17:0/3410066460 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa8a41509a0 msgr2=0x7fa8a40b5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:21.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.459+0000 7fa8a92ec700 1 --2- 172.21.15.17:0/3410066460 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa8a41509a0 0x7fa8a40b5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.459+0000 7fa8a92ec700 1 -- 172.21.15.17:0/3410066460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa8a40cb1b0 msgr2=0x7fa8a40ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:21.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.459+0000 7fa8a92ec700 1 --2- 172.21.15.17:0/3410066460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa8a40cb1b0 0x7fa8a40ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.459+0000 7fa8a92ec700 1 -- 172.21.15.17:0/3410066460 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88c009420 con 0x7fa8a415d610 2023-10-06T04:44:21.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.459+0000 7fa8a92ec700 1 --2- 172.21.15.17:0/3410066460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8a415d610 0x7fa8a40c7bc0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa8a40cbaa0 tx=0x7fa88c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:21.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.459+0000 7fa8a0ff9700 1 -- 172.21.15.17:0/3410066460 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c01be40 con 0x7fa8a415d610 2023-10-06T04:44:21.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.459+0000 7fa8a0ff9700 1 -- 172.21.15.17:0/3410066460 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88c011630 con 0x7fa8a415d610 2023-10-06T04:44:21.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.459+0000 7fa8aad4f700 1 -- 172.21.15.17:0/3410066460 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a416aa60 con 0x7fa8a415d610 2023-10-06T04:44:21.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.459+0000 7fa8a0ff9700 1 -- 172.21.15.17:0/3410066460 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c0119f0 con 0x7fa8a415d610 2023-10-06T04:44:21.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.459+0000 7fa8aad4f700 1 -- 172.21.15.17:0/3410066460 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a40ce740 con 0x7fa8a415d610 2023-10-06T04:44:21.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.461+0000 7fa8a0ff9700 1 -- 172.21.15.17:0/3410066460 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa88c02e440 con 0x7fa8a415d610 2023-10-06T04:44:21.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.461+0000 7fa8a0ff9700 1 --2- 172.21.15.17:0/3410066460 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa884066f30 0x7fa8840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:21.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.461+0000 7fa8a0ff9700 1 -- 172.21.15.17:0/3410066460 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa88c086430 con 0x7fa8a415d610 2023-10-06T04:44:21.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.461+0000 7fa8a8aeb700 1 --2- 172.21.15.17:0/3410066460 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa884066f30 0x7fa8840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:21.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.462+0000 7fa8a8aeb700 1 --2- 172.21.15.17:0/3410066460 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa884066f30 0x7fa8840693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa89c009c90 tx=0x7fa89c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:21.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.463+0000 7fa8b4047b80 1 Processor -- start 2023-10-06T04:44:21.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.463+0000 7fa8b4047b80 1 -- start start 2023-10-06T04:44:21.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.464+0000 7fa8b4047b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edb1025a90 0x55edb1025e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:21.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.464+0000 7fa8b4047b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55edb0fe19a0 0x55edb0fde580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:21.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.464+0000 7fa8b4047b80 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55edb0fdfbd0 0x55edb0fdeac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:21.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.464+0000 7fa8b4047b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edb0f5ec80 con 0x55edb0fe19a0 2023-10-06T04:44:21.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.464+0000 7fa8b4047b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edb0f35a70 con 0x55edb1025a90 2023-10-06T04:44:21.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.464+0000 7fa8b4047b80 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x55edb0f33270 con 0x55edb0fdfbd0 2023-10-06T04:44:21.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.464+0000 7fa8a3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55edb0fe19a0 0x55edb0fde580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:21.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.464+0000 7fa8a3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55edb0fe19a0 0x55edb0fde580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60572/0 (socket says 172.21.15.17:60572) 2023-10-06T04:44:21.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.464+0000 7fa8a3fff700 1 -- 172.21.15.17:0/3781797727 learned_addr learned my addr 172.21.15.17:0/3781797727 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:21.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.464+0000 7fa8a92ec700 1 --2- 172.21.15.17:0/3781797727 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55edb0fdfbd0 0x55edb0fdeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:21.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.464+0000 7fa8a8aeb700 1 --2- 172.21.15.17:0/3781797727 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edb1025a90 0x55edb1025e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:21.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.464+0000 7fa8a3fff700 1 -- 172.21.15.17:0/3781797727 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55edb0fdfbd0 msgr2=0x55edb0fdeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:21.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.464+0000 7fa8a3fff700 1 --2- 172.21.15.17:0/3781797727 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55edb0fdfbd0 0x55edb0fdeac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.464+0000 7fa8a3fff700 1 -- 172.21.15.17:0/3781797727 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edb1025a90 msgr2=0x55edb1025e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:21.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.464+0000 7fa8a3fff700 1 --2- 172.21.15.17:0/3781797727 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edb1025a90 0x55edb1025e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.464+0000 7fa8a3fff700 1 -- 172.21.15.17:0/3781797727 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55edb0dc9270 con 0x55edb0fe19a0 2023-10-06T04:44:21.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.464+0000 7fa8a3fff700 1 --2- 172.21.15.17:0/3781797727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55edb0fe19a0 0x55edb0fde580 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa894002130 tx=0x7fa894009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ea0070f3ddf5a0c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:21.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.464+0000 7fa899ffb700 1 -- 172.21.15.17:0/3781797727 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89400ecc0 con 0x55edb0fe19a0 2023-10-06T04:44:21.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.464+0000 7fa899ffb700 1 -- 172.21.15.17:0/3781797727 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89400ee20 con 0x55edb0fe19a0 2023-10-06T04:44:21.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.464+0000 7fa899ffb700 1 -- 172.21.15.17:0/3781797727 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8940146d0 con 0x55edb0fe19a0 2023-10-06T04:44:21.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.465+0000 7fa8b4047b80 1 -- 172.21.15.17:0/3781797727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55edb0fe19a0 msgr2=0x55edb0fde580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:21.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.465+0000 7fa8b4047b80 1 --2- 172.21.15.17:0/3781797727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55edb0fe19a0 0x55edb0fde580 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa894002130 tx=0x7fa894009040 comp rx=0 tx=0).stop 2023-10-06T04:44:21.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.465+0000 7fa8b4047b80 1 -- 172.21.15.17:0/3781797727 shutdown_connections 2023-10-06T04:44:21.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.465+0000 7fa8b4047b80 1 --2- 172.21.15.17:0/3781797727 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55edb0fdfbd0 0x55edb0fdeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.465+0000 7fa8b4047b80 1 --2- 172.21.15.17:0/3781797727 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edb1025a90 0x55edb1025e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.465+0000 7fa8b4047b80 1 --2- 172.21.15.17:0/3781797727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55edb0fe19a0 0x55edb0fde580 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.465+0000 7fa8b4047b80 1 -- 172.21.15.17:0/3781797727 >> 172.21.15.17:0/3781797727 conn(0x55edb0fe0070 msgr2=0x55edb0fe0440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:21.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.465+0000 7fa8b4047b80 1 -- 172.21.15.17:0/3781797727 shutdown_connections 2023-10-06T04:44:21.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.465+0000 7fa8b4047b80 1 -- 172.21.15.17:0/3781797727 wait complete. 2023-10-06T04:44:21.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.466+0000 7fa8b4047b80 1 -- start start 2023-10-06T04:44:21.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.466+0000 7fa8b4047b80 1 Processor -- start 2023-10-06T04:44:21.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.467+0000 7fa8b4047b80 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55edb0fdfbd0 0x55edb1007010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:21.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.467+0000 7fa8b4047b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edb0fe19a0 0x55edb1004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:21.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.467+0000 7fa8b4047b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55edb1025a90 0x55edb1004ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:21.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.467+0000 7fa8b4047b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edb0f2f060 con 0x55edb1025a90 2023-10-06T04:44:21.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.467+0000 7fa8b4047b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edb0eda890 con 0x55edb0fe19a0 2023-10-06T04:44:21.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.467+0000 7fa8b4047b80 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x55edb0ef5ea0 con 0x55edb0fdfbd0 2023-10-06T04:44:21.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.467+0000 7fa8b4047b80 10 client.0 _ll_register_callbacks cb 0x55edb0dcbf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:44:21.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.467+0000 7fa8a92ec700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55edb1025a90 0x55edb1004ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:21.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.467+0000 7fa8a92ec700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55edb1025a90 0x55edb1004ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60586/0 (socket says 172.21.15.17:60586) 2023-10-06T04:44:21.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.467+0000 7fa8a92ec700 1 -- 172.21.15.17:0/1400587712 learned_addr learned my addr 172.21.15.17:0/1400587712 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:21.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.467+0000 7fa8a8aeb700 1 --2- 172.21.15.17:0/1400587712 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55edb0fdfbd0 0x55edb1007010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:21.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.467+0000 7fa8a3fff700 1 --2- 172.21.15.17:0/1400587712 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edb0fe19a0 0x55edb1004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:21.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.467+0000 7fa8a92ec700 1 -- 172.21.15.17:0/1400587712 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55edb0fdfbd0 msgr2=0x55edb1007010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:21.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.467+0000 7fa8a92ec700 1 --2- 172.21.15.17:0/1400587712 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55edb0fdfbd0 0x55edb1007010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.467+0000 7fa8a92ec700 1 -- 172.21.15.17:0/1400587712 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edb0fe19a0 msgr2=0x55edb1004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:21.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.467+0000 7fa8a92ec700 1 --2- 172.21.15.17:0/1400587712 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edb0fe19a0 0x55edb1004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.467+0000 7fa8a92ec700 1 -- 172.21.15.17:0/1400587712 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa89400f040 con 0x55edb1025a90 2023-10-06T04:44:21.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.467+0000 7fa8a92ec700 1 --2- 172.21.15.17:0/1400587712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55edb1025a90 0x55edb1004ec0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa88c0091e0 tx=0x7fa88c003040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13b440c56f401f74 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:21.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.467+0000 7fa882ffd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-06T04:44:21.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.467+0000 7fa882ffd700 1 -- 172.21.15.17:0/1400587712 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c057860 con 0x55edb1025a90 2023-10-06T04:44:21.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.467+0000 7fa882ffd700 1 -- 172.21.15.17:0/1400587712 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa88c057160 con 0x55edb1025a90 2023-10-06T04:44:21.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.467+0000 7fa8b4047b80 1 -- 172.21.15.17:0/1400587712 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55edb0fd3690 con 0x55edb1025a90 2023-10-06T04:44:21.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.468+0000 7fa882ffd700 1 -- 172.21.15.17:0/1400587712 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa88c05a3b0 con 0x55edb1025a90 2023-10-06T04:44:21.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.468+0000 7fa8b4047b80 10 client.5148 fetch_fsmap learned FSMap version 16 2023-10-06T04:44:21.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.468+0000 7fa8b4047b80 1 -- 172.21.15.17:0/1400587712 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55edb0d6bfe0 con 0x55edb1025a90 2023-10-06T04:44:21.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.468+0000 7fa882ffd700 1 -- 172.21.15.17:0/1400587712 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55edb0fd3690 con 0x55edb1025a90 2023-10-06T04:44:21.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.468+0000 7fa882ffd700 1 -- 172.21.15.17:0/1400587712 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 16) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa88c0573c0 con 0x55edb1025a90 2023-10-06T04:44:21.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.468+0000 7fa8b4047b80 10 client.5148 fetch_fsmap finished waiting for FSMap version 16 2023-10-06T04:44:21.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.468+0000 7fa8b4047b80 10 client.5148 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T04:44:21.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.468+0000 7fa8b4047b80 20 client.5148 populate_metadata read hostname 'smithi017' 2023-10-06T04:44:21.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.468+0000 7fa8b4047b80 1 --2- 172.21.15.17:0/1400587712 >> [v2:172.21.15.17:6835/460551791,v1:172.21.15.17:6837/460551791] conn(0x55edb1008670 0x55edb1008a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:21.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.468+0000 7fa8b4047b80 4 client.5148 mds_command: new command op to 4971 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T04:44:21.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.468+0000 7fa8b4047b80 1 -- 172.21.15.17:0/1400587712 --> [v2:172.21.15.17:6835/460551791,v1:172.21.15.17:6837/460551791] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55edb0fb05c0 con 0x55edb1008670 2023-10-06T04:44:21.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.468+0000 7fa8a8aeb700 1 --2- 172.21.15.17:0/1400587712 >> [v2:172.21.15.17:6835/460551791,v1:172.21.15.17:6837/460551791] conn(0x55edb1008670 0x55edb1008a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:21.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.468+0000 7fa8a8aeb700 1 --2- 172.21.15.17:0/1400587712 >> [v2:172.21.15.17:6835/460551791,v1:172.21.15.17:6837/460551791] conn(0x55edb1008670 0x55edb1008a40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6b746c69a35d815 server_cookie=f525513af55e79a6 in_seq=0 out_seq=0 2023-10-06T04:44:21.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.468+0000 7fa882ffd700 10 client.5148 ms_handle_connect on v2:172.21.15.17:6835/460551791 2023-10-06T04:44:21.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.469+0000 7fa882ffd700 1 -- 172.21.15.17:0/1400587712 <== mds.0 v2:172.21.15.17:6835/460551791 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55edb0fb05c0 con 0x55edb1008670 2023-10-06T04:44:21.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.469+0000 7fa882ffd700 10 client.5148 handle_command_reply: tid=0 2023-10-06T04:44:21.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.469+0000 7fa8b4047b80 1 client.5148 shutdown 2023-10-06T04:44:21.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.469+0000 7fa8b4047b80 1 -- 172.21.15.17:0/1400587712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55edb1025a90 msgr2=0x55edb1004ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:21.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.469+0000 7fa8b4047b80 1 --2- 172.21.15.17:0/1400587712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55edb1025a90 0x55edb1004ec0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa88c0091e0 tx=0x7fa88c003040 comp rx=0 tx=0).stop 2023-10-06T04:44:21.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.469+0000 7fa8b4047b80 1 -- 172.21.15.17:0/1400587712 shutdown_connections 2023-10-06T04:44:21.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.469+0000 7fa8b4047b80 1 --2- 172.21.15.17:0/1400587712 >> [v2:172.21.15.17:6835/460551791,v1:172.21.15.17:6837/460551791] conn(0x55edb1008670 0x55edb1008a40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.469+0000 7fa8b4047b80 1 --2- 172.21.15.17:0/1400587712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55edb1025a90 0x55edb1004ec0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.469+0000 7fa8b4047b80 1 --2- 172.21.15.17:0/1400587712 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55edb0fdfbd0 0x55edb1007010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.469+0000 7fa882ffd700 0 client.5148 ms_handle_reset on v2:172.21.15.17:6835/460551791 2023-10-06T04:44:21.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.469+0000 7fa8b4047b80 1 --2- 172.21.15.17:0/1400587712 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edb0fe19a0 0x55edb1004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.469+0000 7fa8b4047b80 1 -- 172.21.15.17:0/1400587712 >> 172.21.15.17:0/1400587712 conn(0x55edb0fe0070 msgr2=0x55edb1023560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:21.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.469+0000 7fa8b4047b80 1 -- 172.21.15.17:0/1400587712 shutdown_connections 2023-10-06T04:44:21.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.469+0000 7fa8b4047b80 1 -- 172.21.15.17:0/1400587712 wait complete. 2023-10-06T04:44:21.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.469+0000 7fa8b4047b80 20 client.5148 trim_cache size 0 max 16384 2023-10-06T04:44:21.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.486+0000 7fa8b4047b80 1 Processor -- start 2023-10-06T04:44:21.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.486+0000 7fa8b4047b80 1 -- start start 2023-10-06T04:44:21.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.487+0000 7fa8b4047b80 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55edb0fdfbd0 0x55edb1021580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:21.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.487+0000 7fa8b4047b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edb0fe19a0 0x55edb0fda710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:21.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.487+0000 7fa8b4047b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55edb1025a90 0x55edb0fdac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:21.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.487+0000 7fa8b4047b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edb0db1e30 con 0x55edb1025a90 2023-10-06T04:44:21.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.487+0000 7fa8b4047b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edb1007010 con 0x55edb0fe19a0 2023-10-06T04:44:21.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.487+0000 7fa8b4047b80 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x55edb0fe12b0 con 0x55edb0fdfbd0 2023-10-06T04:44:21.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.487+0000 7fa8a92ec700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55edb1025a90 0x55edb0fdac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:21.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.487+0000 7fa8a92ec700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55edb1025a90 0x55edb0fdac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60590/0 (socket says 172.21.15.17:60590) 2023-10-06T04:44:21.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.487+0000 7fa8a92ec700 1 -- 172.21.15.17:0/1883243874 learned_addr learned my addr 172.21.15.17:0/1883243874 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:21.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.487+0000 7fa8a8aeb700 1 --2- 172.21.15.17:0/1883243874 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55edb0fdfbd0 0x55edb1021580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:21.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.487+0000 7fa8a3fff700 1 --2- 172.21.15.17:0/1883243874 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edb0fe19a0 0x55edb0fda710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:21.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.487+0000 7fa8a92ec700 1 -- 172.21.15.17:0/1883243874 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55edb0fdfbd0 msgr2=0x55edb1021580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:21.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.487+0000 7fa8a92ec700 1 --2- 172.21.15.17:0/1883243874 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55edb0fdfbd0 0x55edb1021580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.487+0000 7fa8a92ec700 1 -- 172.21.15.17:0/1883243874 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edb0fe19a0 msgr2=0x55edb0fda710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:21.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.487+0000 7fa8a92ec700 1 --2- 172.21.15.17:0/1883243874 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edb0fe19a0 0x55edb0fda710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.487+0000 7fa8a92ec700 1 -- 172.21.15.17:0/1883243874 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55edb0efd780 con 0x55edb1025a90 2023-10-06T04:44:21.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.487+0000 7fa8a8aeb700 1 --2- 172.21.15.17:0/1883243874 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55edb0fdfbd0 0x55edb1021580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:21.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.487+0000 7fa8a3fff700 1 --2- 172.21.15.17:0/1883243874 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edb0fe19a0 0x55edb0fda710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:21.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.487+0000 7fa8a92ec700 1 --2- 172.21.15.17:0/1883243874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55edb1025a90 0x55edb0fdac50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa88c056e10 tx=0x7fa88c06a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94efb2f735e0c65c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:21.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.488+0000 7fa89a7fc700 1 -- 172.21.15.17:0/1883243874 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c00f2e0 con 0x55edb1025a90 2023-10-06T04:44:21.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.488+0000 7fa89a7fc700 1 -- 172.21.15.17:0/1883243874 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88c07ee90 con 0x55edb1025a90 2023-10-06T04:44:21.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.488+0000 7fa89a7fc700 1 -- 172.21.15.17:0/1883243874 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c00b260 con 0x55edb1025a90 2023-10-06T04:44:21.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.488+0000 7fa8b4047b80 1 -- 172.21.15.17:0/1883243874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55edb1025a90 msgr2=0x55edb0fdac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:21.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.488+0000 7fa8b4047b80 1 --2- 172.21.15.17:0/1883243874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55edb1025a90 0x55edb0fdac50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa88c056e10 tx=0x7fa88c06a000 comp rx=0 tx=0).stop 2023-10-06T04:44:21.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.488+0000 7fa8b4047b80 1 -- 172.21.15.17:0/1883243874 shutdown_connections 2023-10-06T04:44:21.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.488+0000 7fa8b4047b80 1 --2- 172.21.15.17:0/1883243874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55edb1025a90 0x55edb0fdac50 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.488+0000 7fa8b4047b80 1 --2- 172.21.15.17:0/1883243874 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55edb0fdfbd0 0x55edb1021580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.488+0000 7fa8b4047b80 1 --2- 172.21.15.17:0/1883243874 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edb0fe19a0 0x55edb0fda710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.488+0000 7fa8b4047b80 1 -- 172.21.15.17:0/1883243874 >> 172.21.15.17:0/1883243874 conn(0x55edb0fe0070 msgr2=0x55edb1022a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:21.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.488+0000 7fa8b4047b80 1 -- 172.21.15.17:0/1883243874 shutdown_connections 2023-10-06T04:44:21.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.488+0000 7fa8b4047b80 1 -- 172.21.15.17:0/1883243874 wait complete. 2023-10-06T04:44:21.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.489+0000 7fa8b4047b80 1 -- start start 2023-10-06T04:44:21.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.489+0000 7fa8b4047b80 1 Processor -- start 2023-10-06T04:44:21.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.490+0000 7fa8b4047b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55edb0fdfbd0 0x55edb1020210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:21.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.490+0000 7fa8b4047b80 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55edb0fe19a0 0x55edb1020750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:21.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.490+0000 7fa8b4047b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edb1025a90 0x55edb10292a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:21.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.490+0000 7fa8b4047b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edb1028e50 con 0x55edb0fdfbd0 2023-10-06T04:44:21.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.490+0000 7fa8b4047b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edb108aef0 con 0x55edb1025a90 2023-10-06T04:44:21.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.490+0000 7fa8b4047b80 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x55edb101b260 con 0x55edb0fe19a0 2023-10-06T04:44:21.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.490+0000 7fa8b4047b80 10 client.0 _ll_register_callbacks cb 0x55edb0dcbf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:44:21.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.490+0000 7fa8a8aeb700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55edb0fdfbd0 0x55edb1020210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:21.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.490+0000 7fa8a8aeb700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55edb0fdfbd0 0x55edb1020210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60598/0 (socket says 172.21.15.17:60598) 2023-10-06T04:44:21.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.490+0000 7fa8a8aeb700 1 -- 172.21.15.17:0/778942519 learned_addr learned my addr 172.21.15.17:0/778942519 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:21.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.490+0000 7fa8a92ec700 1 --2- 172.21.15.17:0/778942519 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edb1025a90 0x55edb10292a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:21.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.490+0000 7fa8a3fff700 1 --2- 172.21.15.17:0/778942519 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55edb0fe19a0 0x55edb1020750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:21.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.490+0000 7fa8a8aeb700 1 -- 172.21.15.17:0/778942519 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55edb0fe19a0 msgr2=0x55edb1020750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:21.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.490+0000 7fa8a8aeb700 1 --2- 172.21.15.17:0/778942519 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55edb0fe19a0 0x55edb1020750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.490+0000 7fa8a8aeb700 1 -- 172.21.15.17:0/778942519 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edb1025a90 msgr2=0x55edb10292a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:21.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.490+0000 7fa8a8aeb700 1 --2- 172.21.15.17:0/778942519 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edb1025a90 0x55edb10292a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.490+0000 7fa8a8aeb700 1 -- 172.21.15.17:0/778942519 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa89400f040 con 0x55edb0fdfbd0 2023-10-06T04:44:21.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.490+0000 7fa8a92ec700 1 --2- 172.21.15.17:0/778942519 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edb1025a90 0x55edb10292a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:21.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.490+0000 7fa8a8aeb700 1 --2- 172.21.15.17:0/778942519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55edb0fdfbd0 0x55edb1020210 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa89c009390 tx=0x7fa89c025040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4046552391e70f4a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:21.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.490+0000 7fa882ffd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-06T04:44:21.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.490+0000 7fa882ffd700 1 -- 172.21.15.17:0/778942519 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89c030070 con 0x55edb0fdfbd0 2023-10-06T04:44:21.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.490+0000 7fa882ffd700 1 -- 172.21.15.17:0/778942519 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa89c015e40 con 0x55edb0fdfbd0 2023-10-06T04:44:21.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.490+0000 7fa8b4047b80 1 -- 172.21.15.17:0/778942519 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa89400ee20 con 0x55edb0fdfbd0 2023-10-06T04:44:21.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.490+0000 7fa882ffd700 1 -- 172.21.15.17:0/778942519 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa89c005c10 con 0x55edb0fdfbd0 2023-10-06T04:44:21.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.490+0000 7fa8b4047b80 10 client.5154 fetch_fsmap learned FSMap version 16 2023-10-06T04:44:21.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.490+0000 7fa8b4047b80 1 -- 172.21.15.17:0/778942519 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55edb0ee4470 con 0x55edb0fdfbd0 2023-10-06T04:44:21.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.491+0000 7fa882ffd700 1 -- 172.21.15.17:0/778942519 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89400ee20 con 0x55edb0fdfbd0 2023-10-06T04:44:21.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.491+0000 7fa882ffd700 1 -- 172.21.15.17:0/778942519 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 16) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa89c033020 con 0x55edb0fdfbd0 2023-10-06T04:44:21.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.491+0000 7fa8b4047b80 10 client.5154 fetch_fsmap finished waiting for FSMap version 16 2023-10-06T04:44:21.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.491+0000 7fa8b4047b80 10 client.5154 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T04:44:21.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.491+0000 7fa8b4047b80 20 client.5154 populate_metadata read hostname 'smithi017' 2023-10-06T04:44:21.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.491+0000 7fa8b4047b80 1 --2- 172.21.15.17:0/778942519 >> [v2:172.21.15.17:6835/460551791,v1:172.21.15.17:6837/460551791] conn(0x55edb10297e0 0x55edb0fda4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:21.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.491+0000 7fa8b4047b80 4 client.5154 mds_command: new command op to 4971 tid=0[{"prefix": "status"}] 2023-10-06T04:44:21.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.491+0000 7fa8b4047b80 1 -- 172.21.15.17:0/778942519 --> [v2:172.21.15.17:6835/460551791,v1:172.21.15.17:6837/460551791] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55edb0ed1e00 con 0x55edb10297e0 2023-10-06T04:44:21.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.491+0000 7fa8a3fff700 1 --2- 172.21.15.17:0/778942519 >> [v2:172.21.15.17:6835/460551791,v1:172.21.15.17:6837/460551791] conn(0x55edb10297e0 0x55edb0fda4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:21.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.491+0000 7fa882ffd700 10 client.5154 ms_handle_connect on v2:172.21.15.17:6835/460551791 2023-10-06T04:44:21.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.491+0000 7fa8a3fff700 1 --2- 172.21.15.17:0/778942519 >> [v2:172.21.15.17:6835/460551791,v1:172.21.15.17:6837/460551791] conn(0x55edb10297e0 0x55edb0fda4e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a41dc9df2eec2cfe server_cookie=5d9078ff79af1eed in_seq=0 out_seq=0 2023-10-06T04:44:21.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.491+0000 7fa882ffd700 1 -- 172.21.15.17:0/778942519 <== mds.0 v2:172.21.15.17:6835/460551791 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55edb0ed1e00 con 0x55edb10297e0 2023-10-06T04:44:21.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.491+0000 7fa882ffd700 10 client.5154 handle_command_reply: tid=0 2023-10-06T04:44:21.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.491+0000 7fa8b4047b80 1 client.5154 shutdown 2023-10-06T04:44:21.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.491+0000 7fa8b4047b80 1 -- 172.21.15.17:0/778942519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55edb0fdfbd0 msgr2=0x55edb1020210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:21.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.491+0000 7fa8b4047b80 1 --2- 172.21.15.17:0/778942519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55edb0fdfbd0 0x55edb1020210 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa89c009390 tx=0x7fa89c025040 comp rx=0 tx=0).stop 2023-10-06T04:44:21.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.492+0000 7fa8b4047b80 1 -- 172.21.15.17:0/778942519 shutdown_connections 2023-10-06T04:44:21.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.492+0000 7fa8b4047b80 1 --2- 172.21.15.17:0/778942519 >> [v2:172.21.15.17:6835/460551791,v1:172.21.15.17:6837/460551791] conn(0x55edb10297e0 0x55edb0fda4e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.492+0000 7fa8b4047b80 1 --2- 172.21.15.17:0/778942519 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55edb1025a90 0x55edb10292a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.492+0000 7fa8b4047b80 1 --2- 172.21.15.17:0/778942519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55edb0fdfbd0 0x55edb1020210 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.492+0000 7fa882ffd700 0 client.5154 ms_handle_reset on v2:172.21.15.17:6835/460551791 2023-10-06T04:44:21.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.492+0000 7fa8b4047b80 1 --2- 172.21.15.17:0/778942519 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55edb0fe19a0 0x55edb1020750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.492+0000 7fa8b4047b80 1 -- 172.21.15.17:0/778942519 >> 172.21.15.17:0/778942519 conn(0x55edb0fe0070 msgr2=0x55edb0fe0440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:21.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.492+0000 7fa8b4047b80 1 -- 172.21.15.17:0/778942519 shutdown_connections 2023-10-06T04:44:21.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.492+0000 7fa8b4047b80 1 -- 172.21.15.17:0/778942519 wait complete. 2023-10-06T04:44:21.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.492+0000 7fa8b4047b80 20 client.5154 trim_cache size 0 max 16384 2023-10-06T04:44:21.514 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-06T04:44:21.514 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "780777c4-2b25-4d35-9058-c9f2d62e3ad9", 2023-10-06T04:44:21.514 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2023-10-06T04:44:21.514 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4971, 2023-10-06T04:44:21.514 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2023-10-06T04:44:21.514 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2023-10-06T04:44:21.514 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2023-10-06T04:44:21.514 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 5.9109777460000004, 2023-10-06T04:44:21.514 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 16, 2023-10-06T04:44:21.514 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 32, 2023-10-06T04:44:21.514 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 32, 2023-10-06T04:44:21.515 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 13.783563102 2023-10-06T04:44:21.515 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-06T04:44:21.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.492+0000 7fa8aad4f700 1 -- 172.21.15.17:0/3410066460 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa884066f30 msgr2=0x7fa8840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:21.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.492+0000 7fa8aad4f700 1 --2- 172.21.15.17:0/3410066460 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa884066f30 0x7fa8840693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa89c009c90 tx=0x7fa89c008040 comp rx=0 tx=0).stop 2023-10-06T04:44:21.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.492+0000 7fa8aad4f700 1 -- 172.21.15.17:0/3410066460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8a415d610 msgr2=0x7fa8a40c7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:21.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.492+0000 7fa8aad4f700 1 --2- 172.21.15.17:0/3410066460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8a415d610 0x7fa8a40c7bc0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa8a40cbaa0 tx=0x7fa88c017000 comp rx=0 tx=0).stop 2023-10-06T04:44:21.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.492+0000 7fa8aad4f700 1 -- 172.21.15.17:0/3410066460 shutdown_connections 2023-10-06T04:44:21.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.492+0000 7fa8aad4f700 1 --2- 172.21.15.17:0/3410066460 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa884066f30 0x7fa8840693e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.492+0000 7fa8aad4f700 1 --2- 172.21.15.17:0/3410066460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8a415d610 0x7fa8a40c7bc0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.492+0000 7fa8aad4f700 1 --2- 172.21.15.17:0/3410066460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa8a40cb1b0 0x7fa8a40ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.492+0000 7fa8aad4f700 1 --2- 172.21.15.17:0/3410066460 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa8a41509a0 0x7fa8a40b5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.492+0000 7fa8aad4f700 1 -- 172.21.15.17:0/3410066460 >> 172.21.15.17:0/3410066460 conn(0x7fa8a4099960 msgr2=0x7fa8a40b1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:21.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.492+0000 7fa8aad4f700 1 -- 172.21.15.17:0/3410066460 shutdown_connections 2023-10-06T04:44:21.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.492+0000 7fa8aad4f700 1 -- 172.21.15.17:0/3410066460 wait complete. 2023-10-06T04:44:21.518 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:44:21.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.635+0000 7f11ceaf3700 1 Processor -- start 2023-10-06T04:44:21.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.635+0000 7f11ceaf3700 1 -- start start 2023-10-06T04:44:21.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.636+0000 7f11ceaf3700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f11c80cd760 0x7f11c80ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:21.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.636+0000 7f11ceaf3700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11c80ce840 0x7f11c80b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:21.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.636+0000 7f11ceaf3700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11c80cfc80 con 0x7f11c8159630 2023-10-06T04:44:21.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.636+0000 7f11ceaf3700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11c80cf070 con 0x7f11c80cd760 2023-10-06T04:44:21.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.636+0000 7f11ceaf3700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c80cf350 con 0x7f11c80ce840 2023-10-06T04:44:21.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.636+0000 7f11c7fff700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f11c80cd760 0x7f11c80ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:21.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.636+0000 7f11cc88f700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f11c8159630 0x7f11c80cd050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:44622/0 (socket says 172.21.15.17:44622) 2023-10-06T04:44:21.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.636+0000 7f11c7fff700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f11c80cd760 0x7f11c80ce300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60606/0 (socket says 172.21.15.17:60606) 2023-10-06T04:44:21.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.636+0000 7f11cc88f700 1 -- 172.21.15.17:0/2740689194 learned_addr learned my addr 172.21.15.17:0/2740689194 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:21.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.636+0000 7f11cd090700 1 --2- 172.21.15.17:0/2740689194 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11c80ce840 0x7f11c80b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:21.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.637+0000 7f11c7fff700 1 -- 172.21.15.17:0/2740689194 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11c80ce840 msgr2=0x7f11c80b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:21.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.637+0000 7f11c7fff700 1 --2- 172.21.15.17:0/2740689194 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11c80ce840 0x7f11c80b02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.637+0000 7f11c7fff700 1 -- 172.21.15.17:0/2740689194 >> v1:172.21.15.17:6789/0 conn(0x7f11c8159630 legacy=0x7f11c80cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:21.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.637+0000 7f11c7fff700 1 -- 172.21.15.17:0/2740689194 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c80cf630 con 0x7f11c80cd760 2023-10-06T04:44:21.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.637+0000 7f11c77fe700 1 -- 172.21.15.17:0/2740689194 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3786752665 0 0) 0x7f11c80cfc80 con 0x7f11c8159630 2023-10-06T04:44:21.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.637+0000 7f11c7fff700 1 --2- 172.21.15.17:0/2740689194 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11c80cd760 0x7f11c80ce300 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f11b8009e60 tx=0x7f11b8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d3edee4e074ca0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:21.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.637+0000 7f11c77fe700 1 -- 172.21.15.17:0/2740689194 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b800e070 con 0x7f11c80cd760 2023-10-06T04:44:21.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.637+0000 7f11c77fe700 1 -- 172.21.15.17:0/2740689194 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b800bc30 con 0x7f11c80cd760 2023-10-06T04:44:21.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.637+0000 7f11c77fe700 1 -- 172.21.15.17:0/2740689194 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b8012430 con 0x7f11c80cd760 2023-10-06T04:44:21.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.637+0000 7f11ceaf3700 1 -- 172.21.15.17:0/2740689194 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11c80cd760 msgr2=0x7f11c80ce300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:21.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.637+0000 7f11ceaf3700 1 --2- 172.21.15.17:0/2740689194 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11c80cd760 0x7f11c80ce300 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f11b8009e60 tx=0x7f11b8009780 comp rx=0 tx=0).stop 2023-10-06T04:44:21.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.637+0000 7f11ceaf3700 1 -- 172.21.15.17:0/2740689194 shutdown_connections 2023-10-06T04:44:21.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.637+0000 7f11ceaf3700 1 --2- 172.21.15.17:0/2740689194 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11c80ce840 0x7f11c80b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.637+0000 7f11ceaf3700 1 --2- 172.21.15.17:0/2740689194 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11c80cd760 0x7f11c80ce300 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.637+0000 7f11ceaf3700 1 -- 172.21.15.17:0/2740689194 >> 172.21.15.17:0/2740689194 conn(0x7f11c806cff0 msgr2=0x7f11c806d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:21.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.638+0000 7f11ceaf3700 1 -- 172.21.15.17:0/2740689194 shutdown_connections 2023-10-06T04:44:21.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.638+0000 7f11ceaf3700 1 -- 172.21.15.17:0/2740689194 wait complete. 2023-10-06T04:44:21.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.639+0000 7f11ceaf3700 1 Processor -- start 2023-10-06T04:44:21.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.639+0000 7f11ceaf3700 1 -- start start 2023-10-06T04:44:21.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.639+0000 7f11ceaf3700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11c80cd760 0x7f11c815cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:21.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.640+0000 7f11ceaf3700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11c80ce840 0x7f11c814e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:21.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.640+0000 7f11ceaf3700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11c8159630 0x7f11c815e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:21.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.640+0000 7f11ceaf3700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c815c860 con 0x7f11c80ce840 2023-10-06T04:44:21.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.640+0000 7f11ceaf3700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c814e790 con 0x7f11c80cd760 2023-10-06T04:44:21.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.640+0000 7f11ceaf3700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c80c8cf0 con 0x7f11c8159630 2023-10-06T04:44:21.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.640+0000 7f11c7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11c80ce840 0x7f11c814e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:21.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.640+0000 7f11c7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11c80ce840 0x7f11c814e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60610/0 (socket says 172.21.15.17:60610) 2023-10-06T04:44:21.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.640+0000 7f11c7fff700 1 -- 172.21.15.17:0/2533125917 learned_addr learned my addr 172.21.15.17:0/2533125917 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:21.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.640+0000 7f11cd090700 1 --2- 172.21.15.17:0/2533125917 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11c8159630 0x7f11c815e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:21.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.640+0000 7f11cc88f700 1 --2- 172.21.15.17:0/2533125917 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11c80cd760 0x7f11c815cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:21.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.640+0000 7f11c7fff700 1 -- 172.21.15.17:0/2533125917 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11c8159630 msgr2=0x7f11c815e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:21.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.640+0000 7f11c7fff700 1 --2- 172.21.15.17:0/2533125917 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11c8159630 0x7f11c815e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.640+0000 7f11c7fff700 1 -- 172.21.15.17:0/2533125917 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11c80cd760 msgr2=0x7f11c815cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:21.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.640+0000 7f11c7fff700 1 --2- 172.21.15.17:0/2533125917 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11c80cd760 0x7f11c815cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.640+0000 7f11c7fff700 1 -- 172.21.15.17:0/2533125917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b8009a20 con 0x7f11c80ce840 2023-10-06T04:44:21.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.640+0000 7f11c7fff700 1 --2- 172.21.15.17:0/2533125917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11c80ce840 0x7f11c814e250 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f11c80d16b0 tx=0x7f11b8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:21.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.640+0000 7f11c4ff9700 1 -- 172.21.15.17:0/2533125917 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b8012e80 con 0x7f11c80ce840 2023-10-06T04:44:21.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.640+0000 7f11c4ff9700 1 -- 172.21.15.17:0/2533125917 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b8027470 con 0x7f11c80ce840 2023-10-06T04:44:21.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.640+0000 7f11ceaf3700 1 -- 172.21.15.17:0/2533125917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c80c8fd0 con 0x7f11c80ce840 2023-10-06T04:44:21.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.640+0000 7f11c4ff9700 1 -- 172.21.15.17:0/2533125917 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b8027810 con 0x7f11c80ce840 2023-10-06T04:44:21.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.640+0000 7f11ceaf3700 1 -- 172.21.15.17:0/2533125917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c80c9590 con 0x7f11c80ce840 2023-10-06T04:44:21.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.641+0000 7f11ceaf3700 1 -- 172.21.15.17:0/2533125917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11c8063ff0 con 0x7f11c80ce840 2023-10-06T04:44:21.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.642+0000 7f11c4ff9700 1 -- 172.21.15.17:0/2533125917 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f11b8024070 con 0x7f11c80ce840 2023-10-06T04:44:21.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.642+0000 7f11c4ff9700 1 --2- 172.21.15.17:0/2533125917 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f11a8066f30 0x7f11a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:21.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.642+0000 7f11c4ff9700 1 -- 172.21.15.17:0/2533125917 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f11b8087250 con 0x7f11c80ce840 2023-10-06T04:44:21.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.642+0000 7f11cc88f700 1 --2- 172.21.15.17:0/2533125917 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f11a8066f30 0x7f11a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:21.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.643+0000 7f11cc88f700 1 --2- 172.21.15.17:0/2533125917 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f11a8066f30 0x7f11a80693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f11c0001750 tx=0x7f11c0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:21.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.647+0000 7f11c4ff9700 1 -- 172.21.15.17:0/2533125917 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f11b8054360 con 0x7f11c80ce840 2023-10-06T04:44:21.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.886+0000 7f11ceaf3700 1 -- 172.21.15.17:0/2533125917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f11c815fd10 con 0x7f11c80ce840 2023-10-06T04:44:21.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.886+0000 7f11c4ff9700 1 -- 172.21.15.17:0/2533125917 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f11b8057980 con 0x7f11c80ce840 2023-10-06T04:44:21.900 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T04:44:21.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.888+0000 7f11ceaf3700 1 -- 172.21.15.17:0/2533125917 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f11a8066f30 msgr2=0x7f11a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:21.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.888+0000 7f11ceaf3700 1 --2- 172.21.15.17:0/2533125917 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f11a8066f30 0x7f11a80693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f11c0001750 tx=0x7f11c0009040 comp rx=0 tx=0).stop 2023-10-06T04:44:21.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.888+0000 7f11ceaf3700 1 -- 172.21.15.17:0/2533125917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11c80ce840 msgr2=0x7f11c814e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:21.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.888+0000 7f11ceaf3700 1 --2- 172.21.15.17:0/2533125917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11c80ce840 0x7f11c814e250 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f11c80d16b0 tx=0x7f11b8019000 comp rx=0 tx=0).stop 2023-10-06T04:44:21.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.888+0000 7f11ceaf3700 1 -- 172.21.15.17:0/2533125917 shutdown_connections 2023-10-06T04:44:21.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.888+0000 7f11ceaf3700 1 --2- 172.21.15.17:0/2533125917 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f11a8066f30 0x7f11a80693e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.888+0000 7f11ceaf3700 1 --2- 172.21.15.17:0/2533125917 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11c8159630 0x7f11c815e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.888+0000 7f11ceaf3700 1 --2- 172.21.15.17:0/2533125917 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11c80cd760 0x7f11c815cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.888+0000 7f11ceaf3700 1 --2- 172.21.15.17:0/2533125917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11c80ce840 0x7f11c814e250 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:21.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.888+0000 7f11ceaf3700 1 -- 172.21.15.17:0/2533125917 >> 172.21.15.17:0/2533125917 conn(0x7f11c806cff0 msgr2=0x7f11c80b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:21.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.888+0000 7f11ceaf3700 1 -- 172.21.15.17:0/2533125917 shutdown_connections 2023-10-06T04:44:21.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:21.888+0000 7f11ceaf3700 1 -- 172.21.15.17:0/2533125917 wait complete. 2023-10-06T04:44:21.904 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T04:44:21.904 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:44:21.904 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2023-10-06T04:44:21.904 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T04:44:21.904 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T04:44:21.904 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T04:44:21.904 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T04:44:21.904 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:44:21.904 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:44:21.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:21.905 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2023-10-06T04:44:21.920 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:44:21.921 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:44:21.921 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:44:21.921 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:21.921 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2023-10-06T04:44:21.921 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:21.921 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:44:21.921 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:44:21.921 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2023-10-06T04:44:21.922 INFO:teuthology.orchestra.run.smithi017.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:44:21.922 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:44:21.922 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2023-10-06T04:44:21.922 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T04:44:21.922 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 42435sec preferred_lft 42435sec 2023-10-06T04:44:21.922 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link noprefixroute 2023-10-06T04:44:21.923 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:21.923 INFO:teuthology.orchestra.run.smithi017.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:44:21.923 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:44:21.923 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2023-10-06T04:44:21.923 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:44:21.924 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:44:21.924 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2023-10-06T04:44:21.924 INFO:teuthology.orchestra.run.smithi017.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:44:21.924 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 32:4e:22:db:35:54 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:44:21.924 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T04:44:21.924 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:21.924 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::dc99:b6ff:fe76:4553/64 scope link 2023-10-06T04:44:21.924 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:21.924 INFO:teuthology.orchestra.run.smithi017.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T04:44:21.925 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 76:58:b8:0a:23:ad brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T04:44:21.925 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::7458:b8ff:fe0a:23ad/64 scope link 2023-10-06T04:44:21.925 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:21.925 INFO:teuthology.orchestra.run.smithi017.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T04:44:21.925 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 32:4e:22:db:35:54 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T04:44:21.925 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::304e:22ff:fedb:3554/64 scope link 2023-10-06T04:44:21.925 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:44:21.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:21.928 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:44:22.011 INFO:teuthology.orchestra.run.smithi017.stdout:1 2023-10-06T04:44:22.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:22.011 DEBUG:teuthology.orchestra.run.smithi017:> route 2023-10-06T04:44:22.078 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2023-10-06T04:44:22.078 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:44:22.078 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T04:44:22.078 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T04:44:22.078 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:44:22.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:22.079 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-10-06T04:44:22.079 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-10-06T04:44:22.079 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T04:44:22.079 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T04:44:22.079 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T04:44:22.079 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-10-06T04:44:22.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:22.188 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2023-10-06T04:44:22.213 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T04:44:22.213 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T04:44:22.213 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:44:22.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:22.214 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2023-10-06T04:44:22.292 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:44:22.293 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T04:44:22.355 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:44:22.355 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:44:22.355 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T04:44:22.415 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T04:44:22.415 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:44:22.416 DEBUG:teuthology.orchestra.run.smithi017:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T04:44:22.500 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T04:44:22.500 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T04:44:22.501 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-10-06T04:44:22.509 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T04:44:22.509 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T04:44:22.509 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-10-06T04:44:22.509 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.136:3300,172.21.15.136:3301" 2023-10-06T04:44:22.509 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:44:22.531 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T04:44:22.531 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T04:44:22.531 INFO:teuthology.orchestra.run.smithi017.stdout:invalid new device string format 2023-10-06T04:44:22.531 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.136:3300,172.21.15.136:3301" 2023-10-06T04:44:22.531 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:44:22.531 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:6789,172.21.15.136:6789,172.21.15.136:6790" 2023-10-06T04:44:22.532 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.17:6789,172.21.15.136:6789,172.21.15.136:6790:/ 2023-10-06T04:44:22.532 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=780777c4-2b25-4d35-9058-c9f2d62e3ad9" will pass to kernel 2023-10-06T04:44:22.534 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T04:44:22.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:22.534 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T04:44:22.605 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_symlink_recovery false 2023-10-06T04:44:22.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.766+0000 7f863eaad700 1 Processor -- start 2023-10-06T04:44:22.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.766+0000 7f863eaad700 1 -- start start 2023-10-06T04:44:22.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.767+0000 7f863eaad700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8638159b10 0x7f863806f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:22.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.767+0000 7f863eaad700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86380d1120 con 0x7f86380cabf0 2023-10-06T04:44:22.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.767+0000 7f863eaad700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86380d1400 con 0x7f863806d140 2023-10-06T04:44:22.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.767+0000 7f863eaad700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f863806e920 con 0x7f8638159b10 2023-10-06T04:44:22.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.767+0000 7f8637fff700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8638159b10 0x7f863806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:22.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.767+0000 7f863c849700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f86380cabf0 0x7f86380c7660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:44630/0 (socket says 172.21.15.17:44630) 2023-10-06T04:44:22.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.767+0000 7f8637fff700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8638159b10 0x7f863806f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60612/0 (socket says 172.21.15.17:60612) 2023-10-06T04:44:22.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.767+0000 7f863c849700 1 -- 172.21.15.17:0/2292181484 learned_addr learned my addr 172.21.15.17:0/2292181484 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:22.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.767+0000 7f8637fff700 1 -- 172.21.15.17:0/2292181484 >> v1:172.21.15.136:6789/0 conn(0x7f863806d140 legacy=0x7f863806f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:22.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.767+0000 7f8637fff700 1 -- 172.21.15.17:0/2292181484 >> v1:172.21.15.17:6789/0 conn(0x7f86380cabf0 legacy=0x7f86380c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:22.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.767+0000 7f8637fff700 1 -- 172.21.15.17:0/2292181484 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f863806ec00 con 0x7f8638159b10 2023-10-06T04:44:22.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.767+0000 7f8637fff700 1 --2- 172.21.15.17:0/2292181484 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8638159b10 0x7f863806f120 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8628009e60 tx=0x7f8628009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee1ce80c9f1d3f7e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:22.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.768+0000 7f86377fe700 1 -- 172.21.15.17:0/2292181484 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862800e070 con 0x7f8638159b10 2023-10-06T04:44:22.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.768+0000 7f86377fe700 1 -- 172.21.15.17:0/2292181484 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862800bc30 con 0x7f8638159b10 2023-10-06T04:44:22.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.768+0000 7f86377fe700 1 -- 172.21.15.17:0/2292181484 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8628012430 con 0x7f8638159b10 2023-10-06T04:44:22.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.768+0000 7f863eaad700 1 -- 172.21.15.17:0/2292181484 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8638159b10 msgr2=0x7f863806f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:22.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.768+0000 7f863eaad700 1 --2- 172.21.15.17:0/2292181484 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8638159b10 0x7f863806f120 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8628009e60 tx=0x7f8628009780 comp rx=0 tx=0).stop 2023-10-06T04:44:22.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.768+0000 7f863eaad700 1 -- 172.21.15.17:0/2292181484 shutdown_connections 2023-10-06T04:44:22.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.768+0000 7f863eaad700 1 --2- 172.21.15.17:0/2292181484 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8638159b10 0x7f863806f120 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:22.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.768+0000 7f863eaad700 1 -- 172.21.15.17:0/2292181484 >> 172.21.15.17:0/2292181484 conn(0x7f863806cd40 msgr2=0x7f86380d0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:22.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.768+0000 7f863eaad700 1 -- 172.21.15.17:0/2292181484 shutdown_connections 2023-10-06T04:44:22.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.768+0000 7f863eaad700 1 -- 172.21.15.17:0/2292181484 wait complete. 2023-10-06T04:44:22.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.769+0000 7f863eaad700 1 Processor -- start 2023-10-06T04:44:22.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.769+0000 7f863eaad700 1 -- start start 2023-10-06T04:44:22.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.770+0000 7f863eaad700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f863806d140 0x7f86380c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:22.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.770+0000 7f863eaad700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86380cabf0 0x7f86380b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:22.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.770+0000 7f863eaad700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8638159b10 0x7f86380c5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:22.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.770+0000 7f863eaad700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86380b3520 con 0x7f8638159b10 2023-10-06T04:44:22.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.770+0000 7f863eaad700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863815ea70 con 0x7f863806d140 2023-10-06T04:44:22.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.770+0000 7f863eaad700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f863815ed50 con 0x7f86380cabf0 2023-10-06T04:44:22.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.770+0000 7f863d04a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8638159b10 0x7f86380c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:22.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.770+0000 7f863d04a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8638159b10 0x7f86380c5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60624/0 (socket says 172.21.15.17:60624) 2023-10-06T04:44:22.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.770+0000 7f863d04a700 1 -- 172.21.15.17:0/600661166 learned_addr learned my addr 172.21.15.17:0/600661166 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:22.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.770+0000 7f8637fff700 1 --2- 172.21.15.17:0/600661166 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86380cabf0 0x7f86380b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:22.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.770+0000 7f863c849700 1 --2- 172.21.15.17:0/600661166 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f863806d140 0x7f86380c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:22.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.771+0000 7f863d04a700 1 -- 172.21.15.17:0/600661166 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86380cabf0 msgr2=0x7f86380b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:22.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.771+0000 7f863d04a700 1 --2- 172.21.15.17:0/600661166 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86380cabf0 0x7f86380b5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:22.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.771+0000 7f863d04a700 1 -- 172.21.15.17:0/600661166 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f863806d140 msgr2=0x7f86380c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:22.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.771+0000 7f863d04a700 1 --2- 172.21.15.17:0/600661166 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f863806d140 0x7f86380c65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:22.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.771+0000 7f863d04a700 1 -- 172.21.15.17:0/600661166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8628009a20 con 0x7f8638159b10 2023-10-06T04:44:22.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.771+0000 7f863c849700 1 --2- 172.21.15.17:0/600661166 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f863806d140 0x7f86380c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:22.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.771+0000 7f863d04a700 1 --2- 172.21.15.17:0/600661166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8638159b10 0x7f86380c5050 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f862000c560 tx=0x7f8620007e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:22.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.771+0000 7f8634ff9700 1 -- 172.21.15.17:0/600661166 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8620011590 con 0x7f8638159b10 2023-10-06T04:44:22.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.771+0000 7f8634ff9700 1 -- 172.21.15.17:0/600661166 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86200116f0 con 0x7f8638159b10 2023-10-06T04:44:22.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.771+0000 7f863eaad700 1 -- 172.21.15.17:0/600661166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86380b3730 con 0x7f8638159b10 2023-10-06T04:44:22.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.771+0000 7f8634ff9700 1 -- 172.21.15.17:0/600661166 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8620011a90 con 0x7f8638159b10 2023-10-06T04:44:22.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.771+0000 7f863eaad700 1 -- 172.21.15.17:0/600661166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86380b6420 con 0x7f8638159b10 2023-10-06T04:44:22.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.772+0000 7f863eaad700 1 -- 172.21.15.17:0/600661166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86380b3c50 con 0x7f8638159b10 2023-10-06T04:44:22.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.772+0000 7f8634ff9700 1 -- 172.21.15.17:0/600661166 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f862001b3b0 con 0x7f8638159b10 2023-10-06T04:44:22.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.772+0000 7f8634ff9700 1 --2- 172.21.15.17:0/600661166 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8618066f30 0x7f86180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:22.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.773+0000 7f8634ff9700 1 -- 172.21.15.17:0/600661166 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8620083b20 con 0x7f8638159b10 2023-10-06T04:44:22.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.773+0000 7f863c849700 1 --2- 172.21.15.17:0/600661166 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8618066f30 0x7f86180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:22.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.773+0000 7f863c849700 1 --2- 172.21.15.17:0/600661166 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8618066f30 0x7f86180693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f86300010e0 tx=0x7f8630009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:22.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.777+0000 7f8634ff9700 1 -- 172.21.15.17:0/600661166 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f86380b3c50 con 0x7f8638159b10 2023-10-06T04:44:22.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.970+0000 7f863eaad700 1 -- 172.21.15.17:0/600661166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mds_symlink_recovery}] v 0) v1 -- 0x7f86380b3c50 con 0x7f8638159b10 2023-10-06T04:44:22.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.973+0000 7f8634ff9700 1 -- 172.21.15.17:0/600661166 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_symlink_recovery}]=0 v11)=0 v11) v1 ==== 122+0+0 (secure 0 0 0) 0x7f86380b3c50 con 0x7f8638159b10 2023-10-06T04:44:22.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.975+0000 7f863eaad700 1 -- 172.21.15.17:0/600661166 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8618066f30 msgr2=0x7f86180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:22.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.975+0000 7f863eaad700 1 --2- 172.21.15.17:0/600661166 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8618066f30 0x7f86180693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f86300010e0 tx=0x7f8630009040 comp rx=0 tx=0).stop 2023-10-06T04:44:22.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.975+0000 7f863eaad700 1 -- 172.21.15.17:0/600661166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8638159b10 msgr2=0x7f86380c5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:22.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.975+0000 7f863eaad700 1 --2- 172.21.15.17:0/600661166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8638159b10 0x7f86380c5050 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f862000c560 tx=0x7f8620007e90 comp rx=0 tx=0).stop 2023-10-06T04:44:22.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.975+0000 7f863eaad700 1 -- 172.21.15.17:0/600661166 shutdown_connections 2023-10-06T04:44:22.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.975+0000 7f863eaad700 1 --2- 172.21.15.17:0/600661166 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8618066f30 0x7f86180693e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:22.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.976+0000 7f863eaad700 1 --2- 172.21.15.17:0/600661166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8638159b10 0x7f86380c5050 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:22.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.976+0000 7f863eaad700 1 --2- 172.21.15.17:0/600661166 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f863806d140 0x7f86380c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:22.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.976+0000 7f863eaad700 1 --2- 172.21.15.17:0/600661166 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86380cabf0 0x7f86380b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:22.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.976+0000 7f863eaad700 1 -- 172.21.15.17:0/600661166 >> 172.21.15.17:0/600661166 conn(0x7f863806cd40 msgr2=0x7f8638158be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:22.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.976+0000 7f863eaad700 1 -- 172.21.15.17:0/600661166 shutdown_connections 2023-10-06T04:44:22.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:22.976+0000 7f863eaad700 1 -- 172.21.15.17:0/600661166 wait complete. 2023-10-06T04:44:22.990 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:44:22.991 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir sym_dir0) 2023-10-06T04:44:23.010 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:44:23.011 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch sym_dir0/file1) 2023-10-06T04:44:23.068 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:44:23.068 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln -s sym_dir0/file1 sym_dir0/symlink_file1) 2023-10-06T04:44:23.124 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:44:23.124 DEBUG:teuthology.orchestra.run.smithi017:> import os 2023-10-06T04:44:23.124 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2023-10-06T04:44:23.125 DEBUG:teuthology.orchestra.run.smithi017:> 2023-10-06T04:44:23.125 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/sym_dir0/symlink_file1").st_ino) 2023-10-06T04:44:23.125 DEBUG:teuthology.orchestra.run.smithi017:> ' 2023-10-06T04:44:23.230 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628278 2023-10-06T04:44:23.419 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:44:23.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.578+0000 7fc8aaaee700 1 Processor -- start 2023-10-06T04:44:23.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.578+0000 7fc8aaaee700 1 -- start start 2023-10-06T04:44:23.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.579+0000 7fc8aaaee700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc8a4142d50 0x7fc8a40c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:23.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.579+0000 7fc8aaaee700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc8a406c560 0x7fc8a406c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:23.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.579+0000 7fc8aaaee700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8a406cf10 con 0x7fc8a40caf00 2023-10-06T04:44:23.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.579+0000 7fc8aaaee700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8a40c3070 con 0x7fc8a4142d50 2023-10-06T04:44:23.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.579+0000 7fc8aaaee700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a40c3a40 con 0x7fc8a406c560 2023-10-06T04:44:23.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.579+0000 7fc8a3fff700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc8a406c560 0x7fc8a406c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:23.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.579+0000 7fc8a888a700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc8a4142d50 0x7fc8a40c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:23.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.579+0000 7fc8a908b700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fc8a40caf00 0x7fc8a40cb380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.17:57510/0 (socket says 172.21.15.17:57510) 2023-10-06T04:44:23.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.579+0000 7fc8a3fff700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc8a406c560 0x7fc8a406c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.17:47140/0 (socket says 172.21.15.17:47140) 2023-10-06T04:44:23.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.579+0000 7fc8a908b700 1 -- 172.21.15.17:0/3373120503 learned_addr learned my addr 172.21.15.17:0/3373120503 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:23.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.580+0000 7fc8a3fff700 1 -- 172.21.15.17:0/3373120503 >> v2:172.21.15.136:3300/0 conn(0x7fc8a4142d50 msgr2=0x7fc8a40c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:23.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.580+0000 7fc8a3fff700 1 --2- 172.21.15.17:0/3373120503 >> v2:172.21.15.136:3300/0 conn(0x7fc8a4142d50 0x7fc8a40c3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:23.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.580+0000 7fc8a3fff700 1 -- 172.21.15.17:0/3373120503 >> v1:172.21.15.136:6789/0 conn(0x7fc8a40caf00 legacy=0x7fc8a40cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:23.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.580+0000 7fc8a3fff700 1 -- 172.21.15.17:0/3373120503 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a40cbb50 con 0x7fc8a406c560 2023-10-06T04:44:23.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.580+0000 7fc8a3fff700 1 --2- 172.21.15.17:0/3373120503 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc8a406c560 0x7fc8a406c9d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc8980098e0 tx=0x7fc8980091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90c0067b9ad57238 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:23.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.580+0000 7fc8a37fe700 1 -- 172.21.15.17:0/3373120503 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89800b640 con 0x7fc8a406c560 2023-10-06T04:44:23.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.580+0000 7fc8a37fe700 1 -- 172.21.15.17:0/3373120503 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc89800b7a0 con 0x7fc8a406c560 2023-10-06T04:44:23.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.580+0000 7fc8a37fe700 1 -- 172.21.15.17:0/3373120503 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89800bb40 con 0x7fc8a406c560 2023-10-06T04:44:23.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.581+0000 7fc8aaaee700 1 -- 172.21.15.17:0/3373120503 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc8a406c560 msgr2=0x7fc8a406c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:23.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.581+0000 7fc8aaaee700 1 --2- 172.21.15.17:0/3373120503 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc8a406c560 0x7fc8a406c9d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc8980098e0 tx=0x7fc8980091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:23.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.581+0000 7fc8aaaee700 1 -- 172.21.15.17:0/3373120503 shutdown_connections 2023-10-06T04:44:23.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.581+0000 7fc8aaaee700 1 --2- 172.21.15.17:0/3373120503 >> v2:172.21.15.136:3300/0 conn(0x7fc8a4142d50 0x7fc8a40c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:23.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.581+0000 7fc8aaaee700 1 --2- 172.21.15.17:0/3373120503 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc8a406c560 0x7fc8a406c9d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:23.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.581+0000 7fc8aaaee700 1 -- 172.21.15.17:0/3373120503 >> 172.21.15.17:0/3373120503 conn(0x7fc8a406e140 msgr2=0x7fc8a40cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:23.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.581+0000 7fc8aaaee700 1 -- 172.21.15.17:0/3373120503 shutdown_connections 2023-10-06T04:44:23.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.581+0000 7fc8aaaee700 1 -- 172.21.15.17:0/3373120503 wait complete. 2023-10-06T04:44:23.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.582+0000 7fc8aaaee700 1 Processor -- start 2023-10-06T04:44:23.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.582+0000 7fc8aaaee700 1 -- start start 2023-10-06T04:44:23.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.583+0000 7fc8aaaee700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8a406c560 0x7fc8a416ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:23.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.583+0000 7fc8aaaee700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc8a40caf00 0x7fc8a415c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:23.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.583+0000 7fc8aaaee700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc8a4142d50 0x7fc8a416d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:23.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.583+0000 7fc8aaaee700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a415cc00 con 0x7fc8a406c560 2023-10-06T04:44:23.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.583+0000 7fc8aaaee700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a40b07c0 con 0x7fc8a40caf00 2023-10-06T04:44:23.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.583+0000 7fc8aaaee700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a415c6c0 con 0x7fc8a4142d50 2023-10-06T04:44:23.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.583+0000 7fc8a888a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8a406c560 0x7fc8a416ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:23.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.583+0000 7fc8a888a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8a406c560 0x7fc8a416ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60626/0 (socket says 172.21.15.17:60626) 2023-10-06T04:44:23.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.583+0000 7fc8a888a700 1 -- 172.21.15.17:0/2443638202 learned_addr learned my addr 172.21.15.17:0/2443638202 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:23.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.583+0000 7fc8a908b700 1 --2- 172.21.15.17:0/2443638202 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc8a4142d50 0x7fc8a416d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:23.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.583+0000 7fc8a3fff700 1 --2- 172.21.15.17:0/2443638202 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc8a40caf00 0x7fc8a415c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:23.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.583+0000 7fc8a888a700 1 -- 172.21.15.17:0/2443638202 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc8a4142d50 msgr2=0x7fc8a416d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:23.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.583+0000 7fc8a888a700 1 --2- 172.21.15.17:0/2443638202 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc8a4142d50 0x7fc8a416d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:23.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.583+0000 7fc8a888a700 1 -- 172.21.15.17:0/2443638202 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc8a40caf00 msgr2=0x7fc8a415c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:23.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.583+0000 7fc8a888a700 1 --2- 172.21.15.17:0/2443638202 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc8a40caf00 0x7fc8a415c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:23.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.583+0000 7fc8a888a700 1 -- 172.21.15.17:0/2443638202 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc898009420 con 0x7fc8a406c560 2023-10-06T04:44:23.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.583+0000 7fc8a908b700 1 --2- 172.21.15.17:0/2443638202 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc8a4142d50 0x7fc8a416d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:23.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.583+0000 7fc8a3fff700 1 --2- 172.21.15.17:0/2443638202 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc8a40caf00 0x7fc8a415c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:23.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.583+0000 7fc8a888a700 1 --2- 172.21.15.17:0/2443638202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8a406c560 0x7fc8a416ddd0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc89400e930 tx=0x7fc8940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:23.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.583+0000 7fc8a0ff9700 1 -- 172.21.15.17:0/2443638202 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89400eed0 con 0x7fc8a406c560 2023-10-06T04:44:23.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.583+0000 7fc8a0ff9700 1 -- 172.21.15.17:0/2443638202 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc89400c850 con 0x7fc8a406c560 2023-10-06T04:44:23.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.583+0000 7fc8aaaee700 1 -- 172.21.15.17:0/2443638202 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8a415c920 con 0x7fc8a406c560 2023-10-06T04:44:23.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.583+0000 7fc8a0ff9700 1 -- 172.21.15.17:0/2443638202 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89400cbf0 con 0x7fc8a406c560 2023-10-06T04:44:23.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.584+0000 7fc8aaaee700 1 -- 172.21.15.17:0/2443638202 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a40b0450 con 0x7fc8a406c560 2023-10-06T04:44:23.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.585+0000 7fc8aaaee700 1 -- 172.21.15.17:0/2443638202 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8a4063ff0 con 0x7fc8a406c560 2023-10-06T04:44:23.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.585+0000 7fc8a0ff9700 1 -- 172.21.15.17:0/2443638202 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc894013470 con 0x7fc8a406c560 2023-10-06T04:44:23.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.585+0000 7fc8a0ff9700 1 --2- 172.21.15.17:0/2443638202 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc890066f30 0x7fc8900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:23.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.585+0000 7fc8a0ff9700 1 -- 172.21.15.17:0/2443638202 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc894084900 con 0x7fc8a406c560 2023-10-06T04:44:23.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.585+0000 7fc8a3fff700 1 --2- 172.21.15.17:0/2443638202 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc890066f30 0x7fc8900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:23.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.586+0000 7fc8a3fff700 1 --2- 172.21.15.17:0/2443638202 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc890066f30 0x7fc8900693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc8980093f0 tx=0x7fc898017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:23.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.590+0000 7fc8a0ff9700 1 -- 172.21.15.17:0/2443638202 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc894051a10 con 0x7fc8a406c560 2023-10-06T04:44:23.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.830+0000 7fc8aaaee700 1 -- 172.21.15.17:0/2443638202 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8a40c2740 con 0x7fc8a406c560 2023-10-06T04:44:23.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.830+0000 7fc8a0ff9700 1 -- 172.21.15.17:0/2443638202 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4597 (secure 0 0 0) 0x7fc894055030 con 0x7fc8a406c560 2023-10-06T04:44:23.833 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:23.833 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6834/3741747962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3741747962},{"type":"v1","addr":"172.21.15.136:6834","nonce":3741747962}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4688,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/264192509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6833","nonce":264192509},{"type":"v1","addr":"172.21.15.136:6835","nonce":264192509}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4909,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6836/1154731767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1154731767},{"type":"v1","addr":"172.21.15.17:6836","nonce":1154731767}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:44:14.988901+0000","modified":"2023-10-06T04:44:18.598280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4971":{"gid":4971,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6837/460551791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6835","nonce":460551791},{"type":"v1","addr":"172.21.15.17:6837","nonce":460551791}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:44:23.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.833+0000 7fc8aaaee700 1 -- 172.21.15.17:0/2443638202 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc890066f30 msgr2=0x7fc8900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:23.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.833+0000 7fc8aaaee700 1 --2- 172.21.15.17:0/2443638202 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc890066f30 0x7fc8900693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc8980093f0 tx=0x7fc898017000 comp rx=0 tx=0).stop 2023-10-06T04:44:23.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.833+0000 7fc8aaaee700 1 -- 172.21.15.17:0/2443638202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8a406c560 msgr2=0x7fc8a416ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:23.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.833+0000 7fc8aaaee700 1 --2- 172.21.15.17:0/2443638202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8a406c560 0x7fc8a416ddd0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc89400e930 tx=0x7fc8940091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:23.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.833+0000 7fc8aaaee700 1 -- 172.21.15.17:0/2443638202 shutdown_connections 2023-10-06T04:44:23.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.833+0000 7fc8aaaee700 1 --2- 172.21.15.17:0/2443638202 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc890066f30 0x7fc8900693e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:23.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.833+0000 7fc8aaaee700 1 --2- 172.21.15.17:0/2443638202 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc8a4142d50 0x7fc8a416d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:23.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.833+0000 7fc8aaaee700 1 --2- 172.21.15.17:0/2443638202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8a406c560 0x7fc8a416ddd0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:23.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.833+0000 7fc8aaaee700 1 --2- 172.21.15.17:0/2443638202 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc8a40caf00 0x7fc8a415c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:23.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.833+0000 7fc8aaaee700 1 -- 172.21.15.17:0/2443638202 >> 172.21.15.17:0/2443638202 conn(0x7fc8a406e140 msgr2=0x7fc8a4141f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:23.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.833+0000 7fc8aaaee700 1 -- 172.21.15.17:0/2443638202 shutdown_connections 2023-10-06T04:44:23.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:23.833+0000 7fc8aaaee700 1 -- 172.21.15.17:0/2443638202 wait complete. 2023-10-06T04:44:23.837 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 16 2023-10-06T04:44:23.847 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2023-10-06T04:44:23.998 INFO:teuthology.orchestra.run.smithi017.stdout:{"message":"","return_code":0} 2023-10-06T04:44:23.998 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-10-06T04:44:23.999 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f6.00000000 symlink 2023-10-06T04:44:24.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.035+0000 7f02c7392000 1 Processor -- start 2023-10-06T04:44:24.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.035+0000 7f02c7392000 1 -- start start 2023-10-06T04:44:24.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.035+0000 7f02c7392000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02ac0030b0 0x561bb7d9d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:24.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.035+0000 7f02c7392000 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x561bb7db0fc0 0x561bb7e3ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:24.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.035+0000 7f02c7392000 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561bb7e54ce0 0x561bb7e550b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:24.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.035+0000 7f02c7392000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bb7d18320 con 0x7f02ac0030b0 2023-10-06T04:44:24.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.035+0000 7f02c7392000 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bb7cbc980 con 0x561bb7e54ce0 2023-10-06T04:44:24.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.035+0000 7f02c7392000 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x561bb7cbc620 con 0x561bb7db0fc0 2023-10-06T04:44:24.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.036+0000 7f02c05cd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02ac0030b0 0x561bb7d9d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:24.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.036+0000 7f02c05cd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02ac0030b0 0x561bb7d9d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60650/0 (socket says 172.21.15.17:60650) 2023-10-06T04:44:24.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.036+0000 7f02c05cd700 1 -- 172.21.15.17:0/19864327 learned_addr learned my addr 172.21.15.17:0/19864327 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:24.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.036+0000 7f02bfdcc700 1 --2- 172.21.15.17:0/19864327 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x561bb7db0fc0 0x561bb7e3ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:24.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.036+0000 7f02c0dce700 1 --2- 172.21.15.17:0/19864327 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561bb7e54ce0 0x561bb7e550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:24.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.036+0000 7f02c05cd700 1 -- 172.21.15.17:0/19864327 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x561bb7db0fc0 msgr2=0x561bb7e3ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:24.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.036+0000 7f02c05cd700 1 --2- 172.21.15.17:0/19864327 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x561bb7db0fc0 0x561bb7e3ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:24.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.036+0000 7f02c05cd700 1 -- 172.21.15.17:0/19864327 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561bb7e54ce0 msgr2=0x561bb7e550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:24.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.036+0000 7f02c05cd700 1 --2- 172.21.15.17:0/19864327 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561bb7e54ce0 0x561bb7e550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:24.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.036+0000 7f02c05cd700 1 -- 172.21.15.17:0/19864327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561bb7cbeae0 con 0x7f02ac0030b0 2023-10-06T04:44:24.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.036+0000 7f02bfdcc700 1 --2- 172.21.15.17:0/19864327 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x561bb7db0fc0 0x561bb7e3ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:24.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.036+0000 7f02c0dce700 1 --2- 172.21.15.17:0/19864327 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561bb7e54ce0 0x561bb7e550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:24.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.036+0000 7f02c05cd700 1 --2- 172.21.15.17:0/19864327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02ac0030b0 0x561bb7d9d660 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f02a80097d0 tx=0x7f02a8005d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b5644ed4c363551 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:24.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.036+0000 7f02bedca700 1 -- 172.21.15.17:0/19864327 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a8008950 con 0x7f02ac0030b0 2023-10-06T04:44:24.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.036+0000 7f02bedca700 1 -- 172.21.15.17:0/19864327 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a8010040 con 0x7f02ac0030b0 2023-10-06T04:44:24.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.036+0000 7f02bedca700 1 -- 172.21.15.17:0/19864327 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a8008cc0 con 0x7f02ac0030b0 2023-10-06T04:44:24.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.037+0000 7f02c7392000 1 -- 172.21.15.17:0/19864327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02ac0030b0 msgr2=0x561bb7d9d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:24.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.037+0000 7f02c7392000 1 --2- 172.21.15.17:0/19864327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02ac0030b0 0x561bb7d9d660 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f02a80097d0 tx=0x7f02a8005d10 comp rx=0 tx=0).stop 2023-10-06T04:44:24.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.037+0000 7f02c7392000 1 -- 172.21.15.17:0/19864327 shutdown_connections 2023-10-06T04:44:24.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.037+0000 7f02c7392000 1 --2- 172.21.15.17:0/19864327 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561bb7e54ce0 0x561bb7e550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:24.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.037+0000 7f02c7392000 1 --2- 172.21.15.17:0/19864327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02ac0030b0 0x561bb7d9d660 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:24.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.037+0000 7f02c7392000 1 --2- 172.21.15.17:0/19864327 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x561bb7db0fc0 0x561bb7e3ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:24.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.037+0000 7f02c7392000 1 -- 172.21.15.17:0/19864327 >> 172.21.15.17:0/19864327 conn(0x561bb7d72a90 msgr2=0x561bb7e42330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:24.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.037+0000 7f02c7392000 1 -- 172.21.15.17:0/19864327 shutdown_connections 2023-10-06T04:44:24.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.037+0000 7f02c7392000 1 -- 172.21.15.17:0/19864327 wait complete. 2023-10-06T04:44:24.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.037+0000 7f02c7392000 1 Processor -- start 2023-10-06T04:44:24.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.037+0000 7f02c7392000 1 -- start start 2023-10-06T04:44:24.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.038+0000 7f02c7392000 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561bb7db0fc0 0x561bb7e5caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:24.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.038+0000 7f02c7392000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561bb7e54ce0 0x561bb7e5d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:24.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.038+0000 7f02c7392000 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f02ac0030b0 0x561bb7e30860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:24.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.038+0000 7f02c7392000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bb7cb3400 con 0x561bb7e54ce0 2023-10-06T04:44:24.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.038+0000 7f02c7392000 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bb7e39d40 con 0x561bb7db0fc0 2023-10-06T04:44:24.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.038+0000 7f02c7392000 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x561bb7e38e20 con 0x7f02ac0030b0 2023-10-06T04:44:24.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.038+0000 7f02bfdcc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561bb7e54ce0 0x561bb7e5d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:24.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.038+0000 7f02bfdcc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561bb7e54ce0 0x561bb7e5d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60660/0 (socket says 172.21.15.17:60660) 2023-10-06T04:44:24.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.038+0000 7f02bfdcc700 1 -- 172.21.15.17:0/816373024 learned_addr learned my addr 172.21.15.17:0/816373024 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:24.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.038+0000 7f02c05cd700 1 --2- 172.21.15.17:0/816373024 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561bb7db0fc0 0x561bb7e5caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:24.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.038+0000 7f02c0dce700 1 --2- 172.21.15.17:0/816373024 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f02ac0030b0 0x561bb7e30860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:24.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.038+0000 7f02bfdcc700 1 -- 172.21.15.17:0/816373024 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f02ac0030b0 msgr2=0x561bb7e30860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:24.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.038+0000 7f02bfdcc700 1 --2- 172.21.15.17:0/816373024 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f02ac0030b0 0x561bb7e30860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:24.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.038+0000 7f02bfdcc700 1 -- 172.21.15.17:0/816373024 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561bb7db0fc0 msgr2=0x561bb7e5caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:24.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.038+0000 7f02bfdcc700 1 --2- 172.21.15.17:0/816373024 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561bb7db0fc0 0x561bb7e5caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:24.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.038+0000 7f02bfdcc700 1 -- 172.21.15.17:0/816373024 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a8009430 con 0x561bb7e54ce0 2023-10-06T04:44:24.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.038+0000 7f02c0dce700 1 --2- 172.21.15.17:0/816373024 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f02ac0030b0 0x561bb7e30860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:24.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.038+0000 7f02bfdcc700 1 --2- 172.21.15.17:0/816373024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561bb7e54ce0 0x561bb7e5d030 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f02b000e7a0 tx=0x7f02b0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:24.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.039+0000 7f02bd5c7700 1 -- 172.21.15.17:0/816373024 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b0009580 con 0x561bb7e54ce0 2023-10-06T04:44:24.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.039+0000 7f02bd5c7700 1 -- 172.21.15.17:0/816373024 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b000bb80 con 0x561bb7e54ce0 2023-10-06T04:44:24.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.039+0000 7f02c7392000 1 -- 172.21.15.17:0/816373024 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561bb7cbe540 con 0x561bb7e54ce0 2023-10-06T04:44:24.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.039+0000 7f02bd5c7700 1 -- 172.21.15.17:0/816373024 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b000b8b0 con 0x561bb7e54ce0 2023-10-06T04:44:24.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.039+0000 7f02c7392000 1 -- 172.21.15.17:0/816373024 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561bb7e39360 con 0x561bb7e54ce0 2023-10-06T04:44:24.049 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:44:24.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.040+0000 7f02bd5c7700 1 -- 172.21.15.17:0/816373024 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f02b0017660 con 0x561bb7e54ce0 2023-10-06T04:44:24.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.040+0000 7f02bd5c7700 1 --2- 172.21.15.17:0/816373024 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f02a00658c0 0x7f02a0067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:24.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.040+0000 7f02bd5c7700 1 -- 172.21.15.17:0/816373024 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f02b0084eb0 con 0x561bb7e54ce0 2023-10-06T04:44:24.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.040+0000 7f02c05cd700 1 --2- 172.21.15.17:0/816373024 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f02a00658c0 0x7f02a0067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:24.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.041+0000 7f02c7392000 1 --2- 172.21.15.17:0/816373024 >> [v2:172.21.15.136:6800/90902,v1:172.21.15.136:6801/90902] conn(0x561bb7e388a0 0x561bb7e32250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:24.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.041+0000 7f02c7392000 1 -- 172.21.15.17:0/816373024 --> [v2:172.21.15.136:6800/90902,v1:172.21.15.136:6801/90902] -- osd_op(unknown.0.0:1 6.2a 6:57fe7535:::100000001f6.00000000:head [getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561bb7d9eb00 con 0x561bb7e388a0 2023-10-06T04:44:24.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.041+0000 7f02c05cd700 1 --2- 172.21.15.17:0/816373024 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f02a00658c0 0x7f02a0067d70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f02a8005c20 tx=0x7f02a8019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:24.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.041+0000 7f02c0dce700 1 --2- 172.21.15.17:0/816373024 >> [v2:172.21.15.136:6800/90902,v1:172.21.15.136:6801/90902] conn(0x561bb7e388a0 0x561bb7e32250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:24.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.041+0000 7f02c0dce700 1 --2- 172.21.15.17:0/816373024 >> [v2:172.21.15.136:6800/90902,v1:172.21.15.136:6801/90902] conn(0x561bb7e388a0 0x561bb7e32250 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:24.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.042+0000 7f02c0dce700 1 -- 172.21.15.17:0/816373024 <== osd.4 v2:172.21.15.136:6800/90902 1 ==== osd_op_reply(1 100000001f6.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f02b800f4d0 con 0x561bb7e388a0 2023-10-06T04:44:24.050 INFO:teuthology.orchestra.run.smithi017.stderr:error getting xattr cephfs_data/100000001f6.00000000/symlink: (61) No data available 2023-10-06T04:44:24.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.042+0000 7f02c7392000 1 -- 172.21.15.17:0/816373024 >> [v2:172.21.15.136:6800/90902,v1:172.21.15.136:6801/90902] conn(0x561bb7e388a0 msgr2=0x561bb7e32250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:24.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.042+0000 7f02c7392000 1 --2- 172.21.15.17:0/816373024 >> [v2:172.21.15.136:6800/90902,v1:172.21.15.136:6801/90902] conn(0x561bb7e388a0 0x561bb7e32250 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:24.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.042+0000 7f02c7392000 1 -- 172.21.15.17:0/816373024 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f02a00658c0 msgr2=0x7f02a0067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:24.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.042+0000 7f02c7392000 1 --2- 172.21.15.17:0/816373024 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f02a00658c0 0x7f02a0067d70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f02a8005c20 tx=0x7f02a8019000 comp rx=0 tx=0).stop 2023-10-06T04:44:24.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.042+0000 7f02c7392000 1 -- 172.21.15.17:0/816373024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561bb7e54ce0 msgr2=0x561bb7e5d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:24.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.042+0000 7f02c7392000 1 --2- 172.21.15.17:0/816373024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561bb7e54ce0 0x561bb7e5d030 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f02b000e7a0 tx=0x7f02b0017000 comp rx=0 tx=0).stop 2023-10-06T04:44:24.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.042+0000 7f02c0dce700 1 -- 172.21.15.17:0/816373024 reap_dead start 2023-10-06T04:44:24.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.042+0000 7f02c7392000 1 -- 172.21.15.17:0/816373024 shutdown_connections 2023-10-06T04:44:24.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.042+0000 7f02c7392000 1 -- 172.21.15.17:0/816373024 >> 172.21.15.17:0/816373024 conn(0x561bb7d72a90 msgr2=0x561bb7e42330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:24.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.042+0000 7f02c7392000 1 -- 172.21.15.17:0/816373024 shutdown_connections 2023-10-06T04:44:24.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.042+0000 7f02c7392000 1 -- 172.21.15.17:0/816373024 wait complete. 2023-10-06T04:44:24.051 ERROR:tasks.cephfs.filesystem:Command failed on smithi017 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f6.00000000 symlink' 2023-10-06T04:44:24.051 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_symlink_recovery true 2023-10-06T04:44:24.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.208+0000 7f14a2e0d700 1 Processor -- start 2023-10-06T04:44:24.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.208+0000 7f14a2e0d700 1 -- start start 2023-10-06T04:44:24.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.209+0000 7f14a2e0d700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f149c0cabf0 0x7f149c0c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:24.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.209+0000 7f14a2e0d700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f149c06d140 0x7f149c06f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:24.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.209+0000 7f14a2e0d700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f149c0d1120 con 0x7f149c159b10 2023-10-06T04:44:24.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.209+0000 7f14a2e0d700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f149c0d1400 con 0x7f149c06d140 2023-10-06T04:44:24.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.209+0000 7f14a2e0d700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f149c06e920 con 0x7f149c0cabf0 2023-10-06T04:44:24.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.209+0000 7f149bfff700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f149c159b10 0x7f149c06f120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:44650/0 (socket says 172.21.15.17:44650) 2023-10-06T04:44:24.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.209+0000 7f149bfff700 1 -- 172.21.15.17:0/1552970291 learned_addr learned my addr 172.21.15.17:0/1552970291 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:24.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.209+0000 7f14a13aa700 1 --2- 172.21.15.17:0/1552970291 >> v2:172.21.15.17:3300/0 conn(0x7f149c06d140 0x7f149c06f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:24.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.210+0000 7f14a0ba9700 1 --2- 172.21.15.17:0/1552970291 >> v2:172.21.15.136:3300/0 conn(0x7f149c0cabf0 0x7f149c0c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:24.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.210+0000 7f14a13aa700 1 -- 172.21.15.17:0/1552970291 >> v2:172.21.15.136:3300/0 conn(0x7f149c0cabf0 msgr2=0x7f149c0c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:24.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.210+0000 7f14a13aa700 1 --2- 172.21.15.17:0/1552970291 >> v2:172.21.15.136:3300/0 conn(0x7f149c0cabf0 0x7f149c0c7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:24.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.210+0000 7f14a13aa700 1 -- 172.21.15.17:0/1552970291 >> v1:172.21.15.17:6789/0 conn(0x7f149c159b10 legacy=0x7f149c06f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:24.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.210+0000 7f149b7fe700 1 -- 172.21.15.17:0/1552970291 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 73322001 0 0) 0x7f149c0d1120 con 0x7f149c159b10 2023-10-06T04:44:24.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.210+0000 7f14a13aa700 1 -- 172.21.15.17:0/1552970291 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f149c06ec00 con 0x7f149c06d140 2023-10-06T04:44:24.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.210+0000 7f14a13aa700 1 --2- 172.21.15.17:0/1552970291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f149c06d140 0x7f149c06f830 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f149c0ce130 tx=0x7f1494009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dcde7c27b1de5f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:24.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.210+0000 7f149b7fe700 1 -- 172.21.15.17:0/1552970291 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149400e070 con 0x7f149c06d140 2023-10-06T04:44:24.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.210+0000 7f149b7fe700 1 -- 172.21.15.17:0/1552970291 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149400bc30 con 0x7f149c06d140 2023-10-06T04:44:24.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.210+0000 7f149b7fe700 1 -- 172.21.15.17:0/1552970291 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1494012430 con 0x7f149c06d140 2023-10-06T04:44:24.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.210+0000 7f14a2e0d700 1 -- 172.21.15.17:0/1552970291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f149c06d140 msgr2=0x7f149c06f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:24.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.210+0000 7f14a2e0d700 1 --2- 172.21.15.17:0/1552970291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f149c06d140 0x7f149c06f830 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f149c0ce130 tx=0x7f1494009780 comp rx=0 tx=0).stop 2023-10-06T04:44:24.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.211+0000 7f14a2e0d700 1 -- 172.21.15.17:0/1552970291 shutdown_connections 2023-10-06T04:44:24.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.211+0000 7f14a2e0d700 1 --2- 172.21.15.17:0/1552970291 >> v2:172.21.15.136:3300/0 conn(0x7f149c0cabf0 0x7f149c0c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:24.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.211+0000 7f14a2e0d700 1 --2- 172.21.15.17:0/1552970291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f149c06d140 0x7f149c06f830 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:24.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.211+0000 7f14a2e0d700 1 -- 172.21.15.17:0/1552970291 >> 172.21.15.17:0/1552970291 conn(0x7f149c06cd40 msgr2=0x7f149c0d0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:24.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.211+0000 7f14a2e0d700 1 -- 172.21.15.17:0/1552970291 shutdown_connections 2023-10-06T04:44:24.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.211+0000 7f14a2e0d700 1 -- 172.21.15.17:0/1552970291 wait complete. 2023-10-06T04:44:24.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.212+0000 7f14a2e0d700 1 Processor -- start 2023-10-06T04:44:24.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.212+0000 7f14a2e0d700 1 -- start start 2023-10-06T04:44:24.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.213+0000 7f14a2e0d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f149c06d140 0x7f149c0b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:24.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.213+0000 7f14a2e0d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f149c0cabf0 0x7f149c09bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:24.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.213+0000 7f14a2e0d700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f149c159b10 0x7f149c1696f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:24.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.213+0000 7f14a2e0d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149c0b3400 con 0x7f149c06d140 2023-10-06T04:44:24.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.213+0000 7f14a2e0d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149c169c30 con 0x7f149c0cabf0 2023-10-06T04:44:24.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.213+0000 7f14a2e0d700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149c0b6030 con 0x7f149c159b10 2023-10-06T04:44:24.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.213+0000 7f14a0ba9700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f149c06d140 0x7f149c0b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:24.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.213+0000 7f14a0ba9700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f149c06d140 0x7f149c0b51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60690/0 (socket says 172.21.15.17:60690) 2023-10-06T04:44:24.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.213+0000 7f14a0ba9700 1 -- 172.21.15.17:0/1099286141 learned_addr learned my addr 172.21.15.17:0/1099286141 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:24.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.213+0000 7f14a0ba9700 1 -- 172.21.15.17:0/1099286141 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f149c159b10 msgr2=0x7f149c1696f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:24.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.213+0000 7f149bfff700 1 --2- 172.21.15.17:0/1099286141 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f149c0cabf0 0x7f149c09bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:24.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.213+0000 7f14a13aa700 1 --2- 172.21.15.17:0/1099286141 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f149c159b10 0x7f149c1696f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:24.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.213+0000 7f14a0ba9700 1 --2- 172.21.15.17:0/1099286141 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f149c159b10 0x7f149c1696f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:24.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.213+0000 7f14a0ba9700 1 -- 172.21.15.17:0/1099286141 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f149c0cabf0 msgr2=0x7f149c09bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:24.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.213+0000 7f14a0ba9700 1 --2- 172.21.15.17:0/1099286141 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f149c0cabf0 0x7f149c09bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:24.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.213+0000 7f14a0ba9700 1 -- 172.21.15.17:0/1099286141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1494009a20 con 0x7f149c06d140 2023-10-06T04:44:24.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.213+0000 7f149bfff700 1 --2- 172.21.15.17:0/1099286141 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f149c0cabf0 0x7f149c09bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:24.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.213+0000 7f14a13aa700 1 --2- 172.21.15.17:0/1099286141 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f149c159b10 0x7f149c1696f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:24.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.213+0000 7f14a0ba9700 1 --2- 172.21.15.17:0/1099286141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f149c06d140 0x7f149c0b51b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f148c00c850 tx=0x7f148c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:24.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.213+0000 7f1498ff9700 1 -- 172.21.15.17:0/1099286141 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c011600 con 0x7f149c06d140 2023-10-06T04:44:24.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.213+0000 7f1498ff9700 1 -- 172.21.15.17:0/1099286141 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148c011780 con 0x7f149c06d140 2023-10-06T04:44:24.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.213+0000 7f1498ff9700 1 -- 172.21.15.17:0/1099286141 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c011b40 con 0x7f149c06d140 2023-10-06T04:44:24.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.213+0000 7f14a2e0d700 1 -- 172.21.15.17:0/1099286141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f149c0b5800 con 0x7f149c06d140 2023-10-06T04:44:24.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.213+0000 7f14a2e0d700 1 -- 172.21.15.17:0/1099286141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f149c0b3930 con 0x7f149c06d140 2023-10-06T04:44:24.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.214+0000 7f14a2e0d700 1 -- 172.21.15.17:0/1099286141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f149c04c380 con 0x7f149c06d140 2023-10-06T04:44:24.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.215+0000 7f1498ff9700 1 -- 172.21.15.17:0/1099286141 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f148c0193f0 con 0x7f149c06d140 2023-10-06T04:44:24.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.215+0000 7f1498ff9700 1 --2- 172.21.15.17:0/1099286141 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1488066f30 0x7f14880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:24.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.215+0000 7f1498ff9700 1 -- 172.21.15.17:0/1099286141 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f148c084b10 con 0x7f149c06d140 2023-10-06T04:44:24.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.215+0000 7f149bfff700 1 --2- 172.21.15.17:0/1099286141 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1488066f30 0x7f14880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:24.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.216+0000 7f149bfff700 1 --2- 172.21.15.17:0/1099286141 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1488066f30 0x7f14880693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f149c0c87e0 tx=0x7f1490009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:24.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.220+0000 7f1498ff9700 1 -- 172.21.15.17:0/1099286141 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f148c051c20 con 0x7f149c06d140 2023-10-06T04:44:24.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.410+0000 7f14a2e0d700 1 -- 172.21.15.17:0/1099286141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mds_symlink_recovery}] v 0) v1 -- 0x7f149c071310 con 0x7f149c06d140 2023-10-06T04:44:24.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.414+0000 7f1498ff9700 1 -- 172.21.15.17:0/1099286141 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_symlink_recovery}]=0 v12)=0 v12) v1 ==== 121+0+0 (secure 0 0 0) 0x7f148c055240 con 0x7f149c06d140 2023-10-06T04:44:24.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.416+0000 7f14a2e0d700 1 -- 172.21.15.17:0/1099286141 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1488066f30 msgr2=0x7f14880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:24.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.416+0000 7f14a2e0d700 1 --2- 172.21.15.17:0/1099286141 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1488066f30 0x7f14880693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f149c0c87e0 tx=0x7f1490009040 comp rx=0 tx=0).stop 2023-10-06T04:44:24.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.416+0000 7f14a2e0d700 1 -- 172.21.15.17:0/1099286141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f149c06d140 msgr2=0x7f149c0b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:24.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.416+0000 7f14a2e0d700 1 --2- 172.21.15.17:0/1099286141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f149c06d140 0x7f149c0b51b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f148c00c850 tx=0x7f148c008040 comp rx=0 tx=0).stop 2023-10-06T04:44:24.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.416+0000 7f14a2e0d700 1 -- 172.21.15.17:0/1099286141 shutdown_connections 2023-10-06T04:44:24.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.416+0000 7f14a2e0d700 1 --2- 172.21.15.17:0/1099286141 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1488066f30 0x7f14880693e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:24.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.416+0000 7f14a2e0d700 1 --2- 172.21.15.17:0/1099286141 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f149c159b10 0x7f149c1696f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:24.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.416+0000 7f14a2e0d700 1 --2- 172.21.15.17:0/1099286141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f149c06d140 0x7f149c0b51b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:24.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.416+0000 7f14a2e0d700 1 --2- 172.21.15.17:0/1099286141 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f149c0cabf0 0x7f149c09bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:24.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.416+0000 7f14a2e0d700 1 -- 172.21.15.17:0/1099286141 >> 172.21.15.17:0/1099286141 conn(0x7f149c06cd40 msgr2=0x7f149c0cf370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:24.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.416+0000 7f14a2e0d700 1 -- 172.21.15.17:0/1099286141 shutdown_connections 2023-10-06T04:44:24.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:24.416+0000 7f14a2e0d700 1 -- 172.21.15.17:0/1099286141 wait complete. 2023-10-06T04:44:24.431 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:44:24.431 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir sym_dir) 2023-10-06T04:44:24.447 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:44:24.447 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch sym_dir/file1) 2023-10-06T04:44:24.506 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:44:24.506 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln -s ./file1 sym_dir/symlink_file1) 2023-10-06T04:44:24.562 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:44:24.562 DEBUG:teuthology.orchestra.run.smithi017:> import os 2023-10-06T04:44:24.562 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2023-10-06T04:44:24.563 DEBUG:teuthology.orchestra.run.smithi017:> 2023-10-06T04:44:24.563 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/sym_dir/symlink_file1").st_ino) 2023-10-06T04:44:24.563 DEBUG:teuthology.orchestra.run.smithi017:> ' 2023-10-06T04:44:24.668 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628281 2023-10-06T04:44:24.857 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:44:25.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.017+0000 7f5cbb5b5700 1 Processor -- start 2023-10-06T04:44:25.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.017+0000 7f5cbb5b5700 1 -- start start 2023-10-06T04:44:25.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.018+0000 7f5cbb5b5700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5cb40cd760 0x7f5cb40ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:25.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.018+0000 7f5cbb5b5700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f5cb40ce840 0x7f5cb40b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:25.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.018+0000 7f5cbb5b5700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cb40cfc80 con 0x7f5cb4159630 2023-10-06T04:44:25.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.018+0000 7f5cbb5b5700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cb40cf070 con 0x7f5cb40ce840 2023-10-06T04:44:25.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.018+0000 7f5cbb5b5700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb40cf350 con 0x7f5cb40cd760 2023-10-06T04:44:25.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.018+0000 7f5cb9b52700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f5cb40ce840 0x7f5cb40b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:25.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.018+0000 7f5cb9b52700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f5cb40ce840 0x7f5cb40b02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60704/0 (socket says 172.21.15.17:60704) 2023-10-06T04:44:25.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.018+0000 7f5cb9b52700 1 -- 172.21.15.17:0/924157809 learned_addr learned my addr 172.21.15.17:0/924157809 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:25.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.018+0000 7f5cb8b50700 1 --2- 172.21.15.17:0/924157809 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5cb40cd760 0x7f5cb40ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:25.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.018+0000 7f5cb9b52700 1 -- 172.21.15.17:0/924157809 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5cb40cd760 msgr2=0x7f5cb40ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:25.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.018+0000 7f5cb9b52700 1 --2- 172.21.15.17:0/924157809 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5cb40cd760 0x7f5cb40ce300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:25.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.018+0000 7f5cb9b52700 1 -- 172.21.15.17:0/924157809 >> v1:172.21.15.136:6789/0 conn(0x7f5cb4159630 legacy=0x7f5cb40cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:25.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.018+0000 7f5cb9b52700 1 -- 172.21.15.17:0/924157809 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb40cf630 con 0x7f5cb40ce840 2023-10-06T04:44:25.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.018+0000 7f5cb8b50700 1 --2- 172.21.15.17:0/924157809 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5cb40cd760 0x7f5cb40ce300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:25.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.018+0000 7f5cb9b52700 1 --2- 172.21.15.17:0/924157809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cb40ce840 0x7f5cb40b02d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5cac009f20 tx=0x7f5cac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=369f195233f344ad server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:25.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.019+0000 7f5cabfff700 1 -- 172.21.15.17:0/924157809 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac00e070 con 0x7f5cb40ce840 2023-10-06T04:44:25.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.019+0000 7f5cabfff700 1 -- 172.21.15.17:0/924157809 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cac00ba80 con 0x7f5cb40ce840 2023-10-06T04:44:25.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.019+0000 7f5cabfff700 1 -- 172.21.15.17:0/924157809 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac0092e0 con 0x7f5cb40ce840 2023-10-06T04:44:25.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.019+0000 7f5cbb5b5700 1 -- 172.21.15.17:0/924157809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cb40ce840 msgr2=0x7f5cb40b02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:25.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.019+0000 7f5cbb5b5700 1 --2- 172.21.15.17:0/924157809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cb40ce840 0x7f5cb40b02d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5cac009f20 tx=0x7f5cac009840 comp rx=0 tx=0).stop 2023-10-06T04:44:25.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.019+0000 7f5cbb5b5700 1 -- 172.21.15.17:0/924157809 shutdown_connections 2023-10-06T04:44:25.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.019+0000 7f5cbb5b5700 1 --2- 172.21.15.17:0/924157809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cb40ce840 0x7f5cb40b02d0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:25.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.019+0000 7f5cbb5b5700 1 --2- 172.21.15.17:0/924157809 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5cb40cd760 0x7f5cb40ce300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:25.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.019+0000 7f5cbb5b5700 1 -- 172.21.15.17:0/924157809 >> 172.21.15.17:0/924157809 conn(0x7f5cb406cff0 msgr2=0x7f5cb406d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:25.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.019+0000 7f5cbb5b5700 1 -- 172.21.15.17:0/924157809 shutdown_connections 2023-10-06T04:44:25.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.019+0000 7f5cbb5b5700 1 -- 172.21.15.17:0/924157809 wait complete. 2023-10-06T04:44:25.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.020+0000 7f5cbb5b5700 1 Processor -- start 2023-10-06T04:44:25.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.020+0000 7f5cbb5b5700 1 -- start start 2023-10-06T04:44:25.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.021+0000 7f5cbb5b5700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5cb40cd760 0x7f5cb415b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:25.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.021+0000 7f5cbb5b5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5cb40ce840 0x7f5cb40b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:25.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.021+0000 7f5cbb5b5700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cb4159630 0x7f5cb40b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:25.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.021+0000 7f5cbb5b5700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb415af80 con 0x7f5cb4159630 2023-10-06T04:44:25.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.021+0000 7f5cbb5b5700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb415a370 con 0x7f5cb40ce840 2023-10-06T04:44:25.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.021+0000 7f5cbb5b5700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb415a650 con 0x7f5cb40cd760 2023-10-06T04:44:25.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.021+0000 7f5cb9b52700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cb4159630 0x7f5cb40b5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:25.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.021+0000 7f5cb9b52700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cb4159630 0x7f5cb40b5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60716/0 (socket says 172.21.15.17:60716) 2023-10-06T04:44:25.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.021+0000 7f5cb9b52700 1 -- 172.21.15.17:0/3162057489 learned_addr learned my addr 172.21.15.17:0/3162057489 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:25.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.022+0000 7f5cb9351700 1 --2- 172.21.15.17:0/3162057489 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5cb40cd760 0x7f5cb415b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:25.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.022+0000 7f5cb8b50700 1 --2- 172.21.15.17:0/3162057489 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5cb40ce840 0x7f5cb40b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:25.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.022+0000 7f5cb9b52700 1 -- 172.21.15.17:0/3162057489 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5cb40cd760 msgr2=0x7f5cb415b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:25.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.022+0000 7f5cb9b52700 1 --2- 172.21.15.17:0/3162057489 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5cb40cd760 0x7f5cb415b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:25.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.022+0000 7f5cb9b52700 1 -- 172.21.15.17:0/3162057489 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5cb40ce840 msgr2=0x7f5cb40b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:25.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.022+0000 7f5cb9b52700 1 --2- 172.21.15.17:0/3162057489 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5cb40ce840 0x7f5cb40b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:25.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.022+0000 7f5cb9b52700 1 -- 172.21.15.17:0/3162057489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cac009ae0 con 0x7f5cb4159630 2023-10-06T04:44:25.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.022+0000 7f5cb9b52700 1 --2- 172.21.15.17:0/3162057489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cb4159630 0x7f5cb40b5f10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5cac00b6c0 tx=0x7f5cac018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:25.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.022+0000 7f5ca97fa700 1 -- 172.21.15.17:0/3162057489 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac0032f0 con 0x7f5cb4159630 2023-10-06T04:44:25.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.022+0000 7f5ca97fa700 1 -- 172.21.15.17:0/3162057489 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cac026460 con 0x7f5cb4159630 2023-10-06T04:44:25.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.022+0000 7f5cbb5b5700 1 -- 172.21.15.17:0/3162057489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cb415a930 con 0x7f5cb4159630 2023-10-06T04:44:25.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.022+0000 7f5ca97fa700 1 -- 172.21.15.17:0/3162057489 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac026800 con 0x7f5cb4159630 2023-10-06T04:44:25.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.022+0000 7f5cbb5b5700 1 -- 172.21.15.17:0/3162057489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cb4159e00 con 0x7f5cb4159630 2023-10-06T04:44:25.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.023+0000 7f5cbb5b5700 1 -- 172.21.15.17:0/3162057489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cb415b950 con 0x7f5cb4159630 2023-10-06T04:44:25.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.023+0000 7f5ca97fa700 1 -- 172.21.15.17:0/3162057489 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5cac003040 con 0x7f5cb4159630 2023-10-06T04:44:25.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.024+0000 7f5ca97fa700 1 --2- 172.21.15.17:0/3162057489 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5c98066f30 0x7f5c980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:25.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.024+0000 7f5ca97fa700 1 -- 172.21.15.17:0/3162057489 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5cac086700 con 0x7f5cb4159630 2023-10-06T04:44:25.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.024+0000 7f5cb9351700 1 --2- 172.21.15.17:0/3162057489 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5c98066f30 0x7f5c980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:25.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.024+0000 7f5cb9351700 1 --2- 172.21.15.17:0/3162057489 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5c98066f30 0x7f5c980693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5cb00037c0 tx=0x7f5cb0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:25.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.028+0000 7f5ca97fa700 1 -- 172.21.15.17:0/3162057489 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5cac053810 con 0x7f5cb4159630 2023-10-06T04:44:25.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.267+0000 7f5cbb5b5700 1 -- 172.21.15.17:0/3162057489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5cb4063ff0 con 0x7f5cb4159630 2023-10-06T04:44:25.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.267+0000 7f5ca97fa700 1 -- 172.21.15.17:0/3162057489 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f5cac056e30 con 0x7f5cb4159630 2023-10-06T04:44:25.269 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:25.269 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6834/3741747962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3741747962},{"type":"v1","addr":"172.21.15.136:6834","nonce":3741747962}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4688,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/264192509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6833","nonce":264192509},{"type":"v1","addr":"172.21.15.136:6835","nonce":264192509}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4909,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6836/1154731767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1154731767},{"type":"v1","addr":"172.21.15.17:6836","nonce":1154731767}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:44:14.988901+0000","modified":"2023-10-06T04:44:18.598280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4971":{"gid":4971,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6837/460551791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6835","nonce":460551791},{"type":"v1","addr":"172.21.15.17:6837","nonce":460551791}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:44:25.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.269+0000 7f5cbb5b5700 1 -- 172.21.15.17:0/3162057489 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5c98066f30 msgr2=0x7f5c980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:25.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.269+0000 7f5cbb5b5700 1 --2- 172.21.15.17:0/3162057489 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5c98066f30 0x7f5c980693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5cb00037c0 tx=0x7f5cb0009040 comp rx=0 tx=0).stop 2023-10-06T04:44:25.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.269+0000 7f5cbb5b5700 1 -- 172.21.15.17:0/3162057489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cb4159630 msgr2=0x7f5cb40b5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:25.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.269+0000 7f5cbb5b5700 1 --2- 172.21.15.17:0/3162057489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cb4159630 0x7f5cb40b5f10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5cac00b6c0 tx=0x7f5cac018000 comp rx=0 tx=0).stop 2023-10-06T04:44:25.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.270+0000 7f5cbb5b5700 1 -- 172.21.15.17:0/3162057489 shutdown_connections 2023-10-06T04:44:25.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.270+0000 7f5cbb5b5700 1 --2- 172.21.15.17:0/3162057489 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5c98066f30 0x7f5c980693e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:25.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.270+0000 7f5cbb5b5700 1 --2- 172.21.15.17:0/3162057489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cb4159630 0x7f5cb40b5f10 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:25.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.270+0000 7f5cbb5b5700 1 --2- 172.21.15.17:0/3162057489 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5cb40cd760 0x7f5cb415b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:25.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.270+0000 7f5cbb5b5700 1 --2- 172.21.15.17:0/3162057489 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5cb40ce840 0x7f5cb40b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:25.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.270+0000 7f5cbb5b5700 1 -- 172.21.15.17:0/3162057489 >> 172.21.15.17:0/3162057489 conn(0x7f5cb406cff0 msgr2=0x7f5cb40b2330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:25.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.270+0000 7f5cbb5b5700 1 -- 172.21.15.17:0/3162057489 shutdown_connections 2023-10-06T04:44:25.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.270+0000 7f5cbb5b5700 1 -- 172.21.15.17:0/3162057489 wait complete. 2023-10-06T04:44:25.273 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 16 2023-10-06T04:44:25.283 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2023-10-06T04:44:25.434 INFO:teuthology.orchestra.run.smithi017.stdout:{"message":"","return_code":0} 2023-10-06T04:44:25.437 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-10-06T04:44:25.437 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f9.00000000 symlink 2023-10-06T04:44:25.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.474+0000 7fdaf7cab000 1 Processor -- start 2023-10-06T04:44:25.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.474+0000 7fdaf7cab000 1 -- start start 2023-10-06T04:44:25.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.475+0000 7fdaf7cab000 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55de60b37120 0x55de60b7a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:25.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.475+0000 7fdaf7cab000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de60b37520 0x55de60c01470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:25.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.475+0000 7fdaf7cab000 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de60b7b570 0x55de60b602f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:25.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.475+0000 7fdaf7cab000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de60a7f980 con 0x55de60b37520 2023-10-06T04:44:25.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.475+0000 7fdaf7cab000 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de60a7f620 con 0x55de60b7b570 2023-10-06T04:44:25.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.475+0000 7fdaf7cab000 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x55de60a76400 con 0x55de60b37120 2023-10-06T04:44:25.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.475+0000 7fdaf06e5700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de60b37520 0x55de60c01470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:25.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.475+0000 7fdaf06e5700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de60b37520 0x55de60c01470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60724/0 (socket says 172.21.15.17:60724) 2023-10-06T04:44:25.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.475+0000 7fdaf06e5700 1 -- 172.21.15.17:0/1479063871 learned_addr learned my addr 172.21.15.17:0/1479063871 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:25.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.475+0000 7fdaf16e7700 1 --2- 172.21.15.17:0/1479063871 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de60b7b570 0x55de60b602f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:25.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.475+0000 7fdaf0ee6700 1 --2- 172.21.15.17:0/1479063871 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55de60b37120 0x55de60b7a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:25.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.475+0000 7fdaf06e5700 1 -- 172.21.15.17:0/1479063871 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55de60b37120 msgr2=0x55de60b7a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:25.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.475+0000 7fdaf06e5700 1 --2- 172.21.15.17:0/1479063871 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55de60b37120 0x55de60b7a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:25.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.475+0000 7fdaf06e5700 1 -- 172.21.15.17:0/1479063871 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de60b7b570 msgr2=0x55de60b602f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:25.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.475+0000 7fdaf06e5700 1 --2- 172.21.15.17:0/1479063871 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de60b7b570 0x55de60b602f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:25.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.475+0000 7fdaf06e5700 1 -- 172.21.15.17:0/1479063871 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae4005cf0 con 0x55de60b37520 2023-10-06T04:44:25.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.475+0000 7fdaf0ee6700 1 --2- 172.21.15.17:0/1479063871 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55de60b37120 0x55de60b7a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:25.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.475+0000 7fdaf06e5700 1 --2- 172.21.15.17:0/1479063871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de60b37520 0x55de60c01470 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x55de60b23110 tx=0x7fdae4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a17ec14d8b913bbf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:25.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.475+0000 7fdaef6e3700 1 -- 172.21.15.17:0/1479063871 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae4000bc0 con 0x55de60b37520 2023-10-06T04:44:25.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.475+0000 7fdaef6e3700 1 -- 172.21.15.17:0/1479063871 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae4008970 con 0x55de60b37520 2023-10-06T04:44:25.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.475+0000 7fdaef6e3700 1 -- 172.21.15.17:0/1479063871 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae401c440 con 0x55de60b37520 2023-10-06T04:44:25.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.476+0000 7fdaf7cab000 1 -- 172.21.15.17:0/1479063871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de60b37520 msgr2=0x55de60c01470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:25.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.476+0000 7fdaf7cab000 1 --2- 172.21.15.17:0/1479063871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de60b37520 0x55de60c01470 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x55de60b23110 tx=0x7fdae4016000 comp rx=0 tx=0).stop 2023-10-06T04:44:25.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.476+0000 7fdaf7cab000 1 -- 172.21.15.17:0/1479063871 shutdown_connections 2023-10-06T04:44:25.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.476+0000 7fdaf7cab000 1 --2- 172.21.15.17:0/1479063871 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de60b7b570 0x55de60b602f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:25.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.476+0000 7fdaf7cab000 1 --2- 172.21.15.17:0/1479063871 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55de60b37120 0x55de60b7a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:25.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.476+0000 7fdaf7cab000 1 --2- 172.21.15.17:0/1479063871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de60b37520 0x55de60c01470 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:25.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.476+0000 7fdaf7cab000 1 -- 172.21.15.17:0/1479063871 >> 172.21.15.17:0/1479063871 conn(0x55de60b35a90 msgr2=0x55de60c04a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:25.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.476+0000 7fdaf7cab000 1 -- 172.21.15.17:0/1479063871 shutdown_connections 2023-10-06T04:44:25.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.476+0000 7fdaf7cab000 1 -- 172.21.15.17:0/1479063871 wait complete. 2023-10-06T04:44:25.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.477+0000 7fdaf7cab000 1 Processor -- start 2023-10-06T04:44:25.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.477+0000 7fdaf7cab000 1 -- start start 2023-10-06T04:44:25.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.477+0000 7fdaf7cab000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de60b37120 0x55de60b5a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:25.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.477+0000 7fdaf7cab000 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55de60b37520 0x55de60b5b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:25.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.477+0000 7fdaf7cab000 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de60b7b570 0x55de60b5e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:25.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.477+0000 7fdaf7cab000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de60b5b630 con 0x55de60b37120 2023-10-06T04:44:25.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.477+0000 7fdaf7cab000 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de60b5bba0 con 0x55de60b7b570 2023-10-06T04:44:25.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.477+0000 7fdaf7cab000 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x55de60b5be40 con 0x55de60b37520 2023-10-06T04:44:25.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.477+0000 7fdaf0ee6700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de60b37120 0x55de60b5a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:25.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.477+0000 7fdaf0ee6700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de60b37120 0x55de60b5a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60726/0 (socket says 172.21.15.17:60726) 2023-10-06T04:44:25.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.477+0000 7fdaf0ee6700 1 -- 172.21.15.17:0/3099429991 learned_addr learned my addr 172.21.15.17:0/3099429991 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:25.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.478+0000 7fdaf06e5700 1 --2- 172.21.15.17:0/3099429991 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55de60b37520 0x55de60b5b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:25.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.478+0000 7fdaf16e7700 1 --2- 172.21.15.17:0/3099429991 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de60b7b570 0x55de60b5e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:25.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.478+0000 7fdaf0ee6700 1 -- 172.21.15.17:0/3099429991 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55de60b37520 msgr2=0x55de60b5b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:25.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.478+0000 7fdaf0ee6700 1 --2- 172.21.15.17:0/3099429991 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55de60b37520 0x55de60b5b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:25.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.478+0000 7fdaf0ee6700 1 -- 172.21.15.17:0/3099429991 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de60b7b570 msgr2=0x55de60b5e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:25.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.478+0000 7fdaf0ee6700 1 --2- 172.21.15.17:0/3099429991 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de60b7b570 0x55de60b5e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:25.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.478+0000 7fdaf0ee6700 1 -- 172.21.15.17:0/3099429991 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de60aa81c0 con 0x55de60b37120 2023-10-06T04:44:25.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.478+0000 7fdaf0ee6700 1 --2- 172.21.15.17:0/3099429991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de60b37120 0x55de60b5a500 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdae0006850 tx=0x7fdae0005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:25.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.478+0000 7fdaedee0700 1 -- 172.21.15.17:0/3099429991 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae000d5f0 con 0x55de60b37120 2023-10-06T04:44:25.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.478+0000 7fdaedee0700 1 -- 172.21.15.17:0/3099429991 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae000f040 con 0x55de60b37120 2023-10-06T04:44:25.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.478+0000 7fdaf7cab000 1 -- 172.21.15.17:0/3099429991 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55de60a8e3d0 con 0x55de60b37120 2023-10-06T04:44:25.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.478+0000 7fdaedee0700 1 -- 172.21.15.17:0/3099429991 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae000d9a0 con 0x55de60b37120 2023-10-06T04:44:25.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.478+0000 7fdaf7cab000 1 -- 172.21.15.17:0/3099429991 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55de60a81ae0 con 0x55de60b37120 2023-10-06T04:44:25.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.479+0000 7fdaedee0700 1 -- 172.21.15.17:0/3099429991 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdae000dd10 con 0x55de60b37120 2023-10-06T04:44:25.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.480+0000 7fdaedee0700 1 --2- 172.21.15.17:0/3099429991 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fdadc0658c0 0x7fdadc067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:25.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.480+0000 7fdaedee0700 1 -- 172.21.15.17:0/3099429991 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdae0083100 con 0x55de60b37120 2023-10-06T04:44:25.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.480+0000 7fdaf06e5700 1 --2- 172.21.15.17:0/3099429991 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fdadc0658c0 0x7fdadc067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:25.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.480+0000 7fdaf7cab000 1 --2- 172.21.15.17:0/3099429991 >> [v2:172.21.15.136:6808/90901,v1:172.21.15.136:6809/90901] conn(0x55de60b7c980 0x55de60c1b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:25.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.480+0000 7fdaf7cab000 1 -- 172.21.15.17:0/3099429991 --> [v2:172.21.15.136:6808/90901,v1:172.21.15.136:6809/90901] -- osd_op(unknown.0.0:1 6.36 6:6ee5e2c4:::100000001f9.00000000:head [getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55de60c1bec0 con 0x55de60b7c980 2023-10-06T04:44:25.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.480+0000 7fdaf16e7700 1 --2- 172.21.15.17:0/3099429991 >> [v2:172.21.15.136:6808/90901,v1:172.21.15.136:6809/90901] conn(0x55de60b7c980 0x55de60c1b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:25.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.480+0000 7fdaf06e5700 1 --2- 172.21.15.17:0/3099429991 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fdadc0658c0 0x7fdadc067d70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdae4008fd0 tx=0x7fdae4003050 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:25.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.481+0000 7fdaf16e7700 1 --2- 172.21.15.17:0/3099429991 >> [v2:172.21.15.136:6808/90901,v1:172.21.15.136:6809/90901] conn(0x55de60b7c980 0x55de60c1b980 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:25.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.481+0000 7fdaf16e7700 1 -- 172.21.15.17:0/3099429991 <== osd.5 v2:172.21.15.136:6808/90901 1 ==== osd_op_reply(1 100000001f9.00000000 [getxattr (11) out=11b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+11 (crc 0 0 0) 0x7fdae80034b0 con 0x55de60b7c980 2023-10-06T04:44:25.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.481+0000 7fdaf7cab000 1 -- 172.21.15.17:0/3099429991 >> [v2:172.21.15.136:6808/90901,v1:172.21.15.136:6809/90901] conn(0x55de60b7c980 msgr2=0x55de60c1b980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:25.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.481+0000 7fdaf7cab000 1 --2- 172.21.15.17:0/3099429991 >> [v2:172.21.15.136:6808/90901,v1:172.21.15.136:6809/90901] conn(0x55de60b7c980 0x55de60c1b980 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:25.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.481+0000 7fdaf7cab000 1 -- 172.21.15.17:0/3099429991 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fdadc0658c0 msgr2=0x7fdadc067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:25.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.481+0000 7fdaf7cab000 1 --2- 172.21.15.17:0/3099429991 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fdadc0658c0 0x7fdadc067d70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdae4008fd0 tx=0x7fdae4003050 comp rx=0 tx=0).stop 2023-10-06T04:44:25.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.481+0000 7fdaf7cab000 1 -- 172.21.15.17:0/3099429991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de60b37120 msgr2=0x55de60b5a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:25.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.481+0000 7fdaf7cab000 1 --2- 172.21.15.17:0/3099429991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55de60b37120 0x55de60b5a500 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdae0006850 tx=0x7fdae0005d80 comp rx=0 tx=0).stop 2023-10-06T04:44:25.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.481+0000 7fdaf16e7700 1 -- 172.21.15.17:0/3099429991 reap_dead start 2023-10-06T04:44:25.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.481+0000 7fdaf7cab000 1 -- 172.21.15.17:0/3099429991 shutdown_connections 2023-10-06T04:44:25.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.481+0000 7fdaf7cab000 1 -- 172.21.15.17:0/3099429991 >> 172.21.15.17:0/3099429991 conn(0x55de60b35a90 msgr2=0x55de60c05e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:25.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.481+0000 7fdaf7cab000 1 -- 172.21.15.17:0/3099429991 shutdown_connections 2023-10-06T04:44:25.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:25.481+0000 7fdaf7cab000 1 -- 172.21.15.17:0/3099429991 wait complete. 2023-10-06T04:44:25.489 INFO:teuthology.orchestra.run.smithi017.stdout:./file1 2023-10-06T04:44:25.489 DEBUG:teuthology.orchestra.run.smithi017:> ceph-dencoder type string_wrapper import - decode dump_json 2023-10-06T04:44:25.634 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-06T04:44:25.634 INFO:teuthology.orchestra.run.smithi017.stdout: "s": "./file1" 2023-10-06T04:44:25.634 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-06T04:44:25.634 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:25.636 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:44:25.636 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent_a) 2023-10-06T04:44:25.653 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:44:25.653 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parent_a/alpha) 2023-10-06T04:44:25.711 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:44:25.711 DEBUG:teuthology.orchestra.run.smithi017:> import os 2023-10-06T04:44:25.711 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2023-10-06T04:44:25.712 DEBUG:teuthology.orchestra.run.smithi017:> 2023-10-06T04:44:25.712 DEBUG:teuthology.orchestra.run.smithi017:> print(os.stat("/home/ubuntu/cephtest/mnt.0/parent_a/alpha").st_ino) 2023-10-06T04:44:25.712 DEBUG:teuthology.orchestra.run.smithi017:> ' 2023-10-06T04:44:25.817 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628283 2023-10-06T04:44:26.006 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:44:26.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.163+0000 7f6c8b7cf700 1 Processor -- start 2023-10-06T04:44:26.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.163+0000 7f6c8b7cf700 1 -- start start 2023-10-06T04:44:26.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.164+0000 7f6c8b7cf700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6c8415ca80 0x7f6c8406e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:26.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.164+0000 7f6c8b7cf700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c840ab250 con 0x7f6c8415dae0 2023-10-06T04:44:26.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.164+0000 7f6c8b7cf700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c8406e660 con 0x7f6c8415ce50 2023-10-06T04:44:26.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.164+0000 7f6c8b7cf700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c8406e940 con 0x7f6c8415ca80 2023-10-06T04:44:26.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.164+0000 7f6c8956b700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6c8415ca80 0x7f6c8406e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:26.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.164+0000 7f6c89d6c700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f6c8415dae0 0x7f6c840ab6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:44676/0 (socket says 172.21.15.17:44676) 2023-10-06T04:44:26.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.164+0000 7f6c8956b700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6c8415ca80 0x7f6c8406e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60730/0 (socket says 172.21.15.17:60730) 2023-10-06T04:44:26.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.164+0000 7f6c89d6c700 1 -- 172.21.15.17:0/3629908546 learned_addr learned my addr 172.21.15.17:0/3629908546 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:26.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.165+0000 7f6c8956b700 1 -- 172.21.15.17:0/3629908546 >> v1:172.21.15.136:6789/0 conn(0x7f6c8415ce50 legacy=0x7f6c8415d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:26.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.165+0000 7f6c8956b700 1 -- 172.21.15.17:0/3629908546 >> v1:172.21.15.17:6789/0 conn(0x7f6c8415dae0 legacy=0x7f6c840ab6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:26.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.165+0000 7f6c7bfff700 1 -- 172.21.15.17:0/3629908546 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1337851353 0 0) 0x7f6c840ab250 con 0x7f6c8415dae0 2023-10-06T04:44:26.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.165+0000 7f6c8956b700 1 -- 172.21.15.17:0/3629908546 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8406ec20 con 0x7f6c8415ca80 2023-10-06T04:44:26.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.165+0000 7f6c8956b700 1 --2- 172.21.15.17:0/3629908546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c8415ca80 0x7f6c8406e050 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6c800098e0 tx=0x7f6c800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3149cfa68498ef7c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:26.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.165+0000 7f6c7bfff700 1 -- 172.21.15.17:0/3629908546 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c80009e80 con 0x7f6c8415ca80 2023-10-06T04:44:26.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.165+0000 7f6c7bfff700 1 -- 172.21.15.17:0/3629908546 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c8000b860 con 0x7f6c8415ca80 2023-10-06T04:44:26.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.165+0000 7f6c7bfff700 1 -- 172.21.15.17:0/3629908546 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8000bbe0 con 0x7f6c8415ca80 2023-10-06T04:44:26.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.165+0000 7f6c8b7cf700 1 -- 172.21.15.17:0/3629908546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c8415ca80 msgr2=0x7f6c8406e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:26.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.165+0000 7f6c8b7cf700 1 --2- 172.21.15.17:0/3629908546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c8415ca80 0x7f6c8406e050 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6c800098e0 tx=0x7f6c800091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:26.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.165+0000 7f6c8b7cf700 1 -- 172.21.15.17:0/3629908546 shutdown_connections 2023-10-06T04:44:26.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.165+0000 7f6c8b7cf700 1 --2- 172.21.15.17:0/3629908546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c8415ca80 0x7f6c8406e050 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:26.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.165+0000 7f6c8b7cf700 1 -- 172.21.15.17:0/3629908546 >> 172.21.15.17:0/3629908546 conn(0x7f6c8406cd40 msgr2=0x7f6c84087fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:26.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.166+0000 7f6c8b7cf700 1 -- 172.21.15.17:0/3629908546 shutdown_connections 2023-10-06T04:44:26.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.166+0000 7f6c8b7cf700 1 -- 172.21.15.17:0/3629908546 wait complete. 2023-10-06T04:44:26.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.167+0000 7f6c8b7cf700 1 Processor -- start 2023-10-06T04:44:26.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.167+0000 7f6c8b7cf700 1 -- start start 2023-10-06T04:44:26.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.168+0000 7f6c8b7cf700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c8415ca80 0x7f6c840c90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:26.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.168+0000 7f6c8b7cf700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c8415ce50 0x7f6c840c9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:26.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.168+0000 7f6c8b7cf700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c8415dae0 0x7f6c84169c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:26.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.168+0000 7f6c8b7cf700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8416b610 con 0x7f6c8415dae0 2023-10-06T04:44:26.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.168+0000 7f6c8b7cf700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8416ad50 con 0x7f6c8415ca80 2023-10-06T04:44:26.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.168+0000 7f6c8b7cf700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c84148fd0 con 0x7f6c8415ce50 2023-10-06T04:44:26.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.168+0000 7f6c89d6c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c8415dae0 0x7f6c84169c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:26.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.168+0000 7f6c89d6c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c8415dae0 0x7f6c84169c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60744/0 (socket says 172.21.15.17:60744) 2023-10-06T04:44:26.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.168+0000 7f6c89d6c700 1 -- 172.21.15.17:0/2993575062 learned_addr learned my addr 172.21.15.17:0/2993575062 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:26.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.168+0000 7f6c89d6c700 1 -- 172.21.15.17:0/2993575062 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c8415ce50 msgr2=0x7f6c840c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:26.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.168+0000 7f6c88d6a700 1 --2- 172.21.15.17:0/2993575062 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c8415ce50 0x7f6c840c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:26.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.168+0000 7f6c8956b700 1 --2- 172.21.15.17:0/2993575062 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c8415ca80 0x7f6c840c90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:26.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.168+0000 7f6c89d6c700 1 --2- 172.21.15.17:0/2993575062 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c8415ce50 0x7f6c840c9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:26.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.168+0000 7f6c89d6c700 1 -- 172.21.15.17:0/2993575062 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c8415ca80 msgr2=0x7f6c840c90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:26.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.168+0000 7f6c89d6c700 1 --2- 172.21.15.17:0/2993575062 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c8415ca80 0x7f6c840c90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:26.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.168+0000 7f6c89d6c700 1 -- 172.21.15.17:0/2993575062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c80009420 con 0x7f6c8415dae0 2023-10-06T04:44:26.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.168+0000 7f6c88d6a700 1 --2- 172.21.15.17:0/2993575062 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c8415ce50 0x7f6c840c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:26.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.168+0000 7f6c8956b700 1 --2- 172.21.15.17:0/2993575062 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c8415ca80 0x7f6c840c90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:26.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.168+0000 7f6c89d6c700 1 --2- 172.21.15.17:0/2993575062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c8415dae0 0x7f6c84169c10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00cc40 tx=0x7f6c7c001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:26.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.168+0000 7f6c797fa700 1 -- 172.21.15.17:0/2993575062 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c00a920 con 0x7f6c8415dae0 2023-10-06T04:44:26.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.168+0000 7f6c797fa700 1 -- 172.21.15.17:0/2993575062 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7c00aaa0 con 0x7f6c8415dae0 2023-10-06T04:44:26.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.168+0000 7f6c8b7cf700 1 -- 172.21.15.17:0/2993575062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c840c9e80 con 0x7f6c8415dae0 2023-10-06T04:44:26.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.168+0000 7f6c797fa700 1 -- 172.21.15.17:0/2993575062 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c00ae60 con 0x7f6c8415dae0 2023-10-06T04:44:26.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.168+0000 7f6c8b7cf700 1 -- 172.21.15.17:0/2993575062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c8416b2a0 con 0x7f6c8415dae0 2023-10-06T04:44:26.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.169+0000 7f6c8b7cf700 1 -- 172.21.15.17:0/2993575062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c8416b7c0 con 0x7f6c8415dae0 2023-10-06T04:44:26.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.170+0000 7f6c797fa700 1 -- 172.21.15.17:0/2993575062 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6c7c007300 con 0x7f6c8415dae0 2023-10-06T04:44:26.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.170+0000 7f6c797fa700 1 --2- 172.21.15.17:0/2993575062 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6c68066f30 0x7f6c680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:26.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.170+0000 7f6c797fa700 1 -- 172.21.15.17:0/2993575062 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6c7c084ac0 con 0x7f6c8415dae0 2023-10-06T04:44:26.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.170+0000 7f6c8956b700 1 --2- 172.21.15.17:0/2993575062 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6c68066f30 0x7f6c680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:26.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.171+0000 7f6c8956b700 1 --2- 172.21.15.17:0/2993575062 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6c68066f30 0x7f6c680693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6c84068360 tx=0x7f6c80017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:26.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.175+0000 7f6c797fa700 1 -- 172.21.15.17:0/2993575062 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c8416b7c0 con 0x7f6c8415dae0 2023-10-06T04:44:26.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.410+0000 7f6c8b7cf700 1 -- 172.21.15.17:0/2993575062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c8416b7c0 con 0x7f6c8415dae0 2023-10-06T04:44:26.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.411+0000 7f6c797fa700 1 -- 172.21.15.17:0/2993575062 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f6c8416b7c0 con 0x7f6c8415dae0 2023-10-06T04:44:26.412 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:26.413 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6834/3741747962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3741747962},{"type":"v1","addr":"172.21.15.136:6834","nonce":3741747962}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4688,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/264192509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6833","nonce":264192509},{"type":"v1","addr":"172.21.15.136:6835","nonce":264192509}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4909,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6836/1154731767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1154731767},{"type":"v1","addr":"172.21.15.17:6836","nonce":1154731767}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:44:14.988901+0000","modified":"2023-10-06T04:44:18.598280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4971":{"gid":4971,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6837/460551791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6835","nonce":460551791},{"type":"v1","addr":"172.21.15.17:6837","nonce":460551791}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:44:26.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.413+0000 7f6c8b7cf700 1 -- 172.21.15.17:0/2993575062 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6c68066f30 msgr2=0x7f6c680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:26.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.413+0000 7f6c8b7cf700 1 --2- 172.21.15.17:0/2993575062 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6c68066f30 0x7f6c680693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6c84068360 tx=0x7f6c80017000 comp rx=0 tx=0).stop 2023-10-06T04:44:26.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.413+0000 7f6c8b7cf700 1 -- 172.21.15.17:0/2993575062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c8415dae0 msgr2=0x7f6c84169c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:26.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.413+0000 7f6c8b7cf700 1 --2- 172.21.15.17:0/2993575062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c8415dae0 0x7f6c84169c10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00cc40 tx=0x7f6c7c001970 comp rx=0 tx=0).stop 2023-10-06T04:44:26.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.413+0000 7f6c8b7cf700 1 -- 172.21.15.17:0/2993575062 shutdown_connections 2023-10-06T04:44:26.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.413+0000 7f6c8b7cf700 1 --2- 172.21.15.17:0/2993575062 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6c68066f30 0x7f6c680693e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:26.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.413+0000 7f6c8b7cf700 1 --2- 172.21.15.17:0/2993575062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c8415dae0 0x7f6c84169c10 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:26.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.413+0000 7f6c8b7cf700 1 --2- 172.21.15.17:0/2993575062 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c8415ca80 0x7f6c840c90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:26.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.413+0000 7f6c8b7cf700 1 --2- 172.21.15.17:0/2993575062 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c8415ce50 0x7f6c840c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:26.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.413+0000 7f6c8b7cf700 1 -- 172.21.15.17:0/2993575062 >> 172.21.15.17:0/2993575062 conn(0x7f6c8406cd40 msgr2=0x7f6c840b3910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:26.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.413+0000 7f6c8b7cf700 1 -- 172.21.15.17:0/2993575062 shutdown_connections 2023-10-06T04:44:26.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.413+0000 7f6c8b7cf700 1 -- 172.21.15.17:0/2993575062 wait complete. 2023-10-06T04:44:26.416 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 16 2023-10-06T04:44:26.428 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2023-10-06T04:44:26.574 INFO:teuthology.orchestra.run.smithi017.stdout:{"message":"","return_code":0} 2023-10-06T04:44:26.574 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-10-06T04:44:26.574 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001fb.00000000 parent 2023-10-06T04:44:26.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.611+0000 7f18294b3000 1 Processor -- start 2023-10-06T04:44:26.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.611+0000 7f18294b3000 1 -- start start 2023-10-06T04:44:26.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.612+0000 7f18294b3000 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x557e47f57000 0x557e47f59c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:26.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.612+0000 7f18294b3000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e47f83d70 0x557e4802eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:26.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.612+0000 7f18294b3000 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e48016be0 0x557e4802f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:26.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.612+0000 7f18294b3000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e47ea1620 con 0x557e47f83d70 2023-10-06T04:44:26.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.612+0000 7f18294b3000 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e47e98400 con 0x557e48016be0 2023-10-06T04:44:26.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.612+0000 7f18294b3000 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x557e48014270 con 0x557e47f57000 2023-10-06T04:44:26.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.612+0000 7f1821eed700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e47f83d70 0x557e4802eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:26.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.612+0000 7f1821eed700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e47f83d70 0x557e4802eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60760/0 (socket says 172.21.15.17:60760) 2023-10-06T04:44:26.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.612+0000 7f1821eed700 1 -- 172.21.15.17:0/1130832794 learned_addr learned my addr 172.21.15.17:0/1130832794 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:26.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.612+0000 7f1822eef700 1 --2- 172.21.15.17:0/1130832794 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e48016be0 0x557e4802f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:26.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.612+0000 7f18226ee700 1 --2- 172.21.15.17:0/1130832794 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x557e47f57000 0x557e47f59c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:26.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.612+0000 7f1821eed700 1 -- 172.21.15.17:0/1130832794 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x557e47f57000 msgr2=0x557e47f59c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:26.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.612+0000 7f1821eed700 1 --2- 172.21.15.17:0/1130832794 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x557e47f57000 0x557e47f59c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:26.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.612+0000 7f1821eed700 1 -- 172.21.15.17:0/1130832794 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e48016be0 msgr2=0x557e4802f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:26.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.612+0000 7f1821eed700 1 --2- 172.21.15.17:0/1130832794 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e48016be0 0x557e4802f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:26.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.612+0000 7f1821eed700 1 -- 172.21.15.17:0/1130832794 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180c005db0 con 0x557e47f83d70 2023-10-06T04:44:26.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.612+0000 7f1821eed700 1 --2- 172.21.15.17:0/1130832794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e47f83d70 0x557e4802eb00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f180c008410 tx=0x7f180c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f7e578fe154b3a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:26.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.612+0000 7f1820eeb700 1 -- 172.21.15.17:0/1130832794 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180c000bc0 con 0x557e47f83d70 2023-10-06T04:44:26.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.612+0000 7f1820eeb700 1 -- 172.21.15.17:0/1130832794 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f180c008a50 con 0x557e47f83d70 2023-10-06T04:44:26.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.612+0000 7f1820eeb700 1 -- 172.21.15.17:0/1130832794 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180c000d20 con 0x557e47f83d70 2023-10-06T04:44:26.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.613+0000 7f18294b3000 1 -- 172.21.15.17:0/1130832794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e47f83d70 msgr2=0x557e4802eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:26.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.613+0000 7f18294b3000 1 --2- 172.21.15.17:0/1130832794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e47f83d70 0x557e4802eb00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f180c008410 tx=0x7f180c013000 comp rx=0 tx=0).stop 2023-10-06T04:44:26.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.613+0000 7f18294b3000 1 -- 172.21.15.17:0/1130832794 shutdown_connections 2023-10-06T04:44:26.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.613+0000 7f18294b3000 1 --2- 172.21.15.17:0/1130832794 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e48016be0 0x557e4802f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:26.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.613+0000 7f18294b3000 1 --2- 172.21.15.17:0/1130832794 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x557e47f57000 0x557e47f59c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:26.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.613+0000 7f18294b3000 1 --2- 172.21.15.17:0/1130832794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e47f83d70 0x557e4802eb00 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:26.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.613+0000 7f18294b3000 1 -- 172.21.15.17:0/1130832794 >> 172.21.15.17:0/1130832794 conn(0x557e47f58d90 msgr2=0x557e47fa1660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:26.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.613+0000 7f18294b3000 1 -- 172.21.15.17:0/1130832794 shutdown_connections 2023-10-06T04:44:26.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.613+0000 7f18294b3000 1 -- 172.21.15.17:0/1130832794 wait complete. 2023-10-06T04:44:26.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.614+0000 7f18294b3000 1 Processor -- start 2023-10-06T04:44:26.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.614+0000 7f18294b3000 1 -- start start 2023-10-06T04:44:26.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.614+0000 7f18294b3000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e47f57000 0x557e47ffe280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:26.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.614+0000 7f18294b3000 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x557e47f83d70 0x557e480408a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:26.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.614+0000 7f18294b3000 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e48016be0 0x557e4802ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:26.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.614+0000 7f18294b3000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e47ffed10 con 0x557e47f57000 2023-10-06T04:44:26.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.614+0000 7f18294b3000 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e47ffefb0 con 0x557e48016be0 2023-10-06T04:44:26.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.614+0000 7f18294b3000 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x557e47fff250 con 0x557e47f83d70 2023-10-06T04:44:26.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.614+0000 7f18226ee700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e47f57000 0x557e47ffe280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:26.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.614+0000 7f18226ee700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e47f57000 0x557e47ffe280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60762/0 (socket says 172.21.15.17:60762) 2023-10-06T04:44:26.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.614+0000 7f18226ee700 1 -- 172.21.15.17:0/2368731196 learned_addr learned my addr 172.21.15.17:0/2368731196 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:26.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.615+0000 7f1821eed700 1 --2- 172.21.15.17:0/2368731196 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x557e47f83d70 0x557e480408a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:26.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.615+0000 7f1822eef700 1 --2- 172.21.15.17:0/2368731196 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e48016be0 0x557e4802ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:26.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.615+0000 7f18226ee700 1 -- 172.21.15.17:0/2368731196 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x557e47f83d70 msgr2=0x557e480408a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:26.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.615+0000 7f18226ee700 1 --2- 172.21.15.17:0/2368731196 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x557e47f83d70 0x557e480408a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:26.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.615+0000 7f18226ee700 1 -- 172.21.15.17:0/2368731196 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e48016be0 msgr2=0x557e4802ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:26.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.615+0000 7f18226ee700 1 --2- 172.21.15.17:0/2368731196 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e48016be0 0x557e4802ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:26.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.615+0000 7f18226ee700 1 -- 172.21.15.17:0/2368731196 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e47ea3750 con 0x557e47f57000 2023-10-06T04:44:26.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.615+0000 7f1822eef700 1 --2- 172.21.15.17:0/2368731196 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e48016be0 0x557e4802ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:26.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.615+0000 7f18226ee700 1 --2- 172.21.15.17:0/2368731196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e47f57000 0x557e47ffe280 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f181c005940 tx=0x7f181c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:26.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.615+0000 7f181affd700 1 -- 172.21.15.17:0/2368731196 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c0092e0 con 0x557e47f57000 2023-10-06T04:44:26.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.615+0000 7f181affd700 1 -- 172.21.15.17:0/2368731196 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181c00f040 con 0x557e47f57000 2023-10-06T04:44:26.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.615+0000 7f181affd700 1 -- 172.21.15.17:0/2368731196 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c00e840 con 0x557e47f57000 2023-10-06T04:44:26.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.615+0000 7f18294b3000 1 -- 172.21.15.17:0/2368731196 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557e47eca1c0 con 0x557e47f57000 2023-10-06T04:44:26.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.615+0000 7f18294b3000 1 -- 172.21.15.17:0/2368731196 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557e47eb03d0 con 0x557e47f57000 2023-10-06T04:44:26.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.616+0000 7f181affd700 1 -- 172.21.15.17:0/2368731196 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f181c00ebf0 con 0x557e47f57000 2023-10-06T04:44:26.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.617+0000 7f181affd700 1 --2- 172.21.15.17:0/2368731196 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f18040658c0 0x7f1804067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:26.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.617+0000 7f181affd700 1 -- 172.21.15.17:0/2368731196 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f181c0838d0 con 0x557e47f57000 2023-10-06T04:44:26.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.617+0000 7f1821eed700 1 --2- 172.21.15.17:0/2368731196 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f18040658c0 0x7f1804067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:26.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.617+0000 7f18294b3000 1 --2- 172.21.15.17:0/2368731196 >> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] conn(0x557e480009a0 0x557e48049880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:26.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.617+0000 7f18294b3000 1 -- 172.21.15.17:0/2368731196 --> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] -- osd_op(unknown.0.0:1 6.13 6:ca8fdbba:::100000001fb.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557e48040de0 con 0x557e480009a0 2023-10-06T04:44:26.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.617+0000 7f1822eef700 1 --2- 172.21.15.17:0/2368731196 >> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] conn(0x557e480009a0 0x557e48049880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:26.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.617+0000 7f1821eed700 1 --2- 172.21.15.17:0/2368731196 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f18040658c0 0x7f1804067d70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f180c01e000 tx=0x7f180c01c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:26.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.618+0000 7f1822eef700 1 --2- 172.21.15.17:0/2368731196 >> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] conn(0x557e480009a0 0x557e48049880 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:26.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.618+0000 7f1822eef700 1 -- 172.21.15.17:0/2368731196 <== osd.3 v2:172.21.15.17:6824/90688 1 ==== osd_op_reply(1 100000001fb.00000000 [getxattr (95) out=95b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x7f181400ca60 con 0x557e480009a0 2023-10-06T04:44:26.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.618+0000 7f18294b3000 1 -- 172.21.15.17:0/2368731196 >> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] conn(0x557e480009a0 msgr2=0x557e48049880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:26.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.618+0000 7f18294b3000 1 --2- 172.21.15.17:0/2368731196 >> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] conn(0x557e480009a0 0x557e48049880 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:26.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.618+0000 7f18294b3000 1 -- 172.21.15.17:0/2368731196 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f18040658c0 msgr2=0x7f1804067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:26.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.618+0000 7f18294b3000 1 --2- 172.21.15.17:0/2368731196 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f18040658c0 0x7f1804067d70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f180c01e000 tx=0x7f180c01c000 comp rx=0 tx=0).stop 2023-10-06T04:44:26.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.618+0000 7f18294b3000 1 -- 172.21.15.17:0/2368731196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e47f57000 msgr2=0x557e47ffe280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:26.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.618+0000 7f18294b3000 1 --2- 172.21.15.17:0/2368731196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e47f57000 0x557e47ffe280 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f181c005940 tx=0x7f181c00b040 comp rx=0 tx=0).stop 2023-10-06T04:44:26.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.618+0000 7f1822eef700 1 -- 172.21.15.17:0/2368731196 reap_dead start 2023-10-06T04:44:26.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.618+0000 7f18294b3000 1 -- 172.21.15.17:0/2368731196 shutdown_connections 2023-10-06T04:44:26.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.618+0000 7f18294b3000 1 -- 172.21.15.17:0/2368731196 >> 172.21.15.17:0/2368731196 conn(0x557e47f58d90 msgr2=0x557e48030070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:26.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.618+0000 7f18294b3000 1 -- 172.21.15.17:0/2368731196 shutdown_connections 2023-10-06T04:44:26.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.618+0000 7f18294b3000 1 -- 172.21.15.17:0/2368731196 wait complete. 2023-10-06T04:44:26.640 INFO:teuthology.orchestra.run.smithi017.stdout:Y��alphaparent_a 2023-10-06T04:44:26.641 DEBUG:teuthology.orchestra.run.smithi017:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2023-10-06T04:44:26.735 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-06T04:44:26.735 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511628283, 2023-10-06T04:44:26.735 INFO:teuthology.orchestra.run.smithi017.stdout: "ancestors": [ 2023-10-06T04:44:26.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:44:26.735 INFO:teuthology.orchestra.run.smithi017.stdout: "dirino": 1099511628282, 2023-10-06T04:44:26.735 INFO:teuthology.orchestra.run.smithi017.stdout: "dname": "alpha", 2023-10-06T04:44:26.736 INFO:teuthology.orchestra.run.smithi017.stdout: "version": 2 2023-10-06T04:44:26.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-06T04:44:26.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:44:26.736 INFO:teuthology.orchestra.run.smithi017.stdout: "dirino": 1, 2023-10-06T04:44:26.736 INFO:teuthology.orchestra.run.smithi017.stdout: "dname": "parent_a", 2023-10-06T04:44:26.736 INFO:teuthology.orchestra.run.smithi017.stdout: "version": 18 2023-10-06T04:44:26.736 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-06T04:44:26.736 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-06T04:44:26.736 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 6, 2023-10-06T04:44:26.736 INFO:teuthology.orchestra.run.smithi017.stdout: "old_pools": [] 2023-10-06T04:44:26.737 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-06T04:44:26.737 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:26.738 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001fb.00000000 layout 2023-10-06T04:44:26.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.815+0000 7f6bd2a14000 1 Processor -- start 2023-10-06T04:44:26.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.815+0000 7f6bd2a14000 1 -- start start 2023-10-06T04:44:26.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.816+0000 7f6bd2a14000 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bc3f3adda0 0x55bc3f455000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:26.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.816+0000 7f6bd2a14000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc3f43ba30 0x55bc3f37ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:26.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.816+0000 7f6bd2a14000 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55bc3f43be00 0x55bc3f3804b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:26.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.816+0000 7f6bd2a14000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc3f324320 con 0x55bc3f43ba30 2023-10-06T04:44:26.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.816+0000 7f6bd2a14000 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc3f2c8980 con 0x55bc3f3adda0 2023-10-06T04:44:26.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.816+0000 7f6bd2a14000 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bc3f2c8620 con 0x55bc3f43be00 2023-10-06T04:44:26.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.816+0000 7f6bcb44e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc3f43ba30 0x55bc3f37ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:26.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.816+0000 7f6bcb44e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc3f43ba30 0x55bc3f37ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60770/0 (socket says 172.21.15.17:60770) 2023-10-06T04:44:26.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.816+0000 7f6bcb44e700 1 -- 172.21.15.17:0/1382292382 learned_addr learned my addr 172.21.15.17:0/1382292382 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:26.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.816+0000 7f6bcbc4f700 1 --2- 172.21.15.17:0/1382292382 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bc3f3adda0 0x55bc3f455000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:26.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.816+0000 7f6bcb44e700 1 -- 172.21.15.17:0/1382292382 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55bc3f43be00 msgr2=0x55bc3f3804b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:26.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.816+0000 7f6bcb44e700 1 --2- 172.21.15.17:0/1382292382 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55bc3f43be00 0x55bc3f3804b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:26.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.816+0000 7f6bcb44e700 1 -- 172.21.15.17:0/1382292382 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bc3f3adda0 msgr2=0x55bc3f455000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:26.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.816+0000 7f6bcb44e700 1 --2- 172.21.15.17:0/1382292382 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bc3f3adda0 0x55bc3f455000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:26.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.816+0000 7f6bcb44e700 1 -- 172.21.15.17:0/1382292382 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc4005db0 con 0x55bc3f43ba30 2023-10-06T04:44:26.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.816+0000 7f6bcb44e700 1 --2- 172.21.15.17:0/1382292382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc3f43ba30 0x55bc3f37ff70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6bb400a4b0 tx=0x7f6bb40059d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40a9222cbd61ef49 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:26.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.817+0000 7f6bca44c700 1 -- 172.21.15.17:0/1382292382 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb400c610 con 0x55bc3f43ba30 2023-10-06T04:44:26.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.817+0000 7f6bca44c700 1 -- 172.21.15.17:0/1382292382 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb400c790 con 0x55bc3f43ba30 2023-10-06T04:44:26.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.817+0000 7f6bca44c700 1 -- 172.21.15.17:0/1382292382 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb400cb50 con 0x55bc3f43ba30 2023-10-06T04:44:26.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.817+0000 7f6bd2a14000 1 -- 172.21.15.17:0/1382292382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc3f43ba30 msgr2=0x55bc3f37ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:26.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.817+0000 7f6bd2a14000 1 --2- 172.21.15.17:0/1382292382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc3f43ba30 0x55bc3f37ff70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6bb400a4b0 tx=0x7f6bb40059d0 comp rx=0 tx=0).stop 2023-10-06T04:44:26.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.817+0000 7f6bd2a14000 1 -- 172.21.15.17:0/1382292382 shutdown_connections 2023-10-06T04:44:26.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.817+0000 7f6bd2a14000 1 --2- 172.21.15.17:0/1382292382 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55bc3f43be00 0x55bc3f3804b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:26.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.817+0000 7f6bd2a14000 1 --2- 172.21.15.17:0/1382292382 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bc3f3adda0 0x55bc3f455000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:26.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.817+0000 7f6bd2a14000 1 --2- 172.21.15.17:0/1382292382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc3f43ba30 0x55bc3f37ff70 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:26.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.817+0000 7f6bd2a14000 1 -- 172.21.15.17:0/1382292382 >> 172.21.15.17:0/1382292382 conn(0x55bc3f37f310 msgr2=0x55bc3f3a9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:26.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.817+0000 7f6bd2a14000 1 -- 172.21.15.17:0/1382292382 shutdown_connections 2023-10-06T04:44:26.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.817+0000 7f6bd2a14000 1 -- 172.21.15.17:0/1382292382 wait complete. 2023-10-06T04:44:26.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.818+0000 7f6bd2a14000 1 Processor -- start 2023-10-06T04:44:26.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.818+0000 7f6bd2a14000 1 -- start start 2023-10-06T04:44:26.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.818+0000 7f6bd2a14000 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bc3f3adda0 0x55bc3f457600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:26.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.818+0000 7f6bd2a14000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc3f43ba30 0x55bc3f438750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:26.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.818+0000 7f6bd2a14000 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55bc3f43be00 0x55bc3f462940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:26.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.818+0000 7f6bd2a14000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc3f2bf400 con 0x55bc3f43ba30 2023-10-06T04:44:26.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.818+0000 7f6bd2a14000 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc3f458ae0 con 0x55bc3f3adda0 2023-10-06T04:44:26.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.818+0000 7f6bd2a14000 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bc3f458300 con 0x55bc3f43be00 2023-10-06T04:44:26.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.818+0000 7f6bcb44e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc3f43ba30 0x55bc3f438750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:26.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.818+0000 7f6bcb44e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc3f43ba30 0x55bc3f438750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60784/0 (socket says 172.21.15.17:60784) 2023-10-06T04:44:26.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.819+0000 7f6bcb44e700 1 -- 172.21.15.17:0/242229139 learned_addr learned my addr 172.21.15.17:0/242229139 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:26.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.819+0000 7f6bcbc4f700 1 --2- 172.21.15.17:0/242229139 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bc3f3adda0 0x55bc3f457600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:26.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.819+0000 7f6bcc450700 1 --2- 172.21.15.17:0/242229139 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55bc3f43be00 0x55bc3f462940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:26.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.819+0000 7f6bcb44e700 1 -- 172.21.15.17:0/242229139 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55bc3f43be00 msgr2=0x55bc3f462940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:26.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.819+0000 7f6bcb44e700 1 --2- 172.21.15.17:0/242229139 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55bc3f43be00 0x55bc3f462940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:26.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.819+0000 7f6bcb44e700 1 -- 172.21.15.17:0/242229139 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bc3f3adda0 msgr2=0x55bc3f457600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:26.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.819+0000 7f6bcb44e700 1 --2- 172.21.15.17:0/242229139 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bc3f3adda0 0x55bc3f457600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:26.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.819+0000 7f6bcb44e700 1 -- 172.21.15.17:0/242229139 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb4005c90 con 0x55bc3f43ba30 2023-10-06T04:44:26.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.819+0000 7f6bcb44e700 1 --2- 172.21.15.17:0/242229139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc3f43ba30 0x55bc3f438750 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x55bc3f3a7080 tx=0x7f6bb4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:26.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.819+0000 7f6bc8c49700 1 -- 172.21.15.17:0/242229139 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4016960 con 0x55bc3f43ba30 2023-10-06T04:44:26.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.819+0000 7f6bc8c49700 1 -- 172.21.15.17:0/242229139 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb4016ac0 con 0x55bc3f43ba30 2023-10-06T04:44:26.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.819+0000 7f6bc8c49700 1 -- 172.21.15.17:0/242229139 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4016e80 con 0x55bc3f43ba30 2023-10-06T04:44:26.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.819+0000 7f6bd2a14000 1 -- 172.21.15.17:0/242229139 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bc3f2caae0 con 0x55bc3f43ba30 2023-10-06T04:44:26.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.819+0000 7f6bd2a14000 1 -- 172.21.15.17:0/242229139 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bc3f2ca540 con 0x55bc3f43ba30 2023-10-06T04:44:26.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.820+0000 7f6bc8c49700 1 -- 172.21.15.17:0/242229139 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6bb4007050 con 0x55bc3f43ba30 2023-10-06T04:44:26.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.821+0000 7f6bc8c49700 1 --2- 172.21.15.17:0/242229139 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6bac0658c0 0x7f6bac067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:26.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.821+0000 7f6bc8c49700 1 -- 172.21.15.17:0/242229139 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6bb40846d0 con 0x55bc3f43ba30 2023-10-06T04:44:26.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.821+0000 7f6bcbc4f700 1 --2- 172.21.15.17:0/242229139 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6bac0658c0 0x7f6bac067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:26.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.821+0000 7f6bd2a14000 1 --2- 172.21.15.17:0/242229139 >> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] conn(0x55bc3f464dd0 0x55bc3f46e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:26.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.821+0000 7f6bd2a14000 1 -- 172.21.15.17:0/242229139 --> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] -- osd_op(unknown.0.0:1 6.13 6:ca8fdbba:::100000001fb.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bc3f457b40 con 0x55bc3f464dd0 2023-10-06T04:44:26.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.821+0000 7f6bcc450700 1 --2- 172.21.15.17:0/242229139 >> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] conn(0x55bc3f464dd0 0x55bc3f46e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:26.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.821+0000 7f6bcbc4f700 1 --2- 172.21.15.17:0/242229139 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6bac0658c0 0x7f6bac067d70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6bc400a5a0 tx=0x7f6bc4012000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:26.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.821+0000 7f6bcc450700 1 --2- 172.21.15.17:0/242229139 >> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] conn(0x55bc3f464dd0 0x55bc3f46e470 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:26.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.822+0000 7f6bcc450700 1 -- 172.21.15.17:0/242229139 <== osd.3 v2:172.21.15.17:6824/90688 1 ==== osd_op_reply(1 100000001fb.00000000 [getxattr (30) out=30b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x7f6bbc0017e0 con 0x55bc3f464dd0 2023-10-06T04:44:26.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.822+0000 7f6bd2a14000 1 -- 172.21.15.17:0/242229139 >> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] conn(0x55bc3f464dd0 msgr2=0x55bc3f46e470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:26.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.822+0000 7f6bd2a14000 1 --2- 172.21.15.17:0/242229139 >> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] conn(0x55bc3f464dd0 0x55bc3f46e470 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:26.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.822+0000 7f6bd2a14000 1 -- 172.21.15.17:0/242229139 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6bac0658c0 msgr2=0x7f6bac067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:26.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.822+0000 7f6bd2a14000 1 --2- 172.21.15.17:0/242229139 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6bac0658c0 0x7f6bac067d70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6bc400a5a0 tx=0x7f6bc4012000 comp rx=0 tx=0).stop 2023-10-06T04:44:26.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.822+0000 7f6bd2a14000 1 -- 172.21.15.17:0/242229139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc3f43ba30 msgr2=0x55bc3f438750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:26.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.822+0000 7f6bd2a14000 1 --2- 172.21.15.17:0/242229139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc3f43ba30 0x55bc3f438750 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x55bc3f3a7080 tx=0x7f6bb4015000 comp rx=0 tx=0).stop 2023-10-06T04:44:26.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.822+0000 7f6bcc450700 1 -- 172.21.15.17:0/242229139 reap_dead start 2023-10-06T04:44:26.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.822+0000 7f6bd2a14000 1 -- 172.21.15.17:0/242229139 shutdown_connections 2023-10-06T04:44:26.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.822+0000 7f6bd2a14000 1 -- 172.21.15.17:0/242229139 >> 172.21.15.17:0/242229139 conn(0x55bc3f37f310 msgr2=0x55bc3f43a910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:26.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.822+0000 7f6bd2a14000 1 -- 172.21.15.17:0/242229139 shutdown_connections 2023-10-06T04:44:26.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:26.822+0000 7f6bd2a14000 1 -- 172.21.15.17:0/242229139 wait complete. 2023-10-06T04:44:26.829 INFO:teuthology.orchestra.run.smithi017.stdout:@@ 2023-10-06T04:44:26.830 DEBUG:teuthology.orchestra.run.smithi017:> ceph-dencoder type file_layout_t import - decode dump_json 2023-10-06T04:44:26.922 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-06T04:44:26.922 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_unit": 4194304, 2023-10-06T04:44:26.922 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_count": 1, 2023-10-06T04:44:26.922 INFO:teuthology.orchestra.run.smithi017.stdout: "object_size": 4194304, 2023-10-06T04:44:26.922 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_id": 6, 2023-10-06T04:44:26.922 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_ns": "" 2023-10-06T04:44:26.923 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-06T04:44:26.923 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:26.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:44:26.924 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent_b) 2023-10-06T04:44:26.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:44:26.981 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec mv parent_a/alpha parent_b/alpha) 2023-10-06T04:44:27.039 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:44:27.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.195+0000 7fe6b129b700 1 Processor -- start 2023-10-06T04:44:27.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.196+0000 7fe6b129b700 1 -- start start 2023-10-06T04:44:27.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.196+0000 7fe6b129b700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe6ac159630 0x7fe6ac0cd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:27.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.196+0000 7fe6b129b700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe6ac0cea10 0x7fe6ac0b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:27.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.196+0000 7fe6b129b700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6ac0cda00 con 0x7fe6ac0cd590 2023-10-06T04:44:27.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.196+0000 7fe6b129b700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6ac0cee90 con 0x7fe6ac0cea10 2023-10-06T04:44:27.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.196+0000 7fe6b129b700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6ac0cfc80 con 0x7fe6ac159630 2023-10-06T04:44:27.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.197+0000 7fe6ab7fe700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe6ac0cea10 0x7fe6ac0b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:27.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.197+0000 7fe6ab7fe700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe6ac0cea10 0x7fe6ac0b02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60786/0 (socket says 172.21.15.17:60786) 2023-10-06T04:44:27.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.197+0000 7fe6ab7fe700 1 -- 172.21.15.17:0/3659533254 learned_addr learned my addr 172.21.15.17:0/3659533254 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:27.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.197+0000 7fe6aa7fc700 1 --1- 172.21.15.17:0/3659533254 >> v1:172.21.15.17:6789/0 conn(0x7fe6ac0cd590 0x7fe6ac0ce300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:44694/0 (socket says 172.21.15.17:44694) 2023-10-06T04:44:27.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.197+0000 7fe6aaffd700 1 --2- 172.21.15.17:0/3659533254 >> v2:172.21.15.136:3300/0 conn(0x7fe6ac159630 0x7fe6ac0cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:27.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.197+0000 7fe6ab7fe700 1 -- 172.21.15.17:0/3659533254 >> v2:172.21.15.136:3300/0 conn(0x7fe6ac159630 msgr2=0x7fe6ac0cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:27.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.197+0000 7fe6ab7fe700 1 --2- 172.21.15.17:0/3659533254 >> v2:172.21.15.136:3300/0 conn(0x7fe6ac159630 0x7fe6ac0cd050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:27.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.197+0000 7fe6ab7fe700 1 -- 172.21.15.17:0/3659533254 >> v1:172.21.15.17:6789/0 conn(0x7fe6ac0cd590 legacy=0x7fe6ac0ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:27.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.197+0000 7fe6ab7fe700 1 -- 172.21.15.17:0/3659533254 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ac0cf070 con 0x7fe6ac0cea10 2023-10-06T04:44:27.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.197+0000 7fe6a9ffb700 1 -- 172.21.15.17:0/3659533254 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 918075668 0 0) 0x7fe6ac0cda00 con 0x7fe6ac0cd590 2023-10-06T04:44:27.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.197+0000 7fe6ab7fe700 1 --2- 172.21.15.17:0/3659533254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6ac0cea10 0x7fe6ac0b02d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac076960 tx=0x7fe69c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed370163b7c68e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:27.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.197+0000 7fe6a9ffb700 1 -- 172.21.15.17:0/3659533254 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69c00e070 con 0x7fe6ac0cea10 2023-10-06T04:44:27.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.197+0000 7fe6a9ffb700 1 -- 172.21.15.17:0/3659533254 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe69c00ba50 con 0x7fe6ac0cea10 2023-10-06T04:44:27.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.197+0000 7fe6a9ffb700 1 -- 172.21.15.17:0/3659533254 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69c0092e0 con 0x7fe6ac0cea10 2023-10-06T04:44:27.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.198+0000 7fe6b129b700 1 -- 172.21.15.17:0/3659533254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6ac0cea10 msgr2=0x7fe6ac0b02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:27.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.198+0000 7fe6b129b700 1 --2- 172.21.15.17:0/3659533254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6ac0cea10 0x7fe6ac0b02d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac076960 tx=0x7fe69c009840 comp rx=0 tx=0).stop 2023-10-06T04:44:27.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.198+0000 7fe6b129b700 1 -- 172.21.15.17:0/3659533254 shutdown_connections 2023-10-06T04:44:27.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.198+0000 7fe6b129b700 1 --2- 172.21.15.17:0/3659533254 >> v2:172.21.15.136:3300/0 conn(0x7fe6ac159630 0x7fe6ac0cd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:27.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.198+0000 7fe6b129b700 1 --2- 172.21.15.17:0/3659533254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6ac0cea10 0x7fe6ac0b02d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:27.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.198+0000 7fe6b129b700 1 -- 172.21.15.17:0/3659533254 >> 172.21.15.17:0/3659533254 conn(0x7fe6ac06cff0 msgr2=0x7fe6ac06d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:27.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.198+0000 7fe6b129b700 1 -- 172.21.15.17:0/3659533254 shutdown_connections 2023-10-06T04:44:27.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.198+0000 7fe6b129b700 1 -- 172.21.15.17:0/3659533254 wait complete. 2023-10-06T04:44:27.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.199+0000 7fe6b129b700 1 Processor -- start 2023-10-06T04:44:27.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.199+0000 7fe6b129b700 1 -- start start 2023-10-06T04:44:27.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.200+0000 7fe6b129b700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe6ac0cd590 0x7fe6ac14e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:27.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.200+0000 7fe6b129b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6ac0cea10 0x7fe6ac1563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:27.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.200+0000 7fe6b129b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6ac159630 0x7fe6ac0b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:27.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.200+0000 7fe6b129b700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ac14e830 con 0x7fe6ac159630 2023-10-06T04:44:27.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.200+0000 7fe6b129b700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ac158110 con 0x7fe6ac0cea10 2023-10-06T04:44:27.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.200+0000 7fe6b129b700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ac156930 con 0x7fe6ac0cd590 2023-10-06T04:44:27.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.200+0000 7fe6ab7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6ac159630 0x7fe6ac0b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:27.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.200+0000 7fe6ab7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6ac159630 0x7fe6ac0b4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60792/0 (socket says 172.21.15.17:60792) 2023-10-06T04:44:27.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.200+0000 7fe6ab7fe700 1 -- 172.21.15.17:0/4066547758 learned_addr learned my addr 172.21.15.17:0/4066547758 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:27.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.200+0000 7fe6aa7fc700 1 --2- 172.21.15.17:0/4066547758 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6ac0cea10 0x7fe6ac1563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:27.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.200+0000 7fe6ab7fe700 1 -- 172.21.15.17:0/4066547758 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe6ac0cd590 msgr2=0x7fe6ac14e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:27.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.200+0000 7fe6ab7fe700 1 --2- 172.21.15.17:0/4066547758 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe6ac0cd590 0x7fe6ac14e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:27.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.200+0000 7fe6ab7fe700 1 -- 172.21.15.17:0/4066547758 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6ac0cea10 msgr2=0x7fe6ac1563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:27.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.200+0000 7fe6ab7fe700 1 --2- 172.21.15.17:0/4066547758 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6ac0cea10 0x7fe6ac1563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:27.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.200+0000 7fe6ab7fe700 1 -- 172.21.15.17:0/4066547758 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe69c009ae0 con 0x7fe6ac159630 2023-10-06T04:44:27.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.200+0000 7fe6ab7fe700 1 --2- 172.21.15.17:0/4066547758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6ac159630 0x7fe6ac0b4db0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac0d16b0 tx=0x7fe69c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:27.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.201+0000 7fe6a2ffd700 1 -- 172.21.15.17:0/4066547758 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69c008e80 con 0x7fe6ac159630 2023-10-06T04:44:27.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.201+0000 7fe6a2ffd700 1 -- 172.21.15.17:0/4066547758 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe69c026460 con 0x7fe6ac159630 2023-10-06T04:44:27.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.201+0000 7fe6b129b700 1 -- 172.21.15.17:0/4066547758 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6ac15d2c0 con 0x7fe6ac159630 2023-10-06T04:44:27.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.201+0000 7fe6a2ffd700 1 -- 172.21.15.17:0/4066547758 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69c026820 con 0x7fe6ac159630 2023-10-06T04:44:27.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.201+0000 7fe6b129b700 1 -- 172.21.15.17:0/4066547758 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6ac15d650 con 0x7fe6ac159630 2023-10-06T04:44:27.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.202+0000 7fe6b129b700 1 -- 172.21.15.17:0/4066547758 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6ac063ff0 con 0x7fe6ac159630 2023-10-06T04:44:27.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.202+0000 7fe6a2ffd700 1 -- 172.21.15.17:0/4066547758 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe69c003040 con 0x7fe6ac159630 2023-10-06T04:44:27.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.202+0000 7fe6a2ffd700 1 --2- 172.21.15.17:0/4066547758 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe68c066f30 0x7fe68c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:27.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.202+0000 7fe6a2ffd700 1 -- 172.21.15.17:0/4066547758 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe69c0862c0 con 0x7fe6ac159630 2023-10-06T04:44:27.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.203+0000 7fe6aaffd700 1 --2- 172.21.15.17:0/4066547758 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe68c066f30 0x7fe68c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:27.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.203+0000 7fe6aaffd700 1 --2- 172.21.15.17:0/4066547758 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe68c066f30 0x7fe68c0693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe6a400a900 tx=0x7fe6a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:27.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.207+0000 7fe6a2ffd700 1 -- 172.21.15.17:0/4066547758 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe69c0533d0 con 0x7fe6ac159630 2023-10-06T04:44:27.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.448+0000 7fe6b129b700 1 -- 172.21.15.17:0/4066547758 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6ac15a160 con 0x7fe6ac159630 2023-10-06T04:44:27.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.449+0000 7fe6a2ffd700 1 -- 172.21.15.17:0/4066547758 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4597 (secure 0 0 0) 0x7fe69c0569f0 con 0x7fe6ac159630 2023-10-06T04:44:27.451 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:27.451 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6834/3741747962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3741747962},{"type":"v1","addr":"172.21.15.136:6834","nonce":3741747962}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4688,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/264192509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6833","nonce":264192509},{"type":"v1","addr":"172.21.15.136:6835","nonce":264192509}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4909,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6836/1154731767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1154731767},{"type":"v1","addr":"172.21.15.17:6836","nonce":1154731767}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:44:14.988901+0000","modified":"2023-10-06T04:44:18.598280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4971":{"gid":4971,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6837/460551791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6835","nonce":460551791},{"type":"v1","addr":"172.21.15.17:6837","nonce":460551791}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:44:27.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.450+0000 7fe6b129b700 1 -- 172.21.15.17:0/4066547758 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe68c066f30 msgr2=0x7fe68c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:27.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.450+0000 7fe6b129b700 1 --2- 172.21.15.17:0/4066547758 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe68c066f30 0x7fe68c0693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe6a400a900 tx=0x7fe6a4008040 comp rx=0 tx=0).stop 2023-10-06T04:44:27.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.450+0000 7fe6b129b700 1 -- 172.21.15.17:0/4066547758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6ac159630 msgr2=0x7fe6ac0b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:27.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.451+0000 7fe6b129b700 1 --2- 172.21.15.17:0/4066547758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6ac159630 0x7fe6ac0b4db0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac0d16b0 tx=0x7fe69c018000 comp rx=0 tx=0).stop 2023-10-06T04:44:27.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.451+0000 7fe6b129b700 1 -- 172.21.15.17:0/4066547758 shutdown_connections 2023-10-06T04:44:27.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.451+0000 7fe6b129b700 1 --2- 172.21.15.17:0/4066547758 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe68c066f30 0x7fe68c0693e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:27.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.451+0000 7fe6b129b700 1 --2- 172.21.15.17:0/4066547758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6ac159630 0x7fe6ac0b4db0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:27.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.451+0000 7fe6b129b700 1 --2- 172.21.15.17:0/4066547758 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe6ac0cd590 0x7fe6ac14e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:27.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.451+0000 7fe6b129b700 1 --2- 172.21.15.17:0/4066547758 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6ac0cea10 0x7fe6ac1563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:27.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.451+0000 7fe6b129b700 1 -- 172.21.15.17:0/4066547758 >> 172.21.15.17:0/4066547758 conn(0x7fe6ac06cff0 msgr2=0x7fe6ac15efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:27.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.451+0000 7fe6b129b700 1 -- 172.21.15.17:0/4066547758 shutdown_connections 2023-10-06T04:44:27.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.451+0000 7fe6b129b700 1 -- 172.21.15.17:0/4066547758 wait complete. 2023-10-06T04:44:27.454 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 16 2023-10-06T04:44:27.464 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2023-10-06T04:44:27.611 INFO:teuthology.orchestra.run.smithi017.stdout:{"message":"","return_code":0} 2023-10-06T04:44:27.611 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-10-06T04:44:27.612 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001fb.00000000 parent 2023-10-06T04:44:27.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.648+0000 7f902ebf3000 1 Processor -- start 2023-10-06T04:44:27.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.649+0000 7f902ebf3000 1 -- start start 2023-10-06T04:44:27.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.649+0000 7f902ebf3000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3ac3cbe40 0x55e3ac45aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:27.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.649+0000 7f902ebf3000 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e3ac3cc240 0x55e3ac3860d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:27.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.649+0000 7f902ebf3000 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55e3ac441340 0x55e3ac427ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:27.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.649+0000 7f902ebf3000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3ac2cf620 con 0x55e3ac3cbe40 2023-10-06T04:44:27.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.649+0000 7f902ebf3000 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3ac2c6400 con 0x55e3ac3cc240 2023-10-06T04:44:27.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.649+0000 7f902ebf3000 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e3ac459e60 con 0x55e3ac441340 2023-10-06T04:44:27.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.649+0000 7f9027e2e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3ac3cbe40 0x55e3ac45aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:27.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.649+0000 7f9027e2e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3ac3cbe40 0x55e3ac45aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60818/0 (socket says 172.21.15.17:60818) 2023-10-06T04:44:27.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.649+0000 7f9027e2e700 1 -- 172.21.15.17:0/909089730 learned_addr learned my addr 172.21.15.17:0/909089730 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:27.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.649+0000 7f902762d700 1 --2- 172.21.15.17:0/909089730 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e3ac3cc240 0x55e3ac3860d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:27.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.649+0000 7f902862f700 1 --2- 172.21.15.17:0/909089730 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55e3ac441340 0x55e3ac427ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:27.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.650+0000 7f9027e2e700 1 -- 172.21.15.17:0/909089730 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55e3ac441340 msgr2=0x55e3ac427ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:27.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.650+0000 7f9027e2e700 1 --2- 172.21.15.17:0/909089730 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55e3ac441340 0x55e3ac427ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:27.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.650+0000 7f9027e2e700 1 -- 172.21.15.17:0/909089730 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e3ac3cc240 msgr2=0x55e3ac3860d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:27.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.650+0000 7f9027e2e700 1 --2- 172.21.15.17:0/909089730 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e3ac3cc240 0x55e3ac3860d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:27.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.650+0000 7f9027e2e700 1 -- 172.21.15.17:0/909089730 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f901c005db0 con 0x55e3ac3cbe40 2023-10-06T04:44:27.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.650+0000 7f902762d700 1 --2- 172.21.15.17:0/909089730 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e3ac3cc240 0x55e3ac3860d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:27.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.650+0000 7f9027e2e700 1 --2- 172.21.15.17:0/909089730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3ac3cbe40 0x55e3ac45aaa0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9018009670 tx=0x7f9018005ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=400db02f851e8488 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:27.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.650+0000 7f902662b700 1 -- 172.21.15.17:0/909089730 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901800e070 con 0x55e3ac3cbe40 2023-10-06T04:44:27.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.650+0000 7f902662b700 1 -- 172.21.15.17:0/909089730 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9018006530 con 0x55e3ac3cbe40 2023-10-06T04:44:27.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.650+0000 7f902662b700 1 -- 172.21.15.17:0/909089730 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90180068f0 con 0x55e3ac3cbe40 2023-10-06T04:44:27.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.650+0000 7f902ebf3000 1 -- 172.21.15.17:0/909089730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3ac3cbe40 msgr2=0x55e3ac45aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:27.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.650+0000 7f902ebf3000 1 --2- 172.21.15.17:0/909089730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3ac3cbe40 0x55e3ac45aaa0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9018009670 tx=0x7f9018005ba0 comp rx=0 tx=0).stop 2023-10-06T04:44:27.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.650+0000 7f902ebf3000 1 -- 172.21.15.17:0/909089730 shutdown_connections 2023-10-06T04:44:27.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.650+0000 7f902ebf3000 1 --2- 172.21.15.17:0/909089730 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55e3ac441340 0x55e3ac427ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:27.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.650+0000 7f902ebf3000 1 --2- 172.21.15.17:0/909089730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3ac3cbe40 0x55e3ac45aaa0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:27.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.650+0000 7f902ebf3000 1 --2- 172.21.15.17:0/909089730 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e3ac3cc240 0x55e3ac3860d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:27.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.650+0000 7f902ebf3000 1 -- 172.21.15.17:0/909089730 >> 172.21.15.17:0/909089730 conn(0x55e3ac385a90 msgr2=0x55e3ac458450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:27.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.650+0000 7f902ebf3000 1 -- 172.21.15.17:0/909089730 shutdown_connections 2023-10-06T04:44:27.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.650+0000 7f902ebf3000 1 -- 172.21.15.17:0/909089730 wait complete. 2023-10-06T04:44:27.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.651+0000 7f902ebf3000 1 Processor -- start 2023-10-06T04:44:27.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.651+0000 7f902ebf3000 1 -- start start 2023-10-06T04:44:27.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.652+0000 7f902ebf3000 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55e3ac3cbe40 0x55e3ac3cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:27.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.652+0000 7f902ebf3000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3ac3cc240 0x55e3ac429590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:27.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.652+0000 7f902ebf3000 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e3ac441340 0x55e3ac429ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:27.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.652+0000 7f902ebf3000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3ac427150 con 0x55e3ac3cc240 2023-10-06T04:44:27.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.652+0000 7f902ebf3000 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3ac3c3c00 con 0x55e3ac441340 2023-10-06T04:44:27.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.652+0000 7f902ebf3000 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e3ac3c3ea0 con 0x55e3ac3cbe40 2023-10-06T04:44:27.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.652+0000 7f902762d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3ac3cc240 0x55e3ac429590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:27.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.652+0000 7f902762d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3ac3cc240 0x55e3ac429590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60834/0 (socket says 172.21.15.17:60834) 2023-10-06T04:44:27.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.652+0000 7f902762d700 1 -- 172.21.15.17:0/43736208 learned_addr learned my addr 172.21.15.17:0/43736208 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:27.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.652+0000 7f9027e2e700 1 --2- 172.21.15.17:0/43736208 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55e3ac3cbe40 0x55e3ac3cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:27.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.652+0000 7f902762d700 1 -- 172.21.15.17:0/43736208 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55e3ac3cbe40 msgr2=0x55e3ac3cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:27.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.652+0000 7f902762d700 1 --2- 172.21.15.17:0/43736208 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55e3ac3cbe40 0x55e3ac3cb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:27.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.652+0000 7f902762d700 1 -- 172.21.15.17:0/43736208 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e3ac441340 msgr2=0x55e3ac429ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:27.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.652+0000 7f902862f700 1 --2- 172.21.15.17:0/43736208 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e3ac441340 0x55e3ac429ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:27.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.652+0000 7f902762d700 1 --2- 172.21.15.17:0/43736208 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e3ac441340 0x55e3ac429ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:27.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.652+0000 7f902762d700 1 -- 172.21.15.17:0/43736208 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9018005e40 con 0x55e3ac3cc240 2023-10-06T04:44:27.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.652+0000 7f902762d700 1 --2- 172.21.15.17:0/43736208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3ac3cc240 0x55e3ac429590 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x55e3ac373110 tx=0x7f901c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:27.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.652+0000 7f9024e28700 1 -- 172.21.15.17:0/43736208 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c007e90 con 0x55e3ac3cc240 2023-10-06T04:44:27.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.652+0000 7f9024e28700 1 -- 172.21.15.17:0/43736208 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f901c026460 con 0x55e3ac3cc240 2023-10-06T04:44:27.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.652+0000 7f9024e28700 1 -- 172.21.15.17:0/43736208 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c026800 con 0x55e3ac3cc240 2023-10-06T04:44:27.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.652+0000 7f902ebf3000 1 -- 172.21.15.17:0/43736208 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e3ac2f81c0 con 0x55e3ac3cc240 2023-10-06T04:44:27.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.652+0000 7f902ebf3000 1 -- 172.21.15.17:0/43736208 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e3ac2de3d0 con 0x55e3ac3cc240 2023-10-06T04:44:27.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.654+0000 7f9024e28700 1 -- 172.21.15.17:0/43736208 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f901c026bf0 con 0x55e3ac3cc240 2023-10-06T04:44:27.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.654+0000 7f9024e28700 1 --2- 172.21.15.17:0/43736208 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9014065890 0x7f9014067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:27.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.654+0000 7f9024e28700 1 -- 172.21.15.17:0/43736208 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f901c084c80 con 0x55e3ac3cc240 2023-10-06T04:44:27.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.654+0000 7f9027e2e700 1 --2- 172.21.15.17:0/43736208 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9014065890 0x7f9014067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:27.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.654+0000 7f902ebf3000 1 --2- 172.21.15.17:0/43736208 >> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] conn(0x55e3ac428880 0x55e3ac454940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:27.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.654+0000 7f902ebf3000 1 -- 172.21.15.17:0/43736208 --> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] -- osd_op(unknown.0.0:1 6.13 6:ca8fdbba:::100000001fb.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e3ac42a1f0 con 0x55e3ac428880 2023-10-06T04:44:27.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.654+0000 7f902862f700 1 --2- 172.21.15.17:0/43736208 >> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] conn(0x55e3ac428880 0x55e3ac454940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:27.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.655+0000 7f9027e2e700 1 --2- 172.21.15.17:0/43736208 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9014065890 0x7f9014067d40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9018006010 tx=0x7f9018014000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:27.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.655+0000 7f902862f700 1 --2- 172.21.15.17:0/43736208 >> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] conn(0x55e3ac428880 0x55e3ac454940 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:27.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.655+0000 7f902862f700 1 -- 172.21.15.17:0/43736208 <== osd.3 v2:172.21.15.17:6824/90688 1 ==== osd_op_reply(1 100000001fb.00000000 [getxattr (95) out=95b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x7f902000b6f0 con 0x55e3ac428880 2023-10-06T04:44:27.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.655+0000 7f902ebf3000 1 -- 172.21.15.17:0/43736208 >> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] conn(0x55e3ac428880 msgr2=0x55e3ac454940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:27.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.655+0000 7f902ebf3000 1 --2- 172.21.15.17:0/43736208 >> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] conn(0x55e3ac428880 0x55e3ac454940 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:27.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.655+0000 7f902ebf3000 1 -- 172.21.15.17:0/43736208 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9014065890 msgr2=0x7f9014067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:27.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.655+0000 7f902ebf3000 1 --2- 172.21.15.17:0/43736208 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9014065890 0x7f9014067d40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9018006010 tx=0x7f9018014000 comp rx=0 tx=0).stop 2023-10-06T04:44:27.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.655+0000 7f902ebf3000 1 -- 172.21.15.17:0/43736208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3ac3cc240 msgr2=0x55e3ac429590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:27.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.655+0000 7f902ebf3000 1 --2- 172.21.15.17:0/43736208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3ac3cc240 0x55e3ac429590 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x55e3ac373110 tx=0x7f901c018000 comp rx=0 tx=0).stop 2023-10-06T04:44:27.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.655+0000 7f902862f700 1 -- 172.21.15.17:0/43736208 reap_dead start 2023-10-06T04:44:27.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.655+0000 7f902ebf3000 1 -- 172.21.15.17:0/43736208 shutdown_connections 2023-10-06T04:44:27.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.655+0000 7f902ebf3000 1 -- 172.21.15.17:0/43736208 >> 172.21.15.17:0/43736208 conn(0x55e3ac385a90 msgr2=0x55e3ac43e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:27.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.655+0000 7f902ebf3000 1 -- 172.21.15.17:0/43736208 shutdown_connections 2023-10-06T04:44:27.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.655+0000 7f902ebf3000 1 -- 172.21.15.17:0/43736208 wait complete. 2023-10-06T04:44:27.664 INFO:teuthology.orchestra.run.smithi017.stdout:Y��alphaparent_b 2023-10-06T04:44:27.664 DEBUG:teuthology.orchestra.run.smithi017:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2023-10-06T04:44:27.756 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-06T04:44:27.756 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511628283, 2023-10-06T04:44:27.756 INFO:teuthology.orchestra.run.smithi017.stdout: "ancestors": [ 2023-10-06T04:44:27.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:44:27.756 INFO:teuthology.orchestra.run.smithi017.stdout: "dirino": 1099511628284, 2023-10-06T04:44:27.756 INFO:teuthology.orchestra.run.smithi017.stdout: "dname": "alpha", 2023-10-06T04:44:27.756 INFO:teuthology.orchestra.run.smithi017.stdout: "version": 3 2023-10-06T04:44:27.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-06T04:44:27.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:44:27.756 INFO:teuthology.orchestra.run.smithi017.stdout: "dirino": 1, 2023-10-06T04:44:27.757 INFO:teuthology.orchestra.run.smithi017.stdout: "dname": "parent_b", 2023-10-06T04:44:27.757 INFO:teuthology.orchestra.run.smithi017.stdout: "version": 25 2023-10-06T04:44:27.757 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-06T04:44:27.757 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-06T04:44:27.757 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 6, 2023-10-06T04:44:27.757 INFO:teuthology.orchestra.run.smithi017.stdout: "old_pools": [] 2023-10-06T04:44:27.757 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-06T04:44:27.757 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:27.758 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create data_new --pg_num_min 64 2023-10-06T04:44:27.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.919+0000 7f214dd63700 1 Processor -- start 2023-10-06T04:44:27.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.919+0000 7f214dd63700 1 -- start start 2023-10-06T04:44:27.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.920+0000 7f214dd63700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2148150360 0x7f2148150730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:27.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.920+0000 7f214dd63700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f21480cbb30 0x7f2148159e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:27.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.920+0000 7f214dd63700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21480cc050 con 0x7f21480cb6b0 2023-10-06T04:44:27.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.920+0000 7f214dd63700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21480cc330 con 0x7f21480cbb30 2023-10-06T04:44:27.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.920+0000 7f214dd63700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f214815b130 con 0x7f2148150360 2023-10-06T04:44:27.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.920+0000 7f2147fff700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f21480cbb30 0x7f2148159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:27.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.920+0000 7f2147fff700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f21480cbb30 0x7f2148159e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60846/0 (socket says 172.21.15.17:60846) 2023-10-06T04:44:27.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.920+0000 7f2147fff700 1 -- 172.21.15.17:0/2505528756 learned_addr learned my addr 172.21.15.17:0/2505528756 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:27.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.920+0000 7f2147fff700 1 -- 172.21.15.17:0/2505528756 >> v2:172.21.15.136:3300/0 conn(0x7f2148150360 msgr2=0x7f2148150730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:27.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.920+0000 7f21477fe700 1 --2- 172.21.15.17:0/2505528756 >> v2:172.21.15.136:3300/0 conn(0x7f2148150360 0x7f2148150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:27.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.920+0000 7f2147fff700 1 --2- 172.21.15.17:0/2505528756 >> v2:172.21.15.136:3300/0 conn(0x7f2148150360 0x7f2148150730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:27.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.920+0000 7f2147fff700 1 -- 172.21.15.17:0/2505528756 >> v1:172.21.15.136:6789/0 conn(0x7f21480cb6b0 legacy=0x7f21480cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:27.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.920+0000 7f2147fff700 1 -- 172.21.15.17:0/2505528756 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214815b410 con 0x7f21480cbb30 2023-10-06T04:44:27.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.921+0000 7f2147fff700 1 --2- 172.21.15.17:0/2505528756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21480cbb30 0x7f2148159e30 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2140009f20 tx=0x7f2140009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67be75ccf357a6eb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:27.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.921+0000 7f21467fc700 1 -- 172.21.15.17:0/2505528756 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214000e070 con 0x7f21480cbb30 2023-10-06T04:44:27.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.921+0000 7f21467fc700 1 -- 172.21.15.17:0/2505528756 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214000ba00 con 0x7f21480cbb30 2023-10-06T04:44:27.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.921+0000 7f21467fc700 1 -- 172.21.15.17:0/2505528756 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21400092e0 con 0x7f21480cbb30 2023-10-06T04:44:27.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.921+0000 7f214dd63700 1 -- 172.21.15.17:0/2505528756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21480cbb30 msgr2=0x7f2148159e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:27.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.921+0000 7f214dd63700 1 --2- 172.21.15.17:0/2505528756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21480cbb30 0x7f2148159e30 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2140009f20 tx=0x7f2140009840 comp rx=0 tx=0).stop 2023-10-06T04:44:27.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.921+0000 7f214dd63700 1 -- 172.21.15.17:0/2505528756 shutdown_connections 2023-10-06T04:44:27.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.921+0000 7f214dd63700 1 --2- 172.21.15.17:0/2505528756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21480cbb30 0x7f2148159e30 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:27.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.921+0000 7f214dd63700 1 --2- 172.21.15.17:0/2505528756 >> v2:172.21.15.136:3300/0 conn(0x7f2148150360 0x7f2148150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:27.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.921+0000 7f214dd63700 1 -- 172.21.15.17:0/2505528756 >> 172.21.15.17:0/2505528756 conn(0x7f214808a180 msgr2=0x7f2148099aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:27.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.921+0000 7f214dd63700 1 -- 172.21.15.17:0/2505528756 shutdown_connections 2023-10-06T04:44:27.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.921+0000 7f214dd63700 1 -- 172.21.15.17:0/2505528756 wait complete. 2023-10-06T04:44:27.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.922+0000 7f214dd63700 1 Processor -- start 2023-10-06T04:44:27.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.923+0000 7f214dd63700 1 -- start start 2023-10-06T04:44:27.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.923+0000 7f214dd63700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f21480cb6b0 0x7f21480c9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:27.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.923+0000 7f214dd63700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21480cbb30 0x7f21480b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:27.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.923+0000 7f214dd63700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2148150360 0x7f21481697c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:27.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.923+0000 7f214dd63700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21480b4670 con 0x7f21480cbb30 2023-10-06T04:44:27.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.923+0000 7f214dd63700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21480c9770 con 0x7f2148150360 2023-10-06T04:44:27.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.923+0000 7f214dd63700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21480c9a50 con 0x7f21480cb6b0 2023-10-06T04:44:27.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.923+0000 7f2146ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21480cbb30 0x7f21480b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:27.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.923+0000 7f2146ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21480cbb30 0x7f21480b3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60860/0 (socket says 172.21.15.17:60860) 2023-10-06T04:44:27.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.923+0000 7f2146ffd700 1 -- 172.21.15.17:0/789900933 learned_addr learned my addr 172.21.15.17:0/789900933 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:27.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.924+0000 7f2147fff700 1 --2- 172.21.15.17:0/789900933 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2148150360 0x7f21481697c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:27.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.924+0000 7f21477fe700 1 --2- 172.21.15.17:0/789900933 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f21480cb6b0 0x7f21480c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:27.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.924+0000 7f2146ffd700 1 -- 172.21.15.17:0/789900933 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f21480cb6b0 msgr2=0x7f21480c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:27.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.924+0000 7f2146ffd700 1 --2- 172.21.15.17:0/789900933 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f21480cb6b0 0x7f21480c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:27.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.924+0000 7f2146ffd700 1 -- 172.21.15.17:0/789900933 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2148150360 msgr2=0x7f21481697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:27.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.924+0000 7f2146ffd700 1 --2- 172.21.15.17:0/789900933 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2148150360 0x7f21481697c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:27.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.924+0000 7f2146ffd700 1 -- 172.21.15.17:0/789900933 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2140009ae0 con 0x7f21480cbb30 2023-10-06T04:44:27.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.924+0000 7f2147fff700 1 --2- 172.21.15.17:0/789900933 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2148150360 0x7f21481697c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:27.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.924+0000 7f2146ffd700 1 --2- 172.21.15.17:0/789900933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21480cbb30 0x7f21480b3d40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f213c00c5d0 tx=0x7f213c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:27.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.924+0000 7f212f7fe700 1 -- 172.21.15.17:0/789900933 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c011590 con 0x7f21480cbb30 2023-10-06T04:44:27.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.924+0000 7f212f7fe700 1 -- 172.21.15.17:0/789900933 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213c011710 con 0x7f21480cbb30 2023-10-06T04:44:27.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.924+0000 7f214dd63700 1 -- 172.21.15.17:0/789900933 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21480c9d30 con 0x7f21480cbb30 2023-10-06T04:44:27.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.924+0000 7f212f7fe700 1 -- 172.21.15.17:0/789900933 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c011ad0 con 0x7f21480cbb30 2023-10-06T04:44:27.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.924+0000 7f214dd63700 1 -- 172.21.15.17:0/789900933 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21480b4280 con 0x7f21480cbb30 2023-10-06T04:44:27.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.925+0000 7f214dd63700 1 -- 172.21.15.17:0/789900933 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21480b47e0 con 0x7f21480cbb30 2023-10-06T04:44:27.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.925+0000 7f212f7fe700 1 -- 172.21.15.17:0/789900933 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f213c01c460 con 0x7f21480cbb30 2023-10-06T04:44:27.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.926+0000 7f212f7fe700 1 --2- 172.21.15.17:0/789900933 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2134066f30 0x7f21340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:27.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.926+0000 7f212f7fe700 1 -- 172.21.15.17:0/789900933 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f213c084490 con 0x7f21480cbb30 2023-10-06T04:44:27.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.926+0000 7f21477fe700 1 --2- 172.21.15.17:0/789900933 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2134066f30 0x7f21340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:27.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.926+0000 7f21477fe700 1 --2- 172.21.15.17:0/789900933 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2134066f30 0x7f21340693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2138006fd0 tx=0x7f2138008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:27.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:27.930+0000 7f212f7fe700 1 -- 172.21.15.17:0/789900933 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f213c0515a0 con 0x7f21480cbb30 2023-10-06T04:44:28.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.124+0000 7f214dd63700 1 -- 172.21.15.17:0/789900933 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "data_new", "pg_num_min": 64} v 0) v1 -- 0x7f214806ce80 con 0x7f21480cbb30 2023-10-06T04:44:28.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.426+0000 7f212f7fe700 1 -- 172.21.15.17:0/789900933 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "data_new", "pg_num_min": 64}]=0 pool 'data_new' created v33) v1 ==== 124+0+0 (secure 0 0 0) 0x7f213c054bc0 con 0x7f21480cbb30 2023-10-06T04:44:28.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.431+0000 7f214dd63700 1 -- 172.21.15.17:0/789900933 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2134066f30 msgr2=0x7f21340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:28.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.431+0000 7f214dd63700 1 --2- 172.21.15.17:0/789900933 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2134066f30 0x7f21340693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2138006fd0 tx=0x7f2138008040 comp rx=0 tx=0).stop 2023-10-06T04:44:28.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.431+0000 7f214dd63700 1 -- 172.21.15.17:0/789900933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21480cbb30 msgr2=0x7f21480b3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:28.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.431+0000 7f214dd63700 1 --2- 172.21.15.17:0/789900933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21480cbb30 0x7f21480b3d40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f213c00c5d0 tx=0x7f213c007f60 comp rx=0 tx=0).stop 2023-10-06T04:44:28.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.432+0000 7f214dd63700 1 -- 172.21.15.17:0/789900933 shutdown_connections 2023-10-06T04:44:28.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.432+0000 7f214dd63700 1 --2- 172.21.15.17:0/789900933 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2134066f30 0x7f21340693e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:28.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.432+0000 7f214dd63700 1 --2- 172.21.15.17:0/789900933 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2148150360 0x7f21481697c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:28.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.432+0000 7f214dd63700 1 --2- 172.21.15.17:0/789900933 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f21480cb6b0 0x7f21480c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:28.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.432+0000 7f214dd63700 1 --2- 172.21.15.17:0/789900933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21480cbb30 0x7f21480b3d40 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:28.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.432+0000 7f214dd63700 1 -- 172.21.15.17:0/789900933 >> 172.21.15.17:0/789900933 conn(0x7f214808a180 msgr2=0x7f21480ccdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:28.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.432+0000 7f214dd63700 1 -- 172.21.15.17:0/789900933 shutdown_connections 2023-10-06T04:44:28.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.432+0000 7f214dd63700 1 -- 172.21.15.17:0/789900933 wait complete. 2023-10-06T04:44:28.435 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'data_new' created 2023-10-06T04:44:28.447 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs data_new 2023-10-06T04:44:28.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.566+0000 7f982517f700 1 Processor -- start 2023-10-06T04:44:28.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.566+0000 7f982517f700 1 -- start start 2023-10-06T04:44:28.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.567+0000 7f982517f700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f98200cd5e0 0x7f98200af910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:28.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.567+0000 7f982517f700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f982015a650 0x7f982015d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:28.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.567+0000 7f982517f700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f982015d660 con 0x7f98200af540 2023-10-06T04:44:28.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.567+0000 7f982517f700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98200ce890 con 0x7f98200cd5e0 2023-10-06T04:44:28.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.567+0000 7f982517f700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f982015aa60 con 0x7f982015a650 2023-10-06T04:44:28.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.567+0000 7f981f7fe700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f98200cd5e0 0x7f98200af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:28.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.567+0000 7f981f7fe700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f98200cd5e0 0x7f98200af910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60868/0 (socket says 172.21.15.17:60868) 2023-10-06T04:44:28.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.567+0000 7f981f7fe700 1 -- 172.21.15.17:0/3087925991 learned_addr learned my addr 172.21.15.17:0/3087925991 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:28.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.567+0000 7f981f7fe700 1 -- 172.21.15.17:0/3087925991 >> v2:172.21.15.136:3300/0 conn(0x7f982015a650 msgr2=0x7f982015d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:28.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.567+0000 7f981f7fe700 1 --2- 172.21.15.17:0/3087925991 >> v2:172.21.15.136:3300/0 conn(0x7f982015a650 0x7f982015d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:28.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.567+0000 7f981f7fe700 1 -- 172.21.15.17:0/3087925991 >> v1:172.21.15.136:6789/0 conn(0x7f98200af540 legacy=0x7f98200cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:28.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.567+0000 7f981f7fe700 1 -- 172.21.15.17:0/3087925991 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f982015d890 con 0x7f98200cd5e0 2023-10-06T04:44:28.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.568+0000 7f981f7fe700 1 --2- 172.21.15.17:0/3087925991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98200cd5e0 0x7f98200af910 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f98200caa90 tx=0x7f9808009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a9b4304442ee5c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:28.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.568+0000 7f981effd700 1 -- 172.21.15.17:0/3087925991 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980800b820 con 0x7f98200cd5e0 2023-10-06T04:44:28.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.568+0000 7f981effd700 1 -- 172.21.15.17:0/3087925991 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980800b980 con 0x7f98200cd5e0 2023-10-06T04:44:28.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.568+0000 7f981effd700 1 -- 172.21.15.17:0/3087925991 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980800bd20 con 0x7f98200cd5e0 2023-10-06T04:44:28.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.568+0000 7f982517f700 1 -- 172.21.15.17:0/3087925991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98200cd5e0 msgr2=0x7f98200af910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:28.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.568+0000 7f982517f700 1 --2- 172.21.15.17:0/3087925991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98200cd5e0 0x7f98200af910 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f98200caa90 tx=0x7f9808009250 comp rx=0 tx=0).stop 2023-10-06T04:44:28.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.568+0000 7f982517f700 1 -- 172.21.15.17:0/3087925991 shutdown_connections 2023-10-06T04:44:28.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.568+0000 7f982517f700 1 --2- 172.21.15.17:0/3087925991 >> v2:172.21.15.136:3300/0 conn(0x7f982015a650 0x7f982015d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:28.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.568+0000 7f982517f700 1 --2- 172.21.15.17:0/3087925991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98200cd5e0 0x7f98200af910 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:28.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.568+0000 7f982517f700 1 -- 172.21.15.17:0/3087925991 >> 172.21.15.17:0/3087925991 conn(0x7f982006d9b0 msgr2=0x7f982006ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:28.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.568+0000 7f982517f700 1 -- 172.21.15.17:0/3087925991 shutdown_connections 2023-10-06T04:44:28.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.568+0000 7f982517f700 1 -- 172.21.15.17:0/3087925991 wait complete. 2023-10-06T04:44:28.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.569+0000 7f982517f700 1 Processor -- start 2023-10-06T04:44:28.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.570+0000 7f982517f700 1 -- start start 2023-10-06T04:44:28.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.570+0000 7f982517f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98200af540 0x7f9820147fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:28.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.570+0000 7f982517f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98200cd5e0 0x7f98200c7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:28.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.570+0000 7f982517f700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f982015a650 0x7f98200d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:28.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.570+0000 7f982517f700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98200ca8b0 con 0x7f98200af540 2023-10-06T04:44:28.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.570+0000 7f982517f700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9820148520 con 0x7f98200cd5e0 2023-10-06T04:44:28.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.570+0000 7f982517f700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98200ca010 con 0x7f982015a650 2023-10-06T04:44:28.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.570+0000 7f981ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98200af540 0x7f9820147fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:28.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.570+0000 7f981ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98200af540 0x7f9820147fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60880/0 (socket says 172.21.15.17:60880) 2023-10-06T04:44:28.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.570+0000 7f981ffff700 1 -- 172.21.15.17:0/2220560632 learned_addr learned my addr 172.21.15.17:0/2220560632 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:28.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.571+0000 7f982497e700 1 --2- 172.21.15.17:0/2220560632 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f982015a650 0x7f98200d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:28.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.571+0000 7f981f7fe700 1 --2- 172.21.15.17:0/2220560632 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98200cd5e0 0x7f98200c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:28.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.571+0000 7f981ffff700 1 -- 172.21.15.17:0/2220560632 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f982015a650 msgr2=0x7f98200d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:28.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.571+0000 7f981ffff700 1 --2- 172.21.15.17:0/2220560632 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f982015a650 0x7f98200d04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:28.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.571+0000 7f981ffff700 1 -- 172.21.15.17:0/2220560632 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98200cd5e0 msgr2=0x7f98200c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:28.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.571+0000 7f981ffff700 1 --2- 172.21.15.17:0/2220560632 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98200cd5e0 0x7f98200c7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:28.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.571+0000 7f981ffff700 1 -- 172.21.15.17:0/2220560632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98080094f0 con 0x7f98200af540 2023-10-06T04:44:28.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.571+0000 7f981ffff700 1 --2- 172.21.15.17:0/2220560632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98200af540 0x7f9820147fe0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f981000b610 tx=0x7f98100090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:28.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.571+0000 7f9817fff700 1 -- 172.21.15.17:0/2220560632 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981000f510 con 0x7f98200af540 2023-10-06T04:44:28.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.571+0000 7f9817fff700 1 -- 172.21.15.17:0/2220560632 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981000f690 con 0x7f98200af540 2023-10-06T04:44:28.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.571+0000 7f9817fff700 1 -- 172.21.15.17:0/2220560632 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981000fa50 con 0x7f98200af540 2023-10-06T04:44:28.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.571+0000 7f982517f700 1 -- 172.21.15.17:0/2220560632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98200ca2f0 con 0x7f98200af540 2023-10-06T04:44:28.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.571+0000 7f982517f700 1 -- 172.21.15.17:0/2220560632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98200b3890 con 0x7f98200af540 2023-10-06T04:44:28.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.572+0000 7f982517f700 1 -- 172.21.15.17:0/2220560632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98200b36f0 con 0x7f98200af540 2023-10-06T04:44:28.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.573+0000 7f9817fff700 1 -- 172.21.15.17:0/2220560632 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f981001a400 con 0x7f98200af540 2023-10-06T04:44:28.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.573+0000 7f9817fff700 1 --2- 172.21.15.17:0/2220560632 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9800066f30 0x7f98000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:28.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.573+0000 7f9817fff700 1 -- 172.21.15.17:0/2220560632 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6421+0+0 (secure 0 0 0) 0x7f9810084360 con 0x7f98200af540 2023-10-06T04:44:28.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.573+0000 7f981f7fe700 1 --2- 172.21.15.17:0/2220560632 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9800066f30 0x7f98000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:28.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.573+0000 7f981f7fe700 1 --2- 172.21.15.17:0/2220560632 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9800066f30 0x7f98000693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f98200caa90 tx=0x7f9808016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:28.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.577+0000 7f9817fff700 1 -- 172.21.15.17:0/2220560632 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f98200b36f0 con 0x7f98200af540 2023-10-06T04:44:28.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:28.817+0000 7f982517f700 1 -- 172.21.15.17:0/2220560632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "data_new"} v 0) v1 -- 0x7f98200b36f0 con 0x7f98200af540 2023-10-06T04:44:29.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.446+0000 7f9817fff700 1 -- 172.21.15.17:0/2220560632 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "data_new"}]=0 added data pool 7 to fsmap v17) v1 ==== 131+0+0 (secure 0 0 0) 0x7f98200b36f0 con 0x7f98200af540 2023-10-06T04:44:29.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.450+0000 7f982517f700 1 -- 172.21.15.17:0/2220560632 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9800066f30 msgr2=0x7f98000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:29.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.450+0000 7f982517f700 1 --2- 172.21.15.17:0/2220560632 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9800066f30 0x7f98000693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f98200caa90 tx=0x7f9808016000 comp rx=0 tx=0).stop 2023-10-06T04:44:29.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.450+0000 7f982517f700 1 -- 172.21.15.17:0/2220560632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98200af540 msgr2=0x7f9820147fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:29.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.450+0000 7f982517f700 1 --2- 172.21.15.17:0/2220560632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98200af540 0x7f9820147fe0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f981000b610 tx=0x7f98100090f0 comp rx=0 tx=0).stop 2023-10-06T04:44:29.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.450+0000 7f982517f700 1 -- 172.21.15.17:0/2220560632 shutdown_connections 2023-10-06T04:44:29.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.450+0000 7f982517f700 1 --2- 172.21.15.17:0/2220560632 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9800066f30 0x7f98000693e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:29.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.450+0000 7f982517f700 1 --2- 172.21.15.17:0/2220560632 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f982015a650 0x7f98200d04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:29.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.450+0000 7f982517f700 1 --2- 172.21.15.17:0/2220560632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98200af540 0x7f9820147fe0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:29.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.450+0000 7f982517f700 1 --2- 172.21.15.17:0/2220560632 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98200cd5e0 0x7f98200c7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:29.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.450+0000 7f982517f700 1 -- 172.21.15.17:0/2220560632 >> 172.21.15.17:0/2220560632 conn(0x7f982006d9b0 msgr2=0x7f982006dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:29.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.450+0000 7f982517f700 1 -- 172.21.15.17:0/2220560632 shutdown_connections 2023-10-06T04:44:29.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.450+0000 7f982517f700 1 -- 172.21.15.17:0/2220560632 wait complete. 2023-10-06T04:44:29.454 INFO:teuthology.orchestra.run.smithi017.stderr:added data pool 7 to fsmap 2023-10-06T04:44:29.466 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:44:29.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.590+0000 7f1474f04700 1 Processor -- start 2023-10-06T04:44:29.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.590+0000 7f1474f04700 1 -- start start 2023-10-06T04:44:29.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.591+0000 7f1474f04700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1470142d50 0x7f14700c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:29.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.591+0000 7f1474f04700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f147006c560 0x7f147006c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:29.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.591+0000 7f1474f04700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f147006cf10 con 0x7f14700caf00 2023-10-06T04:44:29.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.591+0000 7f1474f04700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14700c3070 con 0x7f147006c560 2023-10-06T04:44:29.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.591+0000 7f1474f04700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14700c3a40 con 0x7f1470142d50 2023-10-06T04:44:29.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.591+0000 7f146dd9b700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f147006c560 0x7f147006c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:29.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.591+0000 7f146ed9d700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f14700caf00 0x7f14700cb340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:44710/0 (socket says 172.21.15.17:44710) 2023-10-06T04:44:29.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.591+0000 7f146ed9d700 1 -- 172.21.15.17:0/2940800439 learned_addr learned my addr 172.21.15.17:0/2940800439 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:29.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.591+0000 7f146dd9b700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f147006c560 0x7f147006c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60886/0 (socket says 172.21.15.17:60886) 2023-10-06T04:44:29.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.591+0000 7f146e59c700 1 --2- 172.21.15.17:0/2940800439 >> v2:172.21.15.136:3300/0 conn(0x7f1470142d50 0x7f14700c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:29.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.591+0000 7f146dd9b700 1 -- 172.21.15.17:0/2940800439 >> v2:172.21.15.136:3300/0 conn(0x7f1470142d50 msgr2=0x7f14700c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:29.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.591+0000 7f146dd9b700 1 --2- 172.21.15.17:0/2940800439 >> v2:172.21.15.136:3300/0 conn(0x7f1470142d50 0x7f14700c3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:29.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.591+0000 7f146dd9b700 1 -- 172.21.15.17:0/2940800439 >> v1:172.21.15.17:6789/0 conn(0x7f14700caf00 legacy=0x7f14700cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:29.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.591+0000 7f146d59a700 1 -- 172.21.15.17:0/2940800439 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 41547947 0 0) 0x7f147006cf10 con 0x7f14700caf00 2023-10-06T04:44:29.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.591+0000 7f146dd9b700 1 -- 172.21.15.17:0/2940800439 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14700cbb50 con 0x7f147006c560 2023-10-06T04:44:29.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.591+0000 7f146dd9b700 1 --2- 172.21.15.17:0/2940800439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f147006c560 0x7f147006c9d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f147006e570 tx=0x7f14640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f8d5018aed7bd4f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:29.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.592+0000 7f146d59a700 1 -- 172.21.15.17:0/2940800439 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146400b6b0 con 0x7f147006c560 2023-10-06T04:44:29.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.592+0000 7f146d59a700 1 -- 172.21.15.17:0/2940800439 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146400b810 con 0x7f147006c560 2023-10-06T04:44:29.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.592+0000 7f146d59a700 1 -- 172.21.15.17:0/2940800439 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146400bbb0 con 0x7f147006c560 2023-10-06T04:44:29.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.592+0000 7f1474f04700 1 -- 172.21.15.17:0/2940800439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f147006c560 msgr2=0x7f147006c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:29.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.592+0000 7f1474f04700 1 --2- 172.21.15.17:0/2940800439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f147006c560 0x7f147006c9d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f147006e570 tx=0x7f14640091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:29.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.592+0000 7f1474f04700 1 -- 172.21.15.17:0/2940800439 shutdown_connections 2023-10-06T04:44:29.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.592+0000 7f1474f04700 1 --2- 172.21.15.17:0/2940800439 >> v2:172.21.15.136:3300/0 conn(0x7f1470142d50 0x7f14700c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:29.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.592+0000 7f1474f04700 1 --2- 172.21.15.17:0/2940800439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f147006c560 0x7f147006c9d0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:29.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.592+0000 7f1474f04700 1 -- 172.21.15.17:0/2940800439 >> 172.21.15.17:0/2940800439 conn(0x7f147006e140 msgr2=0x7f14700cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:29.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.592+0000 7f1474f04700 1 -- 172.21.15.17:0/2940800439 shutdown_connections 2023-10-06T04:44:29.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.592+0000 7f1474f04700 1 -- 172.21.15.17:0/2940800439 wait complete. 2023-10-06T04:44:29.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.593+0000 7f1474f04700 1 Processor -- start 2023-10-06T04:44:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.593+0000 7f1474f04700 1 -- start start 2023-10-06T04:44:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.594+0000 7f1474f04700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f147006c560 0x7f1470140f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.594+0000 7f1474f04700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f14700caf00 0x7f14700b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.594+0000 7f1474f04700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1470142d50 0x7f147015c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.594+0000 7f1474f04700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14700b09b0 con 0x7f147006c560 2023-10-06T04:44:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.594+0000 7f1474f04700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14700b0c90 con 0x7f1470142d50 2023-10-06T04:44:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.594+0000 7f1474f04700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14700b0f70 con 0x7f14700caf00 2023-10-06T04:44:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.594+0000 7f146e59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f147006c560 0x7f1470140f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.594+0000 7f146e59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f147006c560 0x7f1470140f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60902/0 (socket says 172.21.15.17:60902) 2023-10-06T04:44:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.594+0000 7f146e59c700 1 -- 172.21.15.17:0/446210905 learned_addr learned my addr 172.21.15.17:0/446210905 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.594+0000 7f146ed9d700 1 --2- 172.21.15.17:0/446210905 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1470142d50 0x7f147015c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:29.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.594+0000 7f146dd9b700 1 --2- 172.21.15.17:0/446210905 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f14700caf00 0x7f14700b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:29.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.595+0000 7f146e59c700 1 -- 172.21.15.17:0/446210905 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f14700caf00 msgr2=0x7f14700b00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:29.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.595+0000 7f146e59c700 1 --2- 172.21.15.17:0/446210905 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f14700caf00 0x7f14700b00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:29.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.595+0000 7f146e59c700 1 -- 172.21.15.17:0/446210905 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1470142d50 msgr2=0x7f147015c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:29.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.595+0000 7f146e59c700 1 --2- 172.21.15.17:0/446210905 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1470142d50 0x7f147015c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:29.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.595+0000 7f146e59c700 1 -- 172.21.15.17:0/446210905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1464009420 con 0x7f147006c560 2023-10-06T04:44:29.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.595+0000 7f146ed9d700 1 --2- 172.21.15.17:0/446210905 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1470142d50 0x7f147015c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:29.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.595+0000 7f146e59c700 1 --2- 172.21.15.17:0/446210905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f147006c560 0x7f1470140f30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f146000d860 tx=0x7f1460008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:29.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.595+0000 7f145e7fc700 1 -- 172.21.15.17:0/446210905 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1460009610 con 0x7f147006c560 2023-10-06T04:44:29.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.595+0000 7f145e7fc700 1 -- 172.21.15.17:0/446210905 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1460009770 con 0x7f147006c560 2023-10-06T04:44:29.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.595+0000 7f1474f04700 1 -- 172.21.15.17:0/446210905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14700b1250 con 0x7f147006c560 2023-10-06T04:44:29.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.595+0000 7f145e7fc700 1 -- 172.21.15.17:0/446210905 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1460009b30 con 0x7f147006c560 2023-10-06T04:44:29.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.595+0000 7f1474f04700 1 -- 172.21.15.17:0/446210905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14700b1a50 con 0x7f147006c560 2023-10-06T04:44:29.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.596+0000 7f1474f04700 1 -- 172.21.15.17:0/446210905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14700b18a0 con 0x7f147006c560 2023-10-06T04:44:29.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.596+0000 7f145e7fc700 1 -- 172.21.15.17:0/446210905 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f146001e460 con 0x7f147006c560 2023-10-06T04:44:29.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.597+0000 7f145e7fc700 1 --2- 172.21.15.17:0/446210905 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1450066f30 0x7f14500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:29.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.597+0000 7f145e7fc700 1 -- 172.21.15.17:0/446210905 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f1460084e10 con 0x7f147006c560 2023-10-06T04:44:29.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.597+0000 7f146dd9b700 1 --2- 172.21.15.17:0/446210905 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1450066f30 0x7f14500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:29.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.597+0000 7f146dd9b700 1 --2- 172.21.15.17:0/446210905 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1450066f30 0x7f14500693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f14640093f0 tx=0x7f1464017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:29.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.601+0000 7f145e7fc700 1 -- 172.21.15.17:0/446210905 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1460051d90 con 0x7f147006c560 2023-10-06T04:44:29.741 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:44:29.743 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:44:29.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.840+0000 7f1474f04700 1 -- 172.21.15.17:0/446210905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1470063ff0 con 0x7f147006c560 2023-10-06T04:44:29.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.840+0000 7f145e7fc700 1 -- 172.21.15.17:0/446210905 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f14600553b0 con 0x7f147006c560 2023-10-06T04:44:29.842 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:29.842 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6834/3741747962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3741747962},{"type":"v1","addr":"172.21.15.136:6834","nonce":3741747962}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4688,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/264192509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6833","nonce":264192509},{"type":"v1","addr":"172.21.15.136:6835","nonce":264192509}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4909,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6836/1154731767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1154731767},{"type":"v1","addr":"172.21.15.17:6836","nonce":1154731767}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:44:14.988901+0000","modified":"2023-10-06T04:44:29.425634+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4971":{"gid":4971,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6837/460551791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6835","nonce":460551791},{"type":"v1","addr":"172.21.15.17:6837","nonce":460551791}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:44:29.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.842+0000 7f1474f04700 1 -- 172.21.15.17:0/446210905 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1450066f30 msgr2=0x7f14500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:29.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.842+0000 7f1474f04700 1 --2- 172.21.15.17:0/446210905 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1450066f30 0x7f14500693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f14640093f0 tx=0x7f1464017000 comp rx=0 tx=0).stop 2023-10-06T04:44:29.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.842+0000 7f1474f04700 1 -- 172.21.15.17:0/446210905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f147006c560 msgr2=0x7f1470140f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:29.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.842+0000 7f1474f04700 1 --2- 172.21.15.17:0/446210905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f147006c560 0x7f1470140f30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f146000d860 tx=0x7f1460008040 comp rx=0 tx=0).stop 2023-10-06T04:44:29.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.842+0000 7f1474f04700 1 -- 172.21.15.17:0/446210905 shutdown_connections 2023-10-06T04:44:29.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.842+0000 7f1474f04700 1 --2- 172.21.15.17:0/446210905 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1450066f30 0x7f14500693e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:29.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.842+0000 7f1474f04700 1 --2- 172.21.15.17:0/446210905 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1470142d50 0x7f147015c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:29.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.842+0000 7f1474f04700 1 --2- 172.21.15.17:0/446210905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f147006c560 0x7f1470140f30 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:29.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.842+0000 7f1474f04700 1 --2- 172.21.15.17:0/446210905 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f14700caf00 0x7f14700b00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:29.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.842+0000 7f1474f04700 1 -- 172.21.15.17:0/446210905 >> 172.21.15.17:0/446210905 conn(0x7f147006e140 msgr2=0x7f1470141df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:29.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.842+0000 7f1474f04700 1 -- 172.21.15.17:0/446210905 shutdown_connections 2023-10-06T04:44:29.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.842+0000 7f1474f04700 1 -- 172.21.15.17:0/446210905 wait complete. 2023-10-06T04:44:29.846 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 17 2023-10-06T04:44:29.856 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:44:29.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.972+0000 7f175f9b4700 1 Processor -- start 2023-10-06T04:44:29.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.972+0000 7f175f9b4700 1 -- start start 2023-10-06T04:44:29.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.973+0000 7f175f9b4700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f175815ca80 0x7f175806e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:29.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.973+0000 7f175f9b4700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f175815dae0 0x7f17580ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:29.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.973+0000 7f175f9b4700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17580ab250 con 0x7f175815ce50 2023-10-06T04:44:29.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.973+0000 7f175f9b4700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f175806e660 con 0x7f175815ca80 2023-10-06T04:44:29.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.973+0000 7f175f9b4700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f175806e940 con 0x7f175815dae0 2023-10-06T04:44:29.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.973+0000 7f175d750700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f175815ca80 0x7f175806e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:29.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.973+0000 7f175d750700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f175815ca80 0x7f175806e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60914/0 (socket says 172.21.15.17:60914) 2023-10-06T04:44:29.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.973+0000 7f175d750700 1 -- 172.21.15.17:0/578241004 learned_addr learned my addr 172.21.15.17:0/578241004 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:29.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.974+0000 7f175df51700 1 --2- 172.21.15.17:0/578241004 >> v2:172.21.15.136:3300/0 conn(0x7f175815dae0 0x7f17580ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:29.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.974+0000 7f175d750700 1 -- 172.21.15.17:0/578241004 >> v2:172.21.15.136:3300/0 conn(0x7f175815dae0 msgr2=0x7f17580ab6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:29.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.974+0000 7f175d750700 1 --2- 172.21.15.17:0/578241004 >> v2:172.21.15.136:3300/0 conn(0x7f175815dae0 0x7f17580ab6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:29.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.974+0000 7f175d750700 1 -- 172.21.15.17:0/578241004 >> v1:172.21.15.136:6789/0 conn(0x7f175815ce50 legacy=0x7f175815d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:29.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.974+0000 7f175d750700 1 -- 172.21.15.17:0/578241004 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175806ec20 con 0x7f175815ca80 2023-10-06T04:44:29.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.974+0000 7f175df51700 1 --2- 172.21.15.17:0/578241004 >> v2:172.21.15.136:3300/0 conn(0x7f175815dae0 0x7f17580ab6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:29.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.974+0000 7f175d750700 1 --2- 172.21.15.17:0/578241004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f175815ca80 0x7f175806e050 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f17580b1030 tx=0x7f1750009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7327f356bb139a84 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:29.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.974+0000 7f1757fff700 1 -- 172.21.15.17:0/578241004 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175000b820 con 0x7f175815ca80 2023-10-06T04:44:29.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.974+0000 7f1757fff700 1 -- 172.21.15.17:0/578241004 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175000b980 con 0x7f175815ca80 2023-10-06T04:44:29.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.974+0000 7f1757fff700 1 -- 172.21.15.17:0/578241004 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175000bd20 con 0x7f175815ca80 2023-10-06T04:44:29.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.975+0000 7f175f9b4700 1 -- 172.21.15.17:0/578241004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f175815ca80 msgr2=0x7f175806e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:29.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.975+0000 7f175f9b4700 1 --2- 172.21.15.17:0/578241004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f175815ca80 0x7f175806e050 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f17580b1030 tx=0x7f1750009250 comp rx=0 tx=0).stop 2023-10-06T04:44:29.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.975+0000 7f175f9b4700 1 -- 172.21.15.17:0/578241004 shutdown_connections 2023-10-06T04:44:29.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.975+0000 7f175f9b4700 1 --2- 172.21.15.17:0/578241004 >> v2:172.21.15.136:3300/0 conn(0x7f175815dae0 0x7f17580ab6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:29.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.975+0000 7f175f9b4700 1 --2- 172.21.15.17:0/578241004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f175815ca80 0x7f175806e050 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:29.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.975+0000 7f175f9b4700 1 -- 172.21.15.17:0/578241004 >> 172.21.15.17:0/578241004 conn(0x7f175806cd40 msgr2=0x7f1758087fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:29.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.975+0000 7f175f9b4700 1 -- 172.21.15.17:0/578241004 shutdown_connections 2023-10-06T04:44:29.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.975+0000 7f175f9b4700 1 -- 172.21.15.17:0/578241004 wait complete. 2023-10-06T04:44:29.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.976+0000 7f175f9b4700 1 Processor -- start 2023-10-06T04:44:29.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.976+0000 7f175f9b4700 1 -- start start 2023-10-06T04:44:29.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.977+0000 7f175f9b4700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f175815ca80 0x7f175814c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:29.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.977+0000 7f175f9b4700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f175815ce50 0x7f175814c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:29.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.977+0000 7f175f9b4700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f175815dae0 0x7f17580c9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:29.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.977+0000 7f175f9b4700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17580b3eb0 con 0x7f175815ce50 2023-10-06T04:44:29.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.977+0000 7f175f9b4700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17580b1a10 con 0x7f175815dae0 2023-10-06T04:44:29.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.977+0000 7f175f9b4700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17580c8fe0 con 0x7f175815ca80 2023-10-06T04:44:29.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.977+0000 7f175cf4f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f175815ce50 0x7f175814c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:29.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.977+0000 7f175cf4f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f175815ce50 0x7f175814c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60916/0 (socket says 172.21.15.17:60916) 2023-10-06T04:44:29.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.977+0000 7f175cf4f700 1 -- 172.21.15.17:0/2911500109 learned_addr learned my addr 172.21.15.17:0/2911500109 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:29.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.977+0000 7f175df51700 1 --2- 172.21.15.17:0/2911500109 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f175815dae0 0x7f17580c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:29.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.977+0000 7f175d750700 1 --2- 172.21.15.17:0/2911500109 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f175815ca80 0x7f175814c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:29.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.977+0000 7f175cf4f700 1 -- 172.21.15.17:0/2911500109 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f175815ca80 msgr2=0x7f175814c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:29.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.977+0000 7f175cf4f700 1 --2- 172.21.15.17:0/2911500109 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f175815ca80 0x7f175814c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:29.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.977+0000 7f175cf4f700 1 -- 172.21.15.17:0/2911500109 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f175815dae0 msgr2=0x7f17580c9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:29.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.977+0000 7f175cf4f700 1 --2- 172.21.15.17:0/2911500109 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f175815dae0 0x7f17580c9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:29.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.977+0000 7f175cf4f700 1 -- 172.21.15.17:0/2911500109 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17500094f0 con 0x7f175815ce50 2023-10-06T04:44:29.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.977+0000 7f175df51700 1 --2- 172.21.15.17:0/2911500109 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f175815dae0 0x7f17580c9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:29.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.977+0000 7f175cf4f700 1 --2- 172.21.15.17:0/2911500109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f175815ce50 0x7f175814c000 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f174c00c600 tx=0x7f174c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:29.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.977+0000 7f17557fa700 1 -- 172.21.15.17:0/2911500109 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c011590 con 0x7f175815ce50 2023-10-06T04:44:29.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.977+0000 7f17557fa700 1 -- 172.21.15.17:0/2911500109 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174c011710 con 0x7f175815ce50 2023-10-06T04:44:29.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.977+0000 7f175f9b4700 1 -- 172.21.15.17:0/2911500109 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f175814c540 con 0x7f175815ce50 2023-10-06T04:44:29.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.978+0000 7f17557fa700 1 -- 172.21.15.17:0/2911500109 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c011ad0 con 0x7f175815ce50 2023-10-06T04:44:29.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.978+0000 7f175f9b4700 1 -- 172.21.15.17:0/2911500109 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17580b13c0 con 0x7f175815ce50 2023-10-06T04:44:29.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.978+0000 7f175f9b4700 1 -- 172.21.15.17:0/2911500109 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1758063ff0 con 0x7f175815ce50 2023-10-06T04:44:29.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.979+0000 7f17557fa700 1 -- 172.21.15.17:0/2911500109 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f174c01c460 con 0x7f175815ce50 2023-10-06T04:44:29.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.979+0000 7f17557fa700 1 --2- 172.21.15.17:0/2911500109 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1744066f30 0x7f17440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:29.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.979+0000 7f17557fa700 1 -- 172.21.15.17:0/2911500109 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f174c0845f0 con 0x7f175815ce50 2023-10-06T04:44:29.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.979+0000 7f175d750700 1 --2- 172.21.15.17:0/2911500109 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1744066f30 0x7f17440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:29.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.980+0000 7f175d750700 1 --2- 172.21.15.17:0/2911500109 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1744066f30 0x7f17440693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f17580b1030 tx=0x7f1750016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:29.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:29.984+0000 7f17557fa700 1 -- 172.21.15.17:0/2911500109 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f174c051570 con 0x7f175815ce50 2023-10-06T04:44:30.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.176+0000 7f175f9b4700 1 -- 172.21.15.17:0/2911500109 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f175806ef00 con 0x7f175815ce50 2023-10-06T04:44:30.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.177+0000 7f17557fa700 1 -- 172.21.15.17:0/2911500109 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+18438 (secure 0 0 0) 0x7f174c054b90 con 0x7f175815ce50 2023-10-06T04:44:30.179 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:30.179 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":34,"fsid":"780777c4-2b25-4d35-9058-c9f2d62e3ad9","created":"2023-10-06T04:43:10.578520+0000","modified":"2023-10-06T04:44:28.818811+0000","last_up_change":"2023-10-06T04:43:20.682958+0000","last_in_change":"2023-10-06T04:43:12.978917+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:43:21.795733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:43:22.389592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:44:13.266447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T04:44:13.958240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":7,"pool_name":"data_new","create_time":"2023-10-06T04:44:28.154714+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"84737b08-575c-46dd-9488-073ae8504494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6809","nonce":90656},{"type":"v1","addr":"172.21.15.17:6811","nonce":90656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":90656},{"type":"v1","addr":"172.21.15.17:6814","nonce":90656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":90656},{"type":"v1","addr":"172.21.15.17:6822","nonce":90656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":90656},{"type":"v1","addr":"172.21.15.17:6818","nonce":90656}]},"public_addr":"172.21.15.17:6811/90656","cluster_addr":"172.21.15.17:6814/90656","heartbeat_back_addr":"172.21.15.17:6822/90656","heartbeat_front_addr":"172.21.15.17:6818/90656","state":["exists","up"]},{"osd":1,"uuid":"dffeb740-58a2-4fd6-8ff1-a0a11a2cc709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":90655},{"type":"v1","addr":"172.21.15.17:6801","nonce":90655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":90655},{"type":"v1","addr":"172.21.15.17:6803","nonce":90655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":90655},{"type":"v1","addr":"172.21.15.17:6807","nonce":90655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":90655},{"type":"v1","addr":"172.21.15.17:6805","nonce":90655}]},"public_addr":"172.21.15.17:6801/90655","cluster_addr":"172.21.15.17:6803/90655","heartbeat_back_addr":"172.21.15.17:6807/90655","heartbeat_front_addr":"172.21.15.17:6805/90655","state":["exists","up"]},{"osd":2,"uuid":"48bd6831-763d-48c2-b515-e02c216d608b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":90657},{"type":"v1","addr":"172.21.15.17:6810","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":90657},{"type":"v1","addr":"172.21.15.17:6815","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":90657},{"type":"v1","addr":"172.21.15.17:6823","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":90657},{"type":"v1","addr":"172.21.15.17:6819","nonce":90657}]},"public_addr":"172.21.15.17:6810/90657","cluster_addr":"172.21.15.17:6815/90657","heartbeat_back_addr":"172.21.15.17:6823/90657","heartbeat_front_addr":"172.21.15.17:6819/90657","state":["exists","up"]},{"osd":3,"uuid":"ae7dbb23-abe7-4bd3-a4df-6f5963d6804c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":90688},{"type":"v1","addr":"172.21.15.17:6825","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":90688},{"type":"v1","addr":"172.21.15.17:6827","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":90688},{"type":"v1","addr":"172.21.15.17:6831","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":90688},{"type":"v1","addr":"172.21.15.17:6829","nonce":90688}]},"public_addr":"172.21.15.17:6825/90688","cluster_addr":"172.21.15.17:6827/90688","heartbeat_back_addr":"172.21.15.17:6831/90688","heartbeat_front_addr":"172.21.15.17:6829/90688","state":["exists","up"]},{"osd":4,"uuid":"29991fb4-1667-4ea3-aca0-d55db27f3bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":90902},{"type":"v1","addr":"172.21.15.136:6801","nonce":90902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":90902},{"type":"v1","addr":"172.21.15.136:6803","nonce":90902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":90902},{"type":"v1","addr":"172.21.15.136:6807","nonce":90902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":90902},{"type":"v1","addr":"172.21.15.136:6805","nonce":90902}]},"public_addr":"172.21.15.136:6801/90902","cluster_addr":"172.21.15.136:6803/90902","heartbeat_back_addr":"172.21.15.136:6807/90902","heartbeat_front_addr":"172.21.15.136:6805/90902","state":["exists","up"]},{"osd":5,"uuid":"398b4ff9-03fc-421f-882c-ba12aa088eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":90901},{"type":"v1","addr":"172.21.15.136:6809","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":90901},{"type":"v1","addr":"172.21.15.136:6811","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":90901},{"type":"v1","addr":"172.21.15.136:6815","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":90901},{"type":"v1","addr":"172.21.15.136:6813","nonce":90901}]},"public_addr":"172.21.15.136:6809/90901","cluster_addr":"172.21.15.136:6811/90901","heartbeat_back_addr":"172.21.15.136:6815/90901","heartbeat_front_addr":"172.21.15.136:6813/90901","state":["exists","up"]},{"osd":6,"uuid":"1bb91a72-4dab-4cdb-aa1d-2b8a9edf1ad0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":90927},{"type":"v1","addr":"172.21.15.136:6825","nonce":90927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":90927},{"type":"v1","addr":"172.21.15.136:6827","nonce":90927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":90927},{"type":"v1","addr":"172.21.15.136:6831","nonce":90927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":90927},{"type":"v1","addr":"172.21.15.136:6829","nonce":90927}]},"public_addr":"172.21.15.136:6825/90927","cluster_addr":"172.21.15.136:6827/90927","heartbeat_back_addr":"172.21.15.136:6831/90927","heartbeat_front_addr":"172.21.15.136:6829/90927","state":["exists","up"]},{"osd":7,"uuid":"719b654e-010d-4aa4-8c13-83fdde242b47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":90934},{"type":"v1","addr":"172.21.15.136:6817","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":90934},{"type":"v1","addr":"172.21.15.136:6819","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":90934},{"type":"v1","addr":"172.21.15.136:6824","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":90934},{"type":"v1","addr":"172.21.15.136:6821","nonce":90934}]},"public_addr":"172.21.15.136:6817/90934","cluster_addr":"172.21.15.136:6819/90934","heartbeat_back_addr":"172.21.15.136:6824/90934","heartbeat_front_addr":"172.21.15.136:6821/90934","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.157479+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.140520+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.190743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.231396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.156510+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.145822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.202888+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.139532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:44:30.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.179+0000 7f175f9b4700 1 -- 172.21.15.17:0/2911500109 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1744066f30 msgr2=0x7f17440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:30.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.179+0000 7f175f9b4700 1 --2- 172.21.15.17:0/2911500109 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1744066f30 0x7f17440693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f17580b1030 tx=0x7f1750016000 comp rx=0 tx=0).stop 2023-10-06T04:44:30.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.179+0000 7f175f9b4700 1 -- 172.21.15.17:0/2911500109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f175815ce50 msgr2=0x7f175814c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:30.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.179+0000 7f175f9b4700 1 --2- 172.21.15.17:0/2911500109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f175815ce50 0x7f175814c000 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f174c00c600 tx=0x7f174c007f60 comp rx=0 tx=0).stop 2023-10-06T04:44:30.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.179+0000 7f175f9b4700 1 -- 172.21.15.17:0/2911500109 shutdown_connections 2023-10-06T04:44:30.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.179+0000 7f175f9b4700 1 --2- 172.21.15.17:0/2911500109 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f1744066f30 0x7f17440693e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:30.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.179+0000 7f175f9b4700 1 --2- 172.21.15.17:0/2911500109 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f175815dae0 0x7f17580c9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:30.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.179+0000 7f175f9b4700 1 --2- 172.21.15.17:0/2911500109 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f175815ca80 0x7f175814c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:30.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.179+0000 7f175f9b4700 1 --2- 172.21.15.17:0/2911500109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f175815ce50 0x7f175814c000 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:30.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.179+0000 7f175f9b4700 1 -- 172.21.15.17:0/2911500109 >> 172.21.15.17:0/2911500109 conn(0x7f175806cd40 msgr2=0x7f1758067e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:30.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.179+0000 7f175f9b4700 1 -- 172.21.15.17:0/2911500109 shutdown_connections 2023-10-06T04:44:30.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.179+0000 7f175f9b4700 1 -- 172.21.15.17:0/2911500109 wait complete. 2023-10-06T04:44:30.194 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:44:30.194 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout.pool -v data_new ./parent_b/alpha) 2023-10-06T04:44:30.221 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:44:30.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.379+0000 7fd620260700 1 Processor -- start 2023-10-06T04:44:30.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.379+0000 7fd620260700 1 -- start start 2023-10-06T04:44:30.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.380+0000 7fd620260700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6180b12e0 0x7fd6180cea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:30.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.380+0000 7fd620260700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6180cfc80 con 0x7fd618159630 2023-10-06T04:44:30.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.380+0000 7fd620260700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6180cf070 con 0x7fd6180cd760 2023-10-06T04:44:30.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.380+0000 7fd620260700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6180cf350 con 0x7fd6180b12e0 2023-10-06T04:44:30.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.380+0000 7fd61dffc700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fd618159630 0x7fd6180cd050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:44716/0 (socket says 172.21.15.17:44716) 2023-10-06T04:44:30.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.380+0000 7fd61dffc700 1 -- 172.21.15.17:0/429400223 learned_addr learned my addr 172.21.15.17:0/429400223 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:30.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.380+0000 7fd61e7fd700 1 --2- 172.21.15.17:0/429400223 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6180b12e0 0x7fd6180cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:30.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.380+0000 7fd61cffa700 1 -- 172.21.15.17:0/429400223 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1135864717 0 0) 0x7fd6180cfc80 con 0x7fd618159630 2023-10-06T04:44:30.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.380+0000 7fd61cffa700 1 -- 172.21.15.17:0/429400223 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd604003570 con 0x7fd618159630 2023-10-06T04:44:30.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.380+0000 7fd61cffa700 1 -- 172.21.15.17:0/429400223 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1781796991 0 0) 0x7fd604003570 con 0x7fd618159630 2023-10-06T04:44:30.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.381+0000 7fd61cffa700 1 -- 172.21.15.17:0/429400223 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6180b12e0 msgr2=0x7fd6180cea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:30.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.381+0000 7fd61cffa700 1 --2- 172.21.15.17:0/429400223 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6180b12e0 0x7fd6180cea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:30.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.381+0000 7fd61cffa700 1 -- 172.21.15.17:0/429400223 >> v1:172.21.15.136:6789/0 conn(0x7fd6180cd760 legacy=0x7fd6180ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:30.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.381+0000 7fd61cffa700 1 -- 172.21.15.17:0/429400223 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6180cf630 con 0x7fd618159630 2023-10-06T04:44:30.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.381+0000 7fd61cffa700 1 -- 172.21.15.17:0/429400223 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4268781140 0 0) 0x7fd614001470 con 0x7fd618159630 2023-10-06T04:44:30.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.381+0000 7fd61cffa700 1 -- 172.21.15.17:0/429400223 >> v1:172.21.15.17:6789/0 conn(0x7fd618159630 legacy=0x7fd6180cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:30.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.381+0000 7fd61cffa700 1 --2- 172.21.15.17:0/429400223 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd604003a90 0x7fd604003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:30.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.381+0000 7fd61cffa700 1 --2- 172.21.15.17:0/429400223 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6180b12e0 0x7fd604004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:30.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.381+0000 7fd61cffa700 1 --2- 172.21.15.17:0/429400223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd604004d50 0x7fd6040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:30.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.381+0000 7fd61cffa700 1 -- 172.21.15.17:0/429400223 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6180cf350 con 0x7fd604004d50 2023-10-06T04:44:30.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.381+0000 7fd61cffa700 1 -- 172.21.15.17:0/429400223 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60400bb40 con 0x7fd604003a90 2023-10-06T04:44:30.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.381+0000 7fd61cffa700 1 -- 172.21.15.17:0/429400223 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd60400bd00 con 0x7fd6180b12e0 2023-10-06T04:44:30.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.381+0000 7fd61e7fd700 1 --2- 172.21.15.17:0/429400223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd604004d50 0x7fd6040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:30.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.381+0000 7fd61dffc700 1 --2- 172.21.15.17:0/429400223 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd604003a90 0x7fd604003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:30.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.381+0000 7fd61d7fb700 1 --2- 172.21.15.17:0/429400223 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6180b12e0 0x7fd604004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:30.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.381+0000 7fd61e7fd700 1 -- 172.21.15.17:0/429400223 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6180b12e0 msgr2=0x7fd604004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:30.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.381+0000 7fd61e7fd700 1 --2- 172.21.15.17:0/429400223 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6180b12e0 0x7fd604004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:30.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.381+0000 7fd61e7fd700 1 -- 172.21.15.17:0/429400223 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd604003a90 msgr2=0x7fd604003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:30.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.381+0000 7fd61e7fd700 1 --2- 172.21.15.17:0/429400223 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd604003a90 0x7fd604003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:30.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.381+0000 7fd61e7fd700 1 -- 172.21.15.17:0/429400223 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd604003570 con 0x7fd604004d50 2023-10-06T04:44:30.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.381+0000 7fd61e7fd700 1 --2- 172.21.15.17:0/429400223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd604004d50 0x7fd6040051c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd6180b1740 tx=0x7fd61000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1fb4e678bc76ac4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:30.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.381+0000 7fd61cffa700 1 -- 172.21.15.17:0/429400223 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61000ea90 con 0x7fd604004d50 2023-10-06T04:44:30.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.381+0000 7fd61cffa700 1 -- 172.21.15.17:0/429400223 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61000f040 con 0x7fd604004d50 2023-10-06T04:44:30.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.381+0000 7fd61cffa700 1 -- 172.21.15.17:0/429400223 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61000ee40 con 0x7fd604004d50 2023-10-06T04:44:30.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.382+0000 7fd620260700 1 -- 172.21.15.17:0/429400223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd604004d50 msgr2=0x7fd6040051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:30.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.382+0000 7fd620260700 1 --2- 172.21.15.17:0/429400223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd604004d50 0x7fd6040051c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd6180b1740 tx=0x7fd61000b040 comp rx=0 tx=0).stop 2023-10-06T04:44:30.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.382+0000 7fd61e7fd700 1 -- 172.21.15.17:0/429400223 reap_dead start 2023-10-06T04:44:30.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.382+0000 7fd620260700 1 -- 172.21.15.17:0/429400223 shutdown_connections 2023-10-06T04:44:30.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.382+0000 7fd620260700 1 -- 172.21.15.17:0/429400223 >> 172.21.15.17:0/429400223 conn(0x7fd61806cff0 msgr2=0x7fd61806d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:30.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.382+0000 7fd620260700 1 -- 172.21.15.17:0/429400223 shutdown_connections 2023-10-06T04:44:30.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.382+0000 7fd620260700 1 -- 172.21.15.17:0/429400223 wait complete. 2023-10-06T04:44:30.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.383+0000 7fd620260700 1 Processor -- start 2023-10-06T04:44:30.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.383+0000 7fd620260700 1 -- start start 2023-10-06T04:44:30.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.384+0000 7fd620260700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd618141ba0 0x7fd6181568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:30.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.384+0000 7fd620260700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd618141f70 0x7fd61815bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:30.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.384+0000 7fd620260700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd61815a9d0 0x7fd61815ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:30.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.384+0000 7fd620260700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd618156e20 con 0x7fd618141f70 2023-10-06T04:44:30.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.384+0000 7fd620260700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd61815b390 con 0x7fd618141ba0 2023-10-06T04:44:30.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.384+0000 7fd620260700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd61815c140 con 0x7fd61815a9d0 2023-10-06T04:44:30.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.384+0000 7fd61d7fb700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd618141f70 0x7fd61815bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:30.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.384+0000 7fd61d7fb700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd618141f70 0x7fd61815bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60926/0 (socket says 172.21.15.17:60926) 2023-10-06T04:44:30.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.384+0000 7fd61d7fb700 1 -- 172.21.15.17:0/632392914 learned_addr learned my addr 172.21.15.17:0/632392914 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:30.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.384+0000 7fd61dffc700 1 --2- 172.21.15.17:0/632392914 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd618141ba0 0x7fd6181568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:30.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.384+0000 7fd61d7fb700 1 -- 172.21.15.17:0/632392914 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd61815a9d0 msgr2=0x7fd61815ae50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T04:44:30.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.384+0000 7fd61d7fb700 1 --2- 172.21.15.17:0/632392914 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd61815a9d0 0x7fd61815ae50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:30.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.384+0000 7fd61d7fb700 1 -- 172.21.15.17:0/632392914 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd618141ba0 msgr2=0x7fd6181568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:30.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.384+0000 7fd61d7fb700 1 --2- 172.21.15.17:0/632392914 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd618141ba0 0x7fd6181568e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:30.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.384+0000 7fd61d7fb700 1 -- 172.21.15.17:0/632392914 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd61815cf80 con 0x7fd618141f70 2023-10-06T04:44:30.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.384+0000 7fd61d7fb700 1 --2- 172.21.15.17:0/632392914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd618141f70 0x7fd61815bc00 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd608002a90 tx=0x7fd608007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:30.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.385+0000 7fd60dffb700 1 -- 172.21.15.17:0/632392914 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60800f8d0 con 0x7fd618141f70 2023-10-06T04:44:30.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.385+0000 7fd60dffb700 1 -- 172.21.15.17:0/632392914 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60800fa30 con 0x7fd618141f70 2023-10-06T04:44:30.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.385+0000 7fd620260700 1 -- 172.21.15.17:0/632392914 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd61815c370 con 0x7fd618141f70 2023-10-06T04:44:30.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.385+0000 7fd60dffb700 1 -- 172.21.15.17:0/632392914 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60800fdd0 con 0x7fd618141f70 2023-10-06T04:44:30.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.385+0000 7fd620260700 1 -- 172.21.15.17:0/632392914 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd61815c930 con 0x7fd618141f70 2023-10-06T04:44:30.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.386+0000 7fd620260700 1 -- 172.21.15.17:0/632392914 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd61815d110 con 0x7fd618141f70 2023-10-06T04:44:30.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.386+0000 7fd60dffb700 1 -- 172.21.15.17:0/632392914 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd608013600 con 0x7fd618141f70 2023-10-06T04:44:30.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.386+0000 7fd60dffb700 1 --2- 172.21.15.17:0/632392914 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd5fc066f30 0x7fd5fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:30.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.387+0000 7fd60dffb700 1 -- 172.21.15.17:0/632392914 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6453+0+0 (secure 0 0 0) 0x7fd608084d60 con 0x7fd618141f70 2023-10-06T04:44:30.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.387+0000 7fd61dffc700 1 --2- 172.21.15.17:0/632392914 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd5fc066f30 0x7fd5fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:30.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.387+0000 7fd61dffc700 1 --2- 172.21.15.17:0/632392914 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd5fc066f30 0x7fd5fc0693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd6140010e0 tx=0x7fd614001e70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:30.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.391+0000 7fd60dffb700 1 -- 172.21.15.17:0/632392914 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd608051ce0 con 0x7fd618141f70 2023-10-06T04:44:30.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.637+0000 7fd620260700 1 -- 172.21.15.17:0/632392914 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd618063ff0 con 0x7fd618141f70 2023-10-06T04:44:30.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.638+0000 7fd60dffb700 1 -- 172.21.15.17:0/632392914 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fd608017090 con 0x7fd618141f70 2023-10-06T04:44:30.640 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:30.640 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6834/3741747962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3741747962},{"type":"v1","addr":"172.21.15.136:6834","nonce":3741747962}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4688,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/264192509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6833","nonce":264192509},{"type":"v1","addr":"172.21.15.136:6835","nonce":264192509}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4909,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6836/1154731767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1154731767},{"type":"v1","addr":"172.21.15.17:6836","nonce":1154731767}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:44:14.988901+0000","modified":"2023-10-06T04:44:29.425634+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4971":{"gid":4971,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6837/460551791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6835","nonce":460551791},{"type":"v1","addr":"172.21.15.17:6837","nonce":460551791}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:44:30.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.640+0000 7fd620260700 1 -- 172.21.15.17:0/632392914 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd5fc066f30 msgr2=0x7fd5fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:30.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.640+0000 7fd620260700 1 --2- 172.21.15.17:0/632392914 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd5fc066f30 0x7fd5fc0693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd6140010e0 tx=0x7fd614001e70 comp rx=0 tx=0).stop 2023-10-06T04:44:30.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.640+0000 7fd620260700 1 -- 172.21.15.17:0/632392914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd618141f70 msgr2=0x7fd61815bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:30.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.640+0000 7fd620260700 1 --2- 172.21.15.17:0/632392914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd618141f70 0x7fd61815bc00 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd608002a90 tx=0x7fd608007d10 comp rx=0 tx=0).stop 2023-10-06T04:44:30.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.640+0000 7fd620260700 1 -- 172.21.15.17:0/632392914 shutdown_connections 2023-10-06T04:44:30.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.640+0000 7fd620260700 1 --2- 172.21.15.17:0/632392914 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd5fc066f30 0x7fd5fc0693e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:30.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.640+0000 7fd620260700 1 --2- 172.21.15.17:0/632392914 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd61815a9d0 0x7fd61815ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:30.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.640+0000 7fd620260700 1 --2- 172.21.15.17:0/632392914 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd618141ba0 0x7fd6181568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:30.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.640+0000 7fd620260700 1 --2- 172.21.15.17:0/632392914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd618141f70 0x7fd61815bc00 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:30.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.640+0000 7fd620260700 1 -- 172.21.15.17:0/632392914 >> 172.21.15.17:0/632392914 conn(0x7fd61806cff0 msgr2=0x7fd6180b21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:30.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.640+0000 7fd620260700 1 -- 172.21.15.17:0/632392914 shutdown_connections 2023-10-06T04:44:30.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.640+0000 7fd620260700 1 -- 172.21.15.17:0/632392914 wait complete. 2023-10-06T04:44:30.643 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 17 2023-10-06T04:44:30.654 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2023-10-06T04:44:30.799 INFO:teuthology.orchestra.run.smithi017.stdout:{"message":"","return_code":0} 2023-10-06T04:44:30.800 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-10-06T04:44:30.800 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001fb.00000000 parent 2023-10-06T04:44:30.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.837+0000 7fdae24f1000 1 Processor -- start 2023-10-06T04:44:30.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.837+0000 7fdae24f1000 1 -- start start 2023-10-06T04:44:30.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.838+0000 7fdae24f1000 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55df14767ff0 0x55df14824db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:30.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.838+0000 7fdae24f1000 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55df1476a9e0 0x55df1476b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:30.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.838+0000 7fdae24f1000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df14825900 0x55df1476bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:30.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.838+0000 7fdae24f1000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df146b4980 con 0x55df14825900 2023-10-06T04:44:30.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.838+0000 7fdae24f1000 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df146b4620 con 0x55df14767ff0 2023-10-06T04:44:30.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.838+0000 7fdae24f1000 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x55df146ab400 con 0x55df1476a9e0 2023-10-06T04:44:30.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.838+0000 7fdadbf2d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df14825900 0x55df1476bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:30.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.838+0000 7fdadbf2d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df14825900 0x55df1476bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51542/0 (socket says 172.21.15.17:51542) 2023-10-06T04:44:30.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.838+0000 7fdadbf2d700 1 -- 172.21.15.17:0/295081806 learned_addr learned my addr 172.21.15.17:0/295081806 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:30.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.838+0000 7fdadb72c700 1 --2- 172.21.15.17:0/295081806 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55df14767ff0 0x55df14824db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:30.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.838+0000 7fdadaf2b700 1 --2- 172.21.15.17:0/295081806 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55df1476a9e0 0x55df1476b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:30.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.839+0000 7fdadbf2d700 1 -- 172.21.15.17:0/295081806 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55df1476a9e0 msgr2=0x55df1476b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:30.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.839+0000 7fdadbf2d700 1 --2- 172.21.15.17:0/295081806 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55df1476a9e0 0x55df1476b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:30.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.839+0000 7fdadbf2d700 1 -- 172.21.15.17:0/295081806 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55df14767ff0 msgr2=0x55df14824db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:30.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.839+0000 7fdadbf2d700 1 --2- 172.21.15.17:0/295081806 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55df14767ff0 0x55df14824db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:30.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.839+0000 7fdadbf2d700 1 -- 172.21.15.17:0/295081806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac4005cf0 con 0x55df14825900 2023-10-06T04:44:30.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.839+0000 7fdadbf2d700 1 --2- 172.21.15.17:0/295081806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df14825900 0x55df1476bdc0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fdacc00f590 tx=0x7fdacc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f655c26717a9e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:30.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.839+0000 7fdad9f29700 1 -- 172.21.15.17:0/295081806 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc00fe50 con 0x55df14825900 2023-10-06T04:44:30.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.839+0000 7fdad9f29700 1 -- 172.21.15.17:0/295081806 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdacc00f860 con 0x55df14825900 2023-10-06T04:44:30.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.839+0000 7fdad9f29700 1 -- 172.21.15.17:0/295081806 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc024470 con 0x55df14825900 2023-10-06T04:44:30.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.839+0000 7fdae24f1000 1 -- 172.21.15.17:0/295081806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df14825900 msgr2=0x55df1476bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:30.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.839+0000 7fdae24f1000 1 --2- 172.21.15.17:0/295081806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df14825900 0x55df1476bdc0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fdacc00f590 tx=0x7fdacc015000 comp rx=0 tx=0).stop 2023-10-06T04:44:30.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.839+0000 7fdae24f1000 1 -- 172.21.15.17:0/295081806 shutdown_connections 2023-10-06T04:44:30.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.839+0000 7fdae24f1000 1 --2- 172.21.15.17:0/295081806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df14825900 0x55df1476bdc0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:30.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.839+0000 7fdae24f1000 1 --2- 172.21.15.17:0/295081806 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55df14767ff0 0x55df14824db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:30.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.839+0000 7fdae24f1000 1 --2- 172.21.15.17:0/295081806 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55df1476a9e0 0x55df1476b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:30.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.839+0000 7fdae24f1000 1 -- 172.21.15.17:0/295081806 >> 172.21.15.17:0/295081806 conn(0x55df147962b0 msgr2=0x55df14799af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:30.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.839+0000 7fdae24f1000 1 -- 172.21.15.17:0/295081806 shutdown_connections 2023-10-06T04:44:30.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.839+0000 7fdae24f1000 1 -- 172.21.15.17:0/295081806 wait complete. 2023-10-06T04:44:30.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.840+0000 7fdae24f1000 1 Processor -- start 2023-10-06T04:44:30.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.840+0000 7fdae24f1000 1 -- start start 2023-10-06T04:44:30.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.841+0000 7fdae24f1000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df14767ff0 0x55df148505c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:30.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.841+0000 7fdae24f1000 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55df1476a9e0 0x55df14796680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:30.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.841+0000 7fdae24f1000 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55df14825900 0x55df14796bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:30.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.841+0000 7fdae24f1000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df14823ba0 con 0x55df14767ff0 2023-10-06T04:44:30.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.841+0000 7fdae24f1000 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df14823e40 con 0x55df1476a9e0 2023-10-06T04:44:30.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.841+0000 7fdae24f1000 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x55df148240e0 con 0x55df14825900 2023-10-06T04:44:30.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.841+0000 7fdadb72c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df14767ff0 0x55df148505c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:30.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.841+0000 7fdadb72c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df14767ff0 0x55df148505c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51554/0 (socket says 172.21.15.17:51554) 2023-10-06T04:44:30.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.841+0000 7fdadb72c700 1 -- 172.21.15.17:0/171636288 learned_addr learned my addr 172.21.15.17:0/171636288 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:30.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.841+0000 7fdadaf2b700 1 --2- 172.21.15.17:0/171636288 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55df1476a9e0 0x55df14796680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:30.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.841+0000 7fdadbf2d700 1 --2- 172.21.15.17:0/171636288 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55df14825900 0x55df14796bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:30.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.841+0000 7fdadb72c700 1 -- 172.21.15.17:0/171636288 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55df14825900 msgr2=0x55df14796bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:30.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.841+0000 7fdadb72c700 1 --2- 172.21.15.17:0/171636288 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55df14825900 0x55df14796bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:30.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.841+0000 7fdadb72c700 1 -- 172.21.15.17:0/171636288 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55df1476a9e0 msgr2=0x55df14796680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:30.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.841+0000 7fdadb72c700 1 --2- 172.21.15.17:0/171636288 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55df1476a9e0 0x55df14796680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:30.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.841+0000 7fdadb72c700 1 -- 172.21.15.17:0/171636288 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df146dd1c0 con 0x55df14767ff0 2023-10-06T04:44:30.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.841+0000 7fdadb72c700 1 --2- 172.21.15.17:0/171636288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df14767ff0 0x55df148505c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fdad400c6e0 tx=0x7fdad4001730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:30.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.841+0000 7fdad3fff700 1 -- 172.21.15.17:0/171636288 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad4001bc0 con 0x55df14767ff0 2023-10-06T04:44:30.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.842+0000 7fdad3fff700 1 -- 172.21.15.17:0/171636288 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad4005030 con 0x55df14767ff0 2023-10-06T04:44:30.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.842+0000 7fdae24f1000 1 -- 172.21.15.17:0/171636288 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdacc00a0e0 con 0x55df14767ff0 2023-10-06T04:44:30.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.842+0000 7fdad3fff700 1 -- 172.21.15.17:0/171636288 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad400f660 con 0x55df14767ff0 2023-10-06T04:44:30.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.842+0000 7fdae24f1000 1 -- 172.21.15.17:0/171636288 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55df146c33d0 con 0x55df14767ff0 2023-10-06T04:44:30.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.843+0000 7fdad3fff700 1 -- 172.21.15.17:0/171636288 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdad4015020 con 0x55df14767ff0 2023-10-06T04:44:30.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.843+0000 7fdad3fff700 1 --2- 172.21.15.17:0/171636288 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fdabc065890 0x7fdabc067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:30.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.843+0000 7fdadaf2b700 1 --2- 172.21.15.17:0/171636288 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fdabc065890 0x7fdabc067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:30.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.843+0000 7fdad3fff700 1 -- 172.21.15.17:0/171636288 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6453+0+0 (secure 0 0 0) 0x7fdad4083690 con 0x55df14767ff0 2023-10-06T04:44:30.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.843+0000 7fdae24f1000 1 --2- 172.21.15.17:0/171636288 >> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] conn(0x55df147adcb0 0x55df147ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:30.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.844+0000 7fdae24f1000 1 -- 172.21.15.17:0/171636288 --> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] -- osd_op(unknown.0.0:1 6.13 6:ca8fdbba:::100000001fb.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55df147ae5f0 con 0x55df147adcb0 2023-10-06T04:44:30.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.844+0000 7fdadbf2d700 1 --2- 172.21.15.17:0/171636288 >> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] conn(0x55df147adcb0 0x55df147ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:30.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.844+0000 7fdadaf2b700 1 --2- 172.21.15.17:0/171636288 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fdabc065890 0x7fdabc067d40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdac4009c00 tx=0x7fdac400c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:30.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.844+0000 7fdadbf2d700 1 --2- 172.21.15.17:0/171636288 >> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] conn(0x55df147adcb0 0x55df147ae0b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:30.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.844+0000 7fdadbf2d700 1 -- 172.21.15.17:0/171636288 <== osd.3 v2:172.21.15.17:6824/90688 1 ==== osd_op_reply(1 100000001fb.00000000 [getxattr (103) out=103b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+103 (crc 0 0 0) 0x7fdacc020030 con 0x55df147adcb0 2023-10-06T04:44:30.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.844+0000 7fdae24f1000 1 -- 172.21.15.17:0/171636288 >> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] conn(0x55df147adcb0 msgr2=0x55df147ae0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:30.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.844+0000 7fdae24f1000 1 --2- 172.21.15.17:0/171636288 >> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] conn(0x55df147adcb0 0x55df147ae0b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:30.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.844+0000 7fdae24f1000 1 -- 172.21.15.17:0/171636288 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fdabc065890 msgr2=0x7fdabc067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:30.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.844+0000 7fdae24f1000 1 --2- 172.21.15.17:0/171636288 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fdabc065890 0x7fdabc067d40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdac4009c00 tx=0x7fdac400c040 comp rx=0 tx=0).stop 2023-10-06T04:44:30.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.844+0000 7fdae24f1000 1 -- 172.21.15.17:0/171636288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df14767ff0 msgr2=0x55df148505c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:30.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.844+0000 7fdae24f1000 1 --2- 172.21.15.17:0/171636288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df14767ff0 0x55df148505c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fdad400c6e0 tx=0x7fdad4001730 comp rx=0 tx=0).stop 2023-10-06T04:44:30.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.844+0000 7fdadbf2d700 1 -- 172.21.15.17:0/171636288 reap_dead start 2023-10-06T04:44:30.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.844+0000 7fdae24f1000 1 -- 172.21.15.17:0/171636288 shutdown_connections 2023-10-06T04:44:30.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.844+0000 7fdae24f1000 1 -- 172.21.15.17:0/171636288 >> 172.21.15.17:0/171636288 conn(0x55df147962b0 msgr2=0x55df14799ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:30.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.845+0000 7fdae24f1000 1 -- 172.21.15.17:0/171636288 shutdown_connections 2023-10-06T04:44:30.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:30.845+0000 7fdae24f1000 1 -- 172.21.15.17:0/171636288 wait complete. 2023-10-06T04:44:30.853 INFO:teuthology.orchestra.run.smithi017.stdout:a��alphaparent_b 2023-10-06T04:44:30.853 DEBUG:teuthology.orchestra.run.smithi017:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2023-10-06T04:44:30.945 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-06T04:44:30.945 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511628283, 2023-10-06T04:44:30.945 INFO:teuthology.orchestra.run.smithi017.stdout: "ancestors": [ 2023-10-06T04:44:30.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:44:30.946 INFO:teuthology.orchestra.run.smithi017.stdout: "dirino": 1099511628284, 2023-10-06T04:44:30.946 INFO:teuthology.orchestra.run.smithi017.stdout: "dname": "alpha", 2023-10-06T04:44:30.946 INFO:teuthology.orchestra.run.smithi017.stdout: "version": 7 2023-10-06T04:44:30.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-06T04:44:30.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:44:30.946 INFO:teuthology.orchestra.run.smithi017.stdout: "dirino": 1, 2023-10-06T04:44:30.946 INFO:teuthology.orchestra.run.smithi017.stdout: "dname": "parent_b", 2023-10-06T04:44:30.946 INFO:teuthology.orchestra.run.smithi017.stdout: "version": 30 2023-10-06T04:44:30.946 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-06T04:44:30.946 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-06T04:44:30.946 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 7, 2023-10-06T04:44:30.947 INFO:teuthology.orchestra.run.smithi017.stdout: "old_pools": [ 2023-10-06T04:44:30.947 INFO:teuthology.orchestra.run.smithi017.stdout: 6 2023-10-06T04:44:30.947 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-06T04:44:30.947 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-06T04:44:30.947 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:30.948 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool data_new getxattr 100000001fb.00000000 parent 2023-10-06T04:44:31.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.026+0000 7f2857eec000 1 Processor -- start 2023-10-06T04:44:31.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.026+0000 7f2857eec000 1 -- start start 2023-10-06T04:44:31.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.026+0000 7f2857eec000 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559eb794dfd0 0x559eb79fee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:31.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.026+0000 7f2857eec000 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559eb796af50 0x559eb7a050d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:31.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.026+0000 7f2857eec000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559eb79f8250 0x559eb7a05610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:31.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.026+0000 7f2857eec000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559eb786c620 con 0x559eb79f8250 2023-10-06T04:44:31.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.026+0000 7f2857eec000 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x559eb7863400 con 0x559eb794dfd0 2023-10-06T04:44:31.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.026+0000 7f2857eec000 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x559eb7950340 con 0x559eb796af50 2023-10-06T04:44:31.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.026+0000 7f2851928700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559eb79f8250 0x559eb7a05610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:31.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.026+0000 7f2851928700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559eb79f8250 0x559eb7a05610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51580/0 (socket says 172.21.15.17:51580) 2023-10-06T04:44:31.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.026+0000 7f2851928700 1 -- 172.21.15.17:0/2849880094 learned_addr learned my addr 172.21.15.17:0/2849880094 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:31.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.027+0000 7f2851127700 1 --2- 172.21.15.17:0/2849880094 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559eb794dfd0 0x559eb79fee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:31.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.027+0000 7f2850926700 1 --2- 172.21.15.17:0/2849880094 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559eb796af50 0x559eb7a050d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:31.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.027+0000 7f2851928700 1 -- 172.21.15.17:0/2849880094 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559eb796af50 msgr2=0x559eb7a050d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:31.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.027+0000 7f2851928700 1 --2- 172.21.15.17:0/2849880094 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559eb796af50 0x559eb7a050d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.027+0000 7f2851928700 1 -- 172.21.15.17:0/2849880094 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559eb794dfd0 msgr2=0x559eb79fee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:31.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.027+0000 7f2851928700 1 --2- 172.21.15.17:0/2849880094 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559eb794dfd0 0x559eb79fee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.027+0000 7f2851928700 1 -- 172.21.15.17:0/2849880094 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2844005db0 con 0x559eb79f8250 2023-10-06T04:44:31.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.027+0000 7f2851928700 1 --2- 172.21.15.17:0/2849880094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559eb79f8250 0x559eb7a05610 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f284c00b600 tx=0x7f284c007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6576d26e2208ce1e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:31.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.027+0000 7f28437fe700 1 -- 172.21.15.17:0/2849880094 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284c0106f0 con 0x559eb79f8250 2023-10-06T04:44:31.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.027+0000 7f28437fe700 1 -- 172.21.15.17:0/2849880094 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284c00b050 con 0x559eb79f8250 2023-10-06T04:44:31.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.027+0000 7f28437fe700 1 -- 172.21.15.17:0/2849880094 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284c010a60 con 0x559eb79f8250 2023-10-06T04:44:31.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.027+0000 7f2857eec000 1 -- 172.21.15.17:0/2849880094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559eb79f8250 msgr2=0x559eb7a05610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:31.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.027+0000 7f2857eec000 1 --2- 172.21.15.17:0/2849880094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559eb79f8250 0x559eb7a05610 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f284c00b600 tx=0x7f284c007040 comp rx=0 tx=0).stop 2023-10-06T04:44:31.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.027+0000 7f2857eec000 1 -- 172.21.15.17:0/2849880094 shutdown_connections 2023-10-06T04:44:31.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.027+0000 7f2857eec000 1 --2- 172.21.15.17:0/2849880094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559eb79f8250 0x559eb7a05610 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.027+0000 7f2857eec000 1 --2- 172.21.15.17:0/2849880094 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559eb794dfd0 0x559eb79fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.027+0000 7f2857eec000 1 --2- 172.21.15.17:0/2849880094 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559eb796af50 0x559eb7a050d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.027+0000 7f2857eec000 1 -- 172.21.15.17:0/2849880094 >> 172.21.15.17:0/2849880094 conn(0x559eb7922a90 msgr2=0x559eb794cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:31.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.027+0000 7f2857eec000 1 -- 172.21.15.17:0/2849880094 shutdown_connections 2023-10-06T04:44:31.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.028+0000 7f2857eec000 1 -- 172.21.15.17:0/2849880094 wait complete. 2023-10-06T04:44:31.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.028+0000 7f2857eec000 1 Processor -- start 2023-10-06T04:44:31.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.028+0000 7f2857eec000 1 -- start start 2023-10-06T04:44:31.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.029+0000 7f2857eec000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559eb794dfd0 0x559eb79ebcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:31.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.029+0000 7f2857eec000 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559eb796af50 0x559eb7a00880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:31.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.029+0000 7f2857eec000 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559eb79f8250 0x559eb7a00dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:31.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.029+0000 7f2857eec000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559eb7965210 con 0x559eb794dfd0 2023-10-06T04:44:31.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.029+0000 7f2857eec000 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x559eb7965440 con 0x559eb79f8250 2023-10-06T04:44:31.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.029+0000 7f2857eec000 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x559eb79ecff0 con 0x559eb796af50 2023-10-06T04:44:31.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.029+0000 7f2851127700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559eb794dfd0 0x559eb79ebcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:31.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.029+0000 7f2851127700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559eb794dfd0 0x559eb79ebcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51594/0 (socket says 172.21.15.17:51594) 2023-10-06T04:44:31.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.029+0000 7f2851127700 1 -- 172.21.15.17:0/189039461 learned_addr learned my addr 172.21.15.17:0/189039461 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:31.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.029+0000 7f2851928700 1 --2- 172.21.15.17:0/189039461 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559eb79f8250 0x559eb7a00dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:31.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.029+0000 7f2850926700 1 --2- 172.21.15.17:0/189039461 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559eb796af50 0x559eb7a00880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:31.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.029+0000 7f2851127700 1 -- 172.21.15.17:0/189039461 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559eb796af50 msgr2=0x559eb7a00880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:31.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.029+0000 7f2851127700 1 --2- 172.21.15.17:0/189039461 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559eb796af50 0x559eb7a00880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.029+0000 7f2851127700 1 -- 172.21.15.17:0/189039461 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559eb79f8250 msgr2=0x559eb7a00dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:31.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.029+0000 7f2851127700 1 --2- 172.21.15.17:0/189039461 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559eb79f8250 0x559eb7a00dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.029+0000 7f2851127700 1 -- 172.21.15.17:0/189039461 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284c00b230 con 0x559eb794dfd0 2023-10-06T04:44:31.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.029+0000 7f2850926700 1 --2- 172.21.15.17:0/189039461 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559eb796af50 0x559eb7a00880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:31.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.029+0000 7f2851127700 1 --2- 172.21.15.17:0/189039461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559eb794dfd0 0x559eb79ebcc0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f284400c010 tx=0x7f2844016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:31.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.030+0000 7f2841ffb700 1 -- 172.21.15.17:0/189039461 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2844012a60 con 0x559eb794dfd0 2023-10-06T04:44:31.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.030+0000 7f2841ffb700 1 -- 172.21.15.17:0/189039461 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2844020070 con 0x559eb794dfd0 2023-10-06T04:44:31.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.030+0000 7f2857eec000 1 -- 172.21.15.17:0/189039461 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559eb78951c0 con 0x559eb794dfd0 2023-10-06T04:44:31.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.030+0000 7f2841ffb700 1 -- 172.21.15.17:0/189039461 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2844012e10 con 0x559eb794dfd0 2023-10-06T04:44:31.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.030+0000 7f2857eec000 1 -- 172.21.15.17:0/189039461 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559eb787b3d0 con 0x559eb794dfd0 2023-10-06T04:44:31.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.031+0000 7f2841ffb700 1 -- 172.21.15.17:0/189039461 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f284401b410 con 0x559eb794dfd0 2023-10-06T04:44:31.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.031+0000 7f2841ffb700 1 --2- 172.21.15.17:0/189039461 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f28340658c0 0x7f2834067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:31.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.031+0000 7f2841ffb700 1 -- 172.21.15.17:0/189039461 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f2844022070 con 0x559eb794dfd0 2023-10-06T04:44:31.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.031+0000 7f2850926700 1 --2- 172.21.15.17:0/189039461 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f28340658c0 0x7f2834067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:31.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.032+0000 7f2857eec000 1 --2- 172.21.15.17:0/189039461 >> [v2:172.21.15.17:6809/90656,v1:172.21.15.17:6811/90656] conn(0x559eb7a01300 0x559eb7967420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:31.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.032+0000 7f2857eec000 1 -- 172.21.15.17:0/189039461 --> [v2:172.21.15.17:6809/90656,v1:172.21.15.17:6811/90656] -- osd_op(unknown.0.0:1 7.13 7:ca8fdbba:::100000001fb.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559eb7967960 con 0x559eb7a01300 2023-10-06T04:44:31.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.032+0000 7f2851928700 1 --2- 172.21.15.17:0/189039461 >> [v2:172.21.15.17:6809/90656,v1:172.21.15.17:6811/90656] conn(0x559eb7a01300 0x559eb7967420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:31.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.032+0000 7f2850926700 1 --2- 172.21.15.17:0/189039461 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f28340658c0 0x7f2834067d70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f284800a8f0 tx=0x7f2848005e50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:31.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.032+0000 7f2851928700 1 --2- 172.21.15.17:0/189039461 >> [v2:172.21.15.17:6809/90656,v1:172.21.15.17:6811/90656] conn(0x559eb7a01300 0x559eb7967420 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:31.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.032+0000 7f2851928700 1 -- 172.21.15.17:0/189039461 <== osd.0 v2:172.21.15.17:6809/90656 1 ==== osd_op_reply(1 100000001fb.00000000 [getxattr (103) out=103b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+103 (crc 0 0 0) 0x7f284c0108f0 con 0x559eb7a01300 2023-10-06T04:44:31.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.032+0000 7f2857eec000 1 -- 172.21.15.17:0/189039461 >> [v2:172.21.15.17:6809/90656,v1:172.21.15.17:6811/90656] conn(0x559eb7a01300 msgr2=0x559eb7967420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:31.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.032+0000 7f2857eec000 1 --2- 172.21.15.17:0/189039461 >> [v2:172.21.15.17:6809/90656,v1:172.21.15.17:6811/90656] conn(0x559eb7a01300 0x559eb7967420 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.032+0000 7f2857eec000 1 -- 172.21.15.17:0/189039461 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f28340658c0 msgr2=0x7f2834067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:31.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.032+0000 7f2857eec000 1 --2- 172.21.15.17:0/189039461 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f28340658c0 0x7f2834067d70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f284800a8f0 tx=0x7f2848005e50 comp rx=0 tx=0).stop 2023-10-06T04:44:31.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.032+0000 7f2857eec000 1 -- 172.21.15.17:0/189039461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559eb794dfd0 msgr2=0x559eb79ebcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:31.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.032+0000 7f2857eec000 1 --2- 172.21.15.17:0/189039461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559eb794dfd0 0x559eb79ebcc0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f284400c010 tx=0x7f2844016000 comp rx=0 tx=0).stop 2023-10-06T04:44:31.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.032+0000 7f2851928700 1 -- 172.21.15.17:0/189039461 reap_dead start 2023-10-06T04:44:31.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.032+0000 7f2857eec000 1 -- 172.21.15.17:0/189039461 shutdown_connections 2023-10-06T04:44:31.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.032+0000 7f2857eec000 1 -- 172.21.15.17:0/189039461 >> 172.21.15.17:0/189039461 conn(0x559eb7922a90 msgr2=0x559eb794f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:31.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.033+0000 7f2857eec000 1 -- 172.21.15.17:0/189039461 shutdown_connections 2023-10-06T04:44:31.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.033+0000 7f2857eec000 1 -- 172.21.15.17:0/189039461 wait complete. 2023-10-06T04:44:31.042 INFO:teuthology.orchestra.run.smithi017.stdout:a��alphaparent_b 2023-10-06T04:44:31.042 DEBUG:teuthology.orchestra.run.smithi017:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2023-10-06T04:44:31.135 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-06T04:44:31.135 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511628283, 2023-10-06T04:44:31.135 INFO:teuthology.orchestra.run.smithi017.stdout: "ancestors": [ 2023-10-06T04:44:31.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:44:31.135 INFO:teuthology.orchestra.run.smithi017.stdout: "dirino": 1099511628284, 2023-10-06T04:44:31.135 INFO:teuthology.orchestra.run.smithi017.stdout: "dname": "alpha", 2023-10-06T04:44:31.135 INFO:teuthology.orchestra.run.smithi017.stdout: "version": 7 2023-10-06T04:44:31.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-06T04:44:31.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:44:31.136 INFO:teuthology.orchestra.run.smithi017.stdout: "dirino": 1, 2023-10-06T04:44:31.136 INFO:teuthology.orchestra.run.smithi017.stdout: "dname": "parent_b", 2023-10-06T04:44:31.136 INFO:teuthology.orchestra.run.smithi017.stdout: "version": 30 2023-10-06T04:44:31.136 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-06T04:44:31.136 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-06T04:44:31.136 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 7, 2023-10-06T04:44:31.136 INFO:teuthology.orchestra.run.smithi017.stdout: "old_pools": [ 2023-10-06T04:44:31.136 INFO:teuthology.orchestra.run.smithi017.stdout: 6 2023-10-06T04:44:31.136 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-06T04:44:31.136 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-06T04:44:31.136 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:31.138 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool data_new getxattr 100000001fb.00000000 layout 2023-10-06T04:44:31.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.214+0000 7f9567395000 1 Processor -- start 2023-10-06T04:44:31.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.214+0000 7f9567395000 1 -- start start 2023-10-06T04:44:31.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.215+0000 7f9567395000 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5649437f5ff0 0x564943825450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:31.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.215+0000 7f9567395000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5649437f89e0 0x5649438d9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:31.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.215+0000 7f9567395000 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5649438b3900 0x5649438d96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:31.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.215+0000 7f9567395000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564943742980 con 0x5649437f89e0 2023-10-06T04:44:31.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.215+0000 7f9567395000 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x564943742620 con 0x5649437f5ff0 2023-10-06T04:44:31.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.215+0000 7f9567395000 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x564943739400 con 0x5649438b3900 2023-10-06T04:44:31.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.215+0000 7f955fdcf700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5649437f89e0 0x5649438d9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:31.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.215+0000 7f955fdcf700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5649437f89e0 0x5649438d9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51608/0 (socket says 172.21.15.17:51608) 2023-10-06T04:44:31.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.215+0000 7f955fdcf700 1 -- 172.21.15.17:0/3781681266 learned_addr learned my addr 172.21.15.17:0/3781681266 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:31.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.215+0000 7f9560dd1700 1 --2- 172.21.15.17:0/3781681266 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5649438b3900 0x5649438d96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:31.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.215+0000 7f95605d0700 1 --2- 172.21.15.17:0/3781681266 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5649437f5ff0 0x564943825450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:31.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.215+0000 7f955fdcf700 1 -- 172.21.15.17:0/3781681266 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5649438b3900 msgr2=0x5649438d96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:31.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.215+0000 7f955fdcf700 1 --2- 172.21.15.17:0/3781681266 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5649438b3900 0x5649438d96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.215+0000 7f955fdcf700 1 -- 172.21.15.17:0/3781681266 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5649437f5ff0 msgr2=0x564943825450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:31.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.215+0000 7f955fdcf700 1 --2- 172.21.15.17:0/3781681266 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5649437f5ff0 0x564943825450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.215+0000 7f955fdcf700 1 -- 172.21.15.17:0/3781681266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9548005db0 con 0x5649437f89e0 2023-10-06T04:44:31.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.215+0000 7f9560dd1700 1 --2- 172.21.15.17:0/3781681266 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5649438b3900 0x5649438d96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:31.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.215+0000 7f95605d0700 1 --2- 172.21.15.17:0/3781681266 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5649437f5ff0 0x564943825450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:31.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.215+0000 7f955fdcf700 1 --2- 172.21.15.17:0/3781681266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5649437f89e0 0x5649438d9180 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x5649437e4920 tx=0x7f9548016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ff492fe23eb7df8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:31.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.215+0000 7f955edcd700 1 -- 172.21.15.17:0/3781681266 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95480055f0 con 0x5649437f89e0 2023-10-06T04:44:31.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.216+0000 7f955edcd700 1 -- 172.21.15.17:0/3781681266 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9548000bc0 con 0x5649437f89e0 2023-10-06T04:44:31.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.216+0000 7f955edcd700 1 -- 172.21.15.17:0/3781681266 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9548008d00 con 0x5649437f89e0 2023-10-06T04:44:31.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.216+0000 7f9567395000 1 -- 172.21.15.17:0/3781681266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5649437f89e0 msgr2=0x5649438d9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:31.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.216+0000 7f9567395000 1 --2- 172.21.15.17:0/3781681266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5649437f89e0 0x5649438d9180 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x5649437e4920 tx=0x7f9548016000 comp rx=0 tx=0).stop 2023-10-06T04:44:31.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.216+0000 7f9567395000 1 -- 172.21.15.17:0/3781681266 shutdown_connections 2023-10-06T04:44:31.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.216+0000 7f9567395000 1 --2- 172.21.15.17:0/3781681266 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5649438b3900 0x5649438d96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.216+0000 7f9567395000 1 --2- 172.21.15.17:0/3781681266 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5649437f5ff0 0x564943825450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.216+0000 7f9567395000 1 --2- 172.21.15.17:0/3781681266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5649437f89e0 0x5649438d9180 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.216+0000 7f9567395000 1 -- 172.21.15.17:0/3781681266 >> 172.21.15.17:0/3781681266 conn(0x5649438242b0 msgr2=0x5649437f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:31.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.216+0000 7f9567395000 1 -- 172.21.15.17:0/3781681266 shutdown_connections 2023-10-06T04:44:31.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.216+0000 7f9567395000 1 -- 172.21.15.17:0/3781681266 wait complete. 2023-10-06T04:44:31.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.217+0000 7f9567395000 1 Processor -- start 2023-10-06T04:44:31.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.217+0000 7f9567395000 1 -- start start 2023-10-06T04:44:31.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.217+0000 7f9567395000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5649437f5ff0 0x5649438c9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:31.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.217+0000 7f9567395000 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5649437f89e0 0x5649438c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:31.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.217+0000 7f9567395000 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5649438b3900 0x5649438d9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:31.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.217+0000 7f9567395000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649438c96c0 con 0x5649437f5ff0 2023-10-06T04:44:31.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.217+0000 7f9567395000 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649438cbbb0 con 0x5649437f89e0 2023-10-06T04:44:31.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.217+0000 7f9567395000 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x5649438c8500 con 0x5649438b3900 2023-10-06T04:44:31.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.217+0000 7f95605d0700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5649437f5ff0 0x5649438c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:31.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.218+0000 7f95605d0700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5649437f5ff0 0x5649438c9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51616/0 (socket says 172.21.15.17:51616) 2023-10-06T04:44:31.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.218+0000 7f95605d0700 1 -- 172.21.15.17:0/360852826 learned_addr learned my addr 172.21.15.17:0/360852826 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:31.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.218+0000 7f955fdcf700 1 --2- 172.21.15.17:0/360852826 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5649437f89e0 0x5649438c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:31.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.218+0000 7f9560dd1700 1 --2- 172.21.15.17:0/360852826 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5649438b3900 0x5649438d9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:31.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.218+0000 7f95605d0700 1 -- 172.21.15.17:0/360852826 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5649438b3900 msgr2=0x5649438d9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:31.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.218+0000 7f95605d0700 1 --2- 172.21.15.17:0/360852826 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5649438b3900 0x5649438d9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.218+0000 7f95605d0700 1 -- 172.21.15.17:0/360852826 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5649437f89e0 msgr2=0x5649438c9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:31.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.218+0000 7f95605d0700 1 --2- 172.21.15.17:0/360852826 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5649437f89e0 0x5649438c9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.218+0000 7f95605d0700 1 -- 172.21.15.17:0/360852826 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56494376b1c0 con 0x5649437f5ff0 2023-10-06T04:44:31.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.218+0000 7f95605d0700 1 --2- 172.21.15.17:0/360852826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5649437f5ff0 0x5649438c9180 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f955000c430 tx=0x7f9550008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:31.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.218+0000 7f955d5ca700 1 -- 172.21.15.17:0/360852826 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955000a070 con 0x5649437f5ff0 2023-10-06T04:44:31.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.218+0000 7f955d5ca700 1 -- 172.21.15.17:0/360852826 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f955000ce80 con 0x5649437f5ff0 2023-10-06T04:44:31.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.218+0000 7f955d5ca700 1 -- 172.21.15.17:0/360852826 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9550006300 con 0x5649437f5ff0 2023-10-06T04:44:31.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.218+0000 7f9567395000 1 -- 172.21.15.17:0/360852826 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5649437513d0 con 0x5649437f5ff0 2023-10-06T04:44:31.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.218+0000 7f9567395000 1 -- 172.21.15.17:0/360852826 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564943744ae0 con 0x5649437f5ff0 2023-10-06T04:44:31.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.220+0000 7f955d5ca700 1 -- 172.21.15.17:0/360852826 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9550004690 con 0x5649437f5ff0 2023-10-06T04:44:31.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.220+0000 7f955d5ca700 1 --2- 172.21.15.17:0/360852826 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9540065890 0x7f9540067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:31.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.220+0000 7f955d5ca700 1 -- 172.21.15.17:0/360852826 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f95500829f0 con 0x5649437f5ff0 2023-10-06T04:44:31.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.220+0000 7f955fdcf700 1 --2- 172.21.15.17:0/360852826 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9540065890 0x7f9540067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:31.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.220+0000 7f9567395000 1 --2- 172.21.15.17:0/360852826 >> [v2:172.21.15.17:6809/90656,v1:172.21.15.17:6811/90656] conn(0x5649438c9f80 0x5649438e08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:31.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.220+0000 7f9567395000 1 -- 172.21.15.17:0/360852826 --> [v2:172.21.15.17:6809/90656,v1:172.21.15.17:6811/90656] -- osd_op(unknown.0.0:1 7.13 7:ca8fdbba:::100000001fb.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x5649438b1b60 con 0x5649438c9f80 2023-10-06T04:44:31.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.220+0000 7f9560dd1700 1 --2- 172.21.15.17:0/360852826 >> [v2:172.21.15.17:6809/90656,v1:172.21.15.17:6811/90656] conn(0x5649438c9f80 0x5649438e08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:31.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.220+0000 7f955fdcf700 1 --2- 172.21.15.17:0/360852826 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9540065890 0x7f9540067d40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9548008410 tx=0x7f954801c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:31.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.221+0000 7f9560dd1700 1 --2- 172.21.15.17:0/360852826 >> [v2:172.21.15.17:6809/90656,v1:172.21.15.17:6811/90656] conn(0x5649438c9f80 0x5649438e08c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:31.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.221+0000 7f9560dd1700 1 -- 172.21.15.17:0/360852826 <== osd.0 v2:172.21.15.17:6809/90656 1 ==== osd_op_reply(1 100000001fb.00000000 [getxattr (30) out=30b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x7f9558013040 con 0x5649438c9f80 2023-10-06T04:44:31.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.221+0000 7f9567395000 1 -- 172.21.15.17:0/360852826 >> [v2:172.21.15.17:6809/90656,v1:172.21.15.17:6811/90656] conn(0x5649438c9f80 msgr2=0x5649438e08c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:31.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.221+0000 7f9567395000 1 --2- 172.21.15.17:0/360852826 >> [v2:172.21.15.17:6809/90656,v1:172.21.15.17:6811/90656] conn(0x5649438c9f80 0x5649438e08c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.221+0000 7f9567395000 1 -- 172.21.15.17:0/360852826 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9540065890 msgr2=0x7f9540067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:31.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.221+0000 7f9567395000 1 --2- 172.21.15.17:0/360852826 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9540065890 0x7f9540067d40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9548008410 tx=0x7f954801c000 comp rx=0 tx=0).stop 2023-10-06T04:44:31.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.221+0000 7f9567395000 1 -- 172.21.15.17:0/360852826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5649437f5ff0 msgr2=0x5649438c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:31.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.221+0000 7f9567395000 1 --2- 172.21.15.17:0/360852826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5649437f5ff0 0x5649438c9180 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f955000c430 tx=0x7f9550008040 comp rx=0 tx=0).stop 2023-10-06T04:44:31.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.221+0000 7f9560dd1700 1 -- 172.21.15.17:0/360852826 reap_dead start 2023-10-06T04:44:31.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.221+0000 7f9567395000 1 -- 172.21.15.17:0/360852826 shutdown_connections 2023-10-06T04:44:31.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.221+0000 7f9567395000 1 -- 172.21.15.17:0/360852826 >> 172.21.15.17:0/360852826 conn(0x5649438242b0 msgr2=0x5649437f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:31.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.221+0000 7f9567395000 1 -- 172.21.15.17:0/360852826 shutdown_connections 2023-10-06T04:44:31.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.221+0000 7f9567395000 1 -- 172.21.15.17:0/360852826 wait complete. 2023-10-06T04:44:31.230 INFO:teuthology.orchestra.run.smithi017.stdout:@@ 2023-10-06T04:44:31.231 DEBUG:teuthology.orchestra.run.smithi017:> ceph-dencoder type file_layout_t import - decode dump_json 2023-10-06T04:44:31.324 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-06T04:44:31.324 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_unit": 4194304, 2023-10-06T04:44:31.324 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_count": 1, 2023-10-06T04:44:31.324 INFO:teuthology.orchestra.run.smithi017.stdout: "object_size": 4194304, 2023-10-06T04:44:31.325 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_id": 7, 2023-10-06T04:44:31.325 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_ns": "" 2023-10-06T04:44:31.325 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-06T04:44:31.325 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:31.326 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:44:31.327 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent_c) 2023-10-06T04:44:31.383 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:44:31.385 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec mv parent_b/alpha parent_c/alpha) 2023-10-06T04:44:31.441 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:44:31.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.599+0000 7f7e174a7700 1 Processor -- start 2023-10-06T04:44:31.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.599+0000 7f7e174a7700 1 -- start start 2023-10-06T04:44:31.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.600+0000 7f7e174a7700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f7e100ccfc0 0x7f7e100cc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:31.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.600+0000 7f7e174a7700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7e100cc750 0x7f7e100b0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:31.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.600+0000 7f7e174a7700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e100cbd80 con 0x7f7e100cf3b0 2023-10-06T04:44:31.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.600+0000 7f7e174a7700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e100af5f0 con 0x7f7e100ccfc0 2023-10-06T04:44:31.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.600+0000 7f7e174a7700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e100af8d0 con 0x7f7e100cc750 2023-10-06T04:44:31.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.600+0000 7f7e164a5700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f7e100ccfc0 0x7f7e100cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:31.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.600+0000 7f7e15ca4700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f7e100cf3b0 0x7f7e101594a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.17:51476/0 (socket says 172.21.15.17:51476) 2023-10-06T04:44:31.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.600+0000 7f7e15ca4700 1 -- 172.21.15.17:0/505169984 learned_addr learned my addr 172.21.15.17:0/505169984 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:31.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.600+0000 7f7e16ca6700 1 --2- 172.21.15.17:0/505169984 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7e100cc750 0x7f7e100b0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:31.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.601+0000 7f7e164a5700 1 -- 172.21.15.17:0/505169984 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7e100cc750 msgr2=0x7f7e100b0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:31.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.601+0000 7f7e164a5700 1 --2- 172.21.15.17:0/505169984 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7e100cc750 0x7f7e100b0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.601+0000 7f7e164a5700 1 -- 172.21.15.17:0/505169984 >> v1:172.21.15.136:6789/0 conn(0x7f7e100cf3b0 legacy=0x7f7e101594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:31.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.601+0000 7f7e154a3700 1 -- 172.21.15.17:0/505169984 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1876938592 0 0) 0x7f7e100cbd80 con 0x7f7e100cf3b0 2023-10-06T04:44:31.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.601+0000 7f7e164a5700 1 -- 172.21.15.17:0/505169984 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e100afbb0 con 0x7f7e100ccfc0 2023-10-06T04:44:31.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.601+0000 7f7e16ca6700 1 --2- 172.21.15.17:0/505169984 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7e100cc750 0x7f7e100b0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:44:31.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.601+0000 7f7e164a5700 1 --2- 172.21.15.17:0/505169984 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e100ccfc0 0x7f7e100cc210 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c009910 tx=0x7f7e0c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3af2514e89a76bf4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:31.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.601+0000 7f7e154a3700 1 -- 172.21.15.17:0/505169984 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c00b640 con 0x7f7e100ccfc0 2023-10-06T04:44:31.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.601+0000 7f7e154a3700 1 -- 172.21.15.17:0/505169984 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0c00b7a0 con 0x7f7e100ccfc0 2023-10-06T04:44:31.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.601+0000 7f7e154a3700 1 -- 172.21.15.17:0/505169984 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c00bb60 con 0x7f7e100ccfc0 2023-10-06T04:44:31.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.601+0000 7f7e174a7700 1 -- 172.21.15.17:0/505169984 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e100ccfc0 msgr2=0x7f7e100cc210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:31.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.601+0000 7f7e174a7700 1 --2- 172.21.15.17:0/505169984 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e100ccfc0 0x7f7e100cc210 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c009910 tx=0x7f7e0c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.602+0000 7f7e174a7700 1 -- 172.21.15.17:0/505169984 shutdown_connections 2023-10-06T04:44:31.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.602+0000 7f7e174a7700 1 --2- 172.21.15.17:0/505169984 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e100ccfc0 0x7f7e100cc210 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.602+0000 7f7e174a7700 1 --2- 172.21.15.17:0/505169984 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7e100cc750 0x7f7e100b0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.602+0000 7f7e174a7700 1 -- 172.21.15.17:0/505169984 >> 172.21.15.17:0/505169984 conn(0x7f7e1006cff0 msgr2=0x7f7e1006da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:31.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.602+0000 7f7e174a7700 1 -- 172.21.15.17:0/505169984 shutdown_connections 2023-10-06T04:44:31.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.602+0000 7f7e174a7700 1 -- 172.21.15.17:0/505169984 wait complete. 2023-10-06T04:44:31.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.603+0000 7f7e174a7700 1 Processor -- start 2023-10-06T04:44:31.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.603+0000 7f7e174a7700 1 -- start start 2023-10-06T04:44:31.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.603+0000 7f7e174a7700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7e100cc750 0x7f7e100b5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:31.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.603+0000 7f7e174a7700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e100ccfc0 0x7f7e1013f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:31.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.603+0000 7f7e174a7700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e100b44e0 0x7f7e100c6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:31.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.603+0000 7f7e174a7700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e100b5570 con 0x7f7e100ccfc0 2023-10-06T04:44:31.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.603+0000 7f7e174a7700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1013f660 con 0x7f7e100b44e0 2023-10-06T04:44:31.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.603+0000 7f7e174a7700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e100b4960 con 0x7f7e100cc750 2023-10-06T04:44:31.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.604+0000 7f7e15ca4700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e100ccfc0 0x7f7e1013f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:31.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.604+0000 7f7e15ca4700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e100ccfc0 0x7f7e1013f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51632/0 (socket says 172.21.15.17:51632) 2023-10-06T04:44:31.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.604+0000 7f7e15ca4700 1 -- 172.21.15.17:0/406948052 learned_addr learned my addr 172.21.15.17:0/406948052 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:31.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.604+0000 7f7e16ca6700 1 --2- 172.21.15.17:0/406948052 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e100b44e0 0x7f7e100c6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:31.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.604+0000 7f7e164a5700 1 --2- 172.21.15.17:0/406948052 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7e100cc750 0x7f7e100b5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:31.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.604+0000 7f7e15ca4700 1 -- 172.21.15.17:0/406948052 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7e100cc750 msgr2=0x7f7e100b5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:31.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.604+0000 7f7e15ca4700 1 --2- 172.21.15.17:0/406948052 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7e100cc750 0x7f7e100b5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.604+0000 7f7e15ca4700 1 -- 172.21.15.17:0/406948052 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e100b44e0 msgr2=0x7f7e100c6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:31.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.604+0000 7f7e15ca4700 1 --2- 172.21.15.17:0/406948052 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e100b44e0 0x7f7e100c6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.604+0000 7f7e15ca4700 1 -- 172.21.15.17:0/406948052 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e08009a20 con 0x7f7e100ccfc0 2023-10-06T04:44:31.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.604+0000 7f7e15ca4700 1 --2- 172.21.15.17:0/406948052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e100ccfc0 0x7f7e1013f120 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7e0000c5b0 tx=0x7f7e00000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:31.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.604+0000 7f7e067fc700 1 -- 172.21.15.17:0/406948052 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e00005b30 con 0x7f7e100ccfc0 2023-10-06T04:44:31.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.604+0000 7f7e067fc700 1 -- 172.21.15.17:0/406948052 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e00005c90 con 0x7f7e100ccfc0 2023-10-06T04:44:31.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.604+0000 7f7e174a7700 1 -- 172.21.15.17:0/406948052 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e0c009420 con 0x7f7e100ccfc0 2023-10-06T04:44:31.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.604+0000 7f7e067fc700 1 -- 172.21.15.17:0/406948052 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e000072e0 con 0x7f7e100ccfc0 2023-10-06T04:44:31.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.604+0000 7f7e174a7700 1 -- 172.21.15.17:0/406948052 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e100b4f20 con 0x7f7e100ccfc0 2023-10-06T04:44:31.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.605+0000 7f7e174a7700 1 -- 172.21.15.17:0/406948052 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e100b56e0 con 0x7f7e100ccfc0 2023-10-06T04:44:31.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.606+0000 7f7e067fc700 1 -- 172.21.15.17:0/406948052 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7e0001b3b0 con 0x7f7e100ccfc0 2023-10-06T04:44:31.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.606+0000 7f7e067fc700 1 --2- 172.21.15.17:0/406948052 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7df4066f30 0x7f7df40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:31.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.606+0000 7f7e067fc700 1 -- 172.21.15.17:0/406948052 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f7e00083c00 con 0x7f7e100ccfc0 2023-10-06T04:44:31.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.606+0000 7f7e164a5700 1 --2- 172.21.15.17:0/406948052 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7df4066f30 0x7f7df40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:31.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.607+0000 7f7e164a5700 1 --2- 172.21.15.17:0/406948052 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7df4066f30 0x7f7df40693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c0091e0 tx=0x7f7e0c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:31.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.610+0000 7f7e067fc700 1 -- 172.21.15.17:0/406948052 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7e0004b5a0 con 0x7f7e100ccfc0 2023-10-06T04:44:31.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.846+0000 7f7e174a7700 1 -- 172.21.15.17:0/406948052 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7e1004c380 con 0x7f7e100ccfc0 2023-10-06T04:44:31.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.847+0000 7f7e067fc700 1 -- 172.21.15.17:0/406948052 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f7e00017020 con 0x7f7e100ccfc0 2023-10-06T04:44:31.849 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:31.849 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6834/3741747962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3741747962},{"type":"v1","addr":"172.21.15.136:6834","nonce":3741747962}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4688,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/264192509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6833","nonce":264192509},{"type":"v1","addr":"172.21.15.136:6835","nonce":264192509}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4909,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6836/1154731767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1154731767},{"type":"v1","addr":"172.21.15.17:6836","nonce":1154731767}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:44:14.988901+0000","modified":"2023-10-06T04:44:29.425634+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4971":{"gid":4971,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6837/460551791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6835","nonce":460551791},{"type":"v1","addr":"172.21.15.17:6837","nonce":460551791}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:44:31.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.849+0000 7f7e174a7700 1 -- 172.21.15.17:0/406948052 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7df4066f30 msgr2=0x7f7df40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:31.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.849+0000 7f7e174a7700 1 --2- 172.21.15.17:0/406948052 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7df4066f30 0x7f7df40693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c0091e0 tx=0x7f7e0c017000 comp rx=0 tx=0).stop 2023-10-06T04:44:31.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.849+0000 7f7e174a7700 1 -- 172.21.15.17:0/406948052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e100ccfc0 msgr2=0x7f7e1013f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:31.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.849+0000 7f7e174a7700 1 --2- 172.21.15.17:0/406948052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e100ccfc0 0x7f7e1013f120 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7e0000c5b0 tx=0x7f7e00000fe0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.849+0000 7f7e174a7700 1 -- 172.21.15.17:0/406948052 shutdown_connections 2023-10-06T04:44:31.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.849+0000 7f7e174a7700 1 --2- 172.21.15.17:0/406948052 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7df4066f30 0x7f7df40693e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.849+0000 7f7e174a7700 1 --2- 172.21.15.17:0/406948052 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e100b44e0 0x7f7e100c6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.849+0000 7f7e174a7700 1 --2- 172.21.15.17:0/406948052 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7e100cc750 0x7f7e100b5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.849+0000 7f7e174a7700 1 --2- 172.21.15.17:0/406948052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e100ccfc0 0x7f7e1013f120 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:31.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.849+0000 7f7e174a7700 1 -- 172.21.15.17:0/406948052 >> 172.21.15.17:0/406948052 conn(0x7f7e1006cff0 msgr2=0x7f7e100c5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:31.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.849+0000 7f7e174a7700 1 -- 172.21.15.17:0/406948052 shutdown_connections 2023-10-06T04:44:31.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:31.849+0000 7f7e174a7700 1 -- 172.21.15.17:0/406948052 wait complete. 2023-10-06T04:44:31.853 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 17 2023-10-06T04:44:31.863 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2023-10-06T04:44:32.006 INFO:teuthology.orchestra.run.smithi017.stdout:{"message":"","return_code":0} 2023-10-06T04:44:32.006 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-10-06T04:44:32.007 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001fb.00000000 parent 2023-10-06T04:44:32.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.044+0000 7f1a126cc000 1 Processor -- start 2023-10-06T04:44:32.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.044+0000 7f1a126cc000 1 -- start start 2023-10-06T04:44:32.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.045+0000 7f1a126cc000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778f596f30 0x55778f6396b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:32.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.045+0000 7f1a126cc000 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55778f63d1a0 0x55778f5b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:32.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.045+0000 7f1a126cc000 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55778f63dc80 0x55778f591e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:32.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.045+0000 7f1a126cc000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55778f4b1980 con 0x55778f596f30 2023-10-06T04:44:32.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.045+0000 7f1a126cc000 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55778f4b1620 con 0x55778f63d1a0 2023-10-06T04:44:32.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.045+0000 7f1a126cc000 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x55778f4a8400 con 0x55778f63dc80 2023-10-06T04:44:32.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.045+0000 7f1a0b907700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778f596f30 0x55778f6396b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:32.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.045+0000 7f1a0b907700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778f596f30 0x55778f6396b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51646/0 (socket says 172.21.15.17:51646) 2023-10-06T04:44:32.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.045+0000 7f1a0b907700 1 -- 172.21.15.17:0/2902282569 learned_addr learned my addr 172.21.15.17:0/2902282569 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:32.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.045+0000 7f1a0c108700 1 --2- 172.21.15.17:0/2902282569 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55778f63dc80 0x55778f591e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:32.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.045+0000 7f1a0b106700 1 --2- 172.21.15.17:0/2902282569 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55778f63d1a0 0x55778f5b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:32.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.045+0000 7f1a0b907700 1 -- 172.21.15.17:0/2902282569 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55778f63dc80 msgr2=0x55778f591e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:32.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.045+0000 7f1a0b907700 1 --2- 172.21.15.17:0/2902282569 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55778f63dc80 0x55778f591e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.045+0000 7f1a0b907700 1 -- 172.21.15.17:0/2902282569 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55778f63d1a0 msgr2=0x55778f5b07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:32.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.045+0000 7f1a0b907700 1 --2- 172.21.15.17:0/2902282569 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55778f63d1a0 0x55778f5b07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.045+0000 7f1a0b907700 1 -- 172.21.15.17:0/2902282569 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a0400a0e0 con 0x55778f596f30 2023-10-06T04:44:32.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.045+0000 7f1a0b907700 1 --2- 172.21.15.17:0/2902282569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778f596f30 0x55778f6396b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x55778f555110 tx=0x7f1a04015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc27c1c6dbaa3a6d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:32.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.045+0000 7f1a0a104700 1 -- 172.21.15.17:0/2902282569 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0400fe80 con 0x55778f596f30 2023-10-06T04:44:32.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.045+0000 7f1a0a104700 1 -- 172.21.15.17:0/2902282569 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0401f070 con 0x55778f596f30 2023-10-06T04:44:32.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.045+0000 7f1a0a104700 1 -- 172.21.15.17:0/2902282569 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a04000f40 con 0x55778f596f30 2023-10-06T04:44:32.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.046+0000 7f1a126cc000 1 -- 172.21.15.17:0/2902282569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778f596f30 msgr2=0x55778f6396b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:32.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.046+0000 7f1a126cc000 1 --2- 172.21.15.17:0/2902282569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778f596f30 0x55778f6396b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x55778f555110 tx=0x7f1a04015000 comp rx=0 tx=0).stop 2023-10-06T04:44:32.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.046+0000 7f1a126cc000 1 -- 172.21.15.17:0/2902282569 shutdown_connections 2023-10-06T04:44:32.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.046+0000 7f1a126cc000 1 --2- 172.21.15.17:0/2902282569 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55778f63dc80 0x55778f591e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.046+0000 7f1a126cc000 1 --2- 172.21.15.17:0/2902282569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778f596f30 0x55778f6396b0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.046+0000 7f1a126cc000 1 --2- 172.21.15.17:0/2902282569 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55778f63d1a0 0x55778f5b07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.046+0000 7f1a126cc000 1 -- 172.21.15.17:0/2902282569 >> 172.21.15.17:0/2902282569 conn(0x55778f568310 msgr2=0x55778f595d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:32.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.046+0000 7f1a126cc000 1 -- 172.21.15.17:0/2902282569 shutdown_connections 2023-10-06T04:44:32.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.046+0000 7f1a126cc000 1 -- 172.21.15.17:0/2902282569 wait complete. 2023-10-06T04:44:32.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.046+0000 7f1a126cc000 1 Processor -- start 2023-10-06T04:44:32.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.047+0000 7f1a126cc000 1 -- start start 2023-10-06T04:44:32.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.047+0000 7f1a126cc000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778f596f30 0x55778f633d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:32.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.047+0000 7f1a126cc000 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55778f63d1a0 0x55778f594e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:32.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.047+0000 7f1a126cc000 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55778f63dc80 0x55778f595360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:32.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.047+0000 7f1a126cc000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55778f6381d0 con 0x55778f596f30 2023-10-06T04:44:32.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.047+0000 7f1a126cc000 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55778f63a680 con 0x55778f63dc80 2023-10-06T04:44:32.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.047+0000 7f1a126cc000 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x55778f63a920 con 0x55778f63d1a0 2023-10-06T04:44:32.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.047+0000 7f1a0b907700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778f596f30 0x55778f633d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:32.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.047+0000 7f1a0b907700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778f596f30 0x55778f633d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51654/0 (socket says 172.21.15.17:51654) 2023-10-06T04:44:32.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.047+0000 7f1a0b907700 1 -- 172.21.15.17:0/1252004210 learned_addr learned my addr 172.21.15.17:0/1252004210 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:32.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.047+0000 7f1a0c108700 1 --2- 172.21.15.17:0/1252004210 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55778f63dc80 0x55778f595360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:32.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.047+0000 7f1a0b106700 1 --2- 172.21.15.17:0/1252004210 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55778f63d1a0 0x55778f594e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:32.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.048+0000 7f1a0b907700 1 -- 172.21.15.17:0/1252004210 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55778f63d1a0 msgr2=0x55778f594e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:32.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.048+0000 7f1a0b907700 1 --2- 172.21.15.17:0/1252004210 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55778f63d1a0 0x55778f594e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.048+0000 7f1a0b907700 1 -- 172.21.15.17:0/1252004210 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55778f63dc80 msgr2=0x55778f595360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:32.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.048+0000 7f1a0b907700 1 --2- 172.21.15.17:0/1252004210 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55778f63dc80 0x55778f595360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.048+0000 7f1a0b907700 1 -- 172.21.15.17:0/1252004210 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55778f4da1c0 con 0x55778f596f30 2023-10-06T04:44:32.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.048+0000 7f1a0b106700 1 --2- 172.21.15.17:0/1252004210 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55778f63d1a0 0x55778f594e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:32.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.048+0000 7f1a0b907700 1 --2- 172.21.15.17:0/1252004210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778f596f30 0x55778f633d60 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x55778f6405c0 tx=0x7f1a0401d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:32.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.048+0000 7f1a08901700 1 -- 172.21.15.17:0/1252004210 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a040248c0 con 0x55778f596f30 2023-10-06T04:44:32.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.048+0000 7f1a08901700 1 -- 172.21.15.17:0/1252004210 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a04024a20 con 0x55778f596f30 2023-10-06T04:44:32.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.048+0000 7f1a126cc000 1 -- 172.21.15.17:0/1252004210 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55778f4c03d0 con 0x55778f596f30 2023-10-06T04:44:32.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.048+0000 7f1a08901700 1 -- 172.21.15.17:0/1252004210 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a04024dc0 con 0x55778f596f30 2023-10-06T04:44:32.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.048+0000 7f1a126cc000 1 -- 172.21.15.17:0/1252004210 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55778f4b3ae0 con 0x55778f596f30 2023-10-06T04:44:32.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.049+0000 7f1a08901700 1 -- 172.21.15.17:0/1252004210 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1a0402c070 con 0x55778f596f30 2023-10-06T04:44:32.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.050+0000 7f1a08901700 1 --2- 172.21.15.17:0/1252004210 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f19ec065890 0x7f19ec067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:32.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.050+0000 7f1a08901700 1 -- 172.21.15.17:0/1252004210 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f1a04086630 con 0x55778f596f30 2023-10-06T04:44:32.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.050+0000 7f1a0b106700 1 --2- 172.21.15.17:0/1252004210 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f19ec065890 0x7f19ec067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:32.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.050+0000 7f1a126cc000 1 --2- 172.21.15.17:0/1252004210 >> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] conn(0x55778f63b300 0x55778f63b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:32.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.050+0000 7f1a126cc000 1 -- 172.21.15.17:0/1252004210 --> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] -- osd_op(unknown.0.0:1 6.13 6:ca8fdbba:::100000001fb.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55778f63bc40 con 0x55778f63b300 2023-10-06T04:44:32.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.050+0000 7f1a0c108700 1 --2- 172.21.15.17:0/1252004210 >> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] conn(0x55778f63b300 0x55778f63b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:32.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.050+0000 7f1a0b106700 1 --2- 172.21.15.17:0/1252004210 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f19ec065890 0x7f19ec067d40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f19f4000c00 tx=0x7f19f4001730 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:32.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.050+0000 7f1a0c108700 1 --2- 172.21.15.17:0/1252004210 >> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] conn(0x55778f63b300 0x55778f63b700 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:32.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.051+0000 7f1a0c108700 1 -- 172.21.15.17:0/1252004210 <== osd.3 v2:172.21.15.17:6824/90688 1 ==== osd_op_reply(1 100000001fb.00000000 [getxattr (103) out=103b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+103 (crc 0 0 0) 0x7f19fc009a50 con 0x55778f63b300 2023-10-06T04:44:32.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.051+0000 7f1a126cc000 1 -- 172.21.15.17:0/1252004210 >> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] conn(0x55778f63b300 msgr2=0x55778f63b700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:32.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.051+0000 7f1a126cc000 1 --2- 172.21.15.17:0/1252004210 >> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] conn(0x55778f63b300 0x55778f63b700 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.051+0000 7f1a126cc000 1 -- 172.21.15.17:0/1252004210 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f19ec065890 msgr2=0x7f19ec067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:32.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.051+0000 7f1a126cc000 1 --2- 172.21.15.17:0/1252004210 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f19ec065890 0x7f19ec067d40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f19f4000c00 tx=0x7f19f4001730 comp rx=0 tx=0).stop 2023-10-06T04:44:32.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.051+0000 7f1a126cc000 1 -- 172.21.15.17:0/1252004210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778f596f30 msgr2=0x55778f633d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:32.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.051+0000 7f1a126cc000 1 --2- 172.21.15.17:0/1252004210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778f596f30 0x55778f633d60 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x55778f6405c0 tx=0x7f1a0401d070 comp rx=0 tx=0).stop 2023-10-06T04:44:32.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.051+0000 7f1a0c108700 1 -- 172.21.15.17:0/1252004210 reap_dead start 2023-10-06T04:44:32.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.051+0000 7f1a126cc000 1 -- 172.21.15.17:0/1252004210 shutdown_connections 2023-10-06T04:44:32.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.051+0000 7f1a126cc000 1 -- 172.21.15.17:0/1252004210 >> 172.21.15.17:0/1252004210 conn(0x55778f568310 msgr2=0x55778f569610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:32.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.051+0000 7f1a126cc000 1 -- 172.21.15.17:0/1252004210 shutdown_connections 2023-10-06T04:44:32.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.051+0000 7f1a126cc000 1 -- 172.21.15.17:0/1252004210 wait complete. 2023-10-06T04:44:32.059 INFO:teuthology.orchestra.run.smithi017.stdout:a��alphaparent_b 2023-10-06T04:44:32.060 DEBUG:teuthology.orchestra.run.smithi017:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2023-10-06T04:44:32.152 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-06T04:44:32.152 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511628283, 2023-10-06T04:44:32.152 INFO:teuthology.orchestra.run.smithi017.stdout: "ancestors": [ 2023-10-06T04:44:32.152 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:44:32.152 INFO:teuthology.orchestra.run.smithi017.stdout: "dirino": 1099511628284, 2023-10-06T04:44:32.152 INFO:teuthology.orchestra.run.smithi017.stdout: "dname": "alpha", 2023-10-06T04:44:32.152 INFO:teuthology.orchestra.run.smithi017.stdout: "version": 7 2023-10-06T04:44:32.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-06T04:44:32.152 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:44:32.152 INFO:teuthology.orchestra.run.smithi017.stdout: "dirino": 1, 2023-10-06T04:44:32.153 INFO:teuthology.orchestra.run.smithi017.stdout: "dname": "parent_b", 2023-10-06T04:44:32.153 INFO:teuthology.orchestra.run.smithi017.stdout: "version": 30 2023-10-06T04:44:32.153 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-06T04:44:32.153 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-06T04:44:32.153 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 7, 2023-10-06T04:44:32.153 INFO:teuthology.orchestra.run.smithi017.stdout: "old_pools": [ 2023-10-06T04:44:32.153 INFO:teuthology.orchestra.run.smithi017.stdout: 6 2023-10-06T04:44:32.153 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-06T04:44:32.153 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-06T04:44:32.153 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:32.154 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool data_new getxattr 100000001fb.00000000 parent 2023-10-06T04:44:32.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.232+0000 7fb7502bc000 1 Processor -- start 2023-10-06T04:44:32.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.232+0000 7fb7502bc000 1 -- start start 2023-10-06T04:44:32.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.232+0000 7fb7502bc000 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fa66c298e0 0x55fa66cdeca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:32.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.232+0000 7fb7502bc000 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55fa66cb4770 0x55fa66cdf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:32.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.233+0000 7fb7502bc000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa66c29cb0 0x55fa66cdf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:32.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.233+0000 7fb7502bc000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa66b46980 con 0x55fa66c29cb0 2023-10-06T04:44:32.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.233+0000 7fb7502bc000 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa66b46620 con 0x55fa66c298e0 2023-10-06T04:44:32.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.233+0000 7fb7502bc000 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa66b3d400 con 0x55fa66cb4770 2023-10-06T04:44:32.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.233+0000 7fb749cf8700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa66c29cb0 0x55fa66cdf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:32.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.233+0000 7fb749cf8700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa66c29cb0 0x55fa66cdf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51672/0 (socket says 172.21.15.17:51672) 2023-10-06T04:44:32.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.233+0000 7fb749cf8700 1 -- 172.21.15.17:0/268142656 learned_addr learned my addr 172.21.15.17:0/268142656 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:32.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.233+0000 7fb7494f7700 1 --2- 172.21.15.17:0/268142656 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fa66c298e0 0x55fa66cdeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:32.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.233+0000 7fb748cf6700 1 --2- 172.21.15.17:0/268142656 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55fa66cb4770 0x55fa66cdf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:32.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.233+0000 7fb749cf8700 1 -- 172.21.15.17:0/268142656 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55fa66cb4770 msgr2=0x55fa66cdf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:32.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.233+0000 7fb749cf8700 1 --2- 172.21.15.17:0/268142656 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55fa66cb4770 0x55fa66cdf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.233+0000 7fb749cf8700 1 -- 172.21.15.17:0/268142656 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fa66c298e0 msgr2=0x55fa66cdeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:32.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.233+0000 7fb749cf8700 1 --2- 172.21.15.17:0/268142656 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fa66c298e0 0x55fa66cdeca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.233+0000 7fb749cf8700 1 -- 172.21.15.17:0/268142656 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa66b553d0 con 0x55fa66c29cb0 2023-10-06T04:44:32.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.233+0000 7fb7494f7700 1 --2- 172.21.15.17:0/268142656 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fa66c298e0 0x55fa66cdeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:32.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.233+0000 7fb748cf6700 1 --2- 172.21.15.17:0/268142656 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55fa66cb4770 0x55fa66cdf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:32.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.233+0000 7fb749cf8700 1 --2- 172.21.15.17:0/268142656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa66c29cb0 0x55fa66cdf720 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x55fa66bff040 tx=0x7fb73c0017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14848bb341cd9316 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:32.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.233+0000 7fb7437fe700 1 -- 172.21.15.17:0/268142656 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c00f450 con 0x55fa66c29cb0 2023-10-06T04:44:32.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.233+0000 7fb7437fe700 1 -- 172.21.15.17:0/268142656 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73c00f5b0 con 0x55fa66c29cb0 2023-10-06T04:44:32.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.233+0000 7fb7437fe700 1 -- 172.21.15.17:0/268142656 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c00f970 con 0x55fa66c29cb0 2023-10-06T04:44:32.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.234+0000 7fb7502bc000 1 -- 172.21.15.17:0/268142656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa66c29cb0 msgr2=0x55fa66cdf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:32.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.234+0000 7fb7502bc000 1 --2- 172.21.15.17:0/268142656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa66c29cb0 0x55fa66cdf720 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x55fa66bff040 tx=0x7fb73c0017b0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.234+0000 7fb7502bc000 1 -- 172.21.15.17:0/268142656 shutdown_connections 2023-10-06T04:44:32.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.234+0000 7fb7502bc000 1 --2- 172.21.15.17:0/268142656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa66c29cb0 0x55fa66cdf720 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.234+0000 7fb7502bc000 1 --2- 172.21.15.17:0/268142656 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fa66c298e0 0x55fa66cdeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.234+0000 7fb7502bc000 1 --2- 172.21.15.17:0/268142656 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55fa66cb4770 0x55fa66cdf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.234+0000 7fb7502bc000 1 -- 172.21.15.17:0/268142656 >> 172.21.15.17:0/268142656 conn(0x55fa66bfd310 msgr2=0x55fa66c45880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:32.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.234+0000 7fb7502bc000 1 -- 172.21.15.17:0/268142656 shutdown_connections 2023-10-06T04:44:32.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.234+0000 7fb7502bc000 1 -- 172.21.15.17:0/268142656 wait complete. 2023-10-06T04:44:32.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.234+0000 7fb7502bc000 1 Processor -- start 2023-10-06T04:44:32.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.234+0000 7fb7502bc000 1 -- start start 2023-10-06T04:44:32.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.235+0000 7fb7502bc000 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55fa66c298e0 0x55fa66cd1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:32.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.235+0000 7fb7502bc000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa66c29cb0 0x55fa66ce71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:32.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.235+0000 7fb7502bc000 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fa66cb4770 0x55fa66ce7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:32.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.235+0000 7fb7502bc000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa66cd2070 con 0x55fa66c29cb0 2023-10-06T04:44:32.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.235+0000 7fb7502bc000 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa66cb4560 con 0x55fa66cb4770 2023-10-06T04:44:32.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.235+0000 7fb7502bc000 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa66cb42c0 con 0x55fa66c298e0 2023-10-06T04:44:32.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.235+0000 7fb748cf6700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa66c29cb0 0x55fa66ce71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:32.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.235+0000 7fb748cf6700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa66c29cb0 0x55fa66ce71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51684/0 (socket says 172.21.15.17:51684) 2023-10-06T04:44:32.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.235+0000 7fb748cf6700 1 -- 172.21.15.17:0/308180087 learned_addr learned my addr 172.21.15.17:0/308180087 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:32.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.235+0000 7fb749cf8700 1 --2- 172.21.15.17:0/308180087 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fa66cb4770 0x55fa66ce7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:32.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.235+0000 7fb7494f7700 1 --2- 172.21.15.17:0/308180087 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55fa66c298e0 0x55fa66cd1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:32.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.235+0000 7fb748cf6700 1 -- 172.21.15.17:0/308180087 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55fa66c298e0 msgr2=0x55fa66cd1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:32.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.236+0000 7fb748cf6700 1 --2- 172.21.15.17:0/308180087 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55fa66c298e0 0x55fa66cd1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.236+0000 7fb748cf6700 1 -- 172.21.15.17:0/308180087 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fa66cb4770 msgr2=0x55fa66ce7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:32.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.236+0000 7fb748cf6700 1 --2- 172.21.15.17:0/308180087 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fa66cb4770 0x55fa66ce7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.236+0000 7fb748cf6700 1 -- 172.21.15.17:0/308180087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb73c00e040 con 0x55fa66c29cb0 2023-10-06T04:44:32.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.236+0000 7fb748cf6700 1 --2- 172.21.15.17:0/308180087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa66c29cb0 0x55fa66ce71f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb738004070 tx=0x7fb734015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:32.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.236+0000 7fb741ffb700 1 -- 172.21.15.17:0/308180087 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73400e040 con 0x55fa66c29cb0 2023-10-06T04:44:32.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.236+0000 7fb741ffb700 1 -- 172.21.15.17:0/308180087 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb734008ed0 con 0x55fa66c29cb0 2023-10-06T04:44:32.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.236+0000 7fb741ffb700 1 -- 172.21.15.17:0/308180087 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb734027670 con 0x55fa66c29cb0 2023-10-06T04:44:32.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.236+0000 7fb7502bc000 1 -- 172.21.15.17:0/308180087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fa66b48ae0 con 0x55fa66c29cb0 2023-10-06T04:44:32.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.236+0000 7fb7502bc000 1 -- 172.21.15.17:0/308180087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fa66b48540 con 0x55fa66c29cb0 2023-10-06T04:44:32.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.237+0000 7fb741ffb700 1 -- 172.21.15.17:0/308180087 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb734027a60 con 0x55fa66c29cb0 2023-10-06T04:44:32.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.238+0000 7fb741ffb700 1 --2- 172.21.15.17:0/308180087 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fb72c0658c0 0x7fb72c067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:32.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.238+0000 7fb741ffb700 1 -- 172.21.15.17:0/308180087 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6453+0+0 (secure 0 0 0) 0x7fb734084c20 con 0x55fa66c29cb0 2023-10-06T04:44:32.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.238+0000 7fb7494f7700 1 --2- 172.21.15.17:0/308180087 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fb72c0658c0 0x7fb72c067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:32.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.238+0000 7fb7502bc000 1 --2- 172.21.15.17:0/308180087 >> [v2:172.21.15.17:6809/90656,v1:172.21.15.17:6811/90656] conn(0x55fa66cdc550 0x55fa66cb5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:32.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.238+0000 7fb7502bc000 1 -- 172.21.15.17:0/308180087 --> [v2:172.21.15.17:6809/90656,v1:172.21.15.17:6811/90656] -- osd_op(unknown.0.0:1 7.13 7:ca8fdbba:::100000001fb.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55fa66ce7c70 con 0x55fa66cdc550 2023-10-06T04:44:32.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.238+0000 7fb749cf8700 1 --2- 172.21.15.17:0/308180087 >> [v2:172.21.15.17:6809/90656,v1:172.21.15.17:6811/90656] conn(0x55fa66cdc550 0x55fa66cb5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:32.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.238+0000 7fb7494f7700 1 --2- 172.21.15.17:0/308180087 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fb72c0658c0 0x7fb72c067d70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb744005a20 tx=0x7fb74400c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:32.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.238+0000 7fb749cf8700 1 --2- 172.21.15.17:0/308180087 >> [v2:172.21.15.17:6809/90656,v1:172.21.15.17:6811/90656] conn(0x55fa66cdc550 0x55fa66cb5540 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:32.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.238+0000 7fb749cf8700 1 -- 172.21.15.17:0/308180087 <== osd.0 v2:172.21.15.17:6809/90656 1 ==== osd_op_reply(1 100000001fb.00000000 [getxattr (103) out=103b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+103 (crc 0 0 0) 0x7fb73c00fce0 con 0x55fa66cdc550 2023-10-06T04:44:32.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.239+0000 7fb7502bc000 1 -- 172.21.15.17:0/308180087 >> [v2:172.21.15.17:6809/90656,v1:172.21.15.17:6811/90656] conn(0x55fa66cdc550 msgr2=0x55fa66cb5540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:32.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.239+0000 7fb7502bc000 1 --2- 172.21.15.17:0/308180087 >> [v2:172.21.15.17:6809/90656,v1:172.21.15.17:6811/90656] conn(0x55fa66cdc550 0x55fa66cb5540 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.239+0000 7fb7502bc000 1 -- 172.21.15.17:0/308180087 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fb72c0658c0 msgr2=0x7fb72c067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:32.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.239+0000 7fb7502bc000 1 --2- 172.21.15.17:0/308180087 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fb72c0658c0 0x7fb72c067d70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb744005a20 tx=0x7fb74400c040 comp rx=0 tx=0).stop 2023-10-06T04:44:32.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.239+0000 7fb7502bc000 1 -- 172.21.15.17:0/308180087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa66c29cb0 msgr2=0x55fa66ce71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:32.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.239+0000 7fb7502bc000 1 --2- 172.21.15.17:0/308180087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa66c29cb0 0x55fa66ce71f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb738004070 tx=0x7fb734015000 comp rx=0 tx=0).stop 2023-10-06T04:44:32.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.239+0000 7fb749cf8700 1 -- 172.21.15.17:0/308180087 reap_dead start 2023-10-06T04:44:32.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.239+0000 7fb7502bc000 1 -- 172.21.15.17:0/308180087 shutdown_connections 2023-10-06T04:44:32.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.239+0000 7fb7502bc000 1 -- 172.21.15.17:0/308180087 >> 172.21.15.17:0/308180087 conn(0x55fa66bfd310 msgr2=0x55fa66cdbe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:32.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.239+0000 7fb7502bc000 1 -- 172.21.15.17:0/308180087 shutdown_connections 2023-10-06T04:44:32.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.239+0000 7fb7502bc000 1 -- 172.21.15.17:0/308180087 wait complete. 2023-10-06T04:44:32.247 INFO:teuthology.orchestra.run.smithi017.stdout:a��alphaparent_c% 2023-10-06T04:44:32.248 DEBUG:teuthology.orchestra.run.smithi017:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2023-10-06T04:44:32.340 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-06T04:44:32.341 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511628283, 2023-10-06T04:44:32.341 INFO:teuthology.orchestra.run.smithi017.stdout: "ancestors": [ 2023-10-06T04:44:32.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:44:32.341 INFO:teuthology.orchestra.run.smithi017.stdout: "dirino": 1099511628285, 2023-10-06T04:44:32.341 INFO:teuthology.orchestra.run.smithi017.stdout: "dname": "alpha", 2023-10-06T04:44:32.341 INFO:teuthology.orchestra.run.smithi017.stdout: "version": 8 2023-10-06T04:44:32.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-06T04:44:32.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-06T04:44:32.342 INFO:teuthology.orchestra.run.smithi017.stdout: "dirino": 1, 2023-10-06T04:44:32.342 INFO:teuthology.orchestra.run.smithi017.stdout: "dname": "parent_c", 2023-10-06T04:44:32.342 INFO:teuthology.orchestra.run.smithi017.stdout: "version": 37 2023-10-06T04:44:32.342 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-06T04:44:32.342 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-06T04:44:32.342 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 7, 2023-10-06T04:44:32.342 INFO:teuthology.orchestra.run.smithi017.stdout: "old_pools": [ 2023-10-06T04:44:32.342 INFO:teuthology.orchestra.run.smithi017.stdout: 6 2023-10-06T04:44:32.342 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-06T04:44:32.342 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-06T04:44:32.342 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:32.344 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:44:32.344 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout.object_size -v 8388608 ./parent_c/alpha) 2023-10-06T04:44:32.402 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:44:32.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.558+0000 7f2b30b08700 1 Processor -- start 2023-10-06T04:44:32.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.558+0000 7f2b30b08700 1 -- start start 2023-10-06T04:44:32.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.559+0000 7f2b30b08700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2b2c15ca80 0x7f2b2c06e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:32.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.559+0000 7f2b30b08700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2b2c15ce50 0x7f2b2c15d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:32.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.559+0000 7f2b30b08700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b2c0ab250 con 0x7f2b2c15d910 2023-10-06T04:44:32.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.559+0000 7f2b30b08700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b2c06e660 con 0x7f2b2c15ca80 2023-10-06T04:44:32.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.559+0000 7f2b30b08700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c06e940 con 0x7f2b2c15ce50 2023-10-06T04:44:32.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.559+0000 7f2b2ad9d700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f2b2c15d910 0x7f2b2c0aefa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34882/0 (socket says 172.21.15.17:34882) 2023-10-06T04:44:32.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.559+0000 7f2b2ad9d700 1 -- 172.21.15.17:0/1216266801 learned_addr learned my addr 172.21.15.17:0/1216266801 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:32.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.560+0000 7f2b2a59c700 1 --2- 172.21.15.17:0/1216266801 >> v2:172.21.15.136:3300/0 conn(0x7f2b2c15ca80 0x7f2b2c06e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:32.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.560+0000 7f2b29d9b700 1 --2- 172.21.15.17:0/1216266801 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2b2c15ce50 0x7f2b2c15d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:32.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.560+0000 7f2b2959a700 1 -- 172.21.15.17:0/1216266801 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2962278943 0 0) 0x7f2b2c0ab250 con 0x7f2b2c15d910 2023-10-06T04:44:32.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.560+0000 7f2b2959a700 1 -- 172.21.15.17:0/1216266801 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b18003570 con 0x7f2b2c15d910 2023-10-06T04:44:32.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.560+0000 7f2b2959a700 1 -- 172.21.15.17:0/1216266801 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2909151576 0 0) 0x7f2b18003570 con 0x7f2b2c15d910 2023-10-06T04:44:32.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.560+0000 7f2b2959a700 1 -- 172.21.15.17:0/1216266801 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2b2c15ce50 msgr2=0x7f2b2c15d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:32.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.560+0000 7f2b2959a700 1 --2- 172.21.15.17:0/1216266801 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2b2c15ce50 0x7f2b2c15d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.560+0000 7f2b2959a700 1 -- 172.21.15.17:0/1216266801 >> v2:172.21.15.136:3300/0 conn(0x7f2b2c15ca80 msgr2=0x7f2b2c06e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:32.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.560+0000 7f2b2959a700 1 --2- 172.21.15.17:0/1216266801 >> v2:172.21.15.136:3300/0 conn(0x7f2b2c15ca80 0x7f2b2c06e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.560+0000 7f2b2959a700 1 -- 172.21.15.17:0/1216266801 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b2c06ec20 con 0x7f2b2c15d910 2023-10-06T04:44:32.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.560+0000 7f2b2959a700 1 -- 172.21.15.17:0/1216266801 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4268781140 0 0) 0x7f2b1c0017f0 con 0x7f2b2c15d910 2023-10-06T04:44:32.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.560+0000 7f2b2a59c700 1 --2- 172.21.15.17:0/1216266801 >> v2:172.21.15.136:3300/0 conn(0x7f2b2c15ca80 0x7f2b2c06e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:44:32.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.560+0000 7f2b2959a700 1 -- 172.21.15.17:0/1216266801 >> v1:172.21.15.17:6789/0 conn(0x7f2b2c15d910 legacy=0x7f2b2c0aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:32.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.560+0000 7f2b2959a700 1 --2- 172.21.15.17:0/1216266801 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2b18003a60 0x7f2b18003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:32.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.560+0000 7f2b2959a700 1 --2- 172.21.15.17:0/1216266801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b18004810 0x7f2b18004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:32.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.560+0000 7f2b2959a700 1 --2- 172.21.15.17:0/1216266801 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2b2c15ce50 0x7f2b180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:32.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.560+0000 7f2b2959a700 1 -- 172.21.15.17:0/1216266801 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c06e660 con 0x7f2b18004810 2023-10-06T04:44:32.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.560+0000 7f2b2959a700 1 -- 172.21.15.17:0/1216266801 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c06e940 con 0x7f2b18003a60 2023-10-06T04:44:32.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.560+0000 7f2b2959a700 1 -- 172.21.15.17:0/1216266801 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1800ba60 con 0x7f2b2c15ce50 2023-10-06T04:44:32.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.560+0000 7f2b29d9b700 1 --2- 172.21.15.17:0/1216266801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b18004810 0x7f2b18004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:32.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.560+0000 7f2b2ad9d700 1 --2- 172.21.15.17:0/1216266801 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2b2c15ce50 0x7f2b180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:32.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.560+0000 7f2b2a59c700 1 --2- 172.21.15.17:0/1216266801 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2b18003a60 0x7f2b18003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:32.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.560+0000 7f2b29d9b700 1 -- 172.21.15.17:0/1216266801 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2b2c15ce50 msgr2=0x7f2b180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:32.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.560+0000 7f2b29d9b700 1 --2- 172.21.15.17:0/1216266801 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2b2c15ce50 0x7f2b180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.560+0000 7f2b29d9b700 1 -- 172.21.15.17:0/1216266801 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2b18003a60 msgr2=0x7f2b18003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:32.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.560+0000 7f2b29d9b700 1 --2- 172.21.15.17:0/1216266801 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2b18003a60 0x7f2b18003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.560+0000 7f2b29d9b700 1 -- 172.21.15.17:0/1216266801 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b18003570 con 0x7f2b18004810 2023-10-06T04:44:32.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.560+0000 7f2b2a59c700 1 --2- 172.21.15.17:0/1216266801 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2b18003a60 0x7f2b18003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:32.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.560+0000 7f2b2ad9d700 1 --2- 172.21.15.17:0/1216266801 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2b2c15ce50 0x7f2b180051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:32.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.561+0000 7f2b29d9b700 1 --2- 172.21.15.17:0/1216266801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b18004810 0x7f2b18004c80 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2b14009c00 tx=0x7f2b140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d98e1fb89d60954 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:32.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.561+0000 7f2b2959a700 1 -- 172.21.15.17:0/1216266801 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1400e710 con 0x7f2b18004810 2023-10-06T04:44:32.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.561+0000 7f2b2959a700 1 -- 172.21.15.17:0/1216266801 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b1400e870 con 0x7f2b18004810 2023-10-06T04:44:32.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.561+0000 7f2b2959a700 1 -- 172.21.15.17:0/1216266801 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1400ec30 con 0x7f2b18004810 2023-10-06T04:44:32.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.561+0000 7f2b30b08700 1 -- 172.21.15.17:0/1216266801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b18004810 msgr2=0x7f2b18004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:32.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.561+0000 7f2b30b08700 1 --2- 172.21.15.17:0/1216266801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b18004810 0x7f2b18004c80 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2b14009c00 tx=0x7f2b140091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.561+0000 7f2b2ad9d700 1 -- 172.21.15.17:0/1216266801 reap_dead start 2023-10-06T04:44:32.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.561+0000 7f2b30b08700 1 -- 172.21.15.17:0/1216266801 shutdown_connections 2023-10-06T04:44:32.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.561+0000 7f2b30b08700 1 -- 172.21.15.17:0/1216266801 >> 172.21.15.17:0/1216266801 conn(0x7f2b2c06cd40 msgr2=0x7f2b2c087fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:32.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.561+0000 7f2b30b08700 1 -- 172.21.15.17:0/1216266801 shutdown_connections 2023-10-06T04:44:32.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.561+0000 7f2b30b08700 1 -- 172.21.15.17:0/1216266801 wait complete. 2023-10-06T04:44:32.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.562+0000 7f2b30b08700 1 Processor -- start 2023-10-06T04:44:32.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.562+0000 7f2b30b08700 1 -- start start 2023-10-06T04:44:32.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.563+0000 7f2b30b08700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b18004810 0x7f2b2c167450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:32.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.563+0000 7f2b30b08700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2b2c16a900 0x7f2b2c0c95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:32.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.563+0000 7f2b30b08700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2b2c0c76c0 0x7f2b2c0c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:32.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.563+0000 7f2b30b08700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c0c8080 con 0x7f2b18004810 2023-10-06T04:44:32.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.563+0000 7f2b30b08700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c143840 con 0x7f2b2c0c76c0 2023-10-06T04:44:32.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.563+0000 7f2b30b08700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c16ad70 con 0x7f2b2c16a900 2023-10-06T04:44:32.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.563+0000 7f2b2a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b18004810 0x7f2b2c167450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:32.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.563+0000 7f2b2a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b18004810 0x7f2b2c167450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51694/0 (socket says 172.21.15.17:51694) 2023-10-06T04:44:32.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.563+0000 7f2b2a59c700 1 -- 172.21.15.17:0/476436799 learned_addr learned my addr 172.21.15.17:0/476436799 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:32.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.564+0000 7f2b2a59c700 1 -- 172.21.15.17:0/476436799 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2b2c16a900 msgr2=0x7f2b2c0c95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:32.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.564+0000 7f2b2a59c700 1 --2- 172.21.15.17:0/476436799 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2b2c16a900 0x7f2b2c0c95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.564+0000 7f2b2a59c700 1 -- 172.21.15.17:0/476436799 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2b2c0c76c0 msgr2=0x7f2b2c0c7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:32.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.564+0000 7f2b2a59c700 1 --2- 172.21.15.17:0/476436799 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2b2c0c76c0 0x7f2b2c0c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.564+0000 7f2b2a59c700 1 -- 172.21.15.17:0/476436799 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b2c0c9e40 con 0x7f2b18004810 2023-10-06T04:44:32.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.564+0000 7f2b2a59c700 1 --2- 172.21.15.17:0/476436799 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b18004810 0x7f2b2c167450 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2b24009fd0 tx=0x7f2b24008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:32.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.564+0000 7f2b227fc700 1 -- 172.21.15.17:0/476436799 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2400f9b0 con 0x7f2b18004810 2023-10-06T04:44:32.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.564+0000 7f2b227fc700 1 -- 172.21.15.17:0/476436799 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2400fb10 con 0x7f2b18004810 2023-10-06T04:44:32.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.564+0000 7f2b227fc700 1 -- 172.21.15.17:0/476436799 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2400fe90 con 0x7f2b18004810 2023-10-06T04:44:32.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.564+0000 7f2b30b08700 1 -- 172.21.15.17:0/476436799 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b2c0ca120 con 0x7f2b18004810 2023-10-06T04:44:32.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.564+0000 7f2b30b08700 1 -- 172.21.15.17:0/476436799 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b2c0ca6e0 con 0x7f2b18004810 2023-10-06T04:44:32.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.565+0000 7f2b30b08700 1 -- 172.21.15.17:0/476436799 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b2c063ff0 con 0x7f2b18004810 2023-10-06T04:44:32.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.565+0000 7f2b227fc700 1 -- 172.21.15.17:0/476436799 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2b24015670 con 0x7f2b18004810 2023-10-06T04:44:32.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.565+0000 7f2b227fc700 1 --2- 172.21.15.17:0/476436799 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2b0c066f30 0x7f2b0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:32.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.566+0000 7f2b227fc700 1 -- 172.21.15.17:0/476436799 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f2b24085240 con 0x7f2b18004810 2023-10-06T04:44:32.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.566+0000 7f2b29d9b700 1 --2- 172.21.15.17:0/476436799 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2b0c066f30 0x7f2b0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:32.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.566+0000 7f2b29d9b700 1 --2- 172.21.15.17:0/476436799 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2b0c066f30 0x7f2b0c0693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2b140091e0 tx=0x7f2b1401a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:32.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.570+0000 7f2b227fc700 1 -- 172.21.15.17:0/476436799 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2b240521c0 con 0x7f2b18004810 2023-10-06T04:44:32.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.809+0000 7f2b30b08700 1 -- 172.21.15.17:0/476436799 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b2c0cbcb0 con 0x7f2b18004810 2023-10-06T04:44:32.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.809+0000 7f2b227fc700 1 -- 172.21.15.17:0/476436799 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f2b240557e0 con 0x7f2b18004810 2023-10-06T04:44:32.811 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:32.811 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6834/3741747962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3741747962},{"type":"v1","addr":"172.21.15.136:6834","nonce":3741747962}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4688,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/264192509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6833","nonce":264192509},{"type":"v1","addr":"172.21.15.136:6835","nonce":264192509}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4909,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6836/1154731767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1154731767},{"type":"v1","addr":"172.21.15.17:6836","nonce":1154731767}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:44:14.988901+0000","modified":"2023-10-06T04:44:29.425634+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4971":{"gid":4971,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6837/460551791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6835","nonce":460551791},{"type":"v1","addr":"172.21.15.17:6837","nonce":460551791}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:44:32.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.812+0000 7f2b30b08700 1 -- 172.21.15.17:0/476436799 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2b0c066f30 msgr2=0x7f2b0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:32.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.812+0000 7f2b30b08700 1 --2- 172.21.15.17:0/476436799 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2b0c066f30 0x7f2b0c0693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2b140091e0 tx=0x7f2b1401a000 comp rx=0 tx=0).stop 2023-10-06T04:44:32.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.812+0000 7f2b30b08700 1 -- 172.21.15.17:0/476436799 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b18004810 msgr2=0x7f2b2c167450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:32.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.812+0000 7f2b30b08700 1 --2- 172.21.15.17:0/476436799 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b18004810 0x7f2b2c167450 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2b24009fd0 tx=0x7f2b24008040 comp rx=0 tx=0).stop 2023-10-06T04:44:32.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.812+0000 7f2b30b08700 1 -- 172.21.15.17:0/476436799 shutdown_connections 2023-10-06T04:44:32.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.812+0000 7f2b30b08700 1 --2- 172.21.15.17:0/476436799 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2b0c066f30 0x7f2b0c0693e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.812+0000 7f2b30b08700 1 --2- 172.21.15.17:0/476436799 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2b2c0c76c0 0x7f2b2c0c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.812+0000 7f2b30b08700 1 --2- 172.21.15.17:0/476436799 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b18004810 0x7f2b2c167450 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.812+0000 7f2b30b08700 1 --2- 172.21.15.17:0/476436799 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2b2c16a900 0x7f2b2c0c95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:32.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.812+0000 7f2b30b08700 1 -- 172.21.15.17:0/476436799 >> 172.21.15.17:0/476436799 conn(0x7f2b2c06cd40 msgr2=0x7f2b2c15c030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:32.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.812+0000 7f2b30b08700 1 -- 172.21.15.17:0/476436799 shutdown_connections 2023-10-06T04:44:32.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:32.812+0000 7f2b30b08700 1 -- 172.21.15.17:0/476436799 wait complete. 2023-10-06T04:44:32.815 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 17 2023-10-06T04:44:32.826 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2023-10-06T04:44:32.967 INFO:teuthology.orchestra.run.smithi017.stdout:{"message":"","return_code":0} 2023-10-06T04:44:32.967 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-10-06T04:44:32.967 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool data_new getxattr 100000001fb.00000000 layout 2023-10-06T04:44:33.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.004+0000 7fc5f53ff000 1 Processor -- start 2023-10-06T04:44:33.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.004+0000 7fc5f53ff000 1 -- start start 2023-10-06T04:44:33.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.005+0000 7fc5f53ff000 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x556923f57eb0 0x556923f5a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:33.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.005+0000 7fc5f53ff000 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556923f58280 0x556923e855a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:33.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.005+0000 7fc5f53ff000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556923eade10 0x556923eb2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:33.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.005+0000 7fc5f53ff000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556923dcf980 con 0x556923eade10 2023-10-06T04:44:33.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.005+0000 7fc5f53ff000 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x556923dcf620 con 0x556923f58280 2023-10-06T04:44:33.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.005+0000 7fc5f53ff000 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x556923dc6400 con 0x556923f57eb0 2023-10-06T04:44:33.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.005+0000 7fc5eee3b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556923eade10 0x556923eb2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:33.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.005+0000 7fc5eee3b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556923eade10 0x556923eb2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51710/0 (socket says 172.21.15.17:51710) 2023-10-06T04:44:33.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.005+0000 7fc5eee3b700 1 -- 172.21.15.17:0/2631792142 learned_addr learned my addr 172.21.15.17:0/2631792142 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:33.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.005+0000 7fc5ee63a700 1 --2- 172.21.15.17:0/2631792142 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x556923f57eb0 0x556923f5a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:33.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.005+0000 7fc5ede39700 1 --2- 172.21.15.17:0/2631792142 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556923f58280 0x556923e855a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:33.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.005+0000 7fc5eee3b700 1 -- 172.21.15.17:0/2631792142 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x556923f57eb0 msgr2=0x556923f5a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:33.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.005+0000 7fc5eee3b700 1 --2- 172.21.15.17:0/2631792142 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x556923f57eb0 0x556923f5a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.005+0000 7fc5eee3b700 1 -- 172.21.15.17:0/2631792142 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556923f58280 msgr2=0x556923e855a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:33.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.005+0000 7fc5eee3b700 1 --2- 172.21.15.17:0/2631792142 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556923f58280 0x556923e855a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.005+0000 7fc5eee3b700 1 -- 172.21.15.17:0/2631792142 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e000a0e0 con 0x556923eade10 2023-10-06T04:44:33.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.005+0000 7fc5ede39700 1 --2- 172.21.15.17:0/2631792142 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556923f58280 0x556923e855a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:33.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.005+0000 7fc5eee3b700 1 --2- 172.21.15.17:0/2631792142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556923eade10 0x556923eb2d10 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x556923e71920 tx=0x7fc5e0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f340c7aa7a3803 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:33.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.005+0000 7fc5ece37700 1 -- 172.21.15.17:0/2631792142 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e000fe00 con 0x556923eade10 2023-10-06T04:44:33.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.005+0000 7fc5ece37700 1 -- 172.21.15.17:0/2631792142 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e001f070 con 0x556923eade10 2023-10-06T04:44:33.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.005+0000 7fc5ece37700 1 -- 172.21.15.17:0/2631792142 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e000f860 con 0x556923eade10 2023-10-06T04:44:33.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.006+0000 7fc5f53ff000 1 -- 172.21.15.17:0/2631792142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556923eade10 msgr2=0x556923eb2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:33.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.006+0000 7fc5f53ff000 1 --2- 172.21.15.17:0/2631792142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556923eade10 0x556923eb2d10 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x556923e71920 tx=0x7fc5e0015000 comp rx=0 tx=0).stop 2023-10-06T04:44:33.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.006+0000 7fc5f53ff000 1 -- 172.21.15.17:0/2631792142 shutdown_connections 2023-10-06T04:44:33.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.006+0000 7fc5f53ff000 1 --2- 172.21.15.17:0/2631792142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556923eade10 0x556923eb2d10 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.006+0000 7fc5f53ff000 1 --2- 172.21.15.17:0/2631792142 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x556923f57eb0 0x556923f5a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.006+0000 7fc5f53ff000 1 --2- 172.21.15.17:0/2631792142 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556923f58280 0x556923e855a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.006+0000 7fc5f53ff000 1 -- 172.21.15.17:0/2631792142 >> 172.21.15.17:0/2631792142 conn(0x556923eb12b0 msgr2=0x556923f5ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:33.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.006+0000 7fc5f53ff000 1 -- 172.21.15.17:0/2631792142 shutdown_connections 2023-10-06T04:44:33.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.006+0000 7fc5f53ff000 1 -- 172.21.15.17:0/2631792142 wait complete. 2023-10-06T04:44:33.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.006+0000 7fc5f53ff000 1 Processor -- start 2023-10-06T04:44:33.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.006+0000 7fc5f53ff000 1 -- start start 2023-10-06T04:44:33.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.007+0000 7fc5f53ff000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556923eade10 0x556923f3ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:33.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.007+0000 7fc5f53ff000 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x556923f57eb0 0x556923f58830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:33.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.007+0000 7fc5f53ff000 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556923f58280 0x556923f53690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:33.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.007+0000 7fc5f53ff000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556923f66000 con 0x556923eade10 2023-10-06T04:44:33.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.007+0000 7fc5f53ff000 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x556923f662a0 con 0x556923f58280 2023-10-06T04:44:33.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.007+0000 7fc5f53ff000 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x556923f66540 con 0x556923f57eb0 2023-10-06T04:44:33.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.007+0000 7fc5ee63a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556923eade10 0x556923f3ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:33.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.007+0000 7fc5ee63a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556923eade10 0x556923f3ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51714/0 (socket says 172.21.15.17:51714) 2023-10-06T04:44:33.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.007+0000 7fc5ee63a700 1 -- 172.21.15.17:0/155019991 learned_addr learned my addr 172.21.15.17:0/155019991 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:33.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.007+0000 7fc5ede39700 1 --2- 172.21.15.17:0/155019991 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x556923f57eb0 0x556923f58830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:33.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.007+0000 7fc5eee3b700 1 --2- 172.21.15.17:0/155019991 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556923f58280 0x556923f53690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:33.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.008+0000 7fc5ee63a700 1 -- 172.21.15.17:0/155019991 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x556923f57eb0 msgr2=0x556923f58830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:33.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.008+0000 7fc5ee63a700 1 --2- 172.21.15.17:0/155019991 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x556923f57eb0 0x556923f58830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.008+0000 7fc5ee63a700 1 -- 172.21.15.17:0/155019991 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556923f58280 msgr2=0x556923f53690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:33.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.008+0000 7fc5ee63a700 1 --2- 172.21.15.17:0/155019991 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556923f58280 0x556923f53690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.008+0000 7fc5ee63a700 1 -- 172.21.15.17:0/155019991 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556923df81c0 con 0x556923eade10 2023-10-06T04:44:33.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.008+0000 7fc5ee63a700 1 --2- 172.21.15.17:0/155019991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556923eade10 0x556923f3ed40 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8008770 tx=0x7fc5e8005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:33.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.008+0000 7fc5e6ffd700 1 -- 172.21.15.17:0/155019991 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e800f070 con 0x556923eade10 2023-10-06T04:44:33.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.008+0000 7fc5e6ffd700 1 -- 172.21.15.17:0/155019991 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e8006690 con 0x556923eade10 2023-10-06T04:44:33.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.008+0000 7fc5f53ff000 1 -- 172.21.15.17:0/155019991 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556923dde3d0 con 0x556923eade10 2023-10-06T04:44:33.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.008+0000 7fc5e6ffd700 1 -- 172.21.15.17:0/155019991 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8006a70 con 0x556923eade10 2023-10-06T04:44:33.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.008+0000 7fc5f53ff000 1 -- 172.21.15.17:0/155019991 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556923dd1ae0 con 0x556923eade10 2023-10-06T04:44:33.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.009+0000 7fc5e6ffd700 1 -- 172.21.15.17:0/155019991 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc5e801c3b0 con 0x556923eade10 2023-10-06T04:44:33.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.010+0000 7fc5e6ffd700 1 --2- 172.21.15.17:0/155019991 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc5d00658c0 0x7fc5d0067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:33.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.010+0000 7fc5e6ffd700 1 -- 172.21.15.17:0/155019991 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6453+0+0 (secure 0 0 0) 0x7fc5e8082f90 con 0x556923eade10 2023-10-06T04:44:33.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.010+0000 7fc5ede39700 1 --2- 172.21.15.17:0/155019991 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc5d00658c0 0x7fc5d0067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:33.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.010+0000 7fc5f53ff000 1 --2- 172.21.15.17:0/155019991 >> [v2:172.21.15.17:6809/90656,v1:172.21.15.17:6811/90656] conn(0x556923f58d70 0x556923eab280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:33.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.010+0000 7fc5f53ff000 1 -- 172.21.15.17:0/155019991 --> [v2:172.21.15.17:6809/90656,v1:172.21.15.17:6811/90656] -- osd_op(unknown.0.0:1 7.13 7:ca8fdbba:::100000001fb.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x556923f65af0 con 0x556923f58d70 2023-10-06T04:44:33.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.010+0000 7fc5eee3b700 1 --2- 172.21.15.17:0/155019991 >> [v2:172.21.15.17:6809/90656,v1:172.21.15.17:6811/90656] conn(0x556923f58d70 0x556923eab280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:33.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.010+0000 7fc5ede39700 1 --2- 172.21.15.17:0/155019991 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc5d00658c0 0x7fc5d0067d70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8000c00 tx=0x7fc5d80017c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:33.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.010+0000 7fc5eee3b700 1 --2- 172.21.15.17:0/155019991 >> [v2:172.21.15.17:6809/90656,v1:172.21.15.17:6811/90656] conn(0x556923f58d70 0x556923eab280 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:33.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.011+0000 7fc5eee3b700 1 -- 172.21.15.17:0/155019991 <== osd.0 v2:172.21.15.17:6809/90656 1 ==== osd_op_reply(1 100000001fb.00000000 [getxattr (30) out=30b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x7fc5e0016020 con 0x556923f58d70 2023-10-06T04:44:33.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.011+0000 7fc5f53ff000 1 -- 172.21.15.17:0/155019991 >> [v2:172.21.15.17:6809/90656,v1:172.21.15.17:6811/90656] conn(0x556923f58d70 msgr2=0x556923eab280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:33.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.011+0000 7fc5f53ff000 1 --2- 172.21.15.17:0/155019991 >> [v2:172.21.15.17:6809/90656,v1:172.21.15.17:6811/90656] conn(0x556923f58d70 0x556923eab280 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.011+0000 7fc5f53ff000 1 -- 172.21.15.17:0/155019991 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc5d00658c0 msgr2=0x7fc5d0067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:33.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.011+0000 7fc5f53ff000 1 --2- 172.21.15.17:0/155019991 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc5d00658c0 0x7fc5d0067d70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8000c00 tx=0x7fc5d80017c0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.011+0000 7fc5f53ff000 1 -- 172.21.15.17:0/155019991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556923eade10 msgr2=0x556923f3ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:33.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.011+0000 7fc5f53ff000 1 --2- 172.21.15.17:0/155019991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556923eade10 0x556923f3ed40 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8008770 tx=0x7fc5e8005bd0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.011+0000 7fc5eee3b700 1 -- 172.21.15.17:0/155019991 reap_dead start 2023-10-06T04:44:33.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.011+0000 7fc5f53ff000 1 -- 172.21.15.17:0/155019991 shutdown_connections 2023-10-06T04:44:33.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.011+0000 7fc5f53ff000 1 -- 172.21.15.17:0/155019991 >> 172.21.15.17:0/155019991 conn(0x556923eb12b0 msgr2=0x556923eb1680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:33.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.011+0000 7fc5f53ff000 1 -- 172.21.15.17:0/155019991 shutdown_connections 2023-10-06T04:44:33.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.011+0000 7fc5f53ff000 1 -- 172.21.15.17:0/155019991 wait complete. 2023-10-06T04:44:33.023 INFO:teuthology.orchestra.run.smithi017.stdout:@� 2023-10-06T04:44:33.024 DEBUG:teuthology.orchestra.run.smithi017:> ceph-dencoder type file_layout_t import - decode dump_json 2023-10-06T04:44:33.116 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-06T04:44:33.116 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_unit": 4194304, 2023-10-06T04:44:33.116 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_count": 1, 2023-10-06T04:44:33.116 INFO:teuthology.orchestra.run.smithi017.stdout: "object_size": 8388608, 2023-10-06T04:44:33.116 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_id": 7, 2023-10-06T04:44:33.116 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_ns": "" 2023-10-06T04:44:33.116 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-06T04:44:33.116 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:33.118 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001fb.00000000 layout 2023-10-06T04:44:33.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.195+0000 7f5f4581a000 1 Processor -- start 2023-10-06T04:44:33.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.195+0000 7f5f4581a000 1 -- start start 2023-10-06T04:44:33.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.196+0000 7f5f4581a000 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5612a6766400 0x5612a67ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:33.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.196+0000 7f5f4581a000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612a6823b50 0x5612a67adb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:33.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.196+0000 7f5f4581a000 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5612a6823f20 0x5612a6839f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:33.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.196+0000 7f5f4581a000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612a66ae980 con 0x5612a6823b50 2023-10-06T04:44:33.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.196+0000 7f5f4581a000 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612a66ae620 con 0x5612a6823f20 2023-10-06T04:44:33.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.196+0000 7f5f4581a000 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x5612a66a5400 con 0x5612a6766400 2023-10-06T04:44:33.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.196+0000 7f5f3e254700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612a6823b50 0x5612a67adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:33.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.196+0000 7f5f3e254700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612a6823b50 0x5612a67adb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51732/0 (socket says 172.21.15.17:51732) 2023-10-06T04:44:33.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.196+0000 7f5f3e254700 1 -- 172.21.15.17:0/174946621 learned_addr learned my addr 172.21.15.17:0/174946621 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:33.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.196+0000 7f5f3ea55700 1 --2- 172.21.15.17:0/174946621 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5612a6766400 0x5612a67ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:33.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.196+0000 7f5f3f256700 1 --2- 172.21.15.17:0/174946621 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5612a6823f20 0x5612a6839f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:33.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.196+0000 7f5f3e254700 1 -- 172.21.15.17:0/174946621 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5612a6766400 msgr2=0x5612a67ad5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:33.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.196+0000 7f5f3e254700 1 --2- 172.21.15.17:0/174946621 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5612a6766400 0x5612a67ad5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.196+0000 7f5f3e254700 1 -- 172.21.15.17:0/174946621 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5612a6823f20 msgr2=0x5612a6839f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:33.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.196+0000 7f5f3e254700 1 --2- 172.21.15.17:0/174946621 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5612a6823f20 0x5612a6839f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.196+0000 7f5f3e254700 1 -- 172.21.15.17:0/174946621 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3000a180 con 0x5612a6823b50 2023-10-06T04:44:33.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.196+0000 7f5f3e254700 1 --2- 172.21.15.17:0/174946621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612a6823b50 0x5612a67adb30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f5f2800a840 tx=0x7f5f28005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e34311008319e6e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:33.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.197+0000 7f5f3d252700 1 -- 172.21.15.17:0/174946621 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2800f070 con 0x5612a6823b50 2023-10-06T04:44:33.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.197+0000 7f5f3d252700 1 -- 172.21.15.17:0/174946621 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f280085d0 con 0x5612a6823b50 2023-10-06T04:44:33.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.197+0000 7f5f3d252700 1 -- 172.21.15.17:0/174946621 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f28008970 con 0x5612a6823b50 2023-10-06T04:44:33.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.197+0000 7f5f4581a000 1 -- 172.21.15.17:0/174946621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612a6823b50 msgr2=0x5612a67adb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:33.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.197+0000 7f5f4581a000 1 --2- 172.21.15.17:0/174946621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612a6823b50 0x5612a67adb30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f5f2800a840 tx=0x7f5f28005be0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.197+0000 7f5f4581a000 1 -- 172.21.15.17:0/174946621 shutdown_connections 2023-10-06T04:44:33.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.197+0000 7f5f4581a000 1 --2- 172.21.15.17:0/174946621 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5612a6823f20 0x5612a6839f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.197+0000 7f5f4581a000 1 --2- 172.21.15.17:0/174946621 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5612a6766400 0x5612a67ad5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.197+0000 7f5f4581a000 1 --2- 172.21.15.17:0/174946621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612a6823b50 0x5612a67adb30 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.197+0000 7f5f4581a000 1 -- 172.21.15.17:0/174946621 >> 172.21.15.17:0/174946621 conn(0x5612a67902b0 msgr2=0x5612a67ac880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:33.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.197+0000 7f5f4581a000 1 -- 172.21.15.17:0/174946621 shutdown_connections 2023-10-06T04:44:33.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.197+0000 7f5f4581a000 1 -- 172.21.15.17:0/174946621 wait complete. 2023-10-06T04:44:33.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.198+0000 7f5f4581a000 1 Processor -- start 2023-10-06T04:44:33.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.198+0000 7f5f4581a000 1 -- start start 2023-10-06T04:44:33.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.199+0000 7f5f4581a000 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5612a6766400 0x5612a681a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:33.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.199+0000 7f5f4581a000 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5612a6823b50 0x5612a6836d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:33.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.199+0000 7f5f4581a000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612a6823f20 0x5612a67ac670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:33.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.199+0000 7f5f4581a000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612a683ab60 con 0x5612a6823f20 2023-10-06T04:44:33.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.199+0000 7f5f4581a000 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612a6837290 con 0x5612a6823b50 2023-10-06T04:44:33.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.199+0000 7f5f4581a000 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x5612a6816700 con 0x5612a6766400 2023-10-06T04:44:33.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.199+0000 7f5f3f256700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612a6823f20 0x5612a67ac670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:33.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.199+0000 7f5f3f256700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612a6823f20 0x5612a67ac670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51742/0 (socket says 172.21.15.17:51742) 2023-10-06T04:44:33.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.199+0000 7f5f3f256700 1 -- 172.21.15.17:0/2420620957 learned_addr learned my addr 172.21.15.17:0/2420620957 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:33.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.199+0000 7f5f3ea55700 1 --2- 172.21.15.17:0/2420620957 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5612a6766400 0x5612a681a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:33.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.199+0000 7f5f3e254700 1 --2- 172.21.15.17:0/2420620957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5612a6823b50 0x5612a6836d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:33.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.199+0000 7f5f3f256700 1 -- 172.21.15.17:0/2420620957 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5612a6766400 msgr2=0x5612a681a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:33.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.199+0000 7f5f3f256700 1 --2- 172.21.15.17:0/2420620957 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5612a6766400 0x5612a681a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.199+0000 7f5f3f256700 1 -- 172.21.15.17:0/2420620957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5612a6823b50 msgr2=0x5612a6836d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:33.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.199+0000 7f5f3f256700 1 --2- 172.21.15.17:0/2420620957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5612a6823b50 0x5612a6836d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.199+0000 7f5f3f256700 1 -- 172.21.15.17:0/2420620957 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2800a440 con 0x5612a6823f20 2023-10-06T04:44:33.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.199+0000 7f5f3f256700 1 --2- 172.21.15.17:0/2420620957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612a6823f20 0x5612a67ac670 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5f3000a150 tx=0x7f5f30011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:33.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.199+0000 7f5f377fe700 1 -- 172.21.15.17:0/2420620957 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3000e9f0 con 0x5612a6823f20 2023-10-06T04:44:33.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.199+0000 7f5f377fe700 1 -- 172.21.15.17:0/2420620957 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3000ee50 con 0x5612a6823f20 2023-10-06T04:44:33.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.199+0000 7f5f4581a000 1 -- 172.21.15.17:0/2420620957 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5612a66bd3d0 con 0x5612a6823f20 2023-10-06T04:44:33.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.199+0000 7f5f377fe700 1 -- 172.21.15.17:0/2420620957 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f300056b0 con 0x5612a6823f20 2023-10-06T04:44:33.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.199+0000 7f5f4581a000 1 -- 172.21.15.17:0/2420620957 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5612a66b0ae0 con 0x5612a6823f20 2023-10-06T04:44:33.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.201+0000 7f5f377fe700 1 -- 172.21.15.17:0/2420620957 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5f30023020 con 0x5612a6823f20 2023-10-06T04:44:33.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.201+0000 7f5f377fe700 1 --2- 172.21.15.17:0/2420620957 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5f200658c0 0x7f5f20067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:33.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.201+0000 7f5f377fe700 1 -- 172.21.15.17:0/2420620957 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f5f300855a0 con 0x5612a6823f20 2023-10-06T04:44:33.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.201+0000 7f5f3ea55700 1 --2- 172.21.15.17:0/2420620957 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5f200658c0 0x7f5f20067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:33.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.201+0000 7f5f4581a000 1 --2- 172.21.15.17:0/2420620957 >> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] conn(0x5612a681bf50 0x5612a681c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:33.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.201+0000 7f5f4581a000 1 -- 172.21.15.17:0/2420620957 --> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] -- osd_op(unknown.0.0:1 6.13 6:ca8fdbba:::100000001fb.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x5612a681c890 con 0x5612a681bf50 2023-10-06T04:44:33.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.201+0000 7f5f3e254700 1 --2- 172.21.15.17:0/2420620957 >> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] conn(0x5612a681bf50 0x5612a681c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:33.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.202+0000 7f5f3ea55700 1 --2- 172.21.15.17:0/2420620957 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5f200658c0 0x7f5f20067d70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5f3800e680 tx=0x7f5f38000bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:33.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.202+0000 7f5f3e254700 1 --2- 172.21.15.17:0/2420620957 >> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] conn(0x5612a681bf50 0x5612a681c350 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:33.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.202+0000 7f5f3e254700 1 -- 172.21.15.17:0/2420620957 <== osd.3 v2:172.21.15.17:6824/90688 1 ==== osd_op_reply(1 100000001fb.00000000 [getxattr (30) out=30b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x7f5f28008dd0 con 0x5612a681bf50 2023-10-06T04:44:33.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.202+0000 7f5f4581a000 1 -- 172.21.15.17:0/2420620957 >> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] conn(0x5612a681bf50 msgr2=0x5612a681c350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:33.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.202+0000 7f5f4581a000 1 --2- 172.21.15.17:0/2420620957 >> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] conn(0x5612a681bf50 0x5612a681c350 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.202+0000 7f5f4581a000 1 -- 172.21.15.17:0/2420620957 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5f200658c0 msgr2=0x7f5f20067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:33.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.202+0000 7f5f4581a000 1 --2- 172.21.15.17:0/2420620957 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5f200658c0 0x7f5f20067d70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5f3800e680 tx=0x7f5f38000bc0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.202+0000 7f5f4581a000 1 -- 172.21.15.17:0/2420620957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612a6823f20 msgr2=0x5612a67ac670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:33.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.202+0000 7f5f4581a000 1 --2- 172.21.15.17:0/2420620957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612a6823f20 0x5612a67ac670 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5f3000a150 tx=0x7f5f30011000 comp rx=0 tx=0).stop 2023-10-06T04:44:33.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.202+0000 7f5f3f256700 1 -- 172.21.15.17:0/2420620957 reap_dead start 2023-10-06T04:44:33.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.202+0000 7f5f4581a000 1 -- 172.21.15.17:0/2420620957 shutdown_connections 2023-10-06T04:44:33.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.202+0000 7f5f4581a000 1 -- 172.21.15.17:0/2420620957 >> 172.21.15.17:0/2420620957 conn(0x5612a67902b0 msgr2=0x5612a6793d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:33.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.202+0000 7f5f4581a000 1 -- 172.21.15.17:0/2420620957 shutdown_connections 2023-10-06T04:44:33.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.202+0000 7f5f4581a000 1 -- 172.21.15.17:0/2420620957 wait complete. 2023-10-06T04:44:33.210 INFO:teuthology.orchestra.run.smithi017.stdout:@@ 2023-10-06T04:44:33.210 DEBUG:teuthology.orchestra.run.smithi017:> ceph-dencoder type file_layout_t import - decode dump_json 2023-10-06T04:44:33.303 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-06T04:44:33.303 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_unit": 4194304, 2023-10-06T04:44:33.303 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_count": 1, 2023-10-06T04:44:33.303 INFO:teuthology.orchestra.run.smithi017.stdout: "object_size": 4194304, 2023-10-06T04:44:33.303 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_id": 6, 2023-10-06T04:44:33.303 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_ns": "" 2023-10-06T04:44:33.304 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-06T04:44:33.304 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:33.305 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T04:44:33.305 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T04:44:33.386 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T04:44:33.434 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T04:44:33.434 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T04:44:33.434 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:44:33.435 DEBUG:teuthology.orchestra.run.smithi017:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T04:44:33.496 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2023-10-06T04:44:33.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:33.497 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T04:44:33.522 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:44:33.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.679+0000 7f37136d5700 1 Processor -- start 2023-10-06T04:44:33.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.680+0000 7f37136d5700 1 -- start start 2023-10-06T04:44:33.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.680+0000 7f37136d5700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f370c15ca80 0x7f370c06e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:33.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.680+0000 7f37136d5700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f370c0ab250 con 0x7f370c15dae0 2023-10-06T04:44:33.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.680+0000 7f37136d5700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f370c06e660 con 0x7f370c15ce50 2023-10-06T04:44:33.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.680+0000 7f37136d5700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f370c06e940 con 0x7f370c15ca80 2023-10-06T04:44:33.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.681+0000 7f3711471700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f370c15ca80 0x7f370c06e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:33.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.681+0000 7f3711c72700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f370c15dae0 0x7f370c0ab6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34896/0 (socket says 172.21.15.17:34896) 2023-10-06T04:44:33.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.681+0000 7f3711c72700 1 -- 172.21.15.17:0/3457899063 learned_addr learned my addr 172.21.15.17:0/3457899063 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:33.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.681+0000 7f3711471700 1 -- 172.21.15.17:0/3457899063 >> v1:172.21.15.136:6789/0 conn(0x7f370c15ce50 legacy=0x7f370c15d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:33.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.681+0000 7f3711471700 1 -- 172.21.15.17:0/3457899063 >> v1:172.21.15.17:6789/0 conn(0x7f370c15dae0 legacy=0x7f370c0ab6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:33.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.681+0000 7f370bfff700 1 -- 172.21.15.17:0/3457899063 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1490828728 0 0) 0x7f370c0ab250 con 0x7f370c15dae0 2023-10-06T04:44:33.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.681+0000 7f3711471700 1 -- 172.21.15.17:0/3457899063 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370c06ec20 con 0x7f370c15ca80 2023-10-06T04:44:33.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.681+0000 7f3711471700 1 --2- 172.21.15.17:0/3457899063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f370c15ca80 0x7f370c06e050 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f36fc009e60 tx=0x7f36fc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=431bd4f724073fd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:33.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.681+0000 7f370bfff700 1 -- 172.21.15.17:0/3457899063 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc00e070 con 0x7f370c15ca80 2023-10-06T04:44:33.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.681+0000 7f370bfff700 1 -- 172.21.15.17:0/3457899063 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36fc00bbf0 con 0x7f370c15ca80 2023-10-06T04:44:33.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.681+0000 7f370bfff700 1 -- 172.21.15.17:0/3457899063 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc012430 con 0x7f370c15ca80 2023-10-06T04:44:33.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.682+0000 7f37136d5700 1 -- 172.21.15.17:0/3457899063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f370c15ca80 msgr2=0x7f370c06e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:33.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.682+0000 7f37136d5700 1 --2- 172.21.15.17:0/3457899063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f370c15ca80 0x7f370c06e050 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f36fc009e60 tx=0x7f36fc009780 comp rx=0 tx=0).stop 2023-10-06T04:44:33.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.682+0000 7f37136d5700 1 -- 172.21.15.17:0/3457899063 shutdown_connections 2023-10-06T04:44:33.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.682+0000 7f37136d5700 1 --2- 172.21.15.17:0/3457899063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f370c15ca80 0x7f370c06e050 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.682+0000 7f37136d5700 1 -- 172.21.15.17:0/3457899063 >> 172.21.15.17:0/3457899063 conn(0x7f370c06cd40 msgr2=0x7f370c087fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:33.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.682+0000 7f37136d5700 1 -- 172.21.15.17:0/3457899063 shutdown_connections 2023-10-06T04:44:33.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.682+0000 7f37136d5700 1 -- 172.21.15.17:0/3457899063 wait complete. 2023-10-06T04:44:33.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.683+0000 7f37136d5700 1 Processor -- start 2023-10-06T04:44:33.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.683+0000 7f37136d5700 1 -- start start 2023-10-06T04:44:33.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.684+0000 7f37136d5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f370c15ca80 0x7f370c149fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:33.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.684+0000 7f37136d5700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f370c15ce50 0x7f370c157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:33.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.684+0000 7f37136d5700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f370c15dae0 0x7f370c155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:33.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.684+0000 7f37136d5700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370c0c9400 con 0x7f370c15dae0 2023-10-06T04:44:33.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.684+0000 7f37136d5700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370c14a500 con 0x7f370c15ca80 2023-10-06T04:44:33.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.684+0000 7f37136d5700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370c0c9680 con 0x7f370c15ce50 2023-10-06T04:44:33.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.684+0000 7f3711c72700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f370c15dae0 0x7f370c155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:33.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.684+0000 7f3711c72700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f370c15dae0 0x7f370c155410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51764/0 (socket says 172.21.15.17:51764) 2023-10-06T04:44:33.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.684+0000 7f3711c72700 1 -- 172.21.15.17:0/1130292260 learned_addr learned my addr 172.21.15.17:0/1130292260 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:33.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.684+0000 7f3711471700 1 --2- 172.21.15.17:0/1130292260 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f370c15ca80 0x7f370c149fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:33.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.684+0000 7f3710c70700 1 --2- 172.21.15.17:0/1130292260 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f370c15ce50 0x7f370c157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:33.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.684+0000 7f3711c72700 1 -- 172.21.15.17:0/1130292260 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f370c15ce50 msgr2=0x7f370c157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:33.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.684+0000 7f3711c72700 1 --2- 172.21.15.17:0/1130292260 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f370c15ce50 0x7f370c157490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.684+0000 7f3711c72700 1 -- 172.21.15.17:0/1130292260 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f370c15ca80 msgr2=0x7f370c149fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:33.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.684+0000 7f3711c72700 1 --2- 172.21.15.17:0/1130292260 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f370c15ca80 0x7f370c149fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.684+0000 7f3711c72700 1 -- 172.21.15.17:0/1130292260 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36fc009a20 con 0x7f370c15dae0 2023-10-06T04:44:33.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.684+0000 7f3711471700 1 --2- 172.21.15.17:0/1130292260 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f370c15ca80 0x7f370c149fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:33.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.684+0000 7f3710c70700 1 --2- 172.21.15.17:0/1130292260 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f370c15ce50 0x7f370c157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:33.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.684+0000 7f3711c72700 1 --2- 172.21.15.17:0/1130292260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f370c15dae0 0x7f370c155410 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f370400c530 tx=0x7f3704007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:33.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.684+0000 7f37097fa700 1 -- 172.21.15.17:0/1130292260 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3704005b30 con 0x7f370c15dae0 2023-10-06T04:44:33.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.685+0000 7f37097fa700 1 -- 172.21.15.17:0/1130292260 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3704005cb0 con 0x7f370c15dae0 2023-10-06T04:44:33.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.685+0000 7f37136d5700 1 -- 172.21.15.17:0/1130292260 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f370c0c9960 con 0x7f370c15dae0 2023-10-06T04:44:33.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.685+0000 7f37097fa700 1 -- 172.21.15.17:0/1130292260 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3704007320 con 0x7f370c15dae0 2023-10-06T04:44:33.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.685+0000 7f37136d5700 1 -- 172.21.15.17:0/1130292260 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f370c0b2480 con 0x7f370c15dae0 2023-10-06T04:44:33.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.685+0000 7f37136d5700 1 -- 172.21.15.17:0/1130292260 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f370c0b26a0 con 0x7f370c15dae0 2023-10-06T04:44:33.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.686+0000 7f37097fa700 1 -- 172.21.15.17:0/1130292260 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f370401b3b0 con 0x7f370c15dae0 2023-10-06T04:44:33.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.686+0000 7f37097fa700 1 --2- 172.21.15.17:0/1130292260 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f36f8066f30 0x7f36f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:33.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.686+0000 7f37097fa700 1 -- 172.21.15.17:0/1130292260 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f3704083ca0 con 0x7f370c15dae0 2023-10-06T04:44:33.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.686+0000 7f3711471700 1 --2- 172.21.15.17:0/1130292260 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f36f8066f30 0x7f36f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:33.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.687+0000 7f3711471700 1 --2- 172.21.15.17:0/1130292260 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f36f8066f30 0x7f36f80693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f36fc0099f0 tx=0x7f36fc018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:33.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.691+0000 7f37097fa700 1 -- 172.21.15.17:0/1130292260 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3704050c20 con 0x7f370c15dae0 2023-10-06T04:44:33.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.930+0000 7f37136d5700 1 -- 172.21.15.17:0/1130292260 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f370c063ff0 con 0x7f370c15dae0 2023-10-06T04:44:33.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.930+0000 7f37097fa700 1 -- 172.21.15.17:0/1130292260 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f3704017020 con 0x7f370c15dae0 2023-10-06T04:44:33.932 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:33.932 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6834/3741747962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3741747962},{"type":"v1","addr":"172.21.15.136:6834","nonce":3741747962}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4688,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/264192509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6833","nonce":264192509},{"type":"v1","addr":"172.21.15.136:6835","nonce":264192509}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4909,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6836/1154731767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1154731767},{"type":"v1","addr":"172.21.15.17:6836","nonce":1154731767}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:44:14.988901+0000","modified":"2023-10-06T04:44:29.425634+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4971":{"gid":4971,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6837/460551791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6835","nonce":460551791},{"type":"v1","addr":"172.21.15.17:6837","nonce":460551791}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:44:33.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.932+0000 7f37136d5700 1 -- 172.21.15.17:0/1130292260 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f36f8066f30 msgr2=0x7f36f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:33.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.932+0000 7f37136d5700 1 --2- 172.21.15.17:0/1130292260 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f36f8066f30 0x7f36f80693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f36fc0099f0 tx=0x7f36fc018000 comp rx=0 tx=0).stop 2023-10-06T04:44:33.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.932+0000 7f37136d5700 1 -- 172.21.15.17:0/1130292260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f370c15dae0 msgr2=0x7f370c155410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:33.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.932+0000 7f37136d5700 1 --2- 172.21.15.17:0/1130292260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f370c15dae0 0x7f370c155410 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f370400c530 tx=0x7f3704007f90 comp rx=0 tx=0).stop 2023-10-06T04:44:33.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.932+0000 7f37136d5700 1 -- 172.21.15.17:0/1130292260 shutdown_connections 2023-10-06T04:44:33.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.932+0000 7f37136d5700 1 --2- 172.21.15.17:0/1130292260 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f36f8066f30 0x7f36f80693e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.932+0000 7f37136d5700 1 --2- 172.21.15.17:0/1130292260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f370c15dae0 0x7f370c155410 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.932+0000 7f37136d5700 1 --2- 172.21.15.17:0/1130292260 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f370c15ca80 0x7f370c149fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.932+0000 7f37136d5700 1 --2- 172.21.15.17:0/1130292260 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f370c15ce50 0x7f370c157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:33.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.932+0000 7f37136d5700 1 -- 172.21.15.17:0/1130292260 >> 172.21.15.17:0/1130292260 conn(0x7f370c06cd40 msgr2=0x7f370c0aef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:33.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.932+0000 7f37136d5700 1 -- 172.21.15.17:0/1130292260 shutdown_connections 2023-10-06T04:44:33.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:33.933+0000 7f37136d5700 1 -- 172.21.15.17:0/1130292260 wait complete. 2023-10-06T04:44:33.935 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 17 2023-10-06T04:44:33.946 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:44:34.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.063+0000 7f7ec23d8700 1 Processor -- start 2023-10-06T04:44:34.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.063+0000 7f7ec23d8700 1 -- start start 2023-10-06T04:44:34.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.064+0000 7f7ec23d8700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7ebc0cd4b0 0x7f7ebc1620a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.064+0000 7f7ec23d8700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ebc0b1ae0 con 0x7f7ebc1571f0 2023-10-06T04:44:34.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.064+0000 7f7ec23d8700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ebc0b17b0 con 0x7f7ebc0b04e0 2023-10-06T04:44:34.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.064+0000 7f7ec23d8700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ebc0ad8c0 con 0x7f7ebc0cd4b0 2023-10-06T04:44:34.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.064+0000 7f7ec13d6700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f7ebc1571f0 0x7f7ebc0afdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34908/0 (socket says 172.21.15.17:34908) 2023-10-06T04:44:34.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.064+0000 7f7ec13d6700 1 -- 172.21.15.17:0/2533094164 learned_addr learned my addr 172.21.15.17:0/2533094164 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:34.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.064+0000 7f7ec1bd7700 1 --2- 172.21.15.17:0/2533094164 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7ebc0cd4b0 0x7f7ebc1620a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.064+0000 7f7ebbfff700 1 -- 172.21.15.17:0/2533094164 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1712050696 0 0) 0x7f7ebc0b1ae0 con 0x7f7ebc1571f0 2023-10-06T04:44:34.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.064+0000 7f7ebbfff700 1 -- 172.21.15.17:0/2533094164 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ea4003570 con 0x7f7ebc1571f0 2023-10-06T04:44:34.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.064+0000 7f7ebbfff700 1 -- 172.21.15.17:0/2533094164 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 733444963 0 0) 0x7f7ebc0b17b0 con 0x7f7ebc0b04e0 2023-10-06T04:44:34.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.064+0000 7f7ebbfff700 1 -- 172.21.15.17:0/2533094164 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ebc0b1ae0 con 0x7f7ebc0b04e0 2023-10-06T04:44:34.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.065+0000 7f7ec1bd7700 1 -- 172.21.15.17:0/2533094164 >> v1:172.21.15.136:6789/0 conn(0x7f7ebc0b04e0 legacy=0x7f7ebc0ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.065+0000 7f7ec1bd7700 1 -- 172.21.15.17:0/2533094164 >> v1:172.21.15.17:6789/0 conn(0x7f7ebc1571f0 legacy=0x7f7ebc0afdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.065+0000 7f7ec1bd7700 1 -- 172.21.15.17:0/2533094164 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ebc0cd9f0 con 0x7f7ebc0cd4b0 2023-10-06T04:44:34.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.065+0000 7f7ec1bd7700 1 --2- 172.21.15.17:0/2533094164 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7ebc0cd4b0 0x7f7ebc1620a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4009910 tx=0x7f7eb40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6db7681b114ba197 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.065+0000 7f7ebbfff700 1 -- 172.21.15.17:0/2533094164 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb4011630 con 0x7f7ebc0cd4b0 2023-10-06T04:44:34.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.065+0000 7f7ebbfff700 1 -- 172.21.15.17:0/2533094164 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb4011790 con 0x7f7ebc0cd4b0 2023-10-06T04:44:34.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.065+0000 7f7ebbfff700 1 -- 172.21.15.17:0/2533094164 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb4011b10 con 0x7f7ebc0cd4b0 2023-10-06T04:44:34.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.065+0000 7f7ec23d8700 1 -- 172.21.15.17:0/2533094164 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7ebc0cd4b0 msgr2=0x7f7ebc1620a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.065+0000 7f7ec23d8700 1 --2- 172.21.15.17:0/2533094164 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7ebc0cd4b0 0x7f7ebc1620a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4009910 tx=0x7f7eb40091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.065+0000 7f7ec23d8700 1 -- 172.21.15.17:0/2533094164 shutdown_connections 2023-10-06T04:44:34.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.065+0000 7f7ec23d8700 1 --2- 172.21.15.17:0/2533094164 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7ebc0cd4b0 0x7f7ebc1620a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.065+0000 7f7ec23d8700 1 -- 172.21.15.17:0/2533094164 >> 172.21.15.17:0/2533094164 conn(0x7f7ebc06c560 msgr2=0x7f7ebc06c960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:34.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.065+0000 7f7ec23d8700 1 -- 172.21.15.17:0/2533094164 shutdown_connections 2023-10-06T04:44:34.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.066+0000 7f7ec23d8700 1 -- 172.21.15.17:0/2533094164 wait complete. 2023-10-06T04:44:34.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.067+0000 7f7ec23d8700 1 Processor -- start 2023-10-06T04:44:34.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.067+0000 7f7ec23d8700 1 -- start start 2023-10-06T04:44:34.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.067+0000 7f7ec23d8700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ebc0b04e0 0x7f7ebc14fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.067+0000 7f7ec23d8700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7ebc0cd4b0 0x7f7ebc15aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.067+0000 7f7ec23d8700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ebc1571f0 0x7f7ebc06d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.067+0000 7f7ec23d8700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ebc06f4b0 con 0x7f7ebc0b04e0 2023-10-06T04:44:34.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.067+0000 7f7ec23d8700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ebc0c7ac0 con 0x7f7ebc1571f0 2023-10-06T04:44:34.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.067+0000 7f7ec23d8700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ebc06e250 con 0x7f7ebc0cd4b0 2023-10-06T04:44:34.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.068+0000 7f7ec13d6700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ebc0b04e0 0x7f7ebc14fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.068+0000 7f7ec13d6700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ebc0b04e0 0x7f7ebc14fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51780/0 (socket says 172.21.15.17:51780) 2023-10-06T04:44:34.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.068+0000 7f7ec13d6700 1 -- 172.21.15.17:0/1348447489 learned_addr learned my addr 172.21.15.17:0/1348447489 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:34.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.068+0000 7f7ec0bd5700 1 --2- 172.21.15.17:0/1348447489 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7ebc0cd4b0 0x7f7ebc15aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.068+0000 7f7ec1bd7700 1 --2- 172.21.15.17:0/1348447489 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ebc1571f0 0x7f7ebc06d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.068+0000 7f7ec13d6700 1 -- 172.21.15.17:0/1348447489 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7ebc0cd4b0 msgr2=0x7f7ebc15aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.068+0000 7f7ec13d6700 1 --2- 172.21.15.17:0/1348447489 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7ebc0cd4b0 0x7f7ebc15aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.068+0000 7f7ec13d6700 1 -- 172.21.15.17:0/1348447489 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ebc1571f0 msgr2=0x7f7ebc06d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.068+0000 7f7ec13d6700 1 --2- 172.21.15.17:0/1348447489 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ebc1571f0 0x7f7ebc06d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.068+0000 7f7ec13d6700 1 -- 172.21.15.17:0/1348447489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb4009420 con 0x7f7ebc0b04e0 2023-10-06T04:44:34.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.068+0000 7f7ec0bd5700 1 --2- 172.21.15.17:0/1348447489 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7ebc0cd4b0 0x7f7ebc15aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:34.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.068+0000 7f7ec1bd7700 1 --2- 172.21.15.17:0/1348447489 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ebc1571f0 0x7f7ebc06d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:34.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.068+0000 7f7ec13d6700 1 --2- 172.21.15.17:0/1348447489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ebc0b04e0 0x7f7ebc14fae0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7eac00cce0 tx=0x7f7eac001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.068+0000 7f7eb97fa700 1 -- 172.21.15.17:0/1348447489 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac00ab30 con 0x7f7ebc0b04e0 2023-10-06T04:44:34.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.068+0000 7f7eb97fa700 1 -- 172.21.15.17:0/1348447489 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eac00ac90 con 0x7f7ebc0b04e0 2023-10-06T04:44:34.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.068+0000 7f7eb97fa700 1 -- 172.21.15.17:0/1348447489 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac007320 con 0x7f7ebc0b04e0 2023-10-06T04:44:34.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.068+0000 7f7ec23d8700 1 -- 172.21.15.17:0/1348447489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ebc06e530 con 0x7f7ebc0b04e0 2023-10-06T04:44:34.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.068+0000 7f7ec23d8700 1 -- 172.21.15.17:0/1348447489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ebc15af90 con 0x7f7ebc0b04e0 2023-10-06T04:44:34.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.069+0000 7f7ec23d8700 1 -- 172.21.15.17:0/1348447489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ebc0c75b0 con 0x7f7ebc0b04e0 2023-10-06T04:44:34.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.070+0000 7f7eb97fa700 1 -- 172.21.15.17:0/1348447489 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7eac0076d0 con 0x7f7ebc0b04e0 2023-10-06T04:44:34.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.070+0000 7f7eb97fa700 1 --2- 172.21.15.17:0/1348447489 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7ea8066f30 0x7f7ea80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.070+0000 7f7eb97fa700 1 -- 172.21.15.17:0/1348447489 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f7eac084c90 con 0x7f7ebc0b04e0 2023-10-06T04:44:34.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.070+0000 7f7ec0bd5700 1 --2- 172.21.15.17:0/1348447489 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7ea8066f30 0x7f7ea80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.071+0000 7f7ec0bd5700 1 --2- 172.21.15.17:0/1348447489 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7ea8066f30 0x7f7ea80693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc16d2a0 tx=0x7f7eb0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.074+0000 7f7eb97fa700 1 -- 172.21.15.17:0/1348447489 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7ebc0c75b0 con 0x7f7ebc0b04e0 2023-10-06T04:44:34.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.271+0000 7f7ec23d8700 1 -- 172.21.15.17:0/1348447489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ebc0c75b0 con 0x7f7ebc0b04e0 2023-10-06T04:44:34.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.272+0000 7f7eb97fa700 1 -- 172.21.15.17:0/1348447489 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+18425 (secure 0 0 0) 0x7f7ebc0c75b0 con 0x7f7ebc0b04e0 2023-10-06T04:44:34.274 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:34.274 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":35,"fsid":"780777c4-2b25-4d35-9058-c9f2d62e3ad9","created":"2023-10-06T04:43:10.578520+0000","modified":"2023-10-06T04:44:30.426965+0000","last_up_change":"2023-10-06T04:43:20.682958+0000","last_in_change":"2023-10-06T04:43:12.978917+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:43:21.795733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:43:22.389592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:44:13.266447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T04:44:13.958240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":7,"pool_name":"data_new","create_time":"2023-10-06T04:44:28.154714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"84737b08-575c-46dd-9488-073ae8504494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6809","nonce":90656},{"type":"v1","addr":"172.21.15.17:6811","nonce":90656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":90656},{"type":"v1","addr":"172.21.15.17:6814","nonce":90656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":90656},{"type":"v1","addr":"172.21.15.17:6822","nonce":90656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":90656},{"type":"v1","addr":"172.21.15.17:6818","nonce":90656}]},"public_addr":"172.21.15.17:6811/90656","cluster_addr":"172.21.15.17:6814/90656","heartbeat_back_addr":"172.21.15.17:6822/90656","heartbeat_front_addr":"172.21.15.17:6818/90656","state":["exists","up"]},{"osd":1,"uuid":"dffeb740-58a2-4fd6-8ff1-a0a11a2cc709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":90655},{"type":"v1","addr":"172.21.15.17:6801","nonce":90655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":90655},{"type":"v1","addr":"172.21.15.17:6803","nonce":90655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":90655},{"type":"v1","addr":"172.21.15.17:6807","nonce":90655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":90655},{"type":"v1","addr":"172.21.15.17:6805","nonce":90655}]},"public_addr":"172.21.15.17:6801/90655","cluster_addr":"172.21.15.17:6803/90655","heartbeat_back_addr":"172.21.15.17:6807/90655","heartbeat_front_addr":"172.21.15.17:6805/90655","state":["exists","up"]},{"osd":2,"uuid":"48bd6831-763d-48c2-b515-e02c216d608b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":90657},{"type":"v1","addr":"172.21.15.17:6810","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":90657},{"type":"v1","addr":"172.21.15.17:6815","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":90657},{"type":"v1","addr":"172.21.15.17:6823","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":90657},{"type":"v1","addr":"172.21.15.17:6819","nonce":90657}]},"public_addr":"172.21.15.17:6810/90657","cluster_addr":"172.21.15.17:6815/90657","heartbeat_back_addr":"172.21.15.17:6823/90657","heartbeat_front_addr":"172.21.15.17:6819/90657","state":["exists","up"]},{"osd":3,"uuid":"ae7dbb23-abe7-4bd3-a4df-6f5963d6804c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":90688},{"type":"v1","addr":"172.21.15.17:6825","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":90688},{"type":"v1","addr":"172.21.15.17:6827","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":90688},{"type":"v1","addr":"172.21.15.17:6831","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":90688},{"type":"v1","addr":"172.21.15.17:6829","nonce":90688}]},"public_addr":"172.21.15.17:6825/90688","cluster_addr":"172.21.15.17:6827/90688","heartbeat_back_addr":"172.21.15.17:6831/90688","heartbeat_front_addr":"172.21.15.17:6829/90688","state":["exists","up"]},{"osd":4,"uuid":"29991fb4-1667-4ea3-aca0-d55db27f3bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":90902},{"type":"v1","addr":"172.21.15.136:6801","nonce":90902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":90902},{"type":"v1","addr":"172.21.15.136:6803","nonce":90902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":90902},{"type":"v1","addr":"172.21.15.136:6807","nonce":90902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":90902},{"type":"v1","addr":"172.21.15.136:6805","nonce":90902}]},"public_addr":"172.21.15.136:6801/90902","cluster_addr":"172.21.15.136:6803/90902","heartbeat_back_addr":"172.21.15.136:6807/90902","heartbeat_front_addr":"172.21.15.136:6805/90902","state":["exists","up"]},{"osd":5,"uuid":"398b4ff9-03fc-421f-882c-ba12aa088eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":90901},{"type":"v1","addr":"172.21.15.136:6809","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":90901},{"type":"v1","addr":"172.21.15.136:6811","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":90901},{"type":"v1","addr":"172.21.15.136:6815","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":90901},{"type":"v1","addr":"172.21.15.136:6813","nonce":90901}]},"public_addr":"172.21.15.136:6809/90901","cluster_addr":"172.21.15.136:6811/90901","heartbeat_back_addr":"172.21.15.136:6815/90901","heartbeat_front_addr":"172.21.15.136:6813/90901","state":["exists","up"]},{"osd":6,"uuid":"1bb91a72-4dab-4cdb-aa1d-2b8a9edf1ad0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":90927},{"type":"v1","addr":"172.21.15.136:6825","nonce":90927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":90927},{"type":"v1","addr":"172.21.15.136:6827","nonce":90927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":90927},{"type":"v1","addr":"172.21.15.136:6831","nonce":90927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":90927},{"type":"v1","addr":"172.21.15.136:6829","nonce":90927}]},"public_addr":"172.21.15.136:6825/90927","cluster_addr":"172.21.15.136:6827/90927","heartbeat_back_addr":"172.21.15.136:6831/90927","heartbeat_front_addr":"172.21.15.136:6829/90927","state":["exists","up"]},{"osd":7,"uuid":"719b654e-010d-4aa4-8c13-83fdde242b47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":90934},{"type":"v1","addr":"172.21.15.136:6817","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":90934},{"type":"v1","addr":"172.21.15.136:6819","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":90934},{"type":"v1","addr":"172.21.15.136:6824","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":90934},{"type":"v1","addr":"172.21.15.136:6821","nonce":90934}]},"public_addr":"172.21.15.136:6817/90934","cluster_addr":"172.21.15.136:6819/90934","heartbeat_back_addr":"172.21.15.136:6824/90934","heartbeat_front_addr":"172.21.15.136:6821/90934","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.157479+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.140520+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.190743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.231396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.156510+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.145822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.202888+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.139532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:44:34.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.274+0000 7f7ec23d8700 1 -- 172.21.15.17:0/1348447489 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7ea8066f30 msgr2=0x7f7ea80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.274+0000 7f7ec23d8700 1 --2- 172.21.15.17:0/1348447489 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7ea8066f30 0x7f7ea80693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc16d2a0 tx=0x7f7eb0009040 comp rx=0 tx=0).stop 2023-10-06T04:44:34.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.274+0000 7f7ec23d8700 1 -- 172.21.15.17:0/1348447489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ebc0b04e0 msgr2=0x7f7ebc14fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.274+0000 7f7ec23d8700 1 --2- 172.21.15.17:0/1348447489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ebc0b04e0 0x7f7ebc14fae0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7eac00cce0 tx=0x7f7eac001b10 comp rx=0 tx=0).stop 2023-10-06T04:44:34.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.274+0000 7f7ec23d8700 1 -- 172.21.15.17:0/1348447489 shutdown_connections 2023-10-06T04:44:34.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.274+0000 7f7ec23d8700 1 --2- 172.21.15.17:0/1348447489 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7ea8066f30 0x7f7ea80693e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.274+0000 7f7ec23d8700 1 --2- 172.21.15.17:0/1348447489 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ebc1571f0 0x7f7ebc06d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.275+0000 7f7ec23d8700 1 --2- 172.21.15.17:0/1348447489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ebc0b04e0 0x7f7ebc14fae0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.275+0000 7f7ec23d8700 1 --2- 172.21.15.17:0/1348447489 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7ebc0cd4b0 0x7f7ebc15aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.275+0000 7f7ec23d8700 1 -- 172.21.15.17:0/1348447489 >> 172.21.15.17:0/1348447489 conn(0x7f7ebc06c560 msgr2=0x7f7ebc0afdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:34.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.275+0000 7f7ec23d8700 1 -- 172.21.15.17:0/1348447489 shutdown_connections 2023-10-06T04:44:34.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.275+0000 7f7ec23d8700 1 -- 172.21.15.17:0/1348447489 wait complete. 2023-10-06T04:44:34.288 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:43:21.795733+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:43:22.389592+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:44:13.266447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:44:13.958240+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 7, 'pool_name': 'data_new', 'create_time': '2023-10-06T04:44:28.154714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:44:34.289 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:44:34.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.409+0000 7fda34abb700 1 Processor -- start 2023-10-06T04:44:34.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.409+0000 7fda34abb700 1 -- start start 2023-10-06T04:44:34.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.410+0000 7fda34abb700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fda300cabf0 0x7fda300c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.410+0000 7fda34abb700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fda3006d140 0x7fda3006f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.410+0000 7fda34abb700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda300d1120 con 0x7fda30159b10 2023-10-06T04:44:34.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.410+0000 7fda34abb700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda300d1400 con 0x7fda300cabf0 2023-10-06T04:44:34.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.410+0000 7fda34abb700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda3006e920 con 0x7fda3006d140 2023-10-06T04:44:34.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.410+0000 7fda2e59c700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fda300cabf0 0x7fda300c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.410+0000 7fda2e59c700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fda300cabf0 0x7fda300c7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51782/0 (socket says 172.21.15.17:51782) 2023-10-06T04:44:34.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.410+0000 7fda2e59c700 1 -- 172.21.15.17:0/1649707385 learned_addr learned my addr 172.21.15.17:0/1649707385 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:34.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.411+0000 7fda2ed9d700 1 --2- 172.21.15.17:0/1649707385 >> v2:172.21.15.136:3300/0 conn(0x7fda3006d140 0x7fda3006f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.411+0000 7fda2e59c700 1 -- 172.21.15.17:0/1649707385 >> v2:172.21.15.136:3300/0 conn(0x7fda3006d140 msgr2=0x7fda3006f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:34.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.411+0000 7fda2e59c700 1 --2- 172.21.15.17:0/1649707385 >> v2:172.21.15.136:3300/0 conn(0x7fda3006d140 0x7fda3006f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.411+0000 7fda2e59c700 1 -- 172.21.15.17:0/1649707385 >> v1:172.21.15.136:6789/0 conn(0x7fda30159b10 legacy=0x7fda3006f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.411+0000 7fda2e59c700 1 -- 172.21.15.17:0/1649707385 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda3006ec00 con 0x7fda300cabf0 2023-10-06T04:44:34.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.411+0000 7fda2e59c700 1 --2- 172.21.15.17:0/1649707385 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda300cabf0 0x7fda300c7660 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fda300ccd30 tx=0x7fda28009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afe1322b93c784ac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.411+0000 7fda2d59a700 1 -- 172.21.15.17:0/1649707385 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda28005c10 con 0x7fda300cabf0 2023-10-06T04:44:34.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.411+0000 7fda2d59a700 1 -- 172.21.15.17:0/1649707385 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda28005d70 con 0x7fda300cabf0 2023-10-06T04:44:34.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.411+0000 7fda2d59a700 1 -- 172.21.15.17:0/1649707385 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2800b880 con 0x7fda300cabf0 2023-10-06T04:44:34.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.411+0000 7fda34abb700 1 -- 172.21.15.17:0/1649707385 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda300cabf0 msgr2=0x7fda300c7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.411+0000 7fda34abb700 1 --2- 172.21.15.17:0/1649707385 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda300cabf0 0x7fda300c7660 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fda300ccd30 tx=0x7fda28009220 comp rx=0 tx=0).stop 2023-10-06T04:44:34.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.412+0000 7fda34abb700 1 -- 172.21.15.17:0/1649707385 shutdown_connections 2023-10-06T04:44:34.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.412+0000 7fda34abb700 1 --2- 172.21.15.17:0/1649707385 >> v2:172.21.15.136:3300/0 conn(0x7fda3006d140 0x7fda3006f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.412+0000 7fda34abb700 1 --2- 172.21.15.17:0/1649707385 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda300cabf0 0x7fda300c7660 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.412+0000 7fda34abb700 1 -- 172.21.15.17:0/1649707385 >> 172.21.15.17:0/1649707385 conn(0x7fda3006cd40 msgr2=0x7fda300d0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:34.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.412+0000 7fda34abb700 1 -- 172.21.15.17:0/1649707385 shutdown_connections 2023-10-06T04:44:34.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.412+0000 7fda34abb700 1 -- 172.21.15.17:0/1649707385 wait complete. 2023-10-06T04:44:34.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.413+0000 7fda34abb700 1 Processor -- start 2023-10-06T04:44:34.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.413+0000 7fda34abb700 1 -- start start 2023-10-06T04:44:34.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.413+0000 7fda34abb700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fda3006d140 0x7fda3016a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.413+0000 7fda34abb700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fda300cabf0 0x7fda300cd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.413+0000 7fda34abb700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda30159b10 0x7fda300cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.413+0000 7fda34abb700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda30157360 con 0x7fda30159b10 2023-10-06T04:44:34.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.413+0000 7fda34abb700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda3016a1f0 con 0x7fda3006d140 2023-10-06T04:44:34.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.413+0000 7fda34abb700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda3015e480 con 0x7fda300cabf0 2023-10-06T04:44:34.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.414+0000 7fda2ed9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda30159b10 0x7fda300cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.414+0000 7fda2ed9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda30159b10 0x7fda300cd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51794/0 (socket says 172.21.15.17:51794) 2023-10-06T04:44:34.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.414+0000 7fda2ed9d700 1 -- 172.21.15.17:0/1892391522 learned_addr learned my addr 172.21.15.17:0/1892391522 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:34.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.414+0000 7fda2e59c700 1 --2- 172.21.15.17:0/1892391522 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fda3006d140 0x7fda3016a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.414+0000 7fda2dd9b700 1 --2- 172.21.15.17:0/1892391522 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fda300cabf0 0x7fda300cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.414+0000 7fda2ed9d700 1 -- 172.21.15.17:0/1892391522 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fda300cabf0 msgr2=0x7fda300cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.414+0000 7fda2ed9d700 1 --2- 172.21.15.17:0/1892391522 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fda300cabf0 0x7fda300cd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.414+0000 7fda2ed9d700 1 -- 172.21.15.17:0/1892391522 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fda3006d140 msgr2=0x7fda3016a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.414+0000 7fda2ed9d700 1 --2- 172.21.15.17:0/1892391522 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fda3006d140 0x7fda3016a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.414+0000 7fda2ed9d700 1 -- 172.21.15.17:0/1892391522 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda28009480 con 0x7fda30159b10 2023-10-06T04:44:34.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.414+0000 7fda2ed9d700 1 --2- 172.21.15.17:0/1892391522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda30159b10 0x7fda300cd5c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fda20007f20 tx=0x7fda200098a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.414+0000 7fda267fc700 1 -- 172.21.15.17:0/1892391522 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2000eb90 con 0x7fda30159b10 2023-10-06T04:44:34.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.414+0000 7fda267fc700 1 -- 172.21.15.17:0/1892391522 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda2000ed10 con 0x7fda30159b10 2023-10-06T04:44:34.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.414+0000 7fda34abb700 1 -- 172.21.15.17:0/1892391522 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda3015e760 con 0x7fda30159b10 2023-10-06T04:44:34.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.414+0000 7fda267fc700 1 -- 172.21.15.17:0/1892391522 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda20014670 con 0x7fda30159b10 2023-10-06T04:44:34.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.414+0000 7fda34abb700 1 -- 172.21.15.17:0/1892391522 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda3015ed20 con 0x7fda30159b10 2023-10-06T04:44:34.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.415+0000 7fda34abb700 1 -- 172.21.15.17:0/1892391522 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda3015ef10 con 0x7fda30159b10 2023-10-06T04:44:34.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.416+0000 7fda267fc700 1 -- 172.21.15.17:0/1892391522 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fda20014a20 con 0x7fda30159b10 2023-10-06T04:44:34.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.416+0000 7fda267fc700 1 --2- 172.21.15.17:0/1892391522 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fda10066f30 0x7fda100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.416+0000 7fda267fc700 1 -- 172.21.15.17:0/1892391522 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6453+0+0 (secure 0 0 0) 0x7fda20084e20 con 0x7fda30159b10 2023-10-06T04:44:34.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.416+0000 7fda2e59c700 1 --2- 172.21.15.17:0/1892391522 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fda10066f30 0x7fda100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.417+0000 7fda2e59c700 1 --2- 172.21.15.17:0/1892391522 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fda10066f30 0x7fda100693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fda28009260 tx=0x7fda28016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.420+0000 7fda267fc700 1 -- 172.21.15.17:0/1892391522 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fda20051da0 con 0x7fda30159b10 2023-10-06T04:44:34.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.613+0000 7fda34abb700 1 -- 172.21.15.17:0/1892391522 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fda3004c380 con 0x7fda30159b10 2023-10-06T04:44:34.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.613+0000 7fda267fc700 1 -- 172.21.15.17:0/1892391522 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v35) v1 ==== 92+0+10 (secure 0 0 0) 0x7fda200553c0 con 0x7fda30159b10 2023-10-06T04:44:34.615 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-10-06T04:44:34.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.615+0000 7fda34abb700 1 -- 172.21.15.17:0/1892391522 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fda10066f30 msgr2=0x7fda100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.615+0000 7fda34abb700 1 --2- 172.21.15.17:0/1892391522 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fda10066f30 0x7fda100693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fda28009260 tx=0x7fda28016000 comp rx=0 tx=0).stop 2023-10-06T04:44:34.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.615+0000 7fda34abb700 1 -- 172.21.15.17:0/1892391522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda30159b10 msgr2=0x7fda300cd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.615+0000 7fda34abb700 1 --2- 172.21.15.17:0/1892391522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda30159b10 0x7fda300cd5c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fda20007f20 tx=0x7fda200098a0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.615+0000 7fda34abb700 1 -- 172.21.15.17:0/1892391522 shutdown_connections 2023-10-06T04:44:34.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.615+0000 7fda34abb700 1 --2- 172.21.15.17:0/1892391522 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fda10066f30 0x7fda100693e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.615+0000 7fda34abb700 1 --2- 172.21.15.17:0/1892391522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda30159b10 0x7fda300cd5c0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.615+0000 7fda34abb700 1 --2- 172.21.15.17:0/1892391522 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fda3006d140 0x7fda3016a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.615+0000 7fda34abb700 1 --2- 172.21.15.17:0/1892391522 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fda300cabf0 0x7fda300cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.615+0000 7fda34abb700 1 -- 172.21.15.17:0/1892391522 >> 172.21.15.17:0/1892391522 conn(0x7fda3006cd40 msgr2=0x7fda30158d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:34.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.615+0000 7fda34abb700 1 -- 172.21.15.17:0/1892391522 shutdown_connections 2023-10-06T04:44:34.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.615+0000 7fda34abb700 1 -- 172.21.15.17:0/1892391522 wait complete. 2023-10-06T04:44:34.629 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:44:34.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.748+0000 7fabff6fa700 1 Processor -- start 2023-10-06T04:44:34.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.748+0000 7fabff6fa700 1 -- start start 2023-10-06T04:44:34.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.749+0000 7fabff6fa700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fabf8159800 0x7fabf80af520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.749+0000 7fabff6fa700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabf80aec30 con 0x7fabf80af0c0 2023-10-06T04:44:34.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.749+0000 7fabff6fa700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabf80ae300 con 0x7fabf806bb60 2023-10-06T04:44:34.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.749+0000 7fabff6fa700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf80ae5e0 con 0x7fabf8159800 2023-10-06T04:44:34.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.749+0000 7fabfcc95700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fabf80af0c0 0x7fabf806b450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34912/0 (socket says 172.21.15.17:34912) 2023-10-06T04:44:34.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.749+0000 7fabfcc95700 1 -- 172.21.15.17:0/2092193325 learned_addr learned my addr 172.21.15.17:0/2092193325 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:34.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.750+0000 7fabfd496700 1 --2- 172.21.15.17:0/2092193325 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fabf8159800 0x7fabf80af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.750+0000 7fabf7fff700 1 -- 172.21.15.17:0/2092193325 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 73501749 0 0) 0x7fabf80aec30 con 0x7fabf80af0c0 2023-10-06T04:44:34.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.750+0000 7fabf7fff700 1 -- 172.21.15.17:0/2092193325 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabe0003570 con 0x7fabf80af0c0 2023-10-06T04:44:34.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.750+0000 7fabf7fff700 1 -- 172.21.15.17:0/2092193325 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2725320511 0 0) 0x7fabf80ae300 con 0x7fabf806bb60 2023-10-06T04:44:34.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.750+0000 7fabf7fff700 1 -- 172.21.15.17:0/2092193325 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabf80aec30 con 0x7fabf806bb60 2023-10-06T04:44:34.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.750+0000 7fabfd496700 1 -- 172.21.15.17:0/2092193325 >> v1:172.21.15.136:6789/0 conn(0x7fabf806bb60 legacy=0x7fabf8159bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.750+0000 7fabfd496700 1 -- 172.21.15.17:0/2092193325 >> v1:172.21.15.17:6789/0 conn(0x7fabf80af0c0 legacy=0x7fabf806b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.750+0000 7fabfd496700 1 -- 172.21.15.17:0/2092193325 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf80ae8c0 con 0x7fabf8159800 2023-10-06T04:44:34.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.750+0000 7fabfd496700 1 --2- 172.21.15.17:0/2092193325 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fabf8159800 0x7fabf80af520 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fabf0009910 tx=0x7fabf00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b28b957289d58eee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.750+0000 7fabf7fff700 1 -- 172.21.15.17:0/2092193325 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf0011630 con 0x7fabf8159800 2023-10-06T04:44:34.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.750+0000 7fabf7fff700 1 -- 172.21.15.17:0/2092193325 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf0011790 con 0x7fabf8159800 2023-10-06T04:44:34.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.750+0000 7fabf7fff700 1 -- 172.21.15.17:0/2092193325 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf0011b30 con 0x7fabf8159800 2023-10-06T04:44:34.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.751+0000 7fabff6fa700 1 -- 172.21.15.17:0/2092193325 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fabf8159800 msgr2=0x7fabf80af520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.751+0000 7fabff6fa700 1 --2- 172.21.15.17:0/2092193325 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fabf8159800 0x7fabf80af520 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fabf0009910 tx=0x7fabf00091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.751+0000 7fabff6fa700 1 -- 172.21.15.17:0/2092193325 shutdown_connections 2023-10-06T04:44:34.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.751+0000 7fabff6fa700 1 --2- 172.21.15.17:0/2092193325 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fabf8159800 0x7fabf80af520 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.751+0000 7fabff6fa700 1 -- 172.21.15.17:0/2092193325 >> 172.21.15.17:0/2092193325 conn(0x7fabf80cde20 msgr2=0x7fabf806ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:34.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.751+0000 7fabff6fa700 1 -- 172.21.15.17:0/2092193325 shutdown_connections 2023-10-06T04:44:34.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.751+0000 7fabff6fa700 1 -- 172.21.15.17:0/2092193325 wait complete. 2023-10-06T04:44:34.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.752+0000 7fabff6fa700 1 Processor -- start 2023-10-06T04:44:34.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.752+0000 7fabff6fa700 1 -- start start 2023-10-06T04:44:34.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.753+0000 7fabff6fa700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fabf806bb60 0x7fabf8141070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.753+0000 7fabff6fa700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fabf80af0c0 0x7fabf814ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.753+0000 7fabff6fa700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabf8159800 0x7fabf814efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.753+0000 7fabff6fa700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf81415b0 con 0x7fabf8159800 2023-10-06T04:44:34.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.753+0000 7fabff6fa700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf8150b00 con 0x7fabf80af0c0 2023-10-06T04:44:34.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.753+0000 7fabff6fa700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf80aa680 con 0x7fabf806bb60 2023-10-06T04:44:34.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.753+0000 7fabfdc97700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabf8159800 0x7fabf814efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.753+0000 7fabfdc97700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabf8159800 0x7fabf814efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51796/0 (socket says 172.21.15.17:51796) 2023-10-06T04:44:34.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.753+0000 7fabfdc97700 1 -- 172.21.15.17:0/2451751182 learned_addr learned my addr 172.21.15.17:0/2451751182 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:34.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.753+0000 7fabfdc97700 1 -- 172.21.15.17:0/2451751182 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fabf806bb60 msgr2=0x7fabf8141070 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T04:44:34.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.753+0000 7fabfdc97700 1 --2- 172.21.15.17:0/2451751182 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fabf806bb60 0x7fabf8141070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.753+0000 7fabfdc97700 1 -- 172.21.15.17:0/2451751182 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fabf80af0c0 msgr2=0x7fabf814ea70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T04:44:34.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.753+0000 7fabfdc97700 1 --2- 172.21.15.17:0/2451751182 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fabf80af0c0 0x7fabf814ea70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.753+0000 7fabfdc97700 1 -- 172.21.15.17:0/2451751182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf0009420 con 0x7fabf8159800 2023-10-06T04:44:34.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.754+0000 7fabfdc97700 1 --2- 172.21.15.17:0/2451751182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabf8159800 0x7fabf814efb0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fabe800c940 tx=0x7fabe8007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.754+0000 7fabf57fa700 1 -- 172.21.15.17:0/2451751182 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe800a760 con 0x7fabf8159800 2023-10-06T04:44:34.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.754+0000 7fabf57fa700 1 -- 172.21.15.17:0/2451751182 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe800a8e0 con 0x7fabf8159800 2023-10-06T04:44:34.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.754+0000 7fabf57fa700 1 -- 172.21.15.17:0/2451751182 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe800aca0 con 0x7fabf8159800 2023-10-06T04:44:34.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.754+0000 7fabff6fa700 1 -- 172.21.15.17:0/2451751182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf80aa960 con 0x7fabf8159800 2023-10-06T04:44:34.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.754+0000 7fabff6fa700 1 -- 172.21.15.17:0/2451751182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf80aaf20 con 0x7fabf8159800 2023-10-06T04:44:34.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.755+0000 7fabff6fa700 1 -- 172.21.15.17:0/2451751182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabf804c380 con 0x7fabf8159800 2023-10-06T04:44:34.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.755+0000 7fabf57fa700 1 -- 172.21.15.17:0/2451751182 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fabe8012630 con 0x7fabf8159800 2023-10-06T04:44:34.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.756+0000 7fabf57fa700 1 --2- 172.21.15.17:0/2451751182 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fabe4066f30 0x7fabe40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:34.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.756+0000 7fabfd496700 1 --2- 172.21.15.17:0/2451751182 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fabe4066f30 0x7fabe40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:34.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.756+0000 7fabf57fa700 1 -- 172.21.15.17:0/2451751182 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6453+0+0 (secure 0 0 0) 0x7fabe8084c00 con 0x7fabf8159800 2023-10-06T04:44:34.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.756+0000 7fabfd496700 1 --2- 172.21.15.17:0/2451751182 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fabe4066f30 0x7fabe40693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fabf00093a0 tx=0x7fabf0017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:34.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.760+0000 7fabf57fa700 1 -- 172.21.15.17:0/2451751182 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fabe808b080 con 0x7fabf8159800 2023-10-06T04:44:34.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.952+0000 7fabff6fa700 1 -- 172.21.15.17:0/2451751182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fabf80afa60 con 0x7fabf8159800 2023-10-06T04:44:34.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.952+0000 7fabf57fa700 1 -- 172.21.15.17:0/2451751182 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7fabe8051b80 con 0x7fabf8159800 2023-10-06T04:44:34.954 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-10-06T04:44:34.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.954+0000 7fabff6fa700 1 -- 172.21.15.17:0/2451751182 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fabe4066f30 msgr2=0x7fabe40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.954+0000 7fabff6fa700 1 --2- 172.21.15.17:0/2451751182 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fabe4066f30 0x7fabe40693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fabf00093a0 tx=0x7fabf0017000 comp rx=0 tx=0).stop 2023-10-06T04:44:34.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.954+0000 7fabff6fa700 1 -- 172.21.15.17:0/2451751182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabf8159800 msgr2=0x7fabf814efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:34.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.954+0000 7fabff6fa700 1 --2- 172.21.15.17:0/2451751182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabf8159800 0x7fabf814efb0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fabe800c940 tx=0x7fabe8007f90 comp rx=0 tx=0).stop 2023-10-06T04:44:34.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.954+0000 7fabff6fa700 1 -- 172.21.15.17:0/2451751182 shutdown_connections 2023-10-06T04:44:34.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.954+0000 7fabff6fa700 1 --2- 172.21.15.17:0/2451751182 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fabe4066f30 0x7fabe40693e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.954+0000 7fabff6fa700 1 --2- 172.21.15.17:0/2451751182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabf8159800 0x7fabf814efb0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.954+0000 7fabff6fa700 1 --2- 172.21.15.17:0/2451751182 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fabf806bb60 0x7fabf8141070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.954+0000 7fabff6fa700 1 --2- 172.21.15.17:0/2451751182 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fabf80af0c0 0x7fabf814ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:34.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.954+0000 7fabff6fa700 1 -- 172.21.15.17:0/2451751182 >> 172.21.15.17:0/2451751182 conn(0x7fabf80cde20 msgr2=0x7fabf8157d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:34.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.954+0000 7fabff6fa700 1 -- 172.21.15.17:0/2451751182 shutdown_connections 2023-10-06T04:44:34.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:34.954+0000 7fabff6fa700 1 -- 172.21.15.17:0/2451751182 wait complete. 2023-10-06T04:44:34.968 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:44:35.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.087+0000 7f3d3257c700 1 Processor -- start 2023-10-06T04:44:35.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.087+0000 7f3d3257c700 1 -- start start 2023-10-06T04:44:35.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.088+0000 7f3d3257c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3d2c15acd0 0x7f3d2c0abe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.088+0000 7f3d3257c700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3d2c06efa0 0x7f3d2c0ac3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.088+0000 7f3d3257c700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d2c0b0cd0 con 0x7f3d2c159850 2023-10-06T04:44:35.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.088+0000 7f3d3257c700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d2c15a840 con 0x7f3d2c06efa0 2023-10-06T04:44:35.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.088+0000 7f3d3257c700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c159f10 con 0x7f3d2c15acd0 2023-10-06T04:44:35.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.088+0000 7f3d3157a700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f3d2c159850 0x7f3d2c06e890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34918/0 (socket says 172.21.15.17:34918) 2023-10-06T04:44:35.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.088+0000 7f3d3157a700 1 -- 172.21.15.17:0/3315447635 learned_addr learned my addr 172.21.15.17:0/3315447635 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:35.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.088+0000 7f3d31d7b700 1 --2- 172.21.15.17:0/3315447635 >> v2:172.21.15.17:3300/0 conn(0x7f3d2c06efa0 0x7f3d2c0ac3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.088+0000 7f3d30d79700 1 --2- 172.21.15.17:0/3315447635 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3d2c15acd0 0x7f3d2c0abe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.089+0000 7f3d2bfff700 1 -- 172.21.15.17:0/3315447635 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 9942716 0 0) 0x7f3d2c0b0cd0 con 0x7f3d2c159850 2023-10-06T04:44:35.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.089+0000 7f3d2bfff700 1 -- 172.21.15.17:0/3315447635 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d14003570 con 0x7f3d2c159850 2023-10-06T04:44:35.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.089+0000 7f3d31d7b700 1 -- 172.21.15.17:0/3315447635 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3d2c15acd0 msgr2=0x7f3d2c0abe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:35.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.089+0000 7f3d31d7b700 1 --2- 172.21.15.17:0/3315447635 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3d2c15acd0 0x7f3d2c0abe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.089+0000 7f3d31d7b700 1 -- 172.21.15.17:0/3315447635 >> v1:172.21.15.17:6789/0 conn(0x7f3d2c159850 legacy=0x7f3d2c06e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.089+0000 7f3d31d7b700 1 -- 172.21.15.17:0/3315447635 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d2c15a1f0 con 0x7f3d2c06efa0 2023-10-06T04:44:35.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.089+0000 7f3d30d79700 1 --2- 172.21.15.17:0/3315447635 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3d2c15acd0 0x7f3d2c0abe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:35.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.089+0000 7f3d31d7b700 1 --2- 172.21.15.17:0/3315447635 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d2c06efa0 0x7f3d2c0ac3d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c009e60 tx=0x7f3d1c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=171177ce9b5ba681 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:35.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.089+0000 7f3d2bfff700 1 -- 172.21.15.17:0/3315447635 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c00e070 con 0x7f3d2c06efa0 2023-10-06T04:44:35.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.089+0000 7f3d2bfff700 1 -- 172.21.15.17:0/3315447635 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1c00bb60 con 0x7f3d2c06efa0 2023-10-06T04:44:35.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.089+0000 7f3d2bfff700 1 -- 172.21.15.17:0/3315447635 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c012430 con 0x7f3d2c06efa0 2023-10-06T04:44:35.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.089+0000 7f3d3257c700 1 -- 172.21.15.17:0/3315447635 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d2c06efa0 msgr2=0x7f3d2c0ac3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.089+0000 7f3d3257c700 1 --2- 172.21.15.17:0/3315447635 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d2c06efa0 0x7f3d2c0ac3d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c009e60 tx=0x7f3d1c009780 comp rx=0 tx=0).stop 2023-10-06T04:44:35.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.089+0000 7f3d3257c700 1 -- 172.21.15.17:0/3315447635 shutdown_connections 2023-10-06T04:44:35.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.089+0000 7f3d3257c700 1 --2- 172.21.15.17:0/3315447635 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d2c06efa0 0x7f3d2c0ac3d0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.089+0000 7f3d3257c700 1 --2- 172.21.15.17:0/3315447635 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3d2c15acd0 0x7f3d2c0abe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.089+0000 7f3d3257c700 1 -- 172.21.15.17:0/3315447635 >> 172.21.15.17:0/3315447635 conn(0x7f3d2c06cd40 msgr2=0x7f3d2c0ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:35.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.090+0000 7f3d3257c700 1 -- 172.21.15.17:0/3315447635 shutdown_connections 2023-10-06T04:44:35.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.090+0000 7f3d3257c700 1 -- 172.21.15.17:0/3315447635 wait complete. 2023-10-06T04:44:35.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.091+0000 7f3d3257c700 1 Processor -- start 2023-10-06T04:44:35.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.091+0000 7f3d3257c700 1 -- start start 2023-10-06T04:44:35.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.092+0000 7f3d3257c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d2c06efa0 0x7f3d2c0cd670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.092+0000 7f3d3257c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d2c159850 0x7f3d2c14be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.092+0000 7f3d3257c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3d2c15acd0 0x7f3d2c0b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.092+0000 7f3d3257c700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c0b1d60 con 0x7f3d2c159850 2023-10-06T04:44:35.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.092+0000 7f3d3257c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c0b1150 con 0x7f3d2c06efa0 2023-10-06T04:44:35.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.092+0000 7f3d3257c700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c0b1430 con 0x7f3d2c15acd0 2023-10-06T04:44:35.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.092+0000 7f3d30d79700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d2c159850 0x7f3d2c14be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.092+0000 7f3d30d79700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d2c159850 0x7f3d2c14be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51816/0 (socket says 172.21.15.17:51816) 2023-10-06T04:44:35.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.092+0000 7f3d30d79700 1 -- 172.21.15.17:0/1190327218 learned_addr learned my addr 172.21.15.17:0/1190327218 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:35.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.092+0000 7f3d3157a700 1 --2- 172.21.15.17:0/1190327218 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d2c06efa0 0x7f3d2c0cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.092+0000 7f3d31d7b700 1 --2- 172.21.15.17:0/1190327218 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3d2c15acd0 0x7f3d2c0b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.092+0000 7f3d30d79700 1 -- 172.21.15.17:0/1190327218 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3d2c15acd0 msgr2=0x7f3d2c0b21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.092+0000 7f3d30d79700 1 --2- 172.21.15.17:0/1190327218 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3d2c15acd0 0x7f3d2c0b21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.092+0000 7f3d30d79700 1 -- 172.21.15.17:0/1190327218 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d2c06efa0 msgr2=0x7f3d2c0cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.092+0000 7f3d30d79700 1 --2- 172.21.15.17:0/1190327218 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d2c06efa0 0x7f3d2c0cd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.092+0000 7f3d30d79700 1 -- 172.21.15.17:0/1190327218 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d1c009a20 con 0x7f3d2c159850 2023-10-06T04:44:35.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.092+0000 7f3d30d79700 1 --2- 172.21.15.17:0/1190327218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d2c159850 0x7f3d2c14be00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3d2000d860 tx=0x7f3d20008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:35.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.092+0000 7f3d297fa700 1 -- 172.21.15.17:0/1190327218 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d200125f0 con 0x7f3d2c159850 2023-10-06T04:44:35.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.092+0000 7f3d297fa700 1 -- 172.21.15.17:0/1190327218 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d20012750 con 0x7f3d2c159850 2023-10-06T04:44:35.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.092+0000 7f3d3257c700 1 -- 172.21.15.17:0/1190327218 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d2c0b1710 con 0x7f3d2c159850 2023-10-06T04:44:35.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.092+0000 7f3d297fa700 1 -- 172.21.15.17:0/1190327218 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d20012ad0 con 0x7f3d2c159850 2023-10-06T04:44:35.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.092+0000 7f3d3257c700 1 -- 172.21.15.17:0/1190327218 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d2c0cdbb0 con 0x7f3d2c159850 2023-10-06T04:44:35.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.093+0000 7f3d3257c700 1 -- 172.21.15.17:0/1190327218 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d2c0b1ed0 con 0x7f3d2c159850 2023-10-06T04:44:35.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.094+0000 7f3d297fa700 1 -- 172.21.15.17:0/1190327218 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3d20014430 con 0x7f3d2c159850 2023-10-06T04:44:35.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.094+0000 7f3d297fa700 1 --2- 172.21.15.17:0/1190327218 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3d18066f30 0x7f3d180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.094+0000 7f3d297fa700 1 -- 172.21.15.17:0/1190327218 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f3d20084ca0 con 0x7f3d2c159850 2023-10-06T04:44:35.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.094+0000 7f3d3157a700 1 --2- 172.21.15.17:0/1190327218 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3d18066f30 0x7f3d180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.094+0000 7f3d3157a700 1 --2- 172.21.15.17:0/1190327218 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3d18066f30 0x7f3d180693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c15cb30 tx=0x7f3d24009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:35.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.098+0000 7f3d297fa700 1 -- 172.21.15.17:0/1190327218 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d200556b0 con 0x7f3d2c159850 2023-10-06T04:44:35.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.288+0000 7f3d3257c700 1 -- 172.21.15.17:0/1190327218 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3d2c04c380 con 0x7f3d2c159850 2023-10-06T04:44:35.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.288+0000 7f3d297fa700 1 -- 172.21.15.17:0/1190327218 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3d20055240 con 0x7f3d2c159850 2023-10-06T04:44:35.290 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-10-06T04:44:35.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.290+0000 7f3d3257c700 1 -- 172.21.15.17:0/1190327218 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3d18066f30 msgr2=0x7f3d180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.290+0000 7f3d3257c700 1 --2- 172.21.15.17:0/1190327218 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3d18066f30 0x7f3d180693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c15cb30 tx=0x7f3d24009040 comp rx=0 tx=0).stop 2023-10-06T04:44:35.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.290+0000 7f3d3257c700 1 -- 172.21.15.17:0/1190327218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d2c159850 msgr2=0x7f3d2c14be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.290+0000 7f3d3257c700 1 --2- 172.21.15.17:0/1190327218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d2c159850 0x7f3d2c14be00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3d2000d860 tx=0x7f3d20008040 comp rx=0 tx=0).stop 2023-10-06T04:44:35.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.290+0000 7f3d3257c700 1 -- 172.21.15.17:0/1190327218 shutdown_connections 2023-10-06T04:44:35.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.290+0000 7f3d3257c700 1 --2- 172.21.15.17:0/1190327218 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3d18066f30 0x7f3d180693e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.290+0000 7f3d3257c700 1 --2- 172.21.15.17:0/1190327218 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3d2c15acd0 0x7f3d2c0b21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.290+0000 7f3d3257c700 1 --2- 172.21.15.17:0/1190327218 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d2c06efa0 0x7f3d2c0cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.290+0000 7f3d3257c700 1 --2- 172.21.15.17:0/1190327218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d2c159850 0x7f3d2c14be00 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.290+0000 7f3d3257c700 1 -- 172.21.15.17:0/1190327218 >> 172.21.15.17:0/1190327218 conn(0x7f3d2c06cd40 msgr2=0x7f3d2c15d710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:35.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.290+0000 7f3d3257c700 1 -- 172.21.15.17:0/1190327218 shutdown_connections 2023-10-06T04:44:35.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.291+0000 7f3d3257c700 1 -- 172.21.15.17:0/1190327218 wait complete. 2023-10-06T04:44:35.304 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:44:35.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.423+0000 7fe059f9e700 1 Processor -- start 2023-10-06T04:44:35.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.423+0000 7fe059f9e700 1 -- start start 2023-10-06T04:44:35.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.424+0000 7fe059f9e700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe0540af540 0x7fe0540af910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.424+0000 7fe059f9e700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0540ce890 con 0x7fe0540cd5e0 2023-10-06T04:44:35.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.424+0000 7fe059f9e700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe05415aac0 con 0x7fe05415a650 2023-10-06T04:44:35.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.424+0000 7fe059f9e700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05415d890 con 0x7fe0540af540 2023-10-06T04:44:35.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.424+0000 7fe05979d700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fe0540cd5e0 0x7fe0540ced20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34926/0 (socket says 172.21.15.17:34926) 2023-10-06T04:44:35.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.424+0000 7fe05979d700 1 -- 172.21.15.17:0/2979180417 learned_addr learned my addr 172.21.15.17:0/2979180417 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:35.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.424+0000 7fe058f9c700 1 --2- 172.21.15.17:0/2979180417 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe0540af540 0x7fe0540af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.425+0000 7fe0537fe700 1 -- 172.21.15.17:0/2979180417 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1485041519 0 0) 0x7fe0540ce890 con 0x7fe0540cd5e0 2023-10-06T04:44:35.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.425+0000 7fe0537fe700 1 -- 172.21.15.17:0/2979180417 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe040003570 con 0x7fe0540cd5e0 2023-10-06T04:44:35.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.425+0000 7fe0537fe700 1 -- 172.21.15.17:0/2979180417 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3725428261 0 0) 0x7fe05415aac0 con 0x7fe05415a650 2023-10-06T04:44:35.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.425+0000 7fe0537fe700 1 -- 172.21.15.17:0/2979180417 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0540ce890 con 0x7fe05415a650 2023-10-06T04:44:35.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.425+0000 7fe058f9c700 1 -- 172.21.15.17:0/2979180417 >> v1:172.21.15.136:6789/0 conn(0x7fe05415a650 legacy=0x7fe0540cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.425+0000 7fe0537fe700 1 -- 172.21.15.17:0/2979180417 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2931968344 0 0) 0x7fe040003570 con 0x7fe0540cd5e0 2023-10-06T04:44:35.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.425+0000 7fe058f9c700 1 -- 172.21.15.17:0/2979180417 >> v1:172.21.15.17:6789/0 conn(0x7fe0540cd5e0 legacy=0x7fe0540ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.425+0000 7fe058f9c700 1 -- 172.21.15.17:0/2979180417 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe05415db70 con 0x7fe0540af540 2023-10-06T04:44:35.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.425+0000 7fe058f9c700 1 --2- 172.21.15.17:0/2979180417 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe0540af540 0x7fe0540af910 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe04c009e90 tx=0x7fe04c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a7e8a5909613e35 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:35.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.425+0000 7fe0537fe700 1 -- 172.21.15.17:0/2979180417 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c00e070 con 0x7fe0540af540 2023-10-06T04:44:35.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.425+0000 7fe0537fe700 1 -- 172.21.15.17:0/2979180417 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04c00b870 con 0x7fe0540af540 2023-10-06T04:44:35.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.425+0000 7fe0537fe700 1 -- 172.21.15.17:0/2979180417 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c001470 con 0x7fe0540af540 2023-10-06T04:44:35.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.426+0000 7fe059f9e700 1 -- 172.21.15.17:0/2979180417 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe0540af540 msgr2=0x7fe0540af910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.426+0000 7fe059f9e700 1 --2- 172.21.15.17:0/2979180417 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe0540af540 0x7fe0540af910 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe04c009e90 tx=0x7fe04c009780 comp rx=0 tx=0).stop 2023-10-06T04:44:35.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.426+0000 7fe059f9e700 1 -- 172.21.15.17:0/2979180417 shutdown_connections 2023-10-06T04:44:35.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.426+0000 7fe059f9e700 1 --2- 172.21.15.17:0/2979180417 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe0540af540 0x7fe0540af910 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.426+0000 7fe059f9e700 1 -- 172.21.15.17:0/2979180417 >> 172.21.15.17:0/2979180417 conn(0x7fe05406d9b0 msgr2=0x7fe05406ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:35.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.426+0000 7fe059f9e700 1 -- 172.21.15.17:0/2979180417 shutdown_connections 2023-10-06T04:44:35.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.426+0000 7fe059f9e700 1 -- 172.21.15.17:0/2979180417 wait complete. 2023-10-06T04:44:35.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.427+0000 7fe059f9e700 1 Processor -- start 2023-10-06T04:44:35.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.427+0000 7fe059f9e700 1 -- start start 2023-10-06T04:44:35.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.428+0000 7fe059f9e700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe0540af540 0x7fe0540ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.428+0000 7fe059f9e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0540cd5e0 0x7fe05415bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.428+0000 7fe059f9e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe05415a650 0x7fe05415c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.428+0000 7fe059f9e700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05416d2b0 con 0x7fe0540cd5e0 2023-10-06T04:44:35.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.428+0000 7fe059f9e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0540aeb10 con 0x7fe05415a650 2023-10-06T04:44:35.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.428+0000 7fe059f9e700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05416d550 con 0x7fe0540af540 2023-10-06T04:44:35.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.428+0000 7fe053fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0540cd5e0 0x7fe05415bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.428+0000 7fe053fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0540cd5e0 0x7fe05415bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51828/0 (socket says 172.21.15.17:51828) 2023-10-06T04:44:35.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.428+0000 7fe053fff700 1 -- 172.21.15.17:0/662209276 learned_addr learned my addr 172.21.15.17:0/662209276 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:35.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.428+0000 7fe058f9c700 1 --2- 172.21.15.17:0/662209276 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe0540af540 0x7fe0540ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.428+0000 7fe05979d700 1 --2- 172.21.15.17:0/662209276 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe05415a650 0x7fe05415c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.428+0000 7fe053fff700 1 -- 172.21.15.17:0/662209276 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe0540af540 msgr2=0x7fe0540ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.428+0000 7fe053fff700 1 --2- 172.21.15.17:0/662209276 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe0540af540 0x7fe0540ae5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.428+0000 7fe053fff700 1 -- 172.21.15.17:0/662209276 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe05415a650 msgr2=0x7fe05415c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.428+0000 7fe053fff700 1 --2- 172.21.15.17:0/662209276 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe05415a650 0x7fe05415c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.428+0000 7fe053fff700 1 -- 172.21.15.17:0/662209276 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04c009a20 con 0x7fe0540cd5e0 2023-10-06T04:44:35.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.428+0000 7fe05979d700 1 --2- 172.21.15.17:0/662209276 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe05415a650 0x7fe05415c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:35.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.428+0000 7fe053fff700 1 --2- 172.21.15.17:0/662209276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0540cd5e0 0x7fe05415bc50 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fe04400c790 tx=0x7fe044007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:35.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.429+0000 7fe050ff9700 1 -- 172.21.15.17:0/662209276 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe044010510 con 0x7fe0540cd5e0 2023-10-06T04:44:35.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.429+0000 7fe050ff9700 1 -- 172.21.15.17:0/662209276 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe044010670 con 0x7fe0540cd5e0 2023-10-06T04:44:35.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.429+0000 7fe059f9e700 1 -- 172.21.15.17:0/662209276 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe05416d830 con 0x7fe0540cd5e0 2023-10-06T04:44:35.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.429+0000 7fe050ff9700 1 -- 172.21.15.17:0/662209276 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe044010a30 con 0x7fe0540cd5e0 2023-10-06T04:44:35.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.429+0000 7fe059f9e700 1 -- 172.21.15.17:0/662209276 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe05416ab40 con 0x7fe0540cd5e0 2023-10-06T04:44:35.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.430+0000 7fe059f9e700 1 -- 172.21.15.17:0/662209276 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe05416dd30 con 0x7fe0540cd5e0 2023-10-06T04:44:35.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.430+0000 7fe050ff9700 1 -- 172.21.15.17:0/662209276 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe04401b3b0 con 0x7fe0540cd5e0 2023-10-06T04:44:35.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.430+0000 7fe050ff9700 1 --2- 172.21.15.17:0/662209276 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe034066f30 0x7fe0340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.430+0000 7fe050ff9700 1 -- 172.21.15.17:0/662209276 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6453+0+0 (secure 0 0 0) 0x7fe044084090 con 0x7fe0540cd5e0 2023-10-06T04:44:35.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.431+0000 7fe058f9c700 1 --2- 172.21.15.17:0/662209276 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe034066f30 0x7fe0340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.431+0000 7fe058f9c700 1 --2- 172.21.15.17:0/662209276 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe034066f30 0x7fe0340693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe04c0097c0 tx=0x7fe04c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:35.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.435+0000 7fe050ff9700 1 -- 172.21.15.17:0/662209276 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe044051010 con 0x7fe0540cd5e0 2023-10-06T04:44:35.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.628+0000 7fe059f9e700 1 -- 172.21.15.17:0/662209276 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe05404c380 con 0x7fe0540cd5e0 2023-10-06T04:44:35.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.628+0000 7fe050ff9700 1 -- 172.21.15.17:0/662209276 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe0440170a0 con 0x7fe0540cd5e0 2023-10-06T04:44:35.630 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-10-06T04:44:35.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.631+0000 7fe059f9e700 1 -- 172.21.15.17:0/662209276 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe034066f30 msgr2=0x7fe0340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.631+0000 7fe059f9e700 1 --2- 172.21.15.17:0/662209276 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe034066f30 0x7fe0340693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe04c0097c0 tx=0x7fe04c017000 comp rx=0 tx=0).stop 2023-10-06T04:44:35.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.631+0000 7fe059f9e700 1 -- 172.21.15.17:0/662209276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0540cd5e0 msgr2=0x7fe05415bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.631+0000 7fe059f9e700 1 --2- 172.21.15.17:0/662209276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0540cd5e0 0x7fe05415bc50 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fe04400c790 tx=0x7fe044007e10 comp rx=0 tx=0).stop 2023-10-06T04:44:35.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.631+0000 7fe059f9e700 1 -- 172.21.15.17:0/662209276 shutdown_connections 2023-10-06T04:44:35.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.631+0000 7fe059f9e700 1 --2- 172.21.15.17:0/662209276 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe034066f30 0x7fe0340693e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.631+0000 7fe059f9e700 1 --2- 172.21.15.17:0/662209276 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe05415a650 0x7fe05415c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.631+0000 7fe059f9e700 1 --2- 172.21.15.17:0/662209276 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe0540af540 0x7fe0540ae5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.631+0000 7fe059f9e700 1 --2- 172.21.15.17:0/662209276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0540cd5e0 0x7fe05415bc50 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.631+0000 7fe059f9e700 1 -- 172.21.15.17:0/662209276 >> 172.21.15.17:0/662209276 conn(0x7fe05406d9b0 msgr2=0x7fe05415d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:35.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.631+0000 7fe059f9e700 1 -- 172.21.15.17:0/662209276 shutdown_connections 2023-10-06T04:44:35.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.631+0000 7fe059f9e700 1 -- 172.21.15.17:0/662209276 wait complete. 2023-10-06T04:44:35.644 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-10-06T04:44:35.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.764+0000 7fd317fe1700 1 Processor -- start 2023-10-06T04:44:35.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.764+0000 7fd317fe1700 1 -- start start 2023-10-06T04:44:35.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.765+0000 7fd317fe1700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd3100cabf0 0x7fd3100c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.765+0000 7fd317fe1700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd31006d140 0x7fd31006f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.765+0000 7fd317fe1700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3100d1120 con 0x7fd310159b10 2023-10-06T04:44:35.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.765+0000 7fd317fe1700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3100d1400 con 0x7fd31006d140 2023-10-06T04:44:35.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.765+0000 7fd317fe1700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd31006e920 con 0x7fd3100cabf0 2023-10-06T04:44:35.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.765+0000 7fd31657e700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd31006d140 0x7fd31006f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.765+0000 7fd31657e700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd31006d140 0x7fd31006f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51844/0 (socket says 172.21.15.17:51844) 2023-10-06T04:44:35.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.765+0000 7fd31657e700 1 -- 172.21.15.17:0/576004625 learned_addr learned my addr 172.21.15.17:0/576004625 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:35.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.766+0000 7fd315d7d700 1 --2- 172.21.15.17:0/576004625 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd3100cabf0 0x7fd3100c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.766+0000 7fd31657e700 1 -- 172.21.15.17:0/576004625 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd3100cabf0 msgr2=0x7fd3100c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:35.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.766+0000 7fd31657e700 1 --2- 172.21.15.17:0/576004625 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd3100cabf0 0x7fd3100c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.766+0000 7fd31657e700 1 -- 172.21.15.17:0/576004625 >> v1:172.21.15.136:6789/0 conn(0x7fd310159b10 legacy=0x7fd31006f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:35.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.766+0000 7fd31657e700 1 -- 172.21.15.17:0/576004625 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd31006ec00 con 0x7fd31006d140 2023-10-06T04:44:35.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.766+0000 7fd31657e700 1 --2- 172.21.15.17:0/576004625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd31006d140 0x7fd31006f830 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fd308009f20 tx=0x7fd308009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b00a39cc1e8adabb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:35.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.766+0000 7fd314d7b700 1 -- 172.21.15.17:0/576004625 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30800e070 con 0x7fd31006d140 2023-10-06T04:44:35.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.766+0000 7fd314d7b700 1 -- 172.21.15.17:0/576004625 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30800ba40 con 0x7fd31006d140 2023-10-06T04:44:35.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.766+0000 7fd314d7b700 1 -- 172.21.15.17:0/576004625 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3080092e0 con 0x7fd31006d140 2023-10-06T04:44:35.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.767+0000 7fd317fe1700 1 -- 172.21.15.17:0/576004625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd31006d140 msgr2=0x7fd31006f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.767+0000 7fd317fe1700 1 --2- 172.21.15.17:0/576004625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd31006d140 0x7fd31006f830 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fd308009f20 tx=0x7fd308009840 comp rx=0 tx=0).stop 2023-10-06T04:44:35.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.767+0000 7fd317fe1700 1 -- 172.21.15.17:0/576004625 shutdown_connections 2023-10-06T04:44:35.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.767+0000 7fd317fe1700 1 --2- 172.21.15.17:0/576004625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd31006d140 0x7fd31006f830 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.767+0000 7fd317fe1700 1 --2- 172.21.15.17:0/576004625 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd3100cabf0 0x7fd3100c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.767+0000 7fd317fe1700 1 -- 172.21.15.17:0/576004625 >> 172.21.15.17:0/576004625 conn(0x7fd31006cd40 msgr2=0x7fd3100d0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:35.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.767+0000 7fd317fe1700 1 -- 172.21.15.17:0/576004625 shutdown_connections 2023-10-06T04:44:35.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.767+0000 7fd317fe1700 1 -- 172.21.15.17:0/576004625 wait complete. 2023-10-06T04:44:35.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.768+0000 7fd317fe1700 1 Processor -- start 2023-10-06T04:44:35.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.768+0000 7fd317fe1700 1 -- start start 2023-10-06T04:44:35.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.769+0000 7fd317fe1700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd31006d140 0x7fd310156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.769+0000 7fd317fe1700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd3100cabf0 0x7fd31009d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.769+0000 7fd317fe1700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd310159b10 0x7fd3100cd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.769+0000 7fd317fe1700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3100cdca0 con 0x7fd31006d140 2023-10-06T04:44:35.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.769+0000 7fd317fe1700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31009e1a0 con 0x7fd310159b10 2023-10-06T04:44:35.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.769+0000 7fd317fe1700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3100c5900 con 0x7fd3100cabf0 2023-10-06T04:44:35.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.769+0000 7fd315d7d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd31006d140 0x7fd310156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.769+0000 7fd315d7d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd31006d140 0x7fd310156af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51860/0 (socket says 172.21.15.17:51860) 2023-10-06T04:44:35.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.769+0000 7fd315d7d700 1 -- 172.21.15.17:0/3705101553 learned_addr learned my addr 172.21.15.17:0/3705101553 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:35.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.769+0000 7fd31557c700 1 --2- 172.21.15.17:0/3705101553 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd3100cabf0 0x7fd31009d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.769+0000 7fd31657e700 1 --2- 172.21.15.17:0/3705101553 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd310159b10 0x7fd3100cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.769+0000 7fd315d7d700 1 -- 172.21.15.17:0/3705101553 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd3100cabf0 msgr2=0x7fd31009d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.769+0000 7fd315d7d700 1 --2- 172.21.15.17:0/3705101553 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd3100cabf0 0x7fd31009d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.769+0000 7fd315d7d700 1 -- 172.21.15.17:0/3705101553 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd310159b10 msgr2=0x7fd3100cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.769+0000 7fd315d7d700 1 --2- 172.21.15.17:0/3705101553 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd310159b10 0x7fd3100cd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.769+0000 7fd315d7d700 1 -- 172.21.15.17:0/3705101553 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd308009ae0 con 0x7fd31006d140 2023-10-06T04:44:35.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.769+0000 7fd315d7d700 1 --2- 172.21.15.17:0/3705101553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd31006d140 0x7fd310156af0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd30000d840 tx=0x7fd300008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:35.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.769+0000 7fd30dffb700 1 -- 172.21.15.17:0/3705101553 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30000b600 con 0x7fd31006d140 2023-10-06T04:44:35.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.769+0000 7fd30dffb700 1 -- 172.21.15.17:0/3705101553 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30000b760 con 0x7fd31006d140 2023-10-06T04:44:35.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.769+0000 7fd317fe1700 1 -- 172.21.15.17:0/3705101553 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd31009dec0 con 0x7fd31006d140 2023-10-06T04:44:35.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.769+0000 7fd30dffb700 1 -- 172.21.15.17:0/3705101553 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30000bb00 con 0x7fd31006d140 2023-10-06T04:44:35.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.770+0000 7fd317fe1700 1 -- 172.21.15.17:0/3705101553 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3100c5590 con 0x7fd31006d140 2023-10-06T04:44:35.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.770+0000 7fd317fe1700 1 -- 172.21.15.17:0/3705101553 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3100c5be0 con 0x7fd31006d140 2023-10-06T04:44:35.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.771+0000 7fd30dffb700 1 -- 172.21.15.17:0/3705101553 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd30001e460 con 0x7fd31006d140 2023-10-06T04:44:35.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.771+0000 7fd30dffb700 1 --2- 172.21.15.17:0/3705101553 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd2fc066f30 0x7fd2fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:35.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.771+0000 7fd30dffb700 1 -- 172.21.15.17:0/3705101553 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6453+0+0 (secure 0 0 0) 0x7fd300084ed0 con 0x7fd31006d140 2023-10-06T04:44:35.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.771+0000 7fd31557c700 1 --2- 172.21.15.17:0/3705101553 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd2fc066f30 0x7fd2fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:35.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.772+0000 7fd31557c700 1 --2- 172.21.15.17:0/3705101553 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd2fc066f30 0x7fd2fc0693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd310157030 tx=0x7fd304009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:35.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.775+0000 7fd30dffb700 1 -- 172.21.15.17:0/3705101553 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd300051e50 con 0x7fd31006d140 2023-10-06T04:44:35.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.967+0000 7fd317fe1700 1 -- 172.21.15.17:0/3705101553 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7fd310071310 con 0x7fd31006d140 2023-10-06T04:44:35.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.967+0000 7fd30dffb700 1 -- 172.21.15.17:0/3705101553 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v35) v1 ==== 97+0+11 (secure 0 0 0) 0x7fd300055470 con 0x7fd31006d140 2023-10-06T04:44:35.969 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-10-06T04:44:35.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.969+0000 7fd317fe1700 1 -- 172.21.15.17:0/3705101553 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd2fc066f30 msgr2=0x7fd2fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.969+0000 7fd317fe1700 1 --2- 172.21.15.17:0/3705101553 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd2fc066f30 0x7fd2fc0693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd310157030 tx=0x7fd304009040 comp rx=0 tx=0).stop 2023-10-06T04:44:35.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.969+0000 7fd317fe1700 1 -- 172.21.15.17:0/3705101553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd31006d140 msgr2=0x7fd310156af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:35.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.969+0000 7fd317fe1700 1 --2- 172.21.15.17:0/3705101553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd31006d140 0x7fd310156af0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd30000d840 tx=0x7fd300008040 comp rx=0 tx=0).stop 2023-10-06T04:44:35.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.969+0000 7fd317fe1700 1 -- 172.21.15.17:0/3705101553 shutdown_connections 2023-10-06T04:44:35.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.969+0000 7fd317fe1700 1 --2- 172.21.15.17:0/3705101553 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd2fc066f30 0x7fd2fc0693e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.969+0000 7fd317fe1700 1 --2- 172.21.15.17:0/3705101553 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd310159b10 0x7fd3100cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.969+0000 7fd317fe1700 1 --2- 172.21.15.17:0/3705101553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd31006d140 0x7fd310156af0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.969+0000 7fd317fe1700 1 --2- 172.21.15.17:0/3705101553 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd3100cabf0 0x7fd31009d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:35.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.969+0000 7fd317fe1700 1 -- 172.21.15.17:0/3705101553 >> 172.21.15.17:0/3705101553 conn(0x7fd31006cd40 msgr2=0x7fd3100b5410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:35.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.969+0000 7fd317fe1700 1 -- 172.21.15.17:0/3705101553 shutdown_connections 2023-10-06T04:44:35.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:35.969+0000 7fd317fe1700 1 -- 172.21.15.17:0/3705101553 wait complete. 2023-10-06T04:44:35.983 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:44:36.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.100+0000 7f6535384700 1 Processor -- start 2023-10-06T04:44:36.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.100+0000 7f6535384700 1 -- start start 2023-10-06T04:44:36.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.101+0000 7f6535384700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6530159630 0x7f65300cd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:36.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.101+0000 7f6535384700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f65300cea10 0x7f65300b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:36.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.101+0000 7f6535384700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65300cda00 con 0x7f65300cd590 2023-10-06T04:44:36.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.101+0000 7f6535384700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65300cee90 con 0x7f65300cea10 2023-10-06T04:44:36.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.101+0000 7f6535384700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65300cfc80 con 0x7f6530159630 2023-10-06T04:44:36.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.101+0000 7f652e7fc700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f65300cd590 0x7f65300ce300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34938/0 (socket says 172.21.15.17:34938) 2023-10-06T04:44:36.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.101+0000 7f652e7fc700 1 -- 172.21.15.17:0/1558587139 learned_addr learned my addr 172.21.15.17:0/1558587139 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:36.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.101+0000 7f652effd700 1 --2- 172.21.15.17:0/1558587139 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6530159630 0x7f65300cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:36.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.101+0000 7f652f7fe700 1 --2- 172.21.15.17:0/1558587139 >> v2:172.21.15.136:3300/0 conn(0x7f65300cea10 0x7f65300b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:36.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.101+0000 7f652dffb700 1 -- 172.21.15.17:0/1558587139 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 815542839 0 0) 0x7f65300cda00 con 0x7f65300cd590 2023-10-06T04:44:36.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.101+0000 7f652dffb700 1 -- 172.21.15.17:0/1558587139 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f651c003570 con 0x7f65300cd590 2023-10-06T04:44:36.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.101+0000 7f652dffb700 1 -- 172.21.15.17:0/1558587139 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 484126458 0 0) 0x7f651c003570 con 0x7f65300cd590 2023-10-06T04:44:36.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.101+0000 7f652dffb700 1 -- 172.21.15.17:0/1558587139 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6530159630 msgr2=0x7f65300cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:36.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.101+0000 7f652dffb700 1 --2- 172.21.15.17:0/1558587139 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6530159630 0x7f65300cd050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:36.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.101+0000 7f652dffb700 1 -- 172.21.15.17:0/1558587139 >> v2:172.21.15.136:3300/0 conn(0x7f65300cea10 msgr2=0x7f65300b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:36.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.101+0000 7f652dffb700 1 --2- 172.21.15.17:0/1558587139 >> v2:172.21.15.136:3300/0 conn(0x7f65300cea10 0x7f65300b02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:36.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.101+0000 7f652dffb700 1 -- 172.21.15.17:0/1558587139 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65300cf070 con 0x7f65300cd590 2023-10-06T04:44:36.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.101+0000 7f652dffb700 1 -- 172.21.15.17:0/1558587139 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4268781140 0 0) 0x7f6518001470 con 0x7f65300cd590 2023-10-06T04:44:36.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.101+0000 7f652dffb700 1 -- 172.21.15.17:0/1558587139 >> v1:172.21.15.17:6789/0 conn(0x7f65300cd590 legacy=0x7f65300ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:36.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.101+0000 7f652dffb700 1 --2- 172.21.15.17:0/1558587139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f651c003a60 0x7f651c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:36.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.101+0000 7f652dffb700 1 --2- 172.21.15.17:0/1558587139 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6530159630 0x7f651c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:36.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.101+0000 7f652dffb700 1 --2- 172.21.15.17:0/1558587139 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f651c004d50 0x7f651c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:36.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.101+0000 7f652dffb700 1 -- 172.21.15.17:0/1558587139 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65300cee90 con 0x7f651c003a60 2023-10-06T04:44:36.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.101+0000 7f652dffb700 1 -- 172.21.15.17:0/1558587139 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65300cfc80 con 0x7f651c004d50 2023-10-06T04:44:36.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.101+0000 7f652dffb700 1 -- 172.21.15.17:0/1558587139 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f651c00ba60 con 0x7f6530159630 2023-10-06T04:44:36.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.102+0000 7f652effd700 1 --2- 172.21.15.17:0/1558587139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f651c003a60 0x7f651c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:36.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.102+0000 7f652e7fc700 1 --2- 172.21.15.17:0/1558587139 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6530159630 0x7f651c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:36.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.102+0000 7f652f7fe700 1 --2- 172.21.15.17:0/1558587139 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f651c004d50 0x7f651c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:36.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.102+0000 7f652effd700 1 -- 172.21.15.17:0/1558587139 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6530159630 msgr2=0x7f651c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:36.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.102+0000 7f652effd700 1 --2- 172.21.15.17:0/1558587139 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6530159630 0x7f651c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:36.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.102+0000 7f652effd700 1 -- 172.21.15.17:0/1558587139 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f651c004d50 msgr2=0x7f651c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:36.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.102+0000 7f652effd700 1 --2- 172.21.15.17:0/1558587139 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f651c004d50 0x7f651c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:36.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.102+0000 7f652effd700 1 -- 172.21.15.17:0/1558587139 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f651c003570 con 0x7f651c003a60 2023-10-06T04:44:36.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.102+0000 7f652effd700 1 --2- 172.21.15.17:0/1558587139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f651c003a60 0x7f651c003e70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f6520009c00 tx=0x7f65200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06c11302c0d888 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:36.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.102+0000 7f652dffb700 1 -- 172.21.15.17:0/1558587139 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652000e6b0 con 0x7f651c003a60 2023-10-06T04:44:36.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.102+0000 7f652dffb700 1 -- 172.21.15.17:0/1558587139 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f652000e810 con 0x7f651c003a60 2023-10-06T04:44:36.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.102+0000 7f652dffb700 1 -- 172.21.15.17:0/1558587139 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652000ebd0 con 0x7f651c003a60 2023-10-06T04:44:36.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.103+0000 7f6535384700 1 -- 172.21.15.17:0/1558587139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f651c003a60 msgr2=0x7f651c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:36.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.103+0000 7f6535384700 1 --2- 172.21.15.17:0/1558587139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f651c003a60 0x7f651c003e70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f6520009c00 tx=0x7f65200091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:36.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.103+0000 7f652f7fe700 1 -- 172.21.15.17:0/1558587139 reap_dead start 2023-10-06T04:44:36.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.103+0000 7f6535384700 1 -- 172.21.15.17:0/1558587139 shutdown_connections 2023-10-06T04:44:36.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.103+0000 7f6535384700 1 -- 172.21.15.17:0/1558587139 >> 172.21.15.17:0/1558587139 conn(0x7f653006cff0 msgr2=0x7f653006d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:36.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.103+0000 7f6535384700 1 -- 172.21.15.17:0/1558587139 shutdown_connections 2023-10-06T04:44:36.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.103+0000 7f6535384700 1 -- 172.21.15.17:0/1558587139 wait complete. 2023-10-06T04:44:36.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.104+0000 7f6535384700 1 Processor -- start 2023-10-06T04:44:36.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.104+0000 7f6535384700 1 -- start start 2023-10-06T04:44:36.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.105+0000 7f6535384700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f651c003a60 0x7f65300b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:36.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.105+0000 7f6535384700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f65300b3710 0x7f6530151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:36.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.105+0000 7f6535384700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6530157c30 0x7f65301580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:36.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.105+0000 7f6535384700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6530152170 con 0x7f651c003a60 2023-10-06T04:44:36.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.105+0000 7f6535384700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6530151f50 con 0x7f6530157c30 2023-10-06T04:44:36.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.105+0000 7f6535384700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65300b45a0 con 0x7f65300b3710 2023-10-06T04:44:36.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.105+0000 7f652effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f651c003a60 0x7f65300b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:36.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.105+0000 7f652effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f651c003a60 0x7f65300b3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51882/0 (socket says 172.21.15.17:51882) 2023-10-06T04:44:36.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.105+0000 7f652effd700 1 -- 172.21.15.17:0/3816243405 learned_addr learned my addr 172.21.15.17:0/3816243405 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:36.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.105+0000 7f652f7fe700 1 --2- 172.21.15.17:0/3816243405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6530157c30 0x7f65301580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:36.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.105+0000 7f652e7fc700 1 --2- 172.21.15.17:0/3816243405 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f65300b3710 0x7f6530151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:36.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.105+0000 7f652effd700 1 -- 172.21.15.17:0/3816243405 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f65300b3710 msgr2=0x7f6530151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:36.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.105+0000 7f652effd700 1 --2- 172.21.15.17:0/3816243405 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f65300b3710 0x7f6530151a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:36.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.105+0000 7f652effd700 1 -- 172.21.15.17:0/3816243405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6530157c30 msgr2=0x7f65301580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:36.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.105+0000 7f652effd700 1 --2- 172.21.15.17:0/3816243405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6530157c30 0x7f65301580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:36.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.105+0000 7f652effd700 1 -- 172.21.15.17:0/3816243405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65300b4880 con 0x7f651c003a60 2023-10-06T04:44:36.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.105+0000 7f652f7fe700 1 --2- 172.21.15.17:0/3816243405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6530157c30 0x7f65301580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:36.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.105+0000 7f652effd700 1 --2- 172.21.15.17:0/3816243405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f651c003a60 0x7f65300b3f50 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f651c004730 tx=0x7f652001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:36.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.106+0000 7f6526ffd700 1 -- 172.21.15.17:0/3816243405 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6520022070 con 0x7f651c003a60 2023-10-06T04:44:36.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.106+0000 7f6535384700 1 -- 172.21.15.17:0/3816243405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65300b4b60 con 0x7f651c003a60 2023-10-06T04:44:36.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.106+0000 7f6526ffd700 1 -- 172.21.15.17:0/3816243405 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f652000e980 con 0x7f651c003a60 2023-10-06T04:44:36.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.106+0000 7f6526ffd700 1 -- 172.21.15.17:0/3816243405 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6520027470 con 0x7f651c003a60 2023-10-06T04:44:36.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.106+0000 7f6535384700 1 -- 172.21.15.17:0/3816243405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65300b3b80 con 0x7f651c003a60 2023-10-06T04:44:36.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.107+0000 7f6535384700 1 -- 172.21.15.17:0/3816243405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6530063ff0 con 0x7f651c003a60 2023-10-06T04:44:36.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.107+0000 7f6526ffd700 1 -- 172.21.15.17:0/3816243405 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f652001c450 con 0x7f651c003a60 2023-10-06T04:44:36.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.107+0000 7f6526ffd700 1 --2- 172.21.15.17:0/3816243405 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6510066f30 0x7f65100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:36.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.108+0000 7f652e7fc700 1 --2- 172.21.15.17:0/3816243405 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6510066f30 0x7f65100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:36.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.108+0000 7f6526ffd700 1 -- 172.21.15.17:0/3816243405 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f6520086510 con 0x7f651c003a60 2023-10-06T04:44:36.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.108+0000 7f652e7fc700 1 --2- 172.21.15.17:0/3816243405 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6510066f30 0x7f65100693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6518001620 tx=0x7f6518009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:36.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.112+0000 7f6526ffd700 1 -- 172.21.15.17:0/3816243405 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6520053490 con 0x7f651c003a60 2023-10-06T04:44:36.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.349+0000 7f6535384700 1 -- 172.21.15.17:0/3816243405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65300cdea0 con 0x7f651c003a60 2023-10-06T04:44:36.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.350+0000 7f6526ffd700 1 -- 172.21.15.17:0/3816243405 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f6520056ab0 con 0x7f651c003a60 2023-10-06T04:44:36.352 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:36.352 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6834/3741747962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3741747962},{"type":"v1","addr":"172.21.15.136:6834","nonce":3741747962}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4688,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/264192509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6833","nonce":264192509},{"type":"v1","addr":"172.21.15.136:6835","nonce":264192509}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4909,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6836/1154731767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1154731767},{"type":"v1","addr":"172.21.15.17:6836","nonce":1154731767}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:44:14.988901+0000","modified":"2023-10-06T04:44:29.425634+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4971":{"gid":4971,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6837/460551791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6835","nonce":460551791},{"type":"v1","addr":"172.21.15.17:6837","nonce":460551791}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:44:36.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.352+0000 7f6535384700 1 -- 172.21.15.17:0/3816243405 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6510066f30 msgr2=0x7f65100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:36.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.352+0000 7f6535384700 1 --2- 172.21.15.17:0/3816243405 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6510066f30 0x7f65100693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6518001620 tx=0x7f6518009040 comp rx=0 tx=0).stop 2023-10-06T04:44:36.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.352+0000 7f6535384700 1 -- 172.21.15.17:0/3816243405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f651c003a60 msgr2=0x7f65300b3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:36.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.352+0000 7f6535384700 1 --2- 172.21.15.17:0/3816243405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f651c003a60 0x7f65300b3f50 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f651c004730 tx=0x7f652001a000 comp rx=0 tx=0).stop 2023-10-06T04:44:36.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.352+0000 7f6535384700 1 -- 172.21.15.17:0/3816243405 shutdown_connections 2023-10-06T04:44:36.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.352+0000 7f6535384700 1 --2- 172.21.15.17:0/3816243405 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6510066f30 0x7f65100693e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:36.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.352+0000 7f6535384700 1 --2- 172.21.15.17:0/3816243405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6530157c30 0x7f65301580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:36.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.352+0000 7f6535384700 1 --2- 172.21.15.17:0/3816243405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f651c003a60 0x7f65300b3f50 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:36.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.352+0000 7f6535384700 1 --2- 172.21.15.17:0/3816243405 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f65300b3710 0x7f6530151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:36.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.352+0000 7f6535384700 1 -- 172.21.15.17:0/3816243405 >> 172.21.15.17:0/3816243405 conn(0x7f653006cff0 msgr2=0x7f65300b2500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:36.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.352+0000 7f6535384700 1 -- 172.21.15.17:0/3816243405 shutdown_connections 2023-10-06T04:44:36.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.352+0000 7f6535384700 1 -- 172.21.15.17:0/3816243405 wait complete. 2023-10-06T04:44:36.355 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 17 2023-10-06T04:44:36.366 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:44:36.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.483+0000 7f49fccc5700 1 Processor -- start 2023-10-06T04:44:36.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.483+0000 7f49fccc5700 1 -- start start 2023-10-06T04:44:36.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.484+0000 7f49fccc5700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f49f80cd760 0x7f49f80ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:36.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.484+0000 7f49fccc5700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f49f80ce840 0x7f49f80b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:36.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.484+0000 7f49fccc5700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49f80cfc80 con 0x7f49f8159630 2023-10-06T04:44:36.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.484+0000 7f49fccc5700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49f80cf070 con 0x7f49f80cd760 2023-10-06T04:44:36.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.484+0000 7f49fccc5700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f80cf350 con 0x7f49f80ce840 2023-10-06T04:44:36.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.484+0000 7f49f659c700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f49f8159630 0x7f49f80cd050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34940/0 (socket says 172.21.15.17:34940) 2023-10-06T04:44:36.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.484+0000 7f49f659c700 1 -- 172.21.15.17:0/3591187763 learned_addr learned my addr 172.21.15.17:0/3591187763 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:36.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.485+0000 7f49f5d9b700 1 --2- 172.21.15.17:0/3591187763 >> v2:172.21.15.136:3300/0 conn(0x7f49f80cd760 0x7f49f80ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:36.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.485+0000 7f49f6d9d700 1 --2- 172.21.15.17:0/3591187763 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f49f80ce840 0x7f49f80b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:36.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.485+0000 7f49f559a700 1 -- 172.21.15.17:0/3591187763 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 496152389 0 0) 0x7f49f80cfc80 con 0x7f49f8159630 2023-10-06T04:44:36.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.485+0000 7f49f559a700 1 -- 172.21.15.17:0/3591187763 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49e4003570 con 0x7f49f8159630 2023-10-06T04:44:36.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.485+0000 7f49f559a700 1 -- 172.21.15.17:0/3591187763 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3497755250 0 0) 0x7f49e4003570 con 0x7f49f8159630 2023-10-06T04:44:36.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.485+0000 7f49f559a700 1 -- 172.21.15.17:0/3591187763 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f49f80ce840 msgr2=0x7f49f80b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:36.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.485+0000 7f49f559a700 1 --2- 172.21.15.17:0/3591187763 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f49f80ce840 0x7f49f80b02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:36.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.485+0000 7f49f559a700 1 -- 172.21.15.17:0/3591187763 >> v2:172.21.15.136:3300/0 conn(0x7f49f80cd760 msgr2=0x7f49f80ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:36.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.485+0000 7f49f559a700 1 --2- 172.21.15.17:0/3591187763 >> v2:172.21.15.136:3300/0 conn(0x7f49f80cd760 0x7f49f80ce300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:36.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.485+0000 7f49f559a700 1 -- 172.21.15.17:0/3591187763 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f80cf630 con 0x7f49f8159630 2023-10-06T04:44:36.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.485+0000 7f49f559a700 1 -- 172.21.15.17:0/3591187763 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4268781140 0 0) 0x7f49f0001470 con 0x7f49f8159630 2023-10-06T04:44:36.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.485+0000 7f49f5d9b700 1 --2- 172.21.15.17:0/3591187763 >> v2:172.21.15.136:3300/0 conn(0x7f49f80cd760 0x7f49f80ce300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:44:36.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.485+0000 7f49f559a700 1 -- 172.21.15.17:0/3591187763 >> v1:172.21.15.17:6789/0 conn(0x7f49f8159630 legacy=0x7f49f80cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:36.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.485+0000 7f49f559a700 1 --2- 172.21.15.17:0/3591187763 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f49e4003a60 0x7f49e4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:36.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.485+0000 7f49f559a700 1 --2- 172.21.15.17:0/3591187763 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49e4004810 0x7f49e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:36.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.485+0000 7f49f559a700 1 --2- 172.21.15.17:0/3591187763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49e40051c0 0x7f49e400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:36.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.485+0000 7f49f559a700 1 -- 172.21.15.17:0/3591187763 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f80cf070 con 0x7f49e40051c0 2023-10-06T04:44:36.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.485+0000 7f49f559a700 1 -- 172.21.15.17:0/3591187763 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f80cf350 con 0x7f49e4004810 2023-10-06T04:44:36.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.485+0000 7f49f559a700 1 -- 172.21.15.17:0/3591187763 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e400bfa0 con 0x7f49e4003a60 2023-10-06T04:44:36.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.485+0000 7f49f6d9d700 1 --2- 172.21.15.17:0/3591187763 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f49f80ce840 0x7f49f80b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:44:36.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.485+0000 7f49f6d9d700 1 --2- 172.21.15.17:0/3591187763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49e40051c0 0x7f49e400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:36.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.485+0000 7f49f659c700 1 --2- 172.21.15.17:0/3591187763 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f49e4003a60 0x7f49e4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:36.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.485+0000 7f49f5d9b700 1 --2- 172.21.15.17:0/3591187763 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49e4004810 0x7f49e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:36.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.486+0000 7f49f6d9d700 1 -- 172.21.15.17:0/3591187763 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f49e4003a60 msgr2=0x7f49e4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:36.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.486+0000 7f49f6d9d700 1 --2- 172.21.15.17:0/3591187763 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f49e4003a60 0x7f49e4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:36.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.486+0000 7f49f6d9d700 1 -- 172.21.15.17:0/3591187763 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49e4004810 msgr2=0x7f49e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:36.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.486+0000 7f49f6d9d700 1 --2- 172.21.15.17:0/3591187763 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49e4004810 0x7f49e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:36.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.486+0000 7f49f6d9d700 1 -- 172.21.15.17:0/3591187763 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e4003570 con 0x7f49e40051c0 2023-10-06T04:44:36.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.486+0000 7f49f6d9d700 1 --2- 172.21.15.17:0/3591187763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49e40051c0 0x7f49e400ba60 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f49e800e280 tx=0x7f49e800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87582685bb33c976 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:36.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.486+0000 7f49f559a700 1 -- 172.21.15.17:0/3591187763 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e800ead0 con 0x7f49e40051c0 2023-10-06T04:44:36.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.486+0000 7f49f559a700 1 -- 172.21.15.17:0/3591187763 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e800f040 con 0x7f49e40051c0 2023-10-06T04:44:36.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.486+0000 7f49f559a700 1 -- 172.21.15.17:0/3591187763 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e800ee60 con 0x7f49e40051c0 2023-10-06T04:44:36.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.486+0000 7f49fccc5700 1 -- 172.21.15.17:0/3591187763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49e40051c0 msgr2=0x7f49e400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:36.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.486+0000 7f49fccc5700 1 --2- 172.21.15.17:0/3591187763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49e40051c0 0x7f49e400ba60 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f49e800e280 tx=0x7f49e800b040 comp rx=0 tx=0).stop 2023-10-06T04:44:36.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.486+0000 7f49f6d9d700 1 -- 172.21.15.17:0/3591187763 reap_dead start 2023-10-06T04:44:36.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.486+0000 7f49fccc5700 1 -- 172.21.15.17:0/3591187763 shutdown_connections 2023-10-06T04:44:36.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.486+0000 7f49fccc5700 1 -- 172.21.15.17:0/3591187763 >> 172.21.15.17:0/3591187763 conn(0x7f49f806cff0 msgr2=0x7f49f806d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:36.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.487+0000 7f49fccc5700 1 -- 172.21.15.17:0/3591187763 shutdown_connections 2023-10-06T04:44:36.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.487+0000 7f49fccc5700 1 -- 172.21.15.17:0/3591187763 wait complete. 2023-10-06T04:44:36.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.488+0000 7f49fccc5700 1 Processor -- start 2023-10-06T04:44:36.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.488+0000 7f49fccc5700 1 -- start start 2023-10-06T04:44:36.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.488+0000 7f49fccc5700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f49e40051c0 0x7f49f80b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:36.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.488+0000 7f49fccc5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49f80c8e20 0x7f49f8158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:36.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.488+0000 7f49fccc5700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49f81588a0 0x7f49f815ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:36.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.488+0000 7f49fccc5700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f80b47a0 con 0x7f49f81588a0 2023-10-06T04:44:36.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.488+0000 7f49fccc5700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f80b4a80 con 0x7f49f80c8e20 2023-10-06T04:44:36.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.488+0000 7f49fccc5700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f80b4d60 con 0x7f49e40051c0 2023-10-06T04:44:36.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.488+0000 7f49f6d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49f81588a0 0x7f49f815ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:36.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.488+0000 7f49f6d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49f81588a0 0x7f49f815ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51906/0 (socket says 172.21.15.17:51906) 2023-10-06T04:44:36.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.488+0000 7f49f6d9d700 1 -- 172.21.15.17:0/2283111356 learned_addr learned my addr 172.21.15.17:0/2283111356 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:36.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.489+0000 7f49f659c700 1 --2- 172.21.15.17:0/2283111356 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f49e40051c0 0x7f49f80b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:36.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.489+0000 7f49f5d9b700 1 --2- 172.21.15.17:0/2283111356 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49f80c8e20 0x7f49f8158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:36.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.489+0000 7f49f6d9d700 1 -- 172.21.15.17:0/2283111356 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f49e40051c0 msgr2=0x7f49f80b3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:36.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.489+0000 7f49f6d9d700 1 --2- 172.21.15.17:0/2283111356 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f49e40051c0 0x7f49f80b3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:36.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.489+0000 7f49f6d9d700 1 -- 172.21.15.17:0/2283111356 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49f80c8e20 msgr2=0x7f49f8158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:36.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.489+0000 7f49f6d9d700 1 --2- 172.21.15.17:0/2283111356 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49f80c8e20 0x7f49f8158360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:36.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.489+0000 7f49f6d9d700 1 -- 172.21.15.17:0/2283111356 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f80b5040 con 0x7f49f81588a0 2023-10-06T04:44:36.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.489+0000 7f49f6d9d700 1 --2- 172.21.15.17:0/2283111356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49f81588a0 0x7f49f815ab80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f49e8007140 tx=0x7f49e8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:36.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.489+0000 7f49ee7fc700 1 -- 172.21.15.17:0/2283111356 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e8014d50 con 0x7f49f81588a0 2023-10-06T04:44:36.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.489+0000 7f49ee7fc700 1 -- 172.21.15.17:0/2283111356 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e8028470 con 0x7f49f81588a0 2023-10-06T04:44:36.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.489+0000 7f49fccc5700 1 -- 172.21.15.17:0/2283111356 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f80b5320 con 0x7f49f81588a0 2023-10-06T04:44:36.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.489+0000 7f49ee7fc700 1 -- 172.21.15.17:0/2283111356 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e8028830 con 0x7f49f81588a0 2023-10-06T04:44:36.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.489+0000 7f49fccc5700 1 -- 172.21.15.17:0/2283111356 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f815b0c0 con 0x7f49f81588a0 2023-10-06T04:44:36.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.490+0000 7f49fccc5700 1 -- 172.21.15.17:0/2283111356 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49f80b5510 con 0x7f49f81588a0 2023-10-06T04:44:36.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.491+0000 7f49ee7fc700 1 -- 172.21.15.17:0/2283111356 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f49e8025070 con 0x7f49f81588a0 2023-10-06T04:44:36.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.491+0000 7f49ee7fc700 1 --2- 172.21.15.17:0/2283111356 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f49d8066f30 0x7f49d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:36.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.491+0000 7f49ee7fc700 1 -- 172.21.15.17:0/2283111356 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f49e8086720 con 0x7f49f81588a0 2023-10-06T04:44:36.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.491+0000 7f49f659c700 1 --2- 172.21.15.17:0/2283111356 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f49d8066f30 0x7f49d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:36.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.492+0000 7f49f659c700 1 --2- 172.21.15.17:0/2283111356 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f49d8066f30 0x7f49d80693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f49f00010e0 tx=0x7f49f0001e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:36.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.495+0000 7f49ee7fc700 1 -- 172.21.15.17:0/2283111356 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49e80536a0 con 0x7f49f81588a0 2023-10-06T04:44:36.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.690+0000 7f49fccc5700 1 -- 172.21.15.17:0/2283111356 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49f80b0290 con 0x7f49f81588a0 2023-10-06T04:44:36.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.691+0000 7f49ee7fc700 1 -- 172.21.15.17:0/2283111356 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+18425 (secure 0 0 0) 0x7f49e8056cc0 con 0x7f49f81588a0 2023-10-06T04:44:36.693 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:36.693 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":35,"fsid":"780777c4-2b25-4d35-9058-c9f2d62e3ad9","created":"2023-10-06T04:43:10.578520+0000","modified":"2023-10-06T04:44:30.426965+0000","last_up_change":"2023-10-06T04:43:20.682958+0000","last_in_change":"2023-10-06T04:43:12.978917+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:43:21.795733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:43:22.389592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:44:13.266447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T04:44:13.958240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":7,"pool_name":"data_new","create_time":"2023-10-06T04:44:28.154714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"84737b08-575c-46dd-9488-073ae8504494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6809","nonce":90656},{"type":"v1","addr":"172.21.15.17:6811","nonce":90656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":90656},{"type":"v1","addr":"172.21.15.17:6814","nonce":90656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":90656},{"type":"v1","addr":"172.21.15.17:6822","nonce":90656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":90656},{"type":"v1","addr":"172.21.15.17:6818","nonce":90656}]},"public_addr":"172.21.15.17:6811/90656","cluster_addr":"172.21.15.17:6814/90656","heartbeat_back_addr":"172.21.15.17:6822/90656","heartbeat_front_addr":"172.21.15.17:6818/90656","state":["exists","up"]},{"osd":1,"uuid":"dffeb740-58a2-4fd6-8ff1-a0a11a2cc709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":90655},{"type":"v1","addr":"172.21.15.17:6801","nonce":90655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":90655},{"type":"v1","addr":"172.21.15.17:6803","nonce":90655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":90655},{"type":"v1","addr":"172.21.15.17:6807","nonce":90655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":90655},{"type":"v1","addr":"172.21.15.17:6805","nonce":90655}]},"public_addr":"172.21.15.17:6801/90655","cluster_addr":"172.21.15.17:6803/90655","heartbeat_back_addr":"172.21.15.17:6807/90655","heartbeat_front_addr":"172.21.15.17:6805/90655","state":["exists","up"]},{"osd":2,"uuid":"48bd6831-763d-48c2-b515-e02c216d608b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":90657},{"type":"v1","addr":"172.21.15.17:6810","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":90657},{"type":"v1","addr":"172.21.15.17:6815","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":90657},{"type":"v1","addr":"172.21.15.17:6823","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":90657},{"type":"v1","addr":"172.21.15.17:6819","nonce":90657}]},"public_addr":"172.21.15.17:6810/90657","cluster_addr":"172.21.15.17:6815/90657","heartbeat_back_addr":"172.21.15.17:6823/90657","heartbeat_front_addr":"172.21.15.17:6819/90657","state":["exists","up"]},{"osd":3,"uuid":"ae7dbb23-abe7-4bd3-a4df-6f5963d6804c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":90688},{"type":"v1","addr":"172.21.15.17:6825","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":90688},{"type":"v1","addr":"172.21.15.17:6827","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":90688},{"type":"v1","addr":"172.21.15.17:6831","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":90688},{"type":"v1","addr":"172.21.15.17:6829","nonce":90688}]},"public_addr":"172.21.15.17:6825/90688","cluster_addr":"172.21.15.17:6827/90688","heartbeat_back_addr":"172.21.15.17:6831/90688","heartbeat_front_addr":"172.21.15.17:6829/90688","state":["exists","up"]},{"osd":4,"uuid":"29991fb4-1667-4ea3-aca0-d55db27f3bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":90902},{"type":"v1","addr":"172.21.15.136:6801","nonce":90902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":90902},{"type":"v1","addr":"172.21.15.136:6803","nonce":90902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":90902},{"type":"v1","addr":"172.21.15.136:6807","nonce":90902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":90902},{"type":"v1","addr":"172.21.15.136:6805","nonce":90902}]},"public_addr":"172.21.15.136:6801/90902","cluster_addr":"172.21.15.136:6803/90902","heartbeat_back_addr":"172.21.15.136:6807/90902","heartbeat_front_addr":"172.21.15.136:6805/90902","state":["exists","up"]},{"osd":5,"uuid":"398b4ff9-03fc-421f-882c-ba12aa088eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":90901},{"type":"v1","addr":"172.21.15.136:6809","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":90901},{"type":"v1","addr":"172.21.15.136:6811","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":90901},{"type":"v1","addr":"172.21.15.136:6815","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":90901},{"type":"v1","addr":"172.21.15.136:6813","nonce":90901}]},"public_addr":"172.21.15.136:6809/90901","cluster_addr":"172.21.15.136:6811/90901","heartbeat_back_addr":"172.21.15.136:6815/90901","heartbeat_front_addr":"172.21.15.136:6813/90901","state":["exists","up"]},{"osd":6,"uuid":"1bb91a72-4dab-4cdb-aa1d-2b8a9edf1ad0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":90927},{"type":"v1","addr":"172.21.15.136:6825","nonce":90927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":90927},{"type":"v1","addr":"172.21.15.136:6827","nonce":90927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":90927},{"type":"v1","addr":"172.21.15.136:6831","nonce":90927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":90927},{"type":"v1","addr":"172.21.15.136:6829","nonce":90927}]},"public_addr":"172.21.15.136:6825/90927","cluster_addr":"172.21.15.136:6827/90927","heartbeat_back_addr":"172.21.15.136:6831/90927","heartbeat_front_addr":"172.21.15.136:6829/90927","state":["exists","up"]},{"osd":7,"uuid":"719b654e-010d-4aa4-8c13-83fdde242b47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":90934},{"type":"v1","addr":"172.21.15.136:6817","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":90934},{"type":"v1","addr":"172.21.15.136:6819","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":90934},{"type":"v1","addr":"172.21.15.136:6824","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":90934},{"type":"v1","addr":"172.21.15.136:6821","nonce":90934}]},"public_addr":"172.21.15.136:6817/90934","cluster_addr":"172.21.15.136:6819/90934","heartbeat_back_addr":"172.21.15.136:6824/90934","heartbeat_front_addr":"172.21.15.136:6821/90934","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.157479+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.140520+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.190743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.231396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.156510+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.145822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.202888+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.139532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:44:36.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.693+0000 7f49fccc5700 1 -- 172.21.15.17:0/2283111356 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f49d8066f30 msgr2=0x7f49d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:36.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.693+0000 7f49fccc5700 1 --2- 172.21.15.17:0/2283111356 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f49d8066f30 0x7f49d80693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f49f00010e0 tx=0x7f49f0001e90 comp rx=0 tx=0).stop 2023-10-06T04:44:36.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.693+0000 7f49fccc5700 1 -- 172.21.15.17:0/2283111356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49f81588a0 msgr2=0x7f49f815ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:36.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.693+0000 7f49fccc5700 1 --2- 172.21.15.17:0/2283111356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49f81588a0 0x7f49f815ab80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f49e8007140 tx=0x7f49e8016000 comp rx=0 tx=0).stop 2023-10-06T04:44:36.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.693+0000 7f49fccc5700 1 -- 172.21.15.17:0/2283111356 shutdown_connections 2023-10-06T04:44:36.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.693+0000 7f49fccc5700 1 --2- 172.21.15.17:0/2283111356 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f49d8066f30 0x7f49d80693e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:36.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.693+0000 7f49fccc5700 1 --2- 172.21.15.17:0/2283111356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49f81588a0 0x7f49f815ab80 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:36.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.693+0000 7f49fccc5700 1 --2- 172.21.15.17:0/2283111356 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f49e40051c0 0x7f49f80b3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:36.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.693+0000 7f49fccc5700 1 --2- 172.21.15.17:0/2283111356 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49f80c8e20 0x7f49f8158360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:36.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.693+0000 7f49fccc5700 1 -- 172.21.15.17:0/2283111356 >> 172.21.15.17:0/2283111356 conn(0x7f49f806cff0 msgr2=0x7f49f80b1310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:36.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.693+0000 7f49fccc5700 1 -- 172.21.15.17:0/2283111356 shutdown_connections 2023-10-06T04:44:36.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.693+0000 7f49fccc5700 1 -- 172.21.15.17:0/2283111356 wait complete. 2023-10-06T04:44:36.707 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T04:44:36.707 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:44:36.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.826+0000 7fc81cb68700 1 Processor -- start 2023-10-06T04:44:36.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.826+0000 7fc81cb68700 1 -- start start 2023-10-06T04:44:36.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.827+0000 7fc81cb68700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc81815ca80 0x7fc81806e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:36.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.827+0000 7fc81cb68700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc81815ce50 0x7fc81815d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:36.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.827+0000 7fc81cb68700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc81815d910 0x7fc81815ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:36.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.827+0000 7fc81cb68700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8180ab250 con 0x7fc81815d910 2023-10-06T04:44:36.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.827+0000 7fc81cb68700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc81806e660 con 0x7fc81815ca80 2023-10-06T04:44:36.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.827+0000 7fc81cb68700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc81806e940 con 0x7fc81815ce50 2023-10-06T04:44:36.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.828+0000 7fc816d9d700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc81815d910 0x7fc81815ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:36.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.828+0000 7fc816d9d700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc81815d910 0x7fc81815ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51918/0 (socket says 172.21.15.17:51918) 2023-10-06T04:44:36.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.828+0000 7fc816d9d700 1 -- 172.21.15.17:0/1771850361 learned_addr learned my addr 172.21.15.17:0/1771850361 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:36.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.828+0000 7fc81659c700 1 --2- 172.21.15.17:0/1771850361 >> v2:172.21.15.136:3300/0 conn(0x7fc81815ca80 0x7fc81806e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:36.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.828+0000 7fc815d9b700 1 --2- 172.21.15.17:0/1771850361 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc81815ce50 0x7fc81815d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:36.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.828+0000 7fc816d9d700 1 -- 172.21.15.17:0/1771850361 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc81815ce50 msgr2=0x7fc81815d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:36.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.828+0000 7fc816d9d700 1 --2- 172.21.15.17:0/1771850361 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc81815ce50 0x7fc81815d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:36.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.828+0000 7fc816d9d700 1 -- 172.21.15.17:0/1771850361 >> v2:172.21.15.136:3300/0 conn(0x7fc81815ca80 msgr2=0x7fc81806e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:36.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.828+0000 7fc816d9d700 1 --2- 172.21.15.17:0/1771850361 >> v2:172.21.15.136:3300/0 conn(0x7fc81815ca80 0x7fc81806e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:36.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.828+0000 7fc816d9d700 1 -- 172.21.15.17:0/1771850361 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81806ec20 con 0x7fc81815d910 2023-10-06T04:44:36.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.828+0000 7fc816d9d700 1 --2- 172.21.15.17:0/1771850361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc81815d910 0x7fc81815ddb0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc818067d50 tx=0x7fc808009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c776ea058227abf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:36.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.828+0000 7fc81559a700 1 -- 172.21.15.17:0/1771850361 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80800e070 con 0x7fc81815d910 2023-10-06T04:44:36.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.828+0000 7fc81559a700 1 -- 172.21.15.17:0/1771850361 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80800b970 con 0x7fc81815d910 2023-10-06T04:44:36.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.828+0000 7fc81559a700 1 -- 172.21.15.17:0/1771850361 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8080092e0 con 0x7fc81815d910 2023-10-06T04:44:36.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.829+0000 7fc81cb68700 1 -- 172.21.15.17:0/1771850361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc81815d910 msgr2=0x7fc81815ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:36.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.829+0000 7fc81cb68700 1 --2- 172.21.15.17:0/1771850361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc81815d910 0x7fc81815ddb0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc818067d50 tx=0x7fc808009840 comp rx=0 tx=0).stop 2023-10-06T04:44:36.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.829+0000 7fc81cb68700 1 -- 172.21.15.17:0/1771850361 shutdown_connections 2023-10-06T04:44:36.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.829+0000 7fc81cb68700 1 --2- 172.21.15.17:0/1771850361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc81815d910 0x7fc81815ddb0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:36.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.829+0000 7fc81cb68700 1 --2- 172.21.15.17:0/1771850361 >> v2:172.21.15.136:3300/0 conn(0x7fc81815ca80 0x7fc81806e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:36.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.829+0000 7fc81cb68700 1 --2- 172.21.15.17:0/1771850361 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc81815ce50 0x7fc81815d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:36.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.829+0000 7fc81cb68700 1 -- 172.21.15.17:0/1771850361 >> 172.21.15.17:0/1771850361 conn(0x7fc81806cd40 msgr2=0x7fc818087fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:36.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.829+0000 7fc81cb68700 1 -- 172.21.15.17:0/1771850361 shutdown_connections 2023-10-06T04:44:36.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.829+0000 7fc81cb68700 1 -- 172.21.15.17:0/1771850361 wait complete. 2023-10-06T04:44:36.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.830+0000 7fc81cb68700 1 Processor -- start 2023-10-06T04:44:36.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.830+0000 7fc81cb68700 1 -- start start 2023-10-06T04:44:36.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.831+0000 7fc81cb68700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc81815ca80 0x7fc818167900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:36.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.831+0000 7fc81cb68700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc81815ce50 0x7fc81816a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:36.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.831+0000 7fc81cb68700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc81815d910 0x7fc818068080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:36.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.831+0000 7fc81cb68700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81809b080 con 0x7fc81815ce50 2023-10-06T04:44:36.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.831+0000 7fc81cb68700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc818167e40 con 0x7fc81815d910 2023-10-06T04:44:36.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.831+0000 7fc81cb68700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc81816b370 con 0x7fc81815ca80 2023-10-06T04:44:36.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.831+0000 7fc815d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc81815ce50 0x7fc81816a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:36.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.831+0000 7fc815d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc81815ce50 0x7fc81816a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51928/0 (socket says 172.21.15.17:51928) 2023-10-06T04:44:36.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.831+0000 7fc815d9b700 1 -- 172.21.15.17:0/1321891468 learned_addr learned my addr 172.21.15.17:0/1321891468 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:36.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.831+0000 7fc816d9d700 1 --2- 172.21.15.17:0/1321891468 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc81815d910 0x7fc818068080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:36.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.831+0000 7fc81659c700 1 --2- 172.21.15.17:0/1321891468 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc81815ca80 0x7fc818167900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:36.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.831+0000 7fc815d9b700 1 -- 172.21.15.17:0/1321891468 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc81815ca80 msgr2=0x7fc818167900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:36.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.831+0000 7fc815d9b700 1 --2- 172.21.15.17:0/1321891468 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc81815ca80 0x7fc818167900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:36.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.831+0000 7fc815d9b700 1 -- 172.21.15.17:0/1321891468 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc81815d910 msgr2=0x7fc818068080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:36.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.831+0000 7fc815d9b700 1 --2- 172.21.15.17:0/1321891468 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc81815d910 0x7fc818068080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:36.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.831+0000 7fc815d9b700 1 -- 172.21.15.17:0/1321891468 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc808009ae0 con 0x7fc81815ce50 2023-10-06T04:44:36.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.831+0000 7fc816d9d700 1 --2- 172.21.15.17:0/1321891468 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc81815d910 0x7fc818068080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:36.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.831+0000 7fc815d9b700 1 --2- 172.21.15.17:0/1321891468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc81815ce50 0x7fc81816a6e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc80000ec50 tx=0x7fc8000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:36.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.831+0000 7fc80e7fc700 1 -- 172.21.15.17:0/1321891468 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80000c9d0 con 0x7fc81815ce50 2023-10-06T04:44:36.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.831+0000 7fc80e7fc700 1 -- 172.21.15.17:0/1321891468 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80000cb30 con 0x7fc81815ce50 2023-10-06T04:44:36.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.831+0000 7fc80e7fc700 1 -- 172.21.15.17:0/1321891468 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc800013470 con 0x7fc81815ce50 2023-10-06T04:44:36.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.831+0000 7fc81cb68700 1 -- 172.21.15.17:0/1321891468 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc81816b650 con 0x7fc81815ce50 2023-10-06T04:44:36.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.832+0000 7fc81cb68700 1 -- 172.21.15.17:0/1321891468 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc81816bc10 con 0x7fc81815ce50 2023-10-06T04:44:36.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.833+0000 7fc81cb68700 1 -- 172.21.15.17:0/1321891468 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc818063ff0 con 0x7fc81815ce50 2023-10-06T04:44:36.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.833+0000 7fc80e7fc700 1 -- 172.21.15.17:0/1321891468 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc800013820 con 0x7fc81815ce50 2023-10-06T04:44:36.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.833+0000 7fc80e7fc700 1 --2- 172.21.15.17:0/1321891468 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc7f8066f30 0x7fc7f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:36.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.833+0000 7fc80e7fc700 1 -- 172.21.15.17:0/1321891468 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6453+0+0 (secure 0 0 0) 0x7fc800084a30 con 0x7fc81815ce50 2023-10-06T04:44:36.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.833+0000 7fc81659c700 1 --2- 172.21.15.17:0/1321891468 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc7f8066f30 0x7fc7f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:36.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.834+0000 7fc81659c700 1 --2- 172.21.15.17:0/1321891468 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc7f8066f30 0x7fc7f80693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc8180981d0 tx=0x7fc810008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:36.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:36.838+0000 7fc80e7fc700 1 -- 172.21.15.17:0/1321891468 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc800051910 con 0x7fc81815ce50 2023-10-06T04:44:37.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.079+0000 7fc81cb68700 1 -- 172.21.15.17:0/1321891468 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc81806ef00 con 0x7fc81815ce50 2023-10-06T04:44:37.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.080+0000 7fc80e7fc700 1 -- 172.21.15.17:0/1321891468 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fc800054f30 con 0x7fc81815ce50 2023-10-06T04:44:37.082 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:37.082 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6834/3741747962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3741747962},{"type":"v1","addr":"172.21.15.136:6834","nonce":3741747962}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4688,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/264192509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6833","nonce":264192509},{"type":"v1","addr":"172.21.15.136:6835","nonce":264192509}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4909,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6836/1154731767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1154731767},{"type":"v1","addr":"172.21.15.17:6836","nonce":1154731767}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:44:14.988901+0000","modified":"2023-10-06T04:44:29.425634+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4971":{"gid":4971,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6837/460551791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6835","nonce":460551791},{"type":"v1","addr":"172.21.15.17:6837","nonce":460551791}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:44:37.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.082+0000 7fc81cb68700 1 -- 172.21.15.17:0/1321891468 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc7f8066f30 msgr2=0x7fc7f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.082+0000 7fc81cb68700 1 --2- 172.21.15.17:0/1321891468 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc7f8066f30 0x7fc7f80693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc8180981d0 tx=0x7fc810008040 comp rx=0 tx=0).stop 2023-10-06T04:44:37.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.082+0000 7fc81cb68700 1 -- 172.21.15.17:0/1321891468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc81815ce50 msgr2=0x7fc81816a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.082+0000 7fc81cb68700 1 --2- 172.21.15.17:0/1321891468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc81815ce50 0x7fc81816a6e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc80000ec50 tx=0x7fc8000091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.082+0000 7fc81cb68700 1 -- 172.21.15.17:0/1321891468 shutdown_connections 2023-10-06T04:44:37.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.082+0000 7fc81cb68700 1 --2- 172.21.15.17:0/1321891468 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fc7f8066f30 0x7fc7f80693e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.082+0000 7fc81cb68700 1 --2- 172.21.15.17:0/1321891468 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc81815d910 0x7fc818068080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.082+0000 7fc81cb68700 1 --2- 172.21.15.17:0/1321891468 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc81815ca80 0x7fc818167900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.082+0000 7fc81cb68700 1 --2- 172.21.15.17:0/1321891468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc81815ce50 0x7fc81816a6e0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.082+0000 7fc81cb68700 1 -- 172.21.15.17:0/1321891468 >> 172.21.15.17:0/1321891468 conn(0x7fc81806cd40 msgr2=0x7fc8180ab6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:37.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.082+0000 7fc81cb68700 1 -- 172.21.15.17:0/1321891468 shutdown_connections 2023-10-06T04:44:37.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.082+0000 7fc81cb68700 1 -- 172.21.15.17:0/1321891468 wait complete. 2023-10-06T04:44:37.086 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 17 2023-10-06T04:44:37.096 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:44:37.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.212+0000 7f2dbc9a9700 1 Processor -- start 2023-10-06T04:44:37.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.212+0000 7f2dbc9a9700 1 -- start start 2023-10-06T04:44:37.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.213+0000 7f2dbc9a9700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2db80ccfc0 0x7f2db80cc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.213+0000 7f2dbc9a9700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2db80cf3b0 0x7f2db81594a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.213+0000 7f2dbc9a9700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2db80cc750 0x7f2db81599e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.213+0000 7f2dbc9a9700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2db80cbd80 con 0x7f2db80cf3b0 2023-10-06T04:44:37.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.213+0000 7f2dbc9a9700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2db80af5f0 con 0x7f2db80cc750 2023-10-06T04:44:37.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.213+0000 7f2dbc9a9700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db80af8d0 con 0x7f2db80ccfc0 2023-10-06T04:44:37.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.213+0000 7f2db659c700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2db80cf3b0 0x7f2db81594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.213+0000 7f2db659c700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2db80cf3b0 0x7f2db81594a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51932/0 (socket says 172.21.15.17:51932) 2023-10-06T04:44:37.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.213+0000 7f2db659c700 1 -- 172.21.15.17:0/3268727105 learned_addr learned my addr 172.21.15.17:0/3268727105 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:37.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.213+0000 7f2db6d9d700 1 --2- 172.21.15.17:0/3268727105 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2db80ccfc0 0x7f2db80cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.213+0000 7f2db759e700 1 --2- 172.21.15.17:0/3268727105 >> v2:172.21.15.136:3300/0 conn(0x7f2db80cc750 0x7f2db81599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.213+0000 7f2db659c700 1 -- 172.21.15.17:0/3268727105 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2db80ccfc0 msgr2=0x7f2db80cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:37.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.213+0000 7f2db659c700 1 --2- 172.21.15.17:0/3268727105 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2db80ccfc0 0x7f2db80cc210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.213+0000 7f2db659c700 1 -- 172.21.15.17:0/3268727105 >> v2:172.21.15.136:3300/0 conn(0x7f2db80cc750 msgr2=0x7f2db81599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:37.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.213+0000 7f2db659c700 1 --2- 172.21.15.17:0/3268727105 >> v2:172.21.15.136:3300/0 conn(0x7f2db80cc750 0x7f2db81599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.213+0000 7f2db659c700 1 -- 172.21.15.17:0/3268727105 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db80afbb0 con 0x7f2db80cf3b0 2023-10-06T04:44:37.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.213+0000 7f2db659c700 1 --2- 172.21.15.17:0/3268727105 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2db80cf3b0 0x7f2db81594a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2db80cdb60 tx=0x7f2da0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82ed61af519d1b6d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:37.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.214+0000 7f2db5d9b700 1 -- 172.21.15.17:0/3268727105 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da000b860 con 0x7f2db80cf3b0 2023-10-06T04:44:37.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.214+0000 7f2db5d9b700 1 -- 172.21.15.17:0/3268727105 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da000b9c0 con 0x7f2db80cf3b0 2023-10-06T04:44:37.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.214+0000 7f2db5d9b700 1 -- 172.21.15.17:0/3268727105 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da000bd60 con 0x7f2db80cf3b0 2023-10-06T04:44:37.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.214+0000 7f2dbc9a9700 1 -- 172.21.15.17:0/3268727105 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2db80cf3b0 msgr2=0x7f2db81594a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.214+0000 7f2dbc9a9700 1 --2- 172.21.15.17:0/3268727105 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2db80cf3b0 0x7f2db81594a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2db80cdb60 tx=0x7f2da0009250 comp rx=0 tx=0).stop 2023-10-06T04:44:37.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.214+0000 7f2dbc9a9700 1 -- 172.21.15.17:0/3268727105 shutdown_connections 2023-10-06T04:44:37.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.214+0000 7f2dbc9a9700 1 --2- 172.21.15.17:0/3268727105 >> v2:172.21.15.136:3300/0 conn(0x7f2db80cc750 0x7f2db81599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.214+0000 7f2dbc9a9700 1 --2- 172.21.15.17:0/3268727105 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2db80ccfc0 0x7f2db80cc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.214+0000 7f2dbc9a9700 1 --2- 172.21.15.17:0/3268727105 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2db80cf3b0 0x7f2db81594a0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.214+0000 7f2dbc9a9700 1 -- 172.21.15.17:0/3268727105 >> 172.21.15.17:0/3268727105 conn(0x7f2db806cff0 msgr2=0x7f2db806da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:37.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.214+0000 7f2dbc9a9700 1 -- 172.21.15.17:0/3268727105 shutdown_connections 2023-10-06T04:44:37.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.214+0000 7f2dbc9a9700 1 -- 172.21.15.17:0/3268727105 wait complete. 2023-10-06T04:44:37.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.215+0000 7f2dbc9a9700 1 Processor -- start 2023-10-06T04:44:37.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.216+0000 7f2dbc9a9700 1 -- start start 2023-10-06T04:44:37.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.216+0000 7f2dbc9a9700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2db80cc750 0x7f2db80b32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.216+0000 7f2dbc9a9700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2db80ccfc0 0x7f2db8158430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.216+0000 7f2dbc9a9700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2db80c7e60 0x7f2db8152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.216+0000 7f2dbc9a9700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db80b62f0 con 0x7f2db80c7e60 2023-10-06T04:44:37.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.216+0000 7f2dbc9a9700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db8157fa0 con 0x7f2db80cc750 2023-10-06T04:44:37.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.216+0000 7f2dbc9a9700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db80b39a0 con 0x7f2db80ccfc0 2023-10-06T04:44:37.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.216+0000 7f2db759e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2db80c7e60 0x7f2db8152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.216+0000 7f2db759e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2db80c7e60 0x7f2db8152eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51944/0 (socket says 172.21.15.17:51944) 2023-10-06T04:44:37.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.216+0000 7f2db759e700 1 -- 172.21.15.17:0/15211429 learned_addr learned my addr 172.21.15.17:0/15211429 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:37.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.217+0000 7f2db659c700 1 --2- 172.21.15.17:0/15211429 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2db80ccfc0 0x7f2db8158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.217+0000 7f2db6d9d700 1 --2- 172.21.15.17:0/15211429 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2db80cc750 0x7f2db80b32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.217+0000 7f2db759e700 1 -- 172.21.15.17:0/15211429 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2db80ccfc0 msgr2=0x7f2db8158430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.217+0000 7f2db759e700 1 --2- 172.21.15.17:0/15211429 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2db80ccfc0 0x7f2db8158430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.217+0000 7f2db759e700 1 -- 172.21.15.17:0/15211429 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2db80cc750 msgr2=0x7f2db80b32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.217+0000 7f2db759e700 1 --2- 172.21.15.17:0/15211429 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2db80cc750 0x7f2db80b32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.217+0000 7f2db759e700 1 -- 172.21.15.17:0/15211429 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da00094f0 con 0x7f2db80c7e60 2023-10-06T04:44:37.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.217+0000 7f2db6d9d700 1 --2- 172.21.15.17:0/15211429 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2db80cc750 0x7f2db80b32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:37.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.217+0000 7f2db759e700 1 --2- 172.21.15.17:0/15211429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2db80c7e60 0x7f2db8152eb0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2db000d890 tx=0x7f2db0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:37.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.217+0000 7f2daeffd700 1 -- 172.21.15.17:0/15211429 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db00125f0 con 0x7f2db80c7e60 2023-10-06T04:44:37.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.217+0000 7f2daeffd700 1 -- 172.21.15.17:0/15211429 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db0012770 con 0x7f2db80c7e60 2023-10-06T04:44:37.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.217+0000 7f2daeffd700 1 -- 172.21.15.17:0/15211429 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db0012b30 con 0x7f2db80c7e60 2023-10-06T04:44:37.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.217+0000 7f2dbc9a9700 1 -- 172.21.15.17:0/15211429 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db80b3c80 con 0x7f2db80c7e60 2023-10-06T04:44:37.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.217+0000 7f2dbc9a9700 1 -- 172.21.15.17:0/15211429 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db8158970 con 0x7f2db80c7e60 2023-10-06T04:44:37.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.218+0000 7f2dbc9a9700 1 -- 172.21.15.17:0/15211429 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db804c380 con 0x7f2db80c7e60 2023-10-06T04:44:37.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.218+0000 7f2daeffd700 1 -- 172.21.15.17:0/15211429 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2db001e460 con 0x7f2db80c7e60 2023-10-06T04:44:37.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.219+0000 7f2daeffd700 1 --2- 172.21.15.17:0/15211429 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2d98066f30 0x7f2d980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.219+0000 7f2daeffd700 1 -- 172.21.15.17:0/15211429 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f2db0084df0 con 0x7f2db80c7e60 2023-10-06T04:44:37.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.219+0000 7f2db6d9d700 1 --2- 172.21.15.17:0/15211429 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2d98066f30 0x7f2d980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.219+0000 7f2db6d9d700 1 --2- 172.21.15.17:0/15211429 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2d98066f30 0x7f2d980693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2da8007540 tx=0x7f2da800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:37.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.223+0000 7f2daeffd700 1 -- 172.21.15.17:0/15211429 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2db0055800 con 0x7f2db80c7e60 2023-10-06T04:44:37.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.463+0000 7f2dbc9a9700 1 -- 172.21.15.17:0/15211429 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2db80cea90 con 0x7f2db80c7e60 2023-10-06T04:44:37.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.464+0000 7f2daeffd700 1 -- 172.21.15.17:0/15211429 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f2db0055390 con 0x7f2db80c7e60 2023-10-06T04:44:37.466 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:37.466 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6834/3741747962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3741747962},{"type":"v1","addr":"172.21.15.136:6834","nonce":3741747962}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4688,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/264192509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6833","nonce":264192509},{"type":"v1","addr":"172.21.15.136:6835","nonce":264192509}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4909,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6836/1154731767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1154731767},{"type":"v1","addr":"172.21.15.17:6836","nonce":1154731767}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:44:14.988901+0000","modified":"2023-10-06T04:44:29.425634+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4971":{"gid":4971,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6837/460551791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6835","nonce":460551791},{"type":"v1","addr":"172.21.15.17:6837","nonce":460551791}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:44:37.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.466+0000 7f2dbc9a9700 1 -- 172.21.15.17:0/15211429 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2d98066f30 msgr2=0x7f2d980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.466+0000 7f2dbc9a9700 1 --2- 172.21.15.17:0/15211429 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2d98066f30 0x7f2d980693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2da8007540 tx=0x7f2da800b040 comp rx=0 tx=0).stop 2023-10-06T04:44:37.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.466+0000 7f2dbc9a9700 1 -- 172.21.15.17:0/15211429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2db80c7e60 msgr2=0x7f2db8152eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.466+0000 7f2dbc9a9700 1 --2- 172.21.15.17:0/15211429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2db80c7e60 0x7f2db8152eb0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2db000d890 tx=0x7f2db0008040 comp rx=0 tx=0).stop 2023-10-06T04:44:37.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.466+0000 7f2dbc9a9700 1 -- 172.21.15.17:0/15211429 shutdown_connections 2023-10-06T04:44:37.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.466+0000 7f2dbc9a9700 1 --2- 172.21.15.17:0/15211429 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2d98066f30 0x7f2d980693e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.466+0000 7f2dbc9a9700 1 --2- 172.21.15.17:0/15211429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2db80c7e60 0x7f2db8152eb0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.466+0000 7f2dbc9a9700 1 --2- 172.21.15.17:0/15211429 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2db80cc750 0x7f2db80b32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.466+0000 7f2dbc9a9700 1 --2- 172.21.15.17:0/15211429 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2db80ccfc0 0x7f2db8158430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.466+0000 7f2dbc9a9700 1 -- 172.21.15.17:0/15211429 >> 172.21.15.17:0/15211429 conn(0x7f2db806cff0 msgr2=0x7f2db80b2430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:37.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.466+0000 7f2dbc9a9700 1 -- 172.21.15.17:0/15211429 shutdown_connections 2023-10-06T04:44:37.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.466+0000 7f2dbc9a9700 1 -- 172.21.15.17:0/15211429 wait complete. 2023-10-06T04:44:37.469 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 17 2023-10-06T04:44:37.480 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:44:37.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.596+0000 7f8bbe894700 1 Processor -- start 2023-10-06T04:44:37.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.596+0000 7f8bbe894700 1 -- start start 2023-10-06T04:44:37.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.597+0000 7f8bbe894700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8bb8159630 0x7f8bb80cd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.597+0000 7f8bbe894700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8bb80cd590 0x7f8bb80ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.597+0000 7f8bbe894700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bb80cda00 con 0x7f8bb80ce840 2023-10-06T04:44:37.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.597+0000 7f8bbe894700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bb80cfc80 con 0x7f8bb80cd590 2023-10-06T04:44:37.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.597+0000 7f8bbe894700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb80cf070 con 0x7f8bb8159630 2023-10-06T04:44:37.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.597+0000 7f8bb77fe700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8bb80cd590 0x7f8bb80ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.597+0000 7f8bb77fe700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8bb80cd590 0x7f8bb80ce300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51958/0 (socket says 172.21.15.17:51958) 2023-10-06T04:44:37.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.597+0000 7f8bb77fe700 1 -- 172.21.15.17:0/1025311512 learned_addr learned my addr 172.21.15.17:0/1025311512 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:37.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.597+0000 7f8bb7fff700 1 --2- 172.21.15.17:0/1025311512 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8bb8159630 0x7f8bb80cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.597+0000 7f8bb77fe700 1 -- 172.21.15.17:0/1025311512 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8bb8159630 msgr2=0x7f8bb80cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:37.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.598+0000 7f8bb77fe700 1 --2- 172.21.15.17:0/1025311512 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8bb8159630 0x7f8bb80cd050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.598+0000 7f8bb77fe700 1 -- 172.21.15.17:0/1025311512 >> v1:172.21.15.136:6789/0 conn(0x7f8bb80ce840 legacy=0x7f8bb815d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:37.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.598+0000 7f8bb77fe700 1 -- 172.21.15.17:0/1025311512 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb80cf350 con 0x7f8bb80cd590 2023-10-06T04:44:37.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.598+0000 7f8bb77fe700 1 --2- 172.21.15.17:0/1025311512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bb80cd590 0x7f8bb80ce300 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8ba80099b0 tx=0x7f8ba8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9f124a4a578d936 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:37.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.598+0000 7f8bb6ffd700 1 -- 172.21.15.17:0/1025311512 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba800b820 con 0x7f8bb80cd590 2023-10-06T04:44:37.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.598+0000 7f8bb6ffd700 1 -- 172.21.15.17:0/1025311512 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ba800b980 con 0x7f8bb80cd590 2023-10-06T04:44:37.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.598+0000 7f8bb6ffd700 1 -- 172.21.15.17:0/1025311512 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba800bd20 con 0x7f8bb80cd590 2023-10-06T04:44:37.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.598+0000 7f8bbe894700 1 -- 172.21.15.17:0/1025311512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bb80cd590 msgr2=0x7f8bb80ce300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.598+0000 7f8bbe894700 1 --2- 172.21.15.17:0/1025311512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bb80cd590 0x7f8bb80ce300 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8ba80099b0 tx=0x7f8ba8009250 comp rx=0 tx=0).stop 2023-10-06T04:44:37.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.598+0000 7f8bbe894700 1 -- 172.21.15.17:0/1025311512 shutdown_connections 2023-10-06T04:44:37.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.598+0000 7f8bbe894700 1 --2- 172.21.15.17:0/1025311512 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8bb8159630 0x7f8bb80cd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.598+0000 7f8bbe894700 1 --2- 172.21.15.17:0/1025311512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bb80cd590 0x7f8bb80ce300 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.598+0000 7f8bbe894700 1 -- 172.21.15.17:0/1025311512 >> 172.21.15.17:0/1025311512 conn(0x7f8bb806cff0 msgr2=0x7f8bb806d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:37.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.598+0000 7f8bbe894700 1 -- 172.21.15.17:0/1025311512 shutdown_connections 2023-10-06T04:44:37.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.598+0000 7f8bbe894700 1 -- 172.21.15.17:0/1025311512 wait complete. 2023-10-06T04:44:37.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.599+0000 7f8bbe894700 1 Processor -- start 2023-10-06T04:44:37.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.600+0000 7f8bbe894700 1 -- start start 2023-10-06T04:44:37.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.600+0000 7f8bbe894700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bb80cd590 0x7f8bb81492a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.600+0000 7f8bbe894700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8bb80ce840 0x7f8bb80b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.600+0000 7f8bbe894700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8bb8159630 0x7f8bb80b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.600+0000 7f8bbe894700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb8152bf0 con 0x7f8bb80cd590 2023-10-06T04:44:37.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.600+0000 7f8bbe894700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb8151fe0 con 0x7f8bb80ce840 2023-10-06T04:44:37.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.600+0000 7f8bbe894700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb81522c0 con 0x7f8bb8159630 2023-10-06T04:44:37.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.600+0000 7f8bb7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bb80cd590 0x7f8bb81492a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.600+0000 7f8bb7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bb80cd590 0x7f8bb81492a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51960/0 (socket says 172.21.15.17:51960) 2023-10-06T04:44:37.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.600+0000 7f8bb7fff700 1 -- 172.21.15.17:0/12377098 learned_addr learned my addr 172.21.15.17:0/12377098 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:37.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.601+0000 7f8bb7fff700 1 -- 172.21.15.17:0/12377098 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8bb8159630 msgr2=0x7f8bb80b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.601+0000 7f8bb7fff700 1 --2- 172.21.15.17:0/12377098 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8bb8159630 0x7f8bb80b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.601+0000 7f8bb77fe700 1 --2- 172.21.15.17:0/12377098 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8bb80ce840 0x7f8bb80b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.601+0000 7f8bb7fff700 1 -- 172.21.15.17:0/12377098 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8bb80ce840 msgr2=0x7f8bb80b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.601+0000 7f8bb7fff700 1 --2- 172.21.15.17:0/12377098 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8bb80ce840 0x7f8bb80b15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.601+0000 7f8bb7fff700 1 -- 172.21.15.17:0/12377098 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba80094f0 con 0x7f8bb80cd590 2023-10-06T04:44:37.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.601+0000 7f8bb7fff700 1 --2- 172.21.15.17:0/12377098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bb80cd590 0x7f8bb81492a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f8ba000c880 tx=0x7f8ba0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:37.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.601+0000 7f8baffff700 1 -- 172.21.15.17:0/12377098 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba0011600 con 0x7f8bb80cd590 2023-10-06T04:44:37.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.601+0000 7f8baffff700 1 -- 172.21.15.17:0/12377098 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ba0011780 con 0x7f8bb80cd590 2023-10-06T04:44:37.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.601+0000 7f8bbe894700 1 -- 172.21.15.17:0/12377098 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb81525a0 con 0x7f8bb80cd590 2023-10-06T04:44:37.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.601+0000 7f8baffff700 1 -- 172.21.15.17:0/12377098 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba0011b40 con 0x7f8bb80cd590 2023-10-06T04:44:37.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.601+0000 7f8bbe894700 1 -- 172.21.15.17:0/12377098 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb81497e0 con 0x7f8bb80cd590 2023-10-06T04:44:37.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.602+0000 7f8bbe894700 1 -- 172.21.15.17:0/12377098 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb8063ff0 con 0x7f8bb80cd590 2023-10-06T04:44:37.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.603+0000 7f8baffff700 1 -- 172.21.15.17:0/12377098 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ba0018360 con 0x7f8bb80cd590 2023-10-06T04:44:37.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.603+0000 7f8baffff700 1 --2- 172.21.15.17:0/12377098 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8b98066f60 0x7f8b98069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.603+0000 7f8baffff700 1 -- 172.21.15.17:0/12377098 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f8ba00844f0 con 0x7f8bb80cd590 2023-10-06T04:44:37.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.603+0000 7f8bb77fe700 1 --2- 172.21.15.17:0/12377098 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8b98066f60 0x7f8b98069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.603+0000 7f8bb77fe700 1 --2- 172.21.15.17:0/12377098 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8b98066f60 0x7f8b98069410 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8ba80099b0 tx=0x7f8ba8016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:37.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.607+0000 7f8baffff700 1 -- 172.21.15.17:0/12377098 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ba0054f00 con 0x7f8bb80cd590 2023-10-06T04:44:37.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.801+0000 7f8bbe894700 1 -- 172.21.15.17:0/12377098 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8bb80cdea0 con 0x7f8bb80cd590 2023-10-06T04:44:37.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.802+0000 7f8baffff700 1 -- 172.21.15.17:0/12377098 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+18425 (secure 0 0 0) 0x7f8ba0054a90 con 0x7f8bb80cd590 2023-10-06T04:44:37.804 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:37.804 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":35,"fsid":"780777c4-2b25-4d35-9058-c9f2d62e3ad9","created":"2023-10-06T04:43:10.578520+0000","modified":"2023-10-06T04:44:30.426965+0000","last_up_change":"2023-10-06T04:43:20.682958+0000","last_in_change":"2023-10-06T04:43:12.978917+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:43:21.795733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:43:22.389592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:44:13.266447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T04:44:13.958240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":7,"pool_name":"data_new","create_time":"2023-10-06T04:44:28.154714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"84737b08-575c-46dd-9488-073ae8504494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6809","nonce":90656},{"type":"v1","addr":"172.21.15.17:6811","nonce":90656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":90656},{"type":"v1","addr":"172.21.15.17:6814","nonce":90656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":90656},{"type":"v1","addr":"172.21.15.17:6822","nonce":90656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":90656},{"type":"v1","addr":"172.21.15.17:6818","nonce":90656}]},"public_addr":"172.21.15.17:6811/90656","cluster_addr":"172.21.15.17:6814/90656","heartbeat_back_addr":"172.21.15.17:6822/90656","heartbeat_front_addr":"172.21.15.17:6818/90656","state":["exists","up"]},{"osd":1,"uuid":"dffeb740-58a2-4fd6-8ff1-a0a11a2cc709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":90655},{"type":"v1","addr":"172.21.15.17:6801","nonce":90655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":90655},{"type":"v1","addr":"172.21.15.17:6803","nonce":90655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":90655},{"type":"v1","addr":"172.21.15.17:6807","nonce":90655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":90655},{"type":"v1","addr":"172.21.15.17:6805","nonce":90655}]},"public_addr":"172.21.15.17:6801/90655","cluster_addr":"172.21.15.17:6803/90655","heartbeat_back_addr":"172.21.15.17:6807/90655","heartbeat_front_addr":"172.21.15.17:6805/90655","state":["exists","up"]},{"osd":2,"uuid":"48bd6831-763d-48c2-b515-e02c216d608b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":90657},{"type":"v1","addr":"172.21.15.17:6810","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":90657},{"type":"v1","addr":"172.21.15.17:6815","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":90657},{"type":"v1","addr":"172.21.15.17:6823","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":90657},{"type":"v1","addr":"172.21.15.17:6819","nonce":90657}]},"public_addr":"172.21.15.17:6810/90657","cluster_addr":"172.21.15.17:6815/90657","heartbeat_back_addr":"172.21.15.17:6823/90657","heartbeat_front_addr":"172.21.15.17:6819/90657","state":["exists","up"]},{"osd":3,"uuid":"ae7dbb23-abe7-4bd3-a4df-6f5963d6804c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":90688},{"type":"v1","addr":"172.21.15.17:6825","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":90688},{"type":"v1","addr":"172.21.15.17:6827","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":90688},{"type":"v1","addr":"172.21.15.17:6831","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":90688},{"type":"v1","addr":"172.21.15.17:6829","nonce":90688}]},"public_addr":"172.21.15.17:6825/90688","cluster_addr":"172.21.15.17:6827/90688","heartbeat_back_addr":"172.21.15.17:6831/90688","heartbeat_front_addr":"172.21.15.17:6829/90688","state":["exists","up"]},{"osd":4,"uuid":"29991fb4-1667-4ea3-aca0-d55db27f3bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":90902},{"type":"v1","addr":"172.21.15.136:6801","nonce":90902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":90902},{"type":"v1","addr":"172.21.15.136:6803","nonce":90902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":90902},{"type":"v1","addr":"172.21.15.136:6807","nonce":90902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":90902},{"type":"v1","addr":"172.21.15.136:6805","nonce":90902}]},"public_addr":"172.21.15.136:6801/90902","cluster_addr":"172.21.15.136:6803/90902","heartbeat_back_addr":"172.21.15.136:6807/90902","heartbeat_front_addr":"172.21.15.136:6805/90902","state":["exists","up"]},{"osd":5,"uuid":"398b4ff9-03fc-421f-882c-ba12aa088eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":90901},{"type":"v1","addr":"172.21.15.136:6809","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":90901},{"type":"v1","addr":"172.21.15.136:6811","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":90901},{"type":"v1","addr":"172.21.15.136:6815","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":90901},{"type":"v1","addr":"172.21.15.136:6813","nonce":90901}]},"public_addr":"172.21.15.136:6809/90901","cluster_addr":"172.21.15.136:6811/90901","heartbeat_back_addr":"172.21.15.136:6815/90901","heartbeat_front_addr":"172.21.15.136:6813/90901","state":["exists","up"]},{"osd":6,"uuid":"1bb91a72-4dab-4cdb-aa1d-2b8a9edf1ad0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":90927},{"type":"v1","addr":"172.21.15.136:6825","nonce":90927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":90927},{"type":"v1","addr":"172.21.15.136:6827","nonce":90927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":90927},{"type":"v1","addr":"172.21.15.136:6831","nonce":90927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":90927},{"type":"v1","addr":"172.21.15.136:6829","nonce":90927}]},"public_addr":"172.21.15.136:6825/90927","cluster_addr":"172.21.15.136:6827/90927","heartbeat_back_addr":"172.21.15.136:6831/90927","heartbeat_front_addr":"172.21.15.136:6829/90927","state":["exists","up"]},{"osd":7,"uuid":"719b654e-010d-4aa4-8c13-83fdde242b47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":90934},{"type":"v1","addr":"172.21.15.136:6817","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":90934},{"type":"v1","addr":"172.21.15.136:6819","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":90934},{"type":"v1","addr":"172.21.15.136:6824","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":90934},{"type":"v1","addr":"172.21.15.136:6821","nonce":90934}]},"public_addr":"172.21.15.136:6817/90934","cluster_addr":"172.21.15.136:6819/90934","heartbeat_back_addr":"172.21.15.136:6824/90934","heartbeat_front_addr":"172.21.15.136:6821/90934","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.157479+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.140520+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.190743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.231396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.156510+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.145822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.202888+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.139532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:44:37.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.804+0000 7f8bbe894700 1 -- 172.21.15.17:0/12377098 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8b98066f60 msgr2=0x7f8b98069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.804+0000 7f8bbe894700 1 --2- 172.21.15.17:0/12377098 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8b98066f60 0x7f8b98069410 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8ba80099b0 tx=0x7f8ba8016000 comp rx=0 tx=0).stop 2023-10-06T04:44:37.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.804+0000 7f8bbe894700 1 -- 172.21.15.17:0/12377098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bb80cd590 msgr2=0x7f8bb81492a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.804+0000 7f8bbe894700 1 --2- 172.21.15.17:0/12377098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bb80cd590 0x7f8bb81492a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f8ba000c880 tx=0x7f8ba0008040 comp rx=0 tx=0).stop 2023-10-06T04:44:37.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.804+0000 7f8bbe894700 1 -- 172.21.15.17:0/12377098 shutdown_connections 2023-10-06T04:44:37.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.804+0000 7f8bbe894700 1 --2- 172.21.15.17:0/12377098 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8b98066f60 0x7f8b98069410 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.804+0000 7f8bbe894700 1 --2- 172.21.15.17:0/12377098 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8bb8159630 0x7f8bb80b1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.804+0000 7f8bbe894700 1 --2- 172.21.15.17:0/12377098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bb80cd590 0x7f8bb81492a0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.804+0000 7f8bbe894700 1 --2- 172.21.15.17:0/12377098 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8bb80ce840 0x7f8bb80b15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.804+0000 7f8bbe894700 1 -- 172.21.15.17:0/12377098 >> 172.21.15.17:0/12377098 conn(0x7f8bb806cff0 msgr2=0x7f8bb8149b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:37.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.805+0000 7f8bbe894700 1 -- 172.21.15.17:0/12377098 shutdown_connections 2023-10-06T04:44:37.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.805+0000 7f8bbe894700 1 -- 172.21.15.17:0/12377098 wait complete. 2023-10-06T04:44:37.818 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T04:44:37.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.936+0000 7fa5e8906700 1 Processor -- start 2023-10-06T04:44:37.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.936+0000 7fa5e8906700 1 -- start start 2023-10-06T04:44:37.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.937+0000 7fa5e8906700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5e415d610 0x7fa5e40cac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.937+0000 7fa5e8906700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa5e41509a0 0x7fa5e415b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.937+0000 7fa5e8906700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5e415aed0 con 0x7fa5e40cb1b0 2023-10-06T04:44:37.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.937+0000 7fa5e8906700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5e40cb680 con 0x7fa5e41509a0 2023-10-06T04:44:37.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.937+0000 7fa5e8906700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e40cb960 con 0x7fa5e415d610 2023-10-06T04:44:37.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.937+0000 7fa5e2d9d700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa5e41509a0 0x7fa5e415b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.937+0000 7fa5e1d9b700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fa5e40cb1b0 0x7fa5e4150290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34952/0 (socket says 172.21.15.17:34952) 2023-10-06T04:44:37.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.937+0000 7fa5e1d9b700 1 -- 172.21.15.17:0/1007007611 learned_addr learned my addr 172.21.15.17:0/1007007611 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:37.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.937+0000 7fa5e259c700 1 --2- 172.21.15.17:0/1007007611 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5e415d610 0x7fa5e40cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.937+0000 7fa5e2d9d700 1 -- 172.21.15.17:0/1007007611 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5e415d610 msgr2=0x7fa5e40cac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:37.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.937+0000 7fa5e2d9d700 1 --2- 172.21.15.17:0/1007007611 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5e415d610 0x7fa5e40cac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.937+0000 7fa5e2d9d700 1 -- 172.21.15.17:0/1007007611 >> v1:172.21.15.17:6789/0 conn(0x7fa5e40cb1b0 legacy=0x7fa5e4150290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.937+0000 7fa5e2d9d700 1 -- 172.21.15.17:0/1007007611 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e40cbc40 con 0x7fa5e41509a0 2023-10-06T04:44:37.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.937+0000 7fa5e159a700 1 -- 172.21.15.17:0/1007007611 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2657407739 0 0) 0x7fa5e415aed0 con 0x7fa5e40cb1b0 2023-10-06T04:44:37.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.938+0000 7fa5e259c700 1 --2- 172.21.15.17:0/1007007611 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5e415d610 0x7fa5e40cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:37.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.938+0000 7fa5e2d9d700 1 --2- 172.21.15.17:0/1007007611 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5e41509a0 0x7fa5e415b380 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc0098e0 tx=0x7fa5dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62275a0382717c70 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:37.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.938+0000 7fa5e159a700 1 -- 172.21.15.17:0/1007007611 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc009e80 con 0x7fa5e41509a0 2023-10-06T04:44:37.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.938+0000 7fa5e159a700 1 -- 172.21.15.17:0/1007007611 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5dc00b860 con 0x7fa5e41509a0 2023-10-06T04:44:37.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.938+0000 7fa5e159a700 1 -- 172.21.15.17:0/1007007611 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc00bbe0 con 0x7fa5e41509a0 2023-10-06T04:44:37.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.938+0000 7fa5e8906700 1 -- 172.21.15.17:0/1007007611 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5e41509a0 msgr2=0x7fa5e415b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.938+0000 7fa5e8906700 1 --2- 172.21.15.17:0/1007007611 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5e41509a0 0x7fa5e415b380 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc0098e0 tx=0x7fa5dc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.938+0000 7fa5e8906700 1 -- 172.21.15.17:0/1007007611 shutdown_connections 2023-10-06T04:44:37.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.938+0000 7fa5e8906700 1 --2- 172.21.15.17:0/1007007611 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5e415d610 0x7fa5e40cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.938+0000 7fa5e8906700 1 --2- 172.21.15.17:0/1007007611 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5e41509a0 0x7fa5e415b380 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.938+0000 7fa5e8906700 1 -- 172.21.15.17:0/1007007611 >> 172.21.15.17:0/1007007611 conn(0x7fa5e4099960 msgr2=0x7fa5e406cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:37.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.938+0000 7fa5e8906700 1 -- 172.21.15.17:0/1007007611 shutdown_connections 2023-10-06T04:44:37.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.938+0000 7fa5e8906700 1 -- 172.21.15.17:0/1007007611 wait complete. 2023-10-06T04:44:37.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.939+0000 7fa5e8906700 1 Processor -- start 2023-10-06T04:44:37.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.940+0000 7fa5e8906700 1 -- start start 2023-10-06T04:44:37.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.940+0000 7fa5e8906700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5e40cb1b0 0x7fa5e40c62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.940+0000 7fa5e8906700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5e41509a0 0x7fa5e4150e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.940+0000 7fa5e8906700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5e415d610 0x7fa5e40d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.940+0000 7fa5e8906700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e40d1230 con 0x7fa5e415d610 2023-10-06T04:44:37.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.940+0000 7fa5e8906700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e4152130 con 0x7fa5e41509a0 2023-10-06T04:44:37.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.940+0000 7fa5e8906700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e4151520 con 0x7fa5e40cb1b0 2023-10-06T04:44:37.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.940+0000 7fa5e2d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5e415d610 0x7fa5e40d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.940+0000 7fa5e2d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5e415d610 0x7fa5e40d0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51978/0 (socket says 172.21.15.17:51978) 2023-10-06T04:44:37.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.940+0000 7fa5e2d9d700 1 -- 172.21.15.17:0/3235736082 learned_addr learned my addr 172.21.15.17:0/3235736082 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:37.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.940+0000 7fa5e259c700 1 --2- 172.21.15.17:0/3235736082 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5e40cb1b0 0x7fa5e40c62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.940+0000 7fa5e1d9b700 1 --2- 172.21.15.17:0/3235736082 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5e41509a0 0x7fa5e4150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.941+0000 7fa5e2d9d700 1 -- 172.21.15.17:0/3235736082 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5e40cb1b0 msgr2=0x7fa5e40c62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.941+0000 7fa5e2d9d700 1 --2- 172.21.15.17:0/3235736082 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5e40cb1b0 0x7fa5e40c62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.941+0000 7fa5e2d9d700 1 -- 172.21.15.17:0/3235736082 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5e41509a0 msgr2=0x7fa5e4150e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:37.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.941+0000 7fa5e2d9d700 1 --2- 172.21.15.17:0/3235736082 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5e41509a0 0x7fa5e4150e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:37.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.941+0000 7fa5e2d9d700 1 -- 172.21.15.17:0/3235736082 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5dc009420 con 0x7fa5e415d610 2023-10-06T04:44:37.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.941+0000 7fa5e1d9b700 1 --2- 172.21.15.17:0/3235736082 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5e41509a0 0x7fa5e4150e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:37.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.941+0000 7fa5e2d9d700 1 --2- 172.21.15.17:0/3235736082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5e415d610 0x7fa5e40d0cf0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4088ab0 tx=0x7fa5dc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:37.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.941+0000 7fa5da7fc700 1 -- 172.21.15.17:0/3235736082 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc011420 con 0x7fa5e415d610 2023-10-06T04:44:37.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.941+0000 7fa5da7fc700 1 -- 172.21.15.17:0/3235736082 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5dc011580 con 0x7fa5e415d610 2023-10-06T04:44:37.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.941+0000 7fa5da7fc700 1 -- 172.21.15.17:0/3235736082 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc011940 con 0x7fa5e415d610 2023-10-06T04:44:37.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.941+0000 7fa5e8906700 1 -- 172.21.15.17:0/3235736082 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5e4151800 con 0x7fa5e415d610 2023-10-06T04:44:37.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.941+0000 7fa5e8906700 1 -- 172.21.15.17:0/3235736082 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e4151dc0 con 0x7fa5e415d610 2023-10-06T04:44:37.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.942+0000 7fa5e8906700 1 -- 172.21.15.17:0/3235736082 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5e41524c0 con 0x7fa5e415d610 2023-10-06T04:44:37.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.942+0000 7fa5da7fc700 1 -- 172.21.15.17:0/3235736082 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa5dc02c3b0 con 0x7fa5e415d610 2023-10-06T04:44:37.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.943+0000 7fa5da7fc700 1 --2- 172.21.15.17:0/3235736082 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa5c4066f30 0x7fa5c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:37.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.943+0000 7fa5da7fc700 1 -- 172.21.15.17:0/3235736082 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6453+0+0 (secure 0 0 0) 0x7fa5dc085f60 con 0x7fa5e415d610 2023-10-06T04:44:37.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.943+0000 7fa5e259c700 1 --2- 172.21.15.17:0/3235736082 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa5c4066f30 0x7fa5c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:37.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.943+0000 7fa5e259c700 1 --2- 172.21.15.17:0/3235736082 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa5c4066f30 0x7fa5c40693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4007700 tx=0x7fa5d4009980 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:37.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:37.947+0000 7fa5da7fc700 1 -- 172.21.15.17:0/3235736082 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa5e41524c0 con 0x7fa5e415d610 2023-10-06T04:44:38.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.183+0000 7fa5e8906700 1 -- 172.21.15.17:0/3235736082 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa5e41524c0 con 0x7fa5e415d610 2023-10-06T04:44:38.185 INFO:tasks.ceph.mon.a.smithi017.stderr:2023-10-06T04:44:38.184+0000 7efe5a1a7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T04:44:38.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.188+0000 7fa5da7fc700 1 -- 172.21.15.17:0/3235736082 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa5e41524c0 con 0x7fa5e415d610 2023-10-06T04:44:38.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.191+0000 7fa5e8906700 1 -- 172.21.15.17:0/3235736082 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa5c4066f30 msgr2=0x7fa5c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:38.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.191+0000 7fa5e8906700 1 --2- 172.21.15.17:0/3235736082 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa5c4066f30 0x7fa5c40693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4007700 tx=0x7fa5d4009980 comp rx=0 tx=0).stop 2023-10-06T04:44:38.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.191+0000 7fa5e8906700 1 -- 172.21.15.17:0/3235736082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5e415d610 msgr2=0x7fa5e40d0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:38.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.191+0000 7fa5e8906700 1 --2- 172.21.15.17:0/3235736082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5e415d610 0x7fa5e40d0cf0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4088ab0 tx=0x7fa5dc017000 comp rx=0 tx=0).stop 2023-10-06T04:44:38.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.191+0000 7fa5e8906700 1 -- 172.21.15.17:0/3235736082 shutdown_connections 2023-10-06T04:44:38.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.191+0000 7fa5e8906700 1 --2- 172.21.15.17:0/3235736082 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fa5c4066f30 0x7fa5c40693e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:38.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.191+0000 7fa5e8906700 1 --2- 172.21.15.17:0/3235736082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5e415d610 0x7fa5e40d0cf0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:38.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.191+0000 7fa5e8906700 1 --2- 172.21.15.17:0/3235736082 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5e40cb1b0 0x7fa5e40c62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:38.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.191+0000 7fa5e8906700 1 --2- 172.21.15.17:0/3235736082 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5e41509a0 0x7fa5e4150e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:38.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.191+0000 7fa5e8906700 1 -- 172.21.15.17:0/3235736082 >> 172.21.15.17:0/3235736082 conn(0x7fa5e4099960 msgr2=0x7fa5e40b5490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:38.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.191+0000 7fa5e8906700 1 -- 172.21.15.17:0/3235736082 shutdown_connections 2023-10-06T04:44:38.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.191+0000 7fa5e8906700 1 -- 172.21.15.17:0/3235736082 wait complete. 2023-10-06T04:44:38.194 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T04:44:38.195 INFO:tasks.ceph.mds.a.smithi017.stderr: -8436> 2023-10-06T04:44:19.566+0000 7fc571176700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T04:44:38.209 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T04:44:38.231 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2023-10-06T04:44:38.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.330+0000 7fd299518700 1 Processor -- start 2023-10-06T04:44:38.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.330+0000 7fd299518700 1 -- start start 2023-10-06T04:44:38.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.330+0000 7fd299518700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd2940cabf0 0x7fd2940c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:38.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.330+0000 7fd299518700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd29406d140 0x7fd29406f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:38.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.330+0000 7fd299518700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2940d1120 con 0x7fd294159b10 2023-10-06T04:44:38.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.330+0000 7fd299518700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2940d1400 con 0x7fd29406d140 2023-10-06T04:44:38.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.330+0000 7fd299518700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd29406e920 con 0x7fd2940cabf0 2023-10-06T04:44:38.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.331+0000 7fd2937fe700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd29406d140 0x7fd29406f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:38.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.331+0000 7fd2937fe700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd29406d140 0x7fd29406f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51994/0 (socket says 172.21.15.17:51994) 2023-10-06T04:44:38.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.331+0000 7fd2937fe700 1 -- 172.21.15.17:0/2905998901 learned_addr learned my addr 172.21.15.17:0/2905998901 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:38.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.331+0000 7fd292ffd700 1 --2- 172.21.15.17:0/2905998901 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd2940cabf0 0x7fd2940c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:38.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.331+0000 7fd2937fe700 1 -- 172.21.15.17:0/2905998901 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd2940cabf0 msgr2=0x7fd2940c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:38.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.331+0000 7fd2937fe700 1 --2- 172.21.15.17:0/2905998901 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd2940cabf0 0x7fd2940c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:38.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.331+0000 7fd2937fe700 1 -- 172.21.15.17:0/2905998901 >> v1:172.21.15.136:6789/0 conn(0x7fd294159b10 legacy=0x7fd29406f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:38.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.331+0000 7fd2937fe700 1 -- 172.21.15.17:0/2905998901 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29406ec00 con 0x7fd29406d140 2023-10-06T04:44:38.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.331+0000 7fd2937fe700 1 --2- 172.21.15.17:0/2905998901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd29406d140 0x7fd29406f830 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd2840099b0 tx=0x7fd284009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b488fe3ec9b68196 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:38.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.331+0000 7fd291ffb700 1 -- 172.21.15.17:0/2905998901 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28400b860 con 0x7fd29406d140 2023-10-06T04:44:38.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.331+0000 7fd291ffb700 1 -- 172.21.15.17:0/2905998901 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28400b9c0 con 0x7fd29406d140 2023-10-06T04:44:38.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.331+0000 7fd291ffb700 1 -- 172.21.15.17:0/2905998901 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28400bd60 con 0x7fd29406d140 2023-10-06T04:44:38.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.332+0000 7fd299518700 1 -- 172.21.15.17:0/2905998901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd29406d140 msgr2=0x7fd29406f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:38.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.332+0000 7fd299518700 1 --2- 172.21.15.17:0/2905998901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd29406d140 0x7fd29406f830 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd2840099b0 tx=0x7fd284009250 comp rx=0 tx=0).stop 2023-10-06T04:44:38.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.332+0000 7fd299518700 1 -- 172.21.15.17:0/2905998901 shutdown_connections 2023-10-06T04:44:38.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.332+0000 7fd299518700 1 --2- 172.21.15.17:0/2905998901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd29406d140 0x7fd29406f830 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:38.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.332+0000 7fd299518700 1 --2- 172.21.15.17:0/2905998901 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd2940cabf0 0x7fd2940c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:38.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.332+0000 7fd299518700 1 -- 172.21.15.17:0/2905998901 >> 172.21.15.17:0/2905998901 conn(0x7fd29406cd40 msgr2=0x7fd2940d0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:38.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.332+0000 7fd299518700 1 -- 172.21.15.17:0/2905998901 shutdown_connections 2023-10-06T04:44:38.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.332+0000 7fd299518700 1 -- 172.21.15.17:0/2905998901 wait complete. 2023-10-06T04:44:38.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.333+0000 7fd299518700 1 Processor -- start 2023-10-06T04:44:38.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.333+0000 7fd299518700 1 -- start start 2023-10-06T04:44:38.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.334+0000 7fd299518700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd29406d140 0x7fd294156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:38.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.334+0000 7fd299518700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd2940cabf0 0x7fd29409d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:38.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.334+0000 7fd299518700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd294159b10 0x7fd29409d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:38.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.334+0000 7fd299518700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29409a240 con 0x7fd294159b10 2023-10-06T04:44:38.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.334+0000 7fd299518700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29409df20 con 0x7fd2940cabf0 2023-10-06T04:44:38.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.334+0000 7fd299518700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2940b4c40 con 0x7fd29406d140 2023-10-06T04:44:38.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.334+0000 7fd2937fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd294159b10 0x7fd29409d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:38.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.334+0000 7fd292ffd700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd29406d140 0x7fd294156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:38.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.334+0000 7fd2937fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd294159b10 0x7fd29409d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51996/0 (socket says 172.21.15.17:51996) 2023-10-06T04:44:38.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.334+0000 7fd2937fe700 1 -- 172.21.15.17:0/2039741218 learned_addr learned my addr 172.21.15.17:0/2039741218 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:38.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.334+0000 7fd2927fc700 1 --2- 172.21.15.17:0/2039741218 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd2940cabf0 0x7fd29409d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:38.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.334+0000 7fd2937fe700 1 -- 172.21.15.17:0/2039741218 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd29406d140 msgr2=0x7fd294156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:38.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.334+0000 7fd2937fe700 1 --2- 172.21.15.17:0/2039741218 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd29406d140 0x7fd294156ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:38.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.334+0000 7fd2937fe700 1 -- 172.21.15.17:0/2039741218 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd2940cabf0 msgr2=0x7fd29409d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:38.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.334+0000 7fd2937fe700 1 --2- 172.21.15.17:0/2039741218 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd2940cabf0 0x7fd29409d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:38.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.334+0000 7fd2937fe700 1 -- 172.21.15.17:0/2039741218 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2840094f0 con 0x7fd294159b10 2023-10-06T04:44:38.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.334+0000 7fd2937fe700 1 --2- 172.21.15.17:0/2039741218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd294159b10 0x7fd29409d9e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd294064590 tx=0x7fd284017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:38.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.335+0000 7fd28affd700 1 -- 172.21.15.17:0/2039741218 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28400b860 con 0x7fd294159b10 2023-10-06T04:44:38.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.335+0000 7fd28affd700 1 -- 172.21.15.17:0/2039741218 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28401a630 con 0x7fd294159b10 2023-10-06T04:44:38.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.335+0000 7fd299518700 1 -- 172.21.15.17:0/2039741218 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2940b4f20 con 0x7fd294159b10 2023-10-06T04:44:38.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.335+0000 7fd28affd700 1 -- 172.21.15.17:0/2039741218 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28401aa10 con 0x7fd294159b10 2023-10-06T04:44:38.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.335+0000 7fd299518700 1 -- 172.21.15.17:0/2039741218 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd29409a770 con 0x7fd294159b10 2023-10-06T04:44:38.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.336+0000 7fd299518700 1 -- 172.21.15.17:0/2039741218 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd29409a960 con 0x7fd294159b10 2023-10-06T04:44:38.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.336+0000 7fd28affd700 1 -- 172.21.15.17:0/2039741218 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd28402d440 con 0x7fd294159b10 2023-10-06T04:44:38.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.336+0000 7fd28affd700 1 --2- 172.21.15.17:0/2039741218 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd274066f30 0x7fd2740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:38.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.336+0000 7fd28affd700 1 -- 172.21.15.17:0/2039741218 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6539+0+0 (secure 0 0 0) 0x7fd284086330 con 0x7fd294159b10 2023-10-06T04:44:38.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.336+0000 7fd292ffd700 1 --2- 172.21.15.17:0/2039741218 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd274066f30 0x7fd2740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:38.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.337+0000 7fd292ffd700 1 --2- 172.21.15.17:0/2039741218 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd274066f30 0x7fd2740693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd28c007680 tx=0x7fd28c0098d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:38.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.341+0000 7fd28affd700 1 -- 172.21.15.17:0/2039741218 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd284053260 con 0x7fd294159b10 2023-10-06T04:44:38.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:38.581+0000 7fd299518700 1 -- 172.21.15.17:0/2039741218 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd29404c380 con 0x7fd294159b10 2023-10-06T04:44:39.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.191+0000 7fd28affd700 1 -- 172.21.15.17:0/2039741218 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd284056880 con 0x7fd294159b10 2023-10-06T04:44:39.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.194+0000 7fd299518700 1 -- 172.21.15.17:0/2039741218 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd274066f30 msgr2=0x7fd2740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:39.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.194+0000 7fd299518700 1 --2- 172.21.15.17:0/2039741218 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd274066f30 0x7fd2740693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd28c007680 tx=0x7fd28c0098d0 comp rx=0 tx=0).stop 2023-10-06T04:44:39.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.194+0000 7fd299518700 1 -- 172.21.15.17:0/2039741218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd294159b10 msgr2=0x7fd29409d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:39.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.194+0000 7fd299518700 1 --2- 172.21.15.17:0/2039741218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd294159b10 0x7fd29409d9e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd294064590 tx=0x7fd284017000 comp rx=0 tx=0).stop 2023-10-06T04:44:39.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.194+0000 7fd299518700 1 -- 172.21.15.17:0/2039741218 shutdown_connections 2023-10-06T04:44:39.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.194+0000 7fd299518700 1 --2- 172.21.15.17:0/2039741218 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd274066f30 0x7fd2740693e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:39.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.194+0000 7fd299518700 1 --2- 172.21.15.17:0/2039741218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd294159b10 0x7fd29409d9e0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:39.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.194+0000 7fd299518700 1 --2- 172.21.15.17:0/2039741218 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd29406d140 0x7fd294156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:39.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.194+0000 7fd299518700 1 --2- 172.21.15.17:0/2039741218 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd2940cabf0 0x7fd29409d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:39.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.194+0000 7fd299518700 1 -- 172.21.15.17:0/2039741218 >> 172.21.15.17:0/2039741218 conn(0x7fd29406cd40 msgr2=0x7fd294158990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:39.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.194+0000 7fd299518700 1 -- 172.21.15.17:0/2039741218 shutdown_connections 2023-10-06T04:44:39.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.194+0000 7fd299518700 1 -- 172.21.15.17:0/2039741218 wait complete. 2023-10-06T04:44:39.210 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T04:44:39.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.381+0000 7f6ec26ac700 1 Processor -- start 2023-10-06T04:44:39.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.381+0000 7f6ec26ac700 1 -- start start 2023-10-06T04:44:39.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.381+0000 7f6ec26ac700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6ebc15d110 0x7f6ebc06f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:39.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.381+0000 7f6ec26ac700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ebc0b0b00 con 0x7f6ebc06dd80 2023-10-06T04:44:39.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.381+0000 7f6ec26ac700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ebc06e280 con 0x7f6ebc0ce720 2023-10-06T04:44:39.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.381+0000 7f6ec26ac700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ebc06e560 con 0x7f6ebc15d110 2023-10-06T04:44:39.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.382+0000 7f6ec0c49700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6ebc15d110 0x7f6ebc06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:39.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.382+0000 7f6ebb7fe700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f6ebc06dd80 0x7f6ebc15ca00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34978/0 (socket says 172.21.15.17:34978) 2023-10-06T04:44:39.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.382+0000 7f6ebb7fe700 1 -- 172.21.15.17:0/1139351537 learned_addr learned my addr 172.21.15.17:0/1139351537 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:39.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.382+0000 7f6ec0c49700 1 -- 172.21.15.17:0/1139351537 >> v1:172.21.15.136:6789/0 conn(0x7f6ebc0ce720 legacy=0x7f6ebc06d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:39.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.382+0000 7f6ec0c49700 1 -- 172.21.15.17:0/1139351537 >> v1:172.21.15.17:6789/0 conn(0x7f6ebc06dd80 legacy=0x7f6ebc15ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:39.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.382+0000 7f6ec0c49700 1 -- 172.21.15.17:0/1139351537 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ebc06e840 con 0x7f6ebc15d110 2023-10-06T04:44:39.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.382+0000 7f6ebaffd700 1 -- 172.21.15.17:0/1139351537 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 29793355 0 0) 0x7f6ebc0b0b00 con 0x7f6ebc06dd80 2023-10-06T04:44:39.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.382+0000 7f6ec0c49700 1 --2- 172.21.15.17:0/1139351537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ebc15d110 0x7f6ebc06f320 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4009e60 tx=0x7f6eb4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d35c186f39472d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:39.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.382+0000 7f6ebaffd700 1 -- 172.21.15.17:0/1139351537 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb400e070 con 0x7f6ebc15d110 2023-10-06T04:44:39.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.382+0000 7f6ebaffd700 1 -- 172.21.15.17:0/1139351537 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb400bc30 con 0x7f6ebc15d110 2023-10-06T04:44:39.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.382+0000 7f6ebaffd700 1 -- 172.21.15.17:0/1139351537 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb4012430 con 0x7f6ebc15d110 2023-10-06T04:44:39.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.383+0000 7f6ec26ac700 1 -- 172.21.15.17:0/1139351537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ebc15d110 msgr2=0x7f6ebc06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:39.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.383+0000 7f6ec26ac700 1 --2- 172.21.15.17:0/1139351537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ebc15d110 0x7f6ebc06f320 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4009e60 tx=0x7f6eb4009780 comp rx=0 tx=0).stop 2023-10-06T04:44:39.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.383+0000 7f6ec26ac700 1 -- 172.21.15.17:0/1139351537 shutdown_connections 2023-10-06T04:44:39.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.383+0000 7f6ec26ac700 1 --2- 172.21.15.17:0/1139351537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ebc15d110 0x7f6ebc06f320 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:39.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.383+0000 7f6ec26ac700 1 -- 172.21.15.17:0/1139351537 >> 172.21.15.17:0/1139351537 conn(0x7f6ebc070440 msgr2=0x7f6ebc070840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:39.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.383+0000 7f6ec26ac700 1 -- 172.21.15.17:0/1139351537 shutdown_connections 2023-10-06T04:44:39.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.383+0000 7f6ec26ac700 1 -- 172.21.15.17:0/1139351537 wait complete. 2023-10-06T04:44:39.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.384+0000 7f6ec26ac700 1 Processor -- start 2023-10-06T04:44:39.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.384+0000 7f6ec26ac700 1 -- start start 2023-10-06T04:44:39.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.385+0000 7f6ec26ac700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6ebc06dd80 0x7f6ebc15b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:39.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.385+0000 7f6ec26ac700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ebc0ce720 0x7f6ebc0c4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:39.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.385+0000 7f6ec26ac700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ebc15d110 0x7f6ebc0aa950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:39.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.385+0000 7f6ec26ac700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc0b2350 con 0x7f6ebc0ce720 2023-10-06T04:44:39.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.385+0000 7f6ec26ac700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc0b25a0 con 0x7f6ebc15d110 2023-10-06T04:44:39.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.385+0000 7f6ec26ac700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc0b2880 con 0x7f6ebc06dd80 2023-10-06T04:44:39.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.385+0000 7f6ebb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ebc0ce720 0x7f6ebc0c4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:39.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.385+0000 7f6ebb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ebc0ce720 0x7f6ebc0c4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52028/0 (socket says 172.21.15.17:52028) 2023-10-06T04:44:39.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.385+0000 7f6ebb7fe700 1 -- 172.21.15.17:0/2177320296 learned_addr learned my addr 172.21.15.17:0/2177320296 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:39.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.385+0000 7f6ec0c49700 1 --2- 172.21.15.17:0/2177320296 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ebc15d110 0x7f6ebc0aa950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:39.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.385+0000 7f6ebbfff700 1 --2- 172.21.15.17:0/2177320296 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6ebc06dd80 0x7f6ebc15b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:39.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.385+0000 7f6ebb7fe700 1 -- 172.21.15.17:0/2177320296 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6ebc06dd80 msgr2=0x7f6ebc15b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:39.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.385+0000 7f6ebb7fe700 1 --2- 172.21.15.17:0/2177320296 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6ebc06dd80 0x7f6ebc15b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:39.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.385+0000 7f6ebb7fe700 1 -- 172.21.15.17:0/2177320296 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ebc15d110 msgr2=0x7f6ebc0aa950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:39.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.385+0000 7f6ebb7fe700 1 --2- 172.21.15.17:0/2177320296 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ebc15d110 0x7f6ebc0aa950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:39.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.385+0000 7f6ebb7fe700 1 -- 172.21.15.17:0/2177320296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb4009a20 con 0x7f6ebc0ce720 2023-10-06T04:44:39.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.385+0000 7f6ebbfff700 1 --2- 172.21.15.17:0/2177320296 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6ebc06dd80 0x7f6ebc15b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:39.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.385+0000 7f6ec0c49700 1 --2- 172.21.15.17:0/2177320296 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ebc15d110 0x7f6ebc0aa950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:39.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.386+0000 7f6ebb7fe700 1 --2- 172.21.15.17:0/2177320296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ebc0ce720 0x7f6ebc0c4310 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f6eb000c810 tx=0x7f6eb0007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:39.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.386+0000 7f6ea3fff700 1 -- 172.21.15.17:0/2177320296 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb0005c00 con 0x7f6ebc0ce720 2023-10-06T04:44:39.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.386+0000 7f6ea3fff700 1 -- 172.21.15.17:0/2177320296 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb0005d60 con 0x7f6ebc0ce720 2023-10-06T04:44:39.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.386+0000 7f6ec26ac700 1 -- 172.21.15.17:0/2177320296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ebc0b2b60 con 0x7f6ebc0ce720 2023-10-06T04:44:39.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.386+0000 7f6ea3fff700 1 -- 172.21.15.17:0/2177320296 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb0007320 con 0x7f6ebc0ce720 2023-10-06T04:44:39.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.386+0000 7f6ec26ac700 1 -- 172.21.15.17:0/2177320296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ebc15bac0 con 0x7f6ebc0ce720 2023-10-06T04:44:39.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.387+0000 7f6ec26ac700 1 -- 172.21.15.17:0/2177320296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ebc0b3080 con 0x7f6ebc0ce720 2023-10-06T04:44:39.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.387+0000 7f6ea3fff700 1 -- 172.21.15.17:0/2177320296 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6eb001b400 con 0x7f6ebc0ce720 2023-10-06T04:44:39.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.387+0000 7f6ea3fff700 1 --2- 172.21.15.17:0/2177320296 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6ea8066f30 0x7f6ea80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:39.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.388+0000 7f6ea3fff700 1 -- 172.21.15.17:0/2177320296 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6539+0+0 (secure 0 0 0) 0x7f6eb0084350 con 0x7f6ebc0ce720 2023-10-06T04:44:39.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.388+0000 7f6ebbfff700 1 --2- 172.21.15.17:0/2177320296 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6ea8066f30 0x7f6ea80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:39.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.388+0000 7f6ebbfff700 1 --2- 172.21.15.17:0/2177320296 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6ea8066f30 0x7f6ea80693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6eac007fd0 tx=0x7f6eac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:39.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.392+0000 7f6ea3fff700 1 -- 172.21.15.17:0/2177320296 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ebc0b3080 con 0x7f6ebc0ce720 2023-10-06T04:44:39.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:39.585+0000 7f6ec26ac700 1 -- 172.21.15.17:0/2177320296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6ebc0b3080 con 0x7f6ebc0ce720 2023-10-06T04:44:40.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.459+0000 7f6ea3fff700 1 -- 172.21.15.17:0/2177320296 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v37) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6ebc0b3080 con 0x7f6ebc0ce720 2023-10-06T04:44:40.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.463+0000 7f6ec26ac700 1 -- 172.21.15.17:0/2177320296 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6ea8066f30 msgr2=0x7f6ea80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:40.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.463+0000 7f6ec26ac700 1 --2- 172.21.15.17:0/2177320296 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6ea8066f30 0x7f6ea80693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6eac007fd0 tx=0x7f6eac009040 comp rx=0 tx=0).stop 2023-10-06T04:44:40.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.463+0000 7f6ec26ac700 1 -- 172.21.15.17:0/2177320296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ebc0ce720 msgr2=0x7f6ebc0c4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:40.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.463+0000 7f6ec26ac700 1 --2- 172.21.15.17:0/2177320296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ebc0ce720 0x7f6ebc0c4310 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f6eb000c810 tx=0x7f6eb0007db0 comp rx=0 tx=0).stop 2023-10-06T04:44:40.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.463+0000 7f6ec26ac700 1 -- 172.21.15.17:0/2177320296 shutdown_connections 2023-10-06T04:44:40.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.463+0000 7f6ec26ac700 1 --2- 172.21.15.17:0/2177320296 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f6ea8066f30 0x7f6ea80693e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:40.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.463+0000 7f6ec26ac700 1 --2- 172.21.15.17:0/2177320296 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ebc15d110 0x7f6ebc0aa950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:40.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.463+0000 7f6ec26ac700 1 --2- 172.21.15.17:0/2177320296 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6ebc06dd80 0x7f6ebc15b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:40.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.463+0000 7f6ec26ac700 1 --2- 172.21.15.17:0/2177320296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ebc0ce720 0x7f6ebc0c4310 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:40.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.463+0000 7f6ec26ac700 1 -- 172.21.15.17:0/2177320296 >> 172.21.15.17:0/2177320296 conn(0x7f6ebc070440 msgr2=0x7f6ebc0c75f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:40.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.464+0000 7f6ec26ac700 1 -- 172.21.15.17:0/2177320296 shutdown_connections 2023-10-06T04:44:40.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.464+0000 7f6ec26ac700 1 -- 172.21.15.17:0/2177320296 wait complete. 2023-10-06T04:44:40.467 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2023-10-06T04:44:40.480 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T04:44:40.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.614+0000 7fae2a4a9700 1 Processor -- start 2023-10-06T04:44:40.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.614+0000 7fae2a4a9700 1 -- start start 2023-10-06T04:44:40.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.614+0000 7fae2a4a9700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fae24150360 0x7fae24150730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:40.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.615+0000 7fae2a4a9700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae240cc050 con 0x7fae240cb6b0 2023-10-06T04:44:40.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.615+0000 7fae2a4a9700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae2415b130 con 0x7fae240cbb50 2023-10-06T04:44:40.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.615+0000 7fae2a4a9700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae240cc330 con 0x7fae24150360 2023-10-06T04:44:40.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.615+0000 7fae237fe700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fae240cb6b0 0x7fae240cd050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34986/0 (socket says 172.21.15.17:34986) 2023-10-06T04:44:40.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.615+0000 7fae237fe700 1 -- 172.21.15.17:0/1410948388 learned_addr learned my addr 172.21.15.17:0/1410948388 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:40.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.615+0000 7fae23fff700 1 --2- 172.21.15.17:0/1410948388 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fae24150360 0x7fae24150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:40.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.615+0000 7fae22ffd700 1 -- 172.21.15.17:0/1410948388 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3893893014 0 0) 0x7fae240cc050 con 0x7fae240cb6b0 2023-10-06T04:44:40.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.615+0000 7fae22ffd700 1 -- 172.21.15.17:0/1410948388 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae10003570 con 0x7fae240cb6b0 2023-10-06T04:44:40.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.615+0000 7fae22ffd700 1 -- 172.21.15.17:0/1410948388 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1212224953 0 0) 0x7fae2415b130 con 0x7fae240cbb50 2023-10-06T04:44:40.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.615+0000 7fae22ffd700 1 -- 172.21.15.17:0/1410948388 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae240cc050 con 0x7fae240cbb50 2023-10-06T04:44:40.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.615+0000 7fae22ffd700 1 -- 172.21.15.17:0/1410948388 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4032311387 0 0) 0x7fae10003570 con 0x7fae240cb6b0 2023-10-06T04:44:40.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.615+0000 7fae22ffd700 1 -- 172.21.15.17:0/1410948388 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fae24150360 msgr2=0x7fae24150730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:40.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.615+0000 7fae22ffd700 1 --2- 172.21.15.17:0/1410948388 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fae24150360 0x7fae24150730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:40.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.615+0000 7fae22ffd700 1 -- 172.21.15.17:0/1410948388 >> v1:172.21.15.136:6789/0 conn(0x7fae240cbb50 legacy=0x7fae24159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:40.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.615+0000 7fae22ffd700 1 -- 172.21.15.17:0/1410948388 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae2415b410 con 0x7fae240cb6b0 2023-10-06T04:44:40.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.615+0000 7fae22ffd700 1 -- 172.21.15.17:0/1410948388 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4268781140 0 0) 0x7fae14001470 con 0x7fae240cb6b0 2023-10-06T04:44:40.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.615+0000 7fae23fff700 1 --2- 172.21.15.17:0/1410948388 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fae24150360 0x7fae24150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:44:40.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.615+0000 7fae22ffd700 1 -- 172.21.15.17:0/1410948388 >> v1:172.21.15.17:6789/0 conn(0x7fae240cb6b0 legacy=0x7fae240cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:40.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.615+0000 7fae22ffd700 1 --2- 172.21.15.17:0/1410948388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae10003c20 0x7fae10004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:40.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.615+0000 7fae22ffd700 1 --2- 172.21.15.17:0/1410948388 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae10004810 0x7fae10004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:40.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.615+0000 7fae22ffd700 1 --2- 172.21.15.17:0/1410948388 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fae24150360 0x7fae100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:40.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.615+0000 7fae22ffd700 1 -- 172.21.15.17:0/1410948388 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae240cc330 con 0x7fae10003c20 2023-10-06T04:44:40.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.615+0000 7fae22ffd700 1 -- 172.21.15.17:0/1410948388 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1000bb10 con 0x7fae10004810 2023-10-06T04:44:40.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.615+0000 7fae22ffd700 1 -- 172.21.15.17:0/1410948388 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae1000bcd0 con 0x7fae24150360 2023-10-06T04:44:40.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.615+0000 7fae23fff700 1 --2- 172.21.15.17:0/1410948388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae10003c20 0x7fae10004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:40.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.616+0000 7fae237fe700 1 --2- 172.21.15.17:0/1410948388 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae10004810 0x7fae10004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:40.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.616+0000 7fae28a46700 1 --2- 172.21.15.17:0/1410948388 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fae24150360 0x7fae100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:40.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.616+0000 7fae23fff700 1 -- 172.21.15.17:0/1410948388 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fae24150360 msgr2=0x7fae100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:40.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.616+0000 7fae23fff700 1 --2- 172.21.15.17:0/1410948388 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fae24150360 0x7fae100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:40.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.616+0000 7fae23fff700 1 -- 172.21.15.17:0/1410948388 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae10004810 msgr2=0x7fae10004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:40.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.616+0000 7fae23fff700 1 --2- 172.21.15.17:0/1410948388 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae10004810 0x7fae10004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:40.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.616+0000 7fae23fff700 1 -- 172.21.15.17:0/1410948388 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae0c009420 con 0x7fae10003c20 2023-10-06T04:44:40.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.616+0000 7fae23fff700 1 --2- 172.21.15.17:0/1410948388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae10003c20 0x7fae10004010 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fae0c009df0 tx=0x7fae0c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f7f166ba33d4f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:40.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.616+0000 7fae22ffd700 1 -- 172.21.15.17:0/1410948388 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c009740 con 0x7fae10003c20 2023-10-06T04:44:40.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.616+0000 7fae22ffd700 1 -- 172.21.15.17:0/1410948388 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0c00e920 con 0x7fae10003c20 2023-10-06T04:44:40.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.616+0000 7fae22ffd700 1 -- 172.21.15.17:0/1410948388 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c00ece0 con 0x7fae10003c20 2023-10-06T04:44:40.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.616+0000 7fae2a4a9700 1 -- 172.21.15.17:0/1410948388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae10003c20 msgr2=0x7fae10004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:40.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.616+0000 7fae2a4a9700 1 --2- 172.21.15.17:0/1410948388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae10003c20 0x7fae10004010 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fae0c009df0 tx=0x7fae0c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:40.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.616+0000 7fae28a46700 1 -- 172.21.15.17:0/1410948388 reap_dead start 2023-10-06T04:44:40.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.617+0000 7fae2a4a9700 1 -- 172.21.15.17:0/1410948388 shutdown_connections 2023-10-06T04:44:40.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.617+0000 7fae2a4a9700 1 -- 172.21.15.17:0/1410948388 >> 172.21.15.17:0/1410948388 conn(0x7fae2408a180 msgr2=0x7fae24099aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:40.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.617+0000 7fae2a4a9700 1 -- 172.21.15.17:0/1410948388 shutdown_connections 2023-10-06T04:44:40.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.617+0000 7fae2a4a9700 1 -- 172.21.15.17:0/1410948388 wait complete. 2023-10-06T04:44:40.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.618+0000 7fae2a4a9700 1 Processor -- start 2023-10-06T04:44:40.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.618+0000 7fae2a4a9700 1 -- start start 2023-10-06T04:44:40.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.619+0000 7fae2a4a9700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae10003c20 0x7fae240c5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:40.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.619+0000 7fae2a4a9700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae2414fca0 0x7fae2416aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:40.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.619+0000 7fae2a4a9700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fae24152000 0x7fae24152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:40.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.619+0000 7fae2a4a9700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae240c4fe0 con 0x7fae10003c20 2023-10-06T04:44:40.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.619+0000 7fae2a4a9700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae240c43d0 con 0x7fae2414fca0 2023-10-06T04:44:40.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.619+0000 7fae2a4a9700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae240c46b0 con 0x7fae24152000 2023-10-06T04:44:40.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.619+0000 7fae23fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae10003c20 0x7fae240c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:40.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.619+0000 7fae23fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae10003c20 0x7fae240c5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52046/0 (socket says 172.21.15.17:52046) 2023-10-06T04:44:40.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.619+0000 7fae23fff700 1 -- 172.21.15.17:0/55975240 learned_addr learned my addr 172.21.15.17:0/55975240 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:40.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.619+0000 7fae28a46700 1 --2- 172.21.15.17:0/55975240 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fae24152000 0x7fae24152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:40.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.619+0000 7fae23fff700 1 -- 172.21.15.17:0/55975240 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fae24152000 msgr2=0x7fae24152470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:40.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.619+0000 7fae23fff700 1 --2- 172.21.15.17:0/55975240 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fae24152000 0x7fae24152470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:40.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.619+0000 7fae23fff700 1 -- 172.21.15.17:0/55975240 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae2414fca0 msgr2=0x7fae2416aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:40.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.619+0000 7fae23fff700 1 --2- 172.21.15.17:0/55975240 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae2414fca0 0x7fae2416aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:40.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.619+0000 7fae23fff700 1 -- 172.21.15.17:0/55975240 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae240c4990 con 0x7fae10003c20 2023-10-06T04:44:40.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.619+0000 7fae23fff700 1 --2- 172.21.15.17:0/55975240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae10003c20 0x7fae240c5470 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fae0c0091e0 tx=0x7fae0c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:40.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.619+0000 7fae1bfff700 1 -- 172.21.15.17:0/55975240 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c022070 con 0x7fae10003c20 2023-10-06T04:44:40.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.619+0000 7fae1bfff700 1 -- 172.21.15.17:0/55975240 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0c013be0 con 0x7fae10003c20 2023-10-06T04:44:40.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.619+0000 7fae2a4a9700 1 -- 172.21.15.17:0/55975240 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae240c4c70 con 0x7fae10003c20 2023-10-06T04:44:40.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.619+0000 7fae1bfff700 1 -- 172.21.15.17:0/55975240 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c01c450 con 0x7fae10003c20 2023-10-06T04:44:40.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.619+0000 7fae2a4a9700 1 -- 172.21.15.17:0/55975240 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae24150110 con 0x7fae10003c20 2023-10-06T04:44:40.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.620+0000 7fae2a4a9700 1 -- 172.21.15.17:0/55975240 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae240c52c0 con 0x7fae10003c20 2023-10-06T04:44:40.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.621+0000 7fae1bfff700 1 -- 172.21.15.17:0/55975240 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fae0c026070 con 0x7fae10003c20 2023-10-06T04:44:40.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.621+0000 7fae1bfff700 1 --2- 172.21.15.17:0/55975240 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fae04066f30 0x7fae040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:40.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.621+0000 7fae1bfff700 1 -- 172.21.15.17:0/55975240 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fae0c085fe0 con 0x7fae10003c20 2023-10-06T04:44:40.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.621+0000 7fae237fe700 1 --2- 172.21.15.17:0/55975240 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fae04066f30 0x7fae040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:40.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.621+0000 7fae237fe700 1 --2- 172.21.15.17:0/55975240 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fae04066f30 0x7fae040693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fae14001660 tx=0x7fae14000ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:40.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.625+0000 7fae1bfff700 1 -- 172.21.15.17:0/55975240 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fae0c053100 con 0x7fae10003c20 2023-10-06T04:44:40.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:40.819+0000 7fae2a4a9700 1 -- 172.21.15.17:0/55975240 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fae240718b0 con 0x7fae10003c20 2023-10-06T04:44:41.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.464+0000 7fae1bfff700 1 -- 172.21.15.17:0/55975240 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v38) v1 ==== 169+0+0 (secure 0 0 0) 0x7fae0c0566e0 con 0x7fae10003c20 2023-10-06T04:44:41.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.467+0000 7fae2a4a9700 1 -- 172.21.15.17:0/55975240 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fae04066f30 msgr2=0x7fae040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:41.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.467+0000 7fae2a4a9700 1 --2- 172.21.15.17:0/55975240 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fae04066f30 0x7fae040693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fae14001660 tx=0x7fae14000ed0 comp rx=0 tx=0).stop 2023-10-06T04:44:41.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.468+0000 7fae2a4a9700 1 -- 172.21.15.17:0/55975240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae10003c20 msgr2=0x7fae240c5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:41.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.468+0000 7fae2a4a9700 1 --2- 172.21.15.17:0/55975240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae10003c20 0x7fae240c5470 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fae0c0091e0 tx=0x7fae0c01a000 comp rx=0 tx=0).stop 2023-10-06T04:44:41.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.468+0000 7fae2a4a9700 1 -- 172.21.15.17:0/55975240 shutdown_connections 2023-10-06T04:44:41.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.468+0000 7fae2a4a9700 1 --2- 172.21.15.17:0/55975240 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fae04066f30 0x7fae040693e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:41.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.468+0000 7fae2a4a9700 1 --2- 172.21.15.17:0/55975240 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fae24152000 0x7fae24152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:41.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.468+0000 7fae2a4a9700 1 --2- 172.21.15.17:0/55975240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae10003c20 0x7fae240c5470 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:41.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.468+0000 7fae2a4a9700 1 --2- 172.21.15.17:0/55975240 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae2414fca0 0x7fae2416aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:41.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.468+0000 7fae2a4a9700 1 -- 172.21.15.17:0/55975240 >> 172.21.15.17:0/55975240 conn(0x7fae2408a180 msgr2=0x7fae240cf6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:41.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.468+0000 7fae2a4a9700 1 -- 172.21.15.17:0/55975240 shutdown_connections 2023-10-06T04:44:41.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.468+0000 7fae2a4a9700 1 -- 172.21.15.17:0/55975240 wait complete. 2023-10-06T04:44:41.472 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2023-10-06T04:44:41.486 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm data_new data_new --yes-i-really-really-mean-it 2023-10-06T04:44:41.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.614+0000 7f07fc183700 1 Processor -- start 2023-10-06T04:44:41.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.614+0000 7f07fc183700 1 -- start start 2023-10-06T04:44:41.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.615+0000 7f07fc183700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f07f4150360 0x7f07f4150730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:41.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.615+0000 7f07fc183700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f07f40cbb50 0x7f07f4159e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:41.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.615+0000 7f07fc183700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f40cc050 con 0x7f07f40cb6b0 2023-10-06T04:44:41.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.615+0000 7f07fc183700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f40cc330 con 0x7f07f40cbb50 2023-10-06T04:44:41.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.615+0000 7f07fc183700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f415b130 con 0x7f07f4150360 2023-10-06T04:44:41.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.615+0000 7f07fa720700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f07f40cbb50 0x7f07f4159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:41.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.615+0000 7f07fa720700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f07f40cbb50 0x7f07f4159e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46048/0 (socket says 172.21.15.17:46048) 2023-10-06T04:44:41.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.615+0000 7f07fa720700 1 -- 172.21.15.17:0/3259786702 learned_addr learned my addr 172.21.15.17:0/3259786702 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:41.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.615+0000 7f07f9f1f700 1 --2- 172.21.15.17:0/3259786702 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f07f4150360 0x7f07f4150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:41.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.615+0000 7f07fa720700 1 -- 172.21.15.17:0/3259786702 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f07f4150360 msgr2=0x7f07f4150730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:41.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.615+0000 7f07fa720700 1 --2- 172.21.15.17:0/3259786702 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f07f4150360 0x7f07f4150730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:41.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.615+0000 7f07fa720700 1 -- 172.21.15.17:0/3259786702 >> v1:172.21.15.136:6789/0 conn(0x7f07f40cb6b0 legacy=0x7f07f40cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:41.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.615+0000 7f07fa720700 1 -- 172.21.15.17:0/3259786702 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f415b410 con 0x7f07f40cbb50 2023-10-06T04:44:41.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.615+0000 7f07fa720700 1 --2- 172.21.15.17:0/3259786702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07f40cbb50 0x7f07f4159e30 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f07e4009f20 tx=0x7f07e4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bf4dec1e2c60868 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:41.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.615+0000 7f07f8f1d700 1 -- 172.21.15.17:0/3259786702 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e400e070 con 0x7f07f40cbb50 2023-10-06T04:44:41.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.616+0000 7f07f8f1d700 1 -- 172.21.15.17:0/3259786702 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e400ba40 con 0x7f07f40cbb50 2023-10-06T04:44:41.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.616+0000 7f07f8f1d700 1 -- 172.21.15.17:0/3259786702 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e40092e0 con 0x7f07f40cbb50 2023-10-06T04:44:41.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.616+0000 7f07fc183700 1 -- 172.21.15.17:0/3259786702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07f40cbb50 msgr2=0x7f07f4159e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:41.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.616+0000 7f07fc183700 1 --2- 172.21.15.17:0/3259786702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07f40cbb50 0x7f07f4159e30 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f07e4009f20 tx=0x7f07e4009840 comp rx=0 tx=0).stop 2023-10-06T04:44:41.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.616+0000 7f07fc183700 1 -- 172.21.15.17:0/3259786702 shutdown_connections 2023-10-06T04:44:41.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.616+0000 7f07fc183700 1 --2- 172.21.15.17:0/3259786702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07f40cbb50 0x7f07f4159e30 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:41.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.616+0000 7f07fc183700 1 --2- 172.21.15.17:0/3259786702 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f07f4150360 0x7f07f4150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:41.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.616+0000 7f07fc183700 1 -- 172.21.15.17:0/3259786702 >> 172.21.15.17:0/3259786702 conn(0x7f07f408a180 msgr2=0x7f07f4099aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:41.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.616+0000 7f07fc183700 1 -- 172.21.15.17:0/3259786702 shutdown_connections 2023-10-06T04:44:41.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.616+0000 7f07fc183700 1 -- 172.21.15.17:0/3259786702 wait complete. 2023-10-06T04:44:41.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.617+0000 7f07fc183700 1 Processor -- start 2023-10-06T04:44:41.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.617+0000 7f07fc183700 1 -- start start 2023-10-06T04:44:41.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.618+0000 7f07fc183700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07f40cb6b0 0x7f07f40b5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:41.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.618+0000 7f07fc183700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f07f40cbb50 0x7f07f4151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:41.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.618+0000 7f07fc183700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f07f4150360 0x7f07f414e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:41.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.618+0000 7f07fc183700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f4158ea0 con 0x7f07f40cb6b0 2023-10-06T04:44:41.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.618+0000 7f07fc183700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f4151b40 con 0x7f07f4150360 2023-10-06T04:44:41.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.618+0000 7f07fc183700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f4151e20 con 0x7f07f40cbb50 2023-10-06T04:44:41.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.618+0000 7f07f9f1f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07f40cb6b0 0x7f07f40b5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:41.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.618+0000 7f07f9f1f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07f40cb6b0 0x7f07f40b5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46050/0 (socket says 172.21.15.17:46050) 2023-10-06T04:44:41.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.618+0000 7f07f9f1f700 1 -- 172.21.15.17:0/2018927161 learned_addr learned my addr 172.21.15.17:0/2018927161 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:41.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.618+0000 7f07fa720700 1 --2- 172.21.15.17:0/2018927161 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f07f4150360 0x7f07f414e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:41.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.618+0000 7f07f971e700 1 --2- 172.21.15.17:0/2018927161 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f07f40cbb50 0x7f07f4151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:41.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.618+0000 7f07f9f1f700 1 -- 172.21.15.17:0/2018927161 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f07f40cbb50 msgr2=0x7f07f4151240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:41.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.618+0000 7f07f9f1f700 1 --2- 172.21.15.17:0/2018927161 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f07f40cbb50 0x7f07f4151240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:41.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.618+0000 7f07f9f1f700 1 -- 172.21.15.17:0/2018927161 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f07f4150360 msgr2=0x7f07f414e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:41.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.618+0000 7f07f9f1f700 1 --2- 172.21.15.17:0/2018927161 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f07f4150360 0x7f07f414e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:41.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.618+0000 7f07f9f1f700 1 -- 172.21.15.17:0/2018927161 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e4009ae0 con 0x7f07f40cb6b0 2023-10-06T04:44:41.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.618+0000 7f07f971e700 1 --2- 172.21.15.17:0/2018927161 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f07f40cbb50 0x7f07f4151240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:41.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.619+0000 7f07f9f1f700 1 --2- 172.21.15.17:0/2018927161 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07f40cb6b0 0x7f07f40b5e90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f07ec00c7d0 tx=0x7f07ec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:41.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.619+0000 7f07f1ffb700 1 -- 172.21.15.17:0/2018927161 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec011600 con 0x7f07f40cb6b0 2023-10-06T04:44:41.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.619+0000 7f07f1ffb700 1 -- 172.21.15.17:0/2018927161 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ec011760 con 0x7f07f40cb6b0 2023-10-06T04:44:41.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.619+0000 7f07fc183700 1 -- 172.21.15.17:0/2018927161 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f4152100 con 0x7f07f40cb6b0 2023-10-06T04:44:41.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.619+0000 7f07f1ffb700 1 -- 172.21.15.17:0/2018927161 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec011b20 con 0x7f07f40cb6b0 2023-10-06T04:44:41.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.619+0000 7f07fc183700 1 -- 172.21.15.17:0/2018927161 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f40b3570 con 0x7f07f40cb6b0 2023-10-06T04:44:41.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.620+0000 7f07fc183700 1 -- 172.21.15.17:0/2018927161 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f40718b0 con 0x7f07f40cb6b0 2023-10-06T04:44:41.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.620+0000 7f07f1ffb700 1 -- 172.21.15.17:0/2018927161 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f07ec0193f0 con 0x7f07f40cb6b0 2023-10-06T04:44:41.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.621+0000 7f07f1ffb700 1 --2- 172.21.15.17:0/2018927161 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f07e0066f30 0x7f07e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:41.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.621+0000 7f07f1ffb700 1 -- 172.21.15.17:0/2018927161 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5687+0+0 (secure 0 0 0) 0x7f07ec084a60 con 0x7f07f40cb6b0 2023-10-06T04:44:41.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.621+0000 7f07f971e700 1 --2- 172.21.15.17:0/2018927161 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f07e0066f30 0x7f07e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:41.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.621+0000 7f07f971e700 1 --2- 172.21.15.17:0/2018927161 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f07e0066f30 0x7f07e00693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f07e8006fd0 tx=0x7f07e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:41.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.625+0000 7f07f1ffb700 1 -- 172.21.15.17:0/2018927161 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f07ec051c40 con 0x7f07f40cb6b0 2023-10-06T04:44:41.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:41.817+0000 7f07fc183700 1 -- 172.21.15.17:0/2018927161 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "data_new", "pool2": "data_new", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f07f4153d30 con 0x7f07f40cb6b0 2023-10-06T04:44:42.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.474+0000 7f07f1ffb700 1 -- 172.21.15.17:0/2018927161 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "data_new", "pool2": "data_new", "yes_i_really_really_mean_it": true}]=0 pool 'data_new' removed v39) v1 ==== 160+0+0 (secure 0 0 0) 0x7f07ec055260 con 0x7f07f40cb6b0 2023-10-06T04:44:42.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.478+0000 7f07fc183700 1 -- 172.21.15.17:0/2018927161 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f07e0066f30 msgr2=0x7f07e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:42.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.478+0000 7f07fc183700 1 --2- 172.21.15.17:0/2018927161 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f07e0066f30 0x7f07e00693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f07e8006fd0 tx=0x7f07e8008040 comp rx=0 tx=0).stop 2023-10-06T04:44:42.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.478+0000 7f07fc183700 1 -- 172.21.15.17:0/2018927161 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07f40cb6b0 msgr2=0x7f07f40b5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:42.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.478+0000 7f07fc183700 1 --2- 172.21.15.17:0/2018927161 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07f40cb6b0 0x7f07f40b5e90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f07ec00c7d0 tx=0x7f07ec008040 comp rx=0 tx=0).stop 2023-10-06T04:44:42.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.478+0000 7f07fc183700 1 -- 172.21.15.17:0/2018927161 shutdown_connections 2023-10-06T04:44:42.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.478+0000 7f07fc183700 1 --2- 172.21.15.17:0/2018927161 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f07e0066f30 0x7f07e00693e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.478+0000 7f07fc183700 1 --2- 172.21.15.17:0/2018927161 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f07f4150360 0x7f07f414e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.478+0000 7f07fc183700 1 --2- 172.21.15.17:0/2018927161 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07f40cb6b0 0x7f07f40b5e90 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.478+0000 7f07fc183700 1 --2- 172.21.15.17:0/2018927161 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f07f40cbb50 0x7f07f4151240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.478+0000 7f07fc183700 1 -- 172.21.15.17:0/2018927161 >> 172.21.15.17:0/2018927161 conn(0x7f07f408a180 msgr2=0x7f07f4099aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:42.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.479+0000 7f07fc183700 1 -- 172.21.15.17:0/2018927161 shutdown_connections 2023-10-06T04:44:42.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.479+0000 7f07fc183700 1 -- 172.21.15.17:0/2018927161 wait complete. 2023-10-06T04:44:42.482 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'data_new' removed 2023-10-06T04:44:42.497 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_symlink_recovery 2023-10-06T04:44:42.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.620+0000 7ffa4bb06700 1 Processor -- start 2023-10-06T04:44:42.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.620+0000 7ffa4bb06700 1 -- start start 2023-10-06T04:44:42.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.621+0000 7ffa4bb06700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa440cabf0 0x7ffa440c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:42.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.621+0000 7ffa4bb06700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ffa44159b10 0x7ffa4406f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:42.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.621+0000 7ffa4bb06700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ffa4406d140 0x7ffa4406f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:42.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.621+0000 7ffa4bb06700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa440d1120 con 0x7ffa44159b10 2023-10-06T04:44:42.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.621+0000 7ffa4bb06700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa440d1400 con 0x7ffa4406d140 2023-10-06T04:44:42.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.621+0000 7ffa4bb06700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4406e920 con 0x7ffa440cabf0 2023-10-06T04:44:42.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.621+0000 7ffa490a1700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ffa44159b10 0x7ffa4406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:42.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.621+0000 7ffa490a1700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ffa44159b10 0x7ffa4406f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46062/0 (socket says 172.21.15.17:46062) 2023-10-06T04:44:42.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.621+0000 7ffa490a1700 1 -- 172.21.15.17:0/4186822082 learned_addr learned my addr 172.21.15.17:0/4186822082 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:42.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.621+0000 7ffa490a1700 1 -- 172.21.15.17:0/4186822082 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa440cabf0 msgr2=0x7ffa440c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:42.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.621+0000 7ffa490a1700 1 --2- 172.21.15.17:0/4186822082 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa440cabf0 0x7ffa440c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.621+0000 7ffa490a1700 1 -- 172.21.15.17:0/4186822082 >> v2:172.21.15.136:3300/0 conn(0x7ffa4406d140 msgr2=0x7ffa4406f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:42.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.621+0000 7ffa4a0a3700 1 --2- 172.21.15.17:0/4186822082 >> v2:172.21.15.136:3300/0 conn(0x7ffa4406d140 0x7ffa4406f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:42.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.621+0000 7ffa490a1700 1 --2- 172.21.15.17:0/4186822082 >> v2:172.21.15.136:3300/0 conn(0x7ffa4406d140 0x7ffa4406f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.621+0000 7ffa490a1700 1 -- 172.21.15.17:0/4186822082 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa4406ec00 con 0x7ffa44159b10 2023-10-06T04:44:42.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.621+0000 7ffa490a1700 1 --2- 172.21.15.17:0/4186822082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa44159b10 0x7ffa4406f120 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ffa440d0620 tx=0x7ffa34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38f4207fe333a2b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:42.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.621+0000 7ffa488a0700 1 -- 172.21.15.17:0/4186822082 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3400b860 con 0x7ffa44159b10 2023-10-06T04:44:42.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.621+0000 7ffa488a0700 1 -- 172.21.15.17:0/4186822082 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3400b9c0 con 0x7ffa44159b10 2023-10-06T04:44:42.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.621+0000 7ffa488a0700 1 -- 172.21.15.17:0/4186822082 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3400bd60 con 0x7ffa44159b10 2023-10-06T04:44:42.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.622+0000 7ffa4bb06700 1 -- 172.21.15.17:0/4186822082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa44159b10 msgr2=0x7ffa4406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:42.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.622+0000 7ffa4bb06700 1 --2- 172.21.15.17:0/4186822082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa44159b10 0x7ffa4406f120 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ffa440d0620 tx=0x7ffa34009250 comp rx=0 tx=0).stop 2023-10-06T04:44:42.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.622+0000 7ffa4bb06700 1 -- 172.21.15.17:0/4186822082 shutdown_connections 2023-10-06T04:44:42.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.622+0000 7ffa4bb06700 1 --2- 172.21.15.17:0/4186822082 >> v2:172.21.15.136:3300/0 conn(0x7ffa4406d140 0x7ffa4406f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.622+0000 7ffa4bb06700 1 --2- 172.21.15.17:0/4186822082 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa440cabf0 0x7ffa440c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.622+0000 7ffa4bb06700 1 --2- 172.21.15.17:0/4186822082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa44159b10 0x7ffa4406f120 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.622+0000 7ffa4bb06700 1 -- 172.21.15.17:0/4186822082 >> 172.21.15.17:0/4186822082 conn(0x7ffa4406cd40 msgr2=0x7ffa440d0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:42.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.622+0000 7ffa4bb06700 1 -- 172.21.15.17:0/4186822082 shutdown_connections 2023-10-06T04:44:42.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.622+0000 7ffa4bb06700 1 -- 172.21.15.17:0/4186822082 wait complete. 2023-10-06T04:44:42.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.623+0000 7ffa4bb06700 1 Processor -- start 2023-10-06T04:44:42.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.623+0000 7ffa4bb06700 1 -- start start 2023-10-06T04:44:42.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.624+0000 7ffa4bb06700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa4406d140 0x7ffa440b3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:42.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.624+0000 7ffa4bb06700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa440cabf0 0x7ffa440b5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:42.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.624+0000 7ffa4bb06700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa44159b10 0x7ffa44151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:42.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.624+0000 7ffa4bb06700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4415e9d0 con 0x7ffa44159b10 2023-10-06T04:44:42.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.624+0000 7ffa4bb06700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa440b43f0 con 0x7ffa4406d140 2023-10-06T04:44:42.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.624+0000 7ffa4bb06700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa440b46d0 con 0x7ffa440cabf0 2023-10-06T04:44:42.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.624+0000 7ffa4a0a3700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa44159b10 0x7ffa44151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:42.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.624+0000 7ffa4a0a3700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa44159b10 0x7ffa44151f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46074/0 (socket says 172.21.15.17:46074) 2023-10-06T04:44:42.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.624+0000 7ffa4a0a3700 1 -- 172.21.15.17:0/377153882 learned_addr learned my addr 172.21.15.17:0/377153882 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:42.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.624+0000 7ffa490a1700 1 --2- 172.21.15.17:0/377153882 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa440cabf0 0x7ffa440b5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:42.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.624+0000 7ffa498a2700 1 --2- 172.21.15.17:0/377153882 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa4406d140 0x7ffa440b3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:42.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.624+0000 7ffa4a0a3700 1 -- 172.21.15.17:0/377153882 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa440cabf0 msgr2=0x7ffa440b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:42.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.624+0000 7ffa4a0a3700 1 --2- 172.21.15.17:0/377153882 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa440cabf0 0x7ffa440b5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.624+0000 7ffa4a0a3700 1 -- 172.21.15.17:0/377153882 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa4406d140 msgr2=0x7ffa440b3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:42.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.624+0000 7ffa4a0a3700 1 --2- 172.21.15.17:0/377153882 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa4406d140 0x7ffa440b3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.624+0000 7ffa4a0a3700 1 -- 172.21.15.17:0/377153882 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa340094f0 con 0x7ffa44159b10 2023-10-06T04:44:42.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.625+0000 7ffa4a0a3700 1 --2- 172.21.15.17:0/377153882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa44159b10 0x7ffa44151f30 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c00ce80 tx=0x7ffa3c007840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:42.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.625+0000 7ffa39ffb700 1 -- 172.21.15.17:0/377153882 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c00acc0 con 0x7ffa44159b10 2023-10-06T04:44:42.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.625+0000 7ffa39ffb700 1 -- 172.21.15.17:0/377153882 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3c00ae20 con 0x7ffa44159b10 2023-10-06T04:44:42.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.625+0000 7ffa4bb06700 1 -- 172.21.15.17:0/377153882 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa440b49b0 con 0x7ffa44159b10 2023-10-06T04:44:42.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.625+0000 7ffa39ffb700 1 -- 172.21.15.17:0/377153882 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c016680 con 0x7ffa44159b10 2023-10-06T04:44:42.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.625+0000 7ffa4bb06700 1 -- 172.21.15.17:0/377153882 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa440b4f70 con 0x7ffa44159b10 2023-10-06T04:44:42.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.626+0000 7ffa4bb06700 1 -- 172.21.15.17:0/377153882 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa4404c380 con 0x7ffa44159b10 2023-10-06T04:44:42.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.626+0000 7ffa39ffb700 1 -- 172.21.15.17:0/377153882 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffa3c003020 con 0x7ffa44159b10 2023-10-06T04:44:42.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.627+0000 7ffa39ffb700 1 --2- 172.21.15.17:0/377153882 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ffa28066f30 0x7ffa280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:42.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.627+0000 7ffa39ffb700 1 -- 172.21.15.17:0/377153882 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7ffa3c012070 con 0x7ffa44159b10 2023-10-06T04:44:42.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.627+0000 7ffa498a2700 1 --2- 172.21.15.17:0/377153882 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ffa28066f30 0x7ffa280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:42.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.627+0000 7ffa498a2700 1 --2- 172.21.15.17:0/377153882 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ffa28066f30 0x7ffa280693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ffa40009bd0 tx=0x7ffa400091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:42.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.631+0000 7ffa39ffb700 1 -- 172.21.15.17:0/377153882 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa3c052510 con 0x7ffa44159b10 2023-10-06T04:44:42.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.834+0000 7ffa4bb06700 1 -- 172.21.15.17:0/377153882 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_symlink_recovery"} v 0) v1 -- 0x7ffa4408ad10 con 0x7ffa44159b10 2023-10-06T04:44:42.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.838+0000 7ffa39ffb700 1 -- 172.21.15.17:0/377153882 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_symlink_recovery"}]=0 v13) v1 ==== 103+0+0 (secure 0 0 0) 0x7ffa3c055b30 con 0x7ffa44159b10 2023-10-06T04:44:42.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.840+0000 7ffa4bb06700 1 -- 172.21.15.17:0/377153882 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ffa28066f30 msgr2=0x7ffa280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:42.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.840+0000 7ffa4bb06700 1 --2- 172.21.15.17:0/377153882 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ffa28066f30 0x7ffa280693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ffa40009bd0 tx=0x7ffa400091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.840+0000 7ffa4bb06700 1 -- 172.21.15.17:0/377153882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa44159b10 msgr2=0x7ffa44151f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:42.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.840+0000 7ffa4bb06700 1 --2- 172.21.15.17:0/377153882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa44159b10 0x7ffa44151f30 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c00ce80 tx=0x7ffa3c007840 comp rx=0 tx=0).stop 2023-10-06T04:44:42.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.840+0000 7ffa4bb06700 1 -- 172.21.15.17:0/377153882 shutdown_connections 2023-10-06T04:44:42.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.840+0000 7ffa4bb06700 1 --2- 172.21.15.17:0/377153882 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ffa28066f30 0x7ffa280693e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.840+0000 7ffa4bb06700 1 --2- 172.21.15.17:0/377153882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa44159b10 0x7ffa44151f30 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.840+0000 7ffa4bb06700 1 --2- 172.21.15.17:0/377153882 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa4406d140 0x7ffa440b3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.840+0000 7ffa4bb06700 1 --2- 172.21.15.17:0/377153882 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa440cabf0 0x7ffa440b5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.840+0000 7ffa4bb06700 1 -- 172.21.15.17:0/377153882 >> 172.21.15.17:0/377153882 conn(0x7ffa4406cd40 msgr2=0x7ffa440cb850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:42.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.840+0000 7ffa4bb06700 1 -- 172.21.15.17:0/377153882 shutdown_connections 2023-10-06T04:44:42.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.840+0000 7ffa4bb06700 1 -- 172.21.15.17:0/377153882 wait complete. 2023-10-06T04:44:42.854 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T04:44:42.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.973+0000 7ff10ea58700 1 Processor -- start 2023-10-06T04:44:42.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.973+0000 7ff10ea58700 1 -- start start 2023-10-06T04:44:42.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.974+0000 7ff10ea58700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff10806d140 0x7ff10806f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:42.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.974+0000 7ff10ea58700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1080d1120 con 0x7ff108159b10 2023-10-06T04:44:42.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.974+0000 7ff10ea58700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1080d1400 con 0x7ff1080cabf0 2023-10-06T04:44:42.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.974+0000 7ff10ea58700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff10806e920 con 0x7ff10806d140 2023-10-06T04:44:42.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.974+0000 7ff10cff5700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff10806d140 0x7ff10806f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:42.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.974+0000 7ff1077fe700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7ff108159b10 0x7ff10806f120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37848/0 (socket says 172.21.15.17:37848) 2023-10-06T04:44:42.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.974+0000 7ff1077fe700 1 -- 172.21.15.17:0/2787666872 learned_addr learned my addr 172.21.15.17:0/2787666872 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:42.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.974+0000 7ff10cff5700 1 -- 172.21.15.17:0/2787666872 >> v1:172.21.15.136:6789/0 conn(0x7ff1080cabf0 legacy=0x7ff1080c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:42.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.974+0000 7ff10cff5700 1 -- 172.21.15.17:0/2787666872 >> v1:172.21.15.17:6789/0 conn(0x7ff108159b10 legacy=0x7ff10806f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:42.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.974+0000 7ff10cff5700 1 -- 172.21.15.17:0/2787666872 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff10806ec00 con 0x7ff10806d140 2023-10-06T04:44:42.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.974+0000 7ff106ffd700 1 -- 172.21.15.17:0/2787666872 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2885936092 0 0) 0x7ff1080d1120 con 0x7ff108159b10 2023-10-06T04:44:42.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.974+0000 7ff10cff5700 1 --2- 172.21.15.17:0/2787666872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff10806d140 0x7ff10806f830 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff100009e60 tx=0x7ff100009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=836fd6cb39404a0b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:42.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.975+0000 7ff106ffd700 1 -- 172.21.15.17:0/2787666872 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10000e070 con 0x7ff10806d140 2023-10-06T04:44:42.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.975+0000 7ff106ffd700 1 -- 172.21.15.17:0/2787666872 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10000bc30 con 0x7ff10806d140 2023-10-06T04:44:42.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.975+0000 7ff106ffd700 1 -- 172.21.15.17:0/2787666872 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff100012430 con 0x7ff10806d140 2023-10-06T04:44:42.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.975+0000 7ff10ea58700 1 -- 172.21.15.17:0/2787666872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff10806d140 msgr2=0x7ff10806f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:42.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.975+0000 7ff10ea58700 1 --2- 172.21.15.17:0/2787666872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff10806d140 0x7ff10806f830 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff100009e60 tx=0x7ff100009780 comp rx=0 tx=0).stop 2023-10-06T04:44:42.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.975+0000 7ff10ea58700 1 -- 172.21.15.17:0/2787666872 shutdown_connections 2023-10-06T04:44:42.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.975+0000 7ff10ea58700 1 --2- 172.21.15.17:0/2787666872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff10806d140 0x7ff10806f830 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.975+0000 7ff10ea58700 1 -- 172.21.15.17:0/2787666872 >> 172.21.15.17:0/2787666872 conn(0x7ff10806cd40 msgr2=0x7ff1080d0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:42.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.975+0000 7ff10ea58700 1 -- 172.21.15.17:0/2787666872 shutdown_connections 2023-10-06T04:44:42.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.975+0000 7ff10ea58700 1 -- 172.21.15.17:0/2787666872 wait complete. 2023-10-06T04:44:42.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.976+0000 7ff10ea58700 1 Processor -- start 2023-10-06T04:44:42.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.976+0000 7ff10ea58700 1 -- start start 2023-10-06T04:44:42.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.977+0000 7ff10ea58700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff10806d140 0x7ff108157ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:42.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.977+0000 7ff10ea58700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1080cabf0 0x7ff108169a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:42.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.977+0000 7ff10ea58700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff108159b10 0x7ff1080c5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:42.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.977+0000 7ff10ea58700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1080c6280 con 0x7ff10806d140 2023-10-06T04:44:42.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.977+0000 7ff10ea58700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1080c5cc0 con 0x7ff1080cabf0 2023-10-06T04:44:42.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.977+0000 7ff10ea58700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1080c5fa0 con 0x7ff108159b10 2023-10-06T04:44:42.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.977+0000 7ff107fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff10806d140 0x7ff108157ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:42.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.977+0000 7ff107fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff10806d140 0x7ff108157ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46100/0 (socket says 172.21.15.17:46100) 2023-10-06T04:44:42.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.977+0000 7ff107fff700 1 -- 172.21.15.17:0/3556019513 learned_addr learned my addr 172.21.15.17:0/3556019513 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:42.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.978+0000 7ff1077fe700 1 --2- 172.21.15.17:0/3556019513 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1080cabf0 0x7ff108169a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:42.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.978+0000 7ff107fff700 1 -- 172.21.15.17:0/3556019513 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff108159b10 msgr2=0x7ff1080c5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:42.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.978+0000 7ff107fff700 1 --2- 172.21.15.17:0/3556019513 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff108159b10 0x7ff1080c5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.978+0000 7ff107fff700 1 -- 172.21.15.17:0/3556019513 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1080cabf0 msgr2=0x7ff108169a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:42.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.978+0000 7ff107fff700 1 --2- 172.21.15.17:0/3556019513 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1080cabf0 0x7ff108169a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:42.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.978+0000 7ff107fff700 1 -- 172.21.15.17:0/3556019513 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff100009a20 con 0x7ff10806d140 2023-10-06T04:44:42.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.978+0000 7ff107fff700 1 --2- 172.21.15.17:0/3556019513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff10806d140 0x7ff108157ad0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff0f800c7c0 tx=0x7ff0f8007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:42.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.978+0000 7ff0fffff700 1 -- 172.21.15.17:0/3556019513 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f8011590 con 0x7ff10806d140 2023-10-06T04:44:42.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.978+0000 7ff0fffff700 1 -- 172.21.15.17:0/3556019513 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f8011710 con 0x7ff10806d140 2023-10-06T04:44:42.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.978+0000 7ff10ea58700 1 -- 172.21.15.17:0/3556019513 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff10809b630 con 0x7ff10806d140 2023-10-06T04:44:42.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.978+0000 7ff0fffff700 1 -- 172.21.15.17:0/3556019513 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f8011ad0 con 0x7ff10806d140 2023-10-06T04:44:42.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.978+0000 7ff10ea58700 1 -- 172.21.15.17:0/3556019513 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff108158010 con 0x7ff10806d140 2023-10-06T04:44:42.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.979+0000 7ff10ea58700 1 -- 172.21.15.17:0/3556019513 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff108071310 con 0x7ff10806d140 2023-10-06T04:44:42.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.979+0000 7ff0fffff700 1 -- 172.21.15.17:0/3556019513 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff0f801b3b0 con 0x7ff10806d140 2023-10-06T04:44:42.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.980+0000 7ff0fffff700 1 --2- 172.21.15.17:0/3556019513 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff0e8066f30 0x7ff0e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:42.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.980+0000 7ff0fffff700 1 -- 172.21.15.17:0/3556019513 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7ff0f80838a0 con 0x7ff10806d140 2023-10-06T04:44:42.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.980+0000 7ff1077fe700 1 --2- 172.21.15.17:0/3556019513 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff0e8066f30 0x7ff0e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:42.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.980+0000 7ff1077fe700 1 --2- 172.21.15.17:0/3556019513 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff0e8066f30 0x7ff0e80693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff10806f9e0 tx=0x7ff0f0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:42.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:42.984+0000 7ff0fffff700 1 -- 172.21.15.17:0/3556019513 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff0f8050d60 con 0x7ff10806d140 2023-10-06T04:44:43.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.175+0000 7ff10ea58700 1 -- 172.21.15.17:0/3556019513 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff1080cca80 con 0x7ff10806d140 2023-10-06T04:44:43.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.178+0000 7ff0fffff700 1 -- 172.21.15.17:0/3556019513 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v14) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff0f8017020 con 0x7ff10806d140 2023-10-06T04:44:43.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.180+0000 7ff10ea58700 1 -- 172.21.15.17:0/3556019513 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff0e8066f30 msgr2=0x7ff0e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:43.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.180+0000 7ff10ea58700 1 --2- 172.21.15.17:0/3556019513 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff0e8066f30 0x7ff0e80693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff10806f9e0 tx=0x7ff0f0009040 comp rx=0 tx=0).stop 2023-10-06T04:44:43.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.180+0000 7ff10ea58700 1 -- 172.21.15.17:0/3556019513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff10806d140 msgr2=0x7ff108157ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:43.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.180+0000 7ff10ea58700 1 --2- 172.21.15.17:0/3556019513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff10806d140 0x7ff108157ad0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff0f800c7c0 tx=0x7ff0f8007f70 comp rx=0 tx=0).stop 2023-10-06T04:44:43.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.180+0000 7ff10ea58700 1 -- 172.21.15.17:0/3556019513 shutdown_connections 2023-10-06T04:44:43.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.181+0000 7ff10ea58700 1 --2- 172.21.15.17:0/3556019513 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff0e8066f30 0x7ff0e80693e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:43.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.181+0000 7ff10ea58700 1 --2- 172.21.15.17:0/3556019513 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff108159b10 0x7ff1080c5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:43.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.181+0000 7ff10ea58700 1 --2- 172.21.15.17:0/3556019513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff10806d140 0x7ff108157ad0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:43.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.181+0000 7ff10ea58700 1 --2- 172.21.15.17:0/3556019513 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1080cabf0 0x7ff108169a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:43.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.181+0000 7ff10ea58700 1 -- 172.21.15.17:0/3556019513 >> 172.21.15.17:0/3556019513 conn(0x7ff10806cd40 msgr2=0x7ff108158dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:43.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.181+0000 7ff10ea58700 1 -- 172.21.15.17:0/3556019513 shutdown_connections 2023-10-06T04:44:43.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.181+0000 7ff10ea58700 1 -- 172.21.15.17:0/3556019513 wait complete. 2023-10-06T04:44:43.194 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_backtrace.TestBacktrace.test_backtrace' 2023-10-06T04:44:43.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.311+0000 7fee7dfd3700 1 Processor -- start 2023-10-06T04:44:43.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.312+0000 7fee7dfd3700 1 -- start start 2023-10-06T04:44:43.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.312+0000 7fee7dfd3700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fee781572e0 0x7fee781576b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:43.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.312+0000 7fee7dfd3700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fee7815b1c0 0x7fee7815b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:43.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.312+0000 7fee7dfd3700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee7815bb70 con 0x7fee780b1680 2023-10-06T04:44:43.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.312+0000 7fee7dfd3700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee780b2210 con 0x7fee7815b1c0 2023-10-06T04:44:43.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.312+0000 7fee7dfd3700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee780b3000 con 0x7fee781572e0 2023-10-06T04:44:43.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.312+0000 7fee76ffd700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fee7815b1c0 0x7fee7815b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:43.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.313+0000 7fee76ffd700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fee7815b1c0 0x7fee7815b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46116/0 (socket says 172.21.15.17:46116) 2023-10-06T04:44:43.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.313+0000 7fee76ffd700 1 -- 172.21.15.17:0/1344738115 learned_addr learned my addr 172.21.15.17:0/1344738115 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:43.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.313+0000 7fee777fe700 1 --2- 172.21.15.17:0/1344738115 >> v2:172.21.15.136:3300/0 conn(0x7fee781572e0 0x7fee781576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:43.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.313+0000 7fee76ffd700 1 -- 172.21.15.17:0/1344738115 >> v2:172.21.15.136:3300/0 conn(0x7fee781572e0 msgr2=0x7fee781576b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:43.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.313+0000 7fee76ffd700 1 --2- 172.21.15.17:0/1344738115 >> v2:172.21.15.136:3300/0 conn(0x7fee781572e0 0x7fee781576b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:43.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.313+0000 7fee76ffd700 1 -- 172.21.15.17:0/1344738115 >> v1:172.21.15.136:6789/0 conn(0x7fee780b1680 legacy=0x7fee780b1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:43.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.313+0000 7fee76ffd700 1 -- 172.21.15.17:0/1344738115 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee780b23f0 con 0x7fee7815b1c0 2023-10-06T04:44:43.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.313+0000 7fee76ffd700 1 --2- 172.21.15.17:0/1344738115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee7815b1c0 0x7fee7815b630 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fee7806b1e0 tx=0x7fee6c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4f1f6051ed979d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:43.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.313+0000 7fee767fc700 1 -- 172.21.15.17:0/1344738115 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c00b820 con 0x7fee7815b1c0 2023-10-06T04:44:43.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.313+0000 7fee767fc700 1 -- 172.21.15.17:0/1344738115 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6c00b980 con 0x7fee7815b1c0 2023-10-06T04:44:43.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.313+0000 7fee767fc700 1 -- 172.21.15.17:0/1344738115 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c00bd20 con 0x7fee7815b1c0 2023-10-06T04:44:43.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.314+0000 7fee7dfd3700 1 -- 172.21.15.17:0/1344738115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee7815b1c0 msgr2=0x7fee7815b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:43.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.314+0000 7fee7dfd3700 1 --2- 172.21.15.17:0/1344738115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee7815b1c0 0x7fee7815b630 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fee7806b1e0 tx=0x7fee6c009250 comp rx=0 tx=0).stop 2023-10-06T04:44:43.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.314+0000 7fee7dfd3700 1 -- 172.21.15.17:0/1344738115 shutdown_connections 2023-10-06T04:44:43.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.314+0000 7fee7dfd3700 1 --2- 172.21.15.17:0/1344738115 >> v2:172.21.15.136:3300/0 conn(0x7fee781572e0 0x7fee781576b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:43.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.314+0000 7fee7dfd3700 1 --2- 172.21.15.17:0/1344738115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee7815b1c0 0x7fee7815b630 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:43.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.314+0000 7fee7dfd3700 1 -- 172.21.15.17:0/1344738115 >> 172.21.15.17:0/1344738115 conn(0x7fee7806cd40 msgr2=0x7fee78087fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:43.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.314+0000 7fee7dfd3700 1 -- 172.21.15.17:0/1344738115 shutdown_connections 2023-10-06T04:44:43.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.314+0000 7fee7dfd3700 1 -- 172.21.15.17:0/1344738115 wait complete. 2023-10-06T04:44:43.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.315+0000 7fee7dfd3700 1 Processor -- start 2023-10-06T04:44:43.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.315+0000 7fee7dfd3700 1 -- start start 2023-10-06T04:44:43.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.316+0000 7fee7dfd3700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee780b1680 0x7fee78098e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:43.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.316+0000 7fee7dfd3700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee781572e0 0x7fee78153280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:43.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.316+0000 7fee7dfd3700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fee7815b1c0 0x7fee780b3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:43.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.316+0000 7fee7dfd3700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee780acf50 con 0x7fee780b1680 2023-10-06T04:44:43.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.316+0000 7fee7dfd3700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee780ac340 con 0x7fee781572e0 2023-10-06T04:44:43.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.316+0000 7fee7dfd3700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee780ac620 con 0x7fee7815b1c0 2023-10-06T04:44:43.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.316+0000 7fee777fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee780b1680 0x7fee78098e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:43.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.316+0000 7fee777fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee780b1680 0x7fee78098e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46132/0 (socket says 172.21.15.17:46132) 2023-10-06T04:44:43.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.316+0000 7fee777fe700 1 -- 172.21.15.17:0/2831321498 learned_addr learned my addr 172.21.15.17:0/2831321498 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:43.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.316+0000 7fee777fe700 1 -- 172.21.15.17:0/2831321498 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fee7815b1c0 msgr2=0x7fee780b3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:43.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.316+0000 7fee777fe700 1 --2- 172.21.15.17:0/2831321498 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fee7815b1c0 0x7fee780b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:43.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.316+0000 7fee777fe700 1 -- 172.21.15.17:0/2831321498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee781572e0 msgr2=0x7fee78153280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:43.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.316+0000 7fee777fe700 1 --2- 172.21.15.17:0/2831321498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee781572e0 0x7fee78153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:43.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.316+0000 7fee777fe700 1 -- 172.21.15.17:0/2831321498 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee6c0094f0 con 0x7fee780b1680 2023-10-06T04:44:43.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.316+0000 7fee777fe700 1 --2- 172.21.15.17:0/2831321498 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee780b1680 0x7fee78098e80 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fee6800c7d0 tx=0x7fee68008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:43.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.316+0000 7fee5f7fe700 1 -- 172.21.15.17:0/2831321498 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee68011600 con 0x7fee780b1680 2023-10-06T04:44:43.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.316+0000 7fee5f7fe700 1 -- 172.21.15.17:0/2831321498 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee68011760 con 0x7fee780b1680 2023-10-06T04:44:43.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.316+0000 7fee7dfd3700 1 -- 172.21.15.17:0/2831321498 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee780ac900 con 0x7fee780b1680 2023-10-06T04:44:43.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.316+0000 7fee5f7fe700 1 -- 172.21.15.17:0/2831321498 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee68011b00 con 0x7fee780b1680 2023-10-06T04:44:43.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.316+0000 7fee7dfd3700 1 -- 172.21.15.17:0/2831321498 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee781537c0 con 0x7fee780b1680 2023-10-06T04:44:43.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.317+0000 7fee7dfd3700 1 -- 172.21.15.17:0/2831321498 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee78063ff0 con 0x7fee780b1680 2023-10-06T04:44:43.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.318+0000 7fee5f7fe700 1 -- 172.21.15.17:0/2831321498 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fee680193f0 con 0x7fee780b1680 2023-10-06T04:44:43.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.318+0000 7fee5f7fe700 1 --2- 172.21.15.17:0/2831321498 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fee64066f30 0x7fee640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:43.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.318+0000 7fee76ffd700 1 --2- 172.21.15.17:0/2831321498 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fee64066f30 0x7fee640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:43.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.318+0000 7fee5f7fe700 1 -- 172.21.15.17:0/2831321498 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fee680848f0 con 0x7fee780b1680 2023-10-06T04:44:43.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.319+0000 7fee76ffd700 1 --2- 172.21.15.17:0/2831321498 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fee64066f30 0x7fee640693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fee7806b1e0 tx=0x7fee6c016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:43.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.323+0000 7fee5f7fe700 1 -- 172.21.15.17:0/2831321498 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee68051c60 con 0x7fee780b1680 2023-10-06T04:44:43.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:43.600+0000 7fee7dfd3700 1 -- 172.21.15.17:0/2831321498 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_backtrace.TestBacktrace.test_backtrace"]} v 0) v1 -- 0x7fee780b26d0 con 0x7fee780b1680 2023-10-06T04:44:44.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:44.483+0000 7fee5f7fe700 1 -- 172.21.15.17:0/2831321498 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_backtrace.TestBacktrace.test_backtrace"]}]=0 v92) v1 ==== 135+0+0 (secure 0 0 0) 0x7fee68055280 con 0x7fee780b1680 2023-10-06T04:44:44.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:44.485+0000 7fee7dfd3700 1 -- 172.21.15.17:0/2831321498 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fee64066f30 msgr2=0x7fee640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:44.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:44.485+0000 7fee7dfd3700 1 --2- 172.21.15.17:0/2831321498 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fee64066f30 0x7fee640693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fee7806b1e0 tx=0x7fee6c016000 comp rx=0 tx=0).stop 2023-10-06T04:44:44.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:44.485+0000 7fee7dfd3700 1 -- 172.21.15.17:0/2831321498 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee780b1680 msgr2=0x7fee78098e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:44.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:44.485+0000 7fee7dfd3700 1 --2- 172.21.15.17:0/2831321498 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee780b1680 0x7fee78098e80 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fee6800c7d0 tx=0x7fee68008040 comp rx=0 tx=0).stop 2023-10-06T04:44:44.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:44.485+0000 7fee7dfd3700 1 -- 172.21.15.17:0/2831321498 shutdown_connections 2023-10-06T04:44:44.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:44.485+0000 7fee7dfd3700 1 --2- 172.21.15.17:0/2831321498 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fee64066f30 0x7fee640693e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:44.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:44.485+0000 7fee7dfd3700 1 --2- 172.21.15.17:0/2831321498 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fee7815b1c0 0x7fee780b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:44.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:44.485+0000 7fee7dfd3700 1 --2- 172.21.15.17:0/2831321498 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee780b1680 0x7fee78098e80 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:44.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:44.485+0000 7fee7dfd3700 1 --2- 172.21.15.17:0/2831321498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee781572e0 0x7fee78153280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:44.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:44.485+0000 7fee7dfd3700 1 -- 172.21.15.17:0/2831321498 >> 172.21.15.17:0/2831321498 conn(0x7fee7806cd40 msgr2=0x7fee78154100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:44.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:44.486+0000 7fee7dfd3700 1 -- 172.21.15.17:0/2831321498 shutdown_connections 2023-10-06T04:44:44.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:44.486+0000 7fee7dfd3700 1 -- 172.21.15.17:0/2831321498 wait complete. 2023-10-06T04:44:44.503 INFO:tasks.cephfs_test_runner:That the 'parent' 'layout' and 'symlink' xattrs on the head objects of files ... ok 2023-10-06T04:44:44.503 INFO:tasks.cephfs_test_runner: 2023-10-06T04:44:44.503 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-06T04:44:44.503 INFO:tasks.cephfs_test_runner:Ran 1 test in 45.727s 2023-10-06T04:44:44.504 INFO:tasks.cephfs_test_runner: 2023-10-06T04:44:44.504 INFO:tasks.cephfs_test_runner:OK 2023-10-06T04:44:44.504 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-06T04:44:44.518 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-06T04:44:44.579 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-06T04:44:44.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:44.579 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2023-10-06T04:44:44.597 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T04:44:44.598 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T04:44:44.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:44.598 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T04:44:44.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:44.681 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T04:44:44.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:44.762 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link delete ceph-brx 2023-10-06T04:44:44.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:44.863 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2023-10-06T04:44:44.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:44.880 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link delete ceph-brx 2023-10-06T04:44:44.949 INFO:teuthology.orchestra.run.smithi017.stderr:Cannot find device "ceph-brx" 2023-10-06T04:44:44.950 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:44:44.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:44.951 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2023-10-06T04:44:44.969 INFO:teuthology.orchestra.run.smithi136.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T04:44:44.969 INFO:teuthology.orchestra.run.smithi136.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T04:44:44.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:44.970 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T04:44:45.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:45.069 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T04:44:45.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:45.124 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link delete ceph-brx 2023-10-06T04:44:45.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:45.188 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2023-10-06T04:44:45.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:44:45.204 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link delete ceph-brx 2023-10-06T04:44:45.274 INFO:teuthology.orchestra.run.smithi136.stderr:Cannot find device "ceph-brx" 2023-10-06T04:44:45.275 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:44:45.276 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-06T04:44:45.285 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-06T04:44:45.285 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:44:45.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.409+0000 7fe32a872700 1 Processor -- start 2023-10-06T04:44:45.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.409+0000 7fe32a872700 1 -- start start 2023-10-06T04:44:45.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.410+0000 7fe32a872700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe324140d00 0x7fe3240cc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:45.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.410+0000 7fe32a872700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe3240b0800 0x7fe32406c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:45.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.410+0000 7fe32a872700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3240cafa0 con 0x7fe3241410d0 2023-10-06T04:44:45.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.410+0000 7fe32a872700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3240cb280 con 0x7fe324140d00 2023-10-06T04:44:45.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.410+0000 7fe32a872700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3240cb560 con 0x7fe3240b0800 2023-10-06T04:44:45.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.410+0000 7fe323fff700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe324140d00 0x7fe3240cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:45.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.410+0000 7fe323fff700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe324140d00 0x7fe3240cc040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46138/0 (socket says 172.21.15.17:46138) 2023-10-06T04:44:45.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.410+0000 7fe323fff700 1 -- 172.21.15.17:0/1983069716 learned_addr learned my addr 172.21.15.17:0/1983069716 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:45.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.411+0000 7fe328e0f700 1 --2- 172.21.15.17:0/1983069716 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe3240b0800 0x7fe32406c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:45.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.411+0000 7fe323fff700 1 -- 172.21.15.17:0/1983069716 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe3240b0800 msgr2=0x7fe32406c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:45.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.411+0000 7fe323fff700 1 --2- 172.21.15.17:0/1983069716 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe3240b0800 0x7fe32406c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.411+0000 7fe323fff700 1 -- 172.21.15.17:0/1983069716 >> v1:172.21.15.136:6789/0 conn(0x7fe3241410d0 legacy=0x7fe3240b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:45.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.411+0000 7fe323fff700 1 -- 172.21.15.17:0/1983069716 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3240cb840 con 0x7fe324140d00 2023-10-06T04:44:45.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.411+0000 7fe323fff700 1 --2- 172.21.15.17:0/1983069716 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe324140d00 0x7fe3240cc040 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fe30c0099b0 tx=0x7fe30c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a11d98e0b7ee637 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:45.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.411+0000 7fe322ffd700 1 -- 172.21.15.17:0/1983069716 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c009ea0 con 0x7fe324140d00 2023-10-06T04:44:45.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.411+0000 7fe322ffd700 1 -- 172.21.15.17:0/1983069716 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30c00b860 con 0x7fe324140d00 2023-10-06T04:44:45.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.411+0000 7fe322ffd700 1 -- 172.21.15.17:0/1983069716 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c00bc00 con 0x7fe324140d00 2023-10-06T04:44:45.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.412+0000 7fe32a872700 1 -- 172.21.15.17:0/1983069716 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe324140d00 msgr2=0x7fe3240cc040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:45.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.412+0000 7fe32a872700 1 --2- 172.21.15.17:0/1983069716 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe324140d00 0x7fe3240cc040 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fe30c0099b0 tx=0x7fe30c009250 comp rx=0 tx=0).stop 2023-10-06T04:44:45.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.412+0000 7fe32a872700 1 -- 172.21.15.17:0/1983069716 shutdown_connections 2023-10-06T04:44:45.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.412+0000 7fe32a872700 1 --2- 172.21.15.17:0/1983069716 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe324140d00 0x7fe3240cc040 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.412+0000 7fe32a872700 1 --2- 172.21.15.17:0/1983069716 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe3240b0800 0x7fe32406c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.412+0000 7fe32a872700 1 -- 172.21.15.17:0/1983069716 >> 172.21.15.17:0/1983069716 conn(0x7fe32406e140 msgr2=0x7fe3240cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:45.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.412+0000 7fe32a872700 1 -- 172.21.15.17:0/1983069716 shutdown_connections 2023-10-06T04:44:45.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.412+0000 7fe32a872700 1 -- 172.21.15.17:0/1983069716 wait complete. 2023-10-06T04:44:45.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.413+0000 7fe32a872700 1 Processor -- start 2023-10-06T04:44:45.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.413+0000 7fe32a872700 1 -- start start 2023-10-06T04:44:45.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.414+0000 7fe32a872700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe3240b0800 0x7fe3240c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:45.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.414+0000 7fe32a872700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe324140d00 0x7fe32416b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:45.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.414+0000 7fe32a872700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe3241410d0 0x7fe324156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:45.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.414+0000 7fe32a872700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3240c5110 con 0x7fe324140d00 2023-10-06T04:44:45.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.414+0000 7fe32a872700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32413d8a0 con 0x7fe3240b0800 2023-10-06T04:44:45.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.414+0000 7fe32a872700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3240c4500 con 0x7fe3241410d0 2023-10-06T04:44:45.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.414+0000 7fe323fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe3240b0800 0x7fe3240c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:45.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.414+0000 7fe323fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe3240b0800 0x7fe3240c6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.17:40462/0 (socket says 172.21.15.17:40462) 2023-10-06T04:44:45.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.414+0000 7fe3237fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe324140d00 0x7fe32416b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:45.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.414+0000 7fe323fff700 1 -- 172.21.15.17:0/3015401597 learned_addr learned my addr 172.21.15.17:0/3015401597 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:45.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.414+0000 7fe328e0f700 1 --2- 172.21.15.17:0/3015401597 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe3241410d0 0x7fe324156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:45.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.414+0000 7fe3237fe700 1 -- 172.21.15.17:0/3015401597 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe3241410d0 msgr2=0x7fe324156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:45.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.414+0000 7fe3237fe700 1 --2- 172.21.15.17:0/3015401597 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe3241410d0 0x7fe324156e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.414+0000 7fe3237fe700 1 -- 172.21.15.17:0/3015401597 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe3240b0800 msgr2=0x7fe3240c6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:45.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.414+0000 7fe3237fe700 1 --2- 172.21.15.17:0/3015401597 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe3240b0800 0x7fe3240c6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.414+0000 7fe3237fe700 1 -- 172.21.15.17:0/3015401597 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe30c0094f0 con 0x7fe324140d00 2023-10-06T04:44:45.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.414+0000 7fe3237fe700 1 --2- 172.21.15.17:0/3015401597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe324140d00 0x7fe32416b7f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe31400c490 tx=0x7fe314007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:45.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.415+0000 7fe31bfff700 1 -- 172.21.15.17:0/3015401597 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31400ce40 con 0x7fe324140d00 2023-10-06T04:44:45.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.415+0000 7fe31bfff700 1 -- 172.21.15.17:0/3015401597 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe314011590 con 0x7fe324140d00 2023-10-06T04:44:45.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.415+0000 7fe32a872700 1 -- 172.21.15.17:0/3015401597 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3240c47e0 con 0x7fe324140d00 2023-10-06T04:44:45.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.415+0000 7fe31bfff700 1 -- 172.21.15.17:0/3015401597 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe314011950 con 0x7fe324140d00 2023-10-06T04:44:45.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.415+0000 7fe32a872700 1 -- 172.21.15.17:0/3015401597 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3240c4da0 con 0x7fe324140d00 2023-10-06T04:44:45.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.416+0000 7fe32a872700 1 -- 172.21.15.17:0/3015401597 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3240c52c0 con 0x7fe324140d00 2023-10-06T04:44:45.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.416+0000 7fe31bfff700 1 -- 172.21.15.17:0/3015401597 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe314011cc0 con 0x7fe324140d00 2023-10-06T04:44:45.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.416+0000 7fe31bfff700 1 --2- 172.21.15.17:0/3015401597 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe304066f30 0x7fe3040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:45.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.416+0000 7fe31bfff700 1 -- 172.21.15.17:0/3015401597 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fe314083630 con 0x7fe324140d00 2023-10-06T04:44:45.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.416+0000 7fe323fff700 1 --2- 172.21.15.17:0/3015401597 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe304066f30 0x7fe3040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:45.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.417+0000 7fe323fff700 1 --2- 172.21.15.17:0/3015401597 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe304066f30 0x7fe3040693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe30c00c010 tx=0x7fe30c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:45.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.421+0000 7fe31bfff700 1 -- 172.21.15.17:0/3015401597 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe3240c52c0 con 0x7fe324140d00 2023-10-06T04:44:45.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.616+0000 7fe32a872700 1 -- 172.21.15.17:0/3015401597 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe324063ff0 con 0x7fe324140d00 2023-10-06T04:44:45.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.617+0000 7fe31bfff700 1 -- 172.21.15.17:0/3015401597 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+13777 (secure 0 0 0) 0x7fe314017020 con 0x7fe324140d00 2023-10-06T04:44:45.619 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:45.619 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":39,"fsid":"780777c4-2b25-4d35-9058-c9f2d62e3ad9","created":"2023-10-06T04:43:10.578520+0000","modified":"2023-10-06T04:44:42.469110+0000","last_up_change":"2023-10-06T04:43:20.682958+0000","last_in_change":"2023-10-06T04:43:12.978917+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:43:21.795733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:43:22.389592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"84737b08-575c-46dd-9488-073ae8504494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6809","nonce":90656},{"type":"v1","addr":"172.21.15.17:6811","nonce":90656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":90656},{"type":"v1","addr":"172.21.15.17:6814","nonce":90656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":90656},{"type":"v1","addr":"172.21.15.17:6822","nonce":90656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":90656},{"type":"v1","addr":"172.21.15.17:6818","nonce":90656}]},"public_addr":"172.21.15.17:6811/90656","cluster_addr":"172.21.15.17:6814/90656","heartbeat_back_addr":"172.21.15.17:6822/90656","heartbeat_front_addr":"172.21.15.17:6818/90656","state":["exists","up"]},{"osd":1,"uuid":"dffeb740-58a2-4fd6-8ff1-a0a11a2cc709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":90655},{"type":"v1","addr":"172.21.15.17:6801","nonce":90655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":90655},{"type":"v1","addr":"172.21.15.17:6803","nonce":90655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":90655},{"type":"v1","addr":"172.21.15.17:6807","nonce":90655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":90655},{"type":"v1","addr":"172.21.15.17:6805","nonce":90655}]},"public_addr":"172.21.15.17:6801/90655","cluster_addr":"172.21.15.17:6803/90655","heartbeat_back_addr":"172.21.15.17:6807/90655","heartbeat_front_addr":"172.21.15.17:6805/90655","state":["exists","up"]},{"osd":2,"uuid":"48bd6831-763d-48c2-b515-e02c216d608b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":90657},{"type":"v1","addr":"172.21.15.17:6810","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":90657},{"type":"v1","addr":"172.21.15.17:6815","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":90657},{"type":"v1","addr":"172.21.15.17:6823","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":90657},{"type":"v1","addr":"172.21.15.17:6819","nonce":90657}]},"public_addr":"172.21.15.17:6810/90657","cluster_addr":"172.21.15.17:6815/90657","heartbeat_back_addr":"172.21.15.17:6823/90657","heartbeat_front_addr":"172.21.15.17:6819/90657","state":["exists","up"]},{"osd":3,"uuid":"ae7dbb23-abe7-4bd3-a4df-6f5963d6804c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":90688},{"type":"v1","addr":"172.21.15.17:6825","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":90688},{"type":"v1","addr":"172.21.15.17:6827","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":90688},{"type":"v1","addr":"172.21.15.17:6831","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":90688},{"type":"v1","addr":"172.21.15.17:6829","nonce":90688}]},"public_addr":"172.21.15.17:6825/90688","cluster_addr":"172.21.15.17:6827/90688","heartbeat_back_addr":"172.21.15.17:6831/90688","heartbeat_front_addr":"172.21.15.17:6829/90688","state":["exists","up"]},{"osd":4,"uuid":"29991fb4-1667-4ea3-aca0-d55db27f3bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":90902},{"type":"v1","addr":"172.21.15.136:6801","nonce":90902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":90902},{"type":"v1","addr":"172.21.15.136:6803","nonce":90902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":90902},{"type":"v1","addr":"172.21.15.136:6807","nonce":90902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":90902},{"type":"v1","addr":"172.21.15.136:6805","nonce":90902}]},"public_addr":"172.21.15.136:6801/90902","cluster_addr":"172.21.15.136:6803/90902","heartbeat_back_addr":"172.21.15.136:6807/90902","heartbeat_front_addr":"172.21.15.136:6805/90902","state":["exists","up"]},{"osd":5,"uuid":"398b4ff9-03fc-421f-882c-ba12aa088eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":90901},{"type":"v1","addr":"172.21.15.136:6809","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":90901},{"type":"v1","addr":"172.21.15.136:6811","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":90901},{"type":"v1","addr":"172.21.15.136:6815","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":90901},{"type":"v1","addr":"172.21.15.136:6813","nonce":90901}]},"public_addr":"172.21.15.136:6809/90901","cluster_addr":"172.21.15.136:6811/90901","heartbeat_back_addr":"172.21.15.136:6815/90901","heartbeat_front_addr":"172.21.15.136:6813/90901","state":["exists","up"]},{"osd":6,"uuid":"1bb91a72-4dab-4cdb-aa1d-2b8a9edf1ad0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":90927},{"type":"v1","addr":"172.21.15.136:6825","nonce":90927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":90927},{"type":"v1","addr":"172.21.15.136:6827","nonce":90927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":90927},{"type":"v1","addr":"172.21.15.136:6831","nonce":90927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":90927},{"type":"v1","addr":"172.21.15.136:6829","nonce":90927}]},"public_addr":"172.21.15.136:6825/90927","cluster_addr":"172.21.15.136:6827/90927","heartbeat_back_addr":"172.21.15.136:6831/90927","heartbeat_front_addr":"172.21.15.136:6829/90927","state":["exists","up"]},{"osd":7,"uuid":"719b654e-010d-4aa4-8c13-83fdde242b47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":90934},{"type":"v1","addr":"172.21.15.136:6817","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":90934},{"type":"v1","addr":"172.21.15.136:6819","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":90934},{"type":"v1","addr":"172.21.15.136:6824","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":90934},{"type":"v1","addr":"172.21.15.136:6821","nonce":90934}]},"public_addr":"172.21.15.136:6817/90934","cluster_addr":"172.21.15.136:6819/90934","heartbeat_back_addr":"172.21.15.136:6824/90934","heartbeat_front_addr":"172.21.15.136:6821/90934","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.157479+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.140520+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.190743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.231396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.156510+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.145822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.202888+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.139532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6837/460551791":"2023-10-07T04:44:38.185021+0000","172.21.15.17:6835/460551791":"2023-10-07T04:44:38.185021+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:44:45.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.619+0000 7fe32a872700 1 -- 172.21.15.17:0/3015401597 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe304066f30 msgr2=0x7fe3040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:45.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.619+0000 7fe32a872700 1 --2- 172.21.15.17:0/3015401597 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe304066f30 0x7fe3040693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe30c00c010 tx=0x7fe30c017000 comp rx=0 tx=0).stop 2023-10-06T04:44:45.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.619+0000 7fe32a872700 1 -- 172.21.15.17:0/3015401597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe324140d00 msgr2=0x7fe32416b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:45.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.619+0000 7fe32a872700 1 --2- 172.21.15.17:0/3015401597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe324140d00 0x7fe32416b7f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe31400c490 tx=0x7fe314007ec0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.619+0000 7fe32a872700 1 -- 172.21.15.17:0/3015401597 shutdown_connections 2023-10-06T04:44:45.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.619+0000 7fe32a872700 1 --2- 172.21.15.17:0/3015401597 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fe304066f30 0x7fe3040693e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.619+0000 7fe32a872700 1 --2- 172.21.15.17:0/3015401597 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe3241410d0 0x7fe324156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.619+0000 7fe32a872700 1 --2- 172.21.15.17:0/3015401597 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe3240b0800 0x7fe3240c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.619+0000 7fe32a872700 1 --2- 172.21.15.17:0/3015401597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe324140d00 0x7fe32416b7f0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.619+0000 7fe32a872700 1 -- 172.21.15.17:0/3015401597 >> 172.21.15.17:0/3015401597 conn(0x7fe32406e140 msgr2=0x7fe32406b920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:45.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.619+0000 7fe32a872700 1 -- 172.21.15.17:0/3015401597 shutdown_connections 2023-10-06T04:44:45.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.619+0000 7fe32a872700 1 -- 172.21.15.17:0/3015401597 wait complete. 2023-10-06T04:44:45.633 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T04:44:45.633 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:44:45.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.750+0000 7f814f59e700 1 Processor -- start 2023-10-06T04:44:45.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.750+0000 7f814f59e700 1 -- start start 2023-10-06T04:44:45.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.751+0000 7f814f59e700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f81500ccfc0 0x7f81500cc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:45.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.751+0000 7f814f59e700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81500cbd80 con 0x7f81500cf3b0 2023-10-06T04:44:45.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.751+0000 7f814f59e700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81500af5f0 con 0x7f81500cc750 2023-10-06T04:44:45.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.751+0000 7f814f59e700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81500af8d0 con 0x7f81500ccfc0 2023-10-06T04:44:45.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.751+0000 7f814e59c700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f81500ccfc0 0x7f81500cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:45.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.751+0000 7f814dd9b700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f81500cf3b0 0x7f81501594a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37860/0 (socket says 172.21.15.17:37860) 2023-10-06T04:44:45.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.751+0000 7f814dd9b700 1 -- 172.21.15.17:0/1182654854 learned_addr learned my addr 172.21.15.17:0/1182654854 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:45.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.751+0000 7f814e59c700 1 -- 172.21.15.17:0/1182654854 >> v1:172.21.15.136:6789/0 conn(0x7f81500cc750 legacy=0x7f81500b0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:45.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.751+0000 7f814e59c700 1 -- 172.21.15.17:0/1182654854 >> v1:172.21.15.17:6789/0 conn(0x7f81500cf3b0 legacy=0x7f81501594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:45.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.751+0000 7f814e59c700 1 -- 172.21.15.17:0/1182654854 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81500afbb0 con 0x7f81500ccfc0 2023-10-06T04:44:45.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.751+0000 7f814d59a700 1 -- 172.21.15.17:0/1182654854 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1919787583 0 0) 0x7f81500cbd80 con 0x7f81500cf3b0 2023-10-06T04:44:45.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.752+0000 7f814e59c700 1 --2- 172.21.15.17:0/1182654854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81500ccfc0 0x7f81500cc210 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8148009910 tx=0x7f81480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ca932f3fe24073 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:45.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.752+0000 7f814d59a700 1 -- 172.21.15.17:0/1182654854 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814800b820 con 0x7f81500ccfc0 2023-10-06T04:44:45.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.752+0000 7f814d59a700 1 -- 172.21.15.17:0/1182654854 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f814800b980 con 0x7f81500ccfc0 2023-10-06T04:44:45.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.752+0000 7f814d59a700 1 -- 172.21.15.17:0/1182654854 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814800bd20 con 0x7f81500ccfc0 2023-10-06T04:44:45.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.752+0000 7f814f59e700 1 -- 172.21.15.17:0/1182654854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81500ccfc0 msgr2=0x7f81500cc210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:45.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.752+0000 7f814f59e700 1 --2- 172.21.15.17:0/1182654854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81500ccfc0 0x7f81500cc210 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8148009910 tx=0x7f81480091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.752+0000 7f814f59e700 1 -- 172.21.15.17:0/1182654854 shutdown_connections 2023-10-06T04:44:45.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.752+0000 7f814f59e700 1 --2- 172.21.15.17:0/1182654854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81500ccfc0 0x7f81500cc210 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.752+0000 7f814f59e700 1 -- 172.21.15.17:0/1182654854 >> 172.21.15.17:0/1182654854 conn(0x7f815006cff0 msgr2=0x7f815006da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:45.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.752+0000 7f814f59e700 1 -- 172.21.15.17:0/1182654854 shutdown_connections 2023-10-06T04:44:45.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.752+0000 7f814f59e700 1 -- 172.21.15.17:0/1182654854 wait complete. 2023-10-06T04:44:45.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.753+0000 7f814f59e700 1 Processor -- start 2023-10-06T04:44:45.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.753+0000 7f814f59e700 1 -- start start 2023-10-06T04:44:45.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.754+0000 7f814f59e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81500cc750 0x7f815016df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:45.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.754+0000 7f814f59e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81500ccfc0 0x7f8150169710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:45.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.754+0000 7f814f59e700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f81500c5d40 0x7f81500c61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:45.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.754+0000 7f814f59e700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81500c66f0 con 0x7f81500ccfc0 2023-10-06T04:44:45.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.754+0000 7f814f59e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81500b3350 con 0x7f81500cc750 2023-10-06T04:44:45.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.754+0000 7f814f59e700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f815016e490 con 0x7f81500c5d40 2023-10-06T04:44:45.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.754+0000 7f814dd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81500ccfc0 0x7f8150169710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:45.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.754+0000 7f814dd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81500ccfc0 0x7f8150169710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46160/0 (socket says 172.21.15.17:46160) 2023-10-06T04:44:45.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.754+0000 7f814dd9b700 1 -- 172.21.15.17:0/909922046 learned_addr learned my addr 172.21.15.17:0/909922046 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:45.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.754+0000 7f814e59c700 1 --2- 172.21.15.17:0/909922046 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81500cc750 0x7f815016df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:45.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.754+0000 7f814ed9d700 1 --2- 172.21.15.17:0/909922046 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f81500c5d40 0x7f81500c61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:45.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.755+0000 7f814dd9b700 1 -- 172.21.15.17:0/909922046 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f81500c5d40 msgr2=0x7f81500c61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:45.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.755+0000 7f814dd9b700 1 --2- 172.21.15.17:0/909922046 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f81500c5d40 0x7f81500c61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.755+0000 7f814dd9b700 1 -- 172.21.15.17:0/909922046 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81500cc750 msgr2=0x7f815016df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:45.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.755+0000 7f814dd9b700 1 --2- 172.21.15.17:0/909922046 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81500cc750 0x7f815016df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.755+0000 7f814dd9b700 1 -- 172.21.15.17:0/909922046 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8148009420 con 0x7f81500ccfc0 2023-10-06T04:44:45.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.755+0000 7f814ed9d700 1 --2- 172.21.15.17:0/909922046 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f81500c5d40 0x7f81500c61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:45.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.755+0000 7f814dd9b700 1 --2- 172.21.15.17:0/909922046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81500ccfc0 0x7f8150169710 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f813800c500 tx=0x7f8138007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:45.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.755+0000 7f81467fc700 1 -- 172.21.15.17:0/909922046 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8138005b30 con 0x7f81500ccfc0 2023-10-06T04:44:45.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.755+0000 7f81467fc700 1 -- 172.21.15.17:0/909922046 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8138005c90 con 0x7f81500ccfc0 2023-10-06T04:44:45.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.755+0000 7f81467fc700 1 -- 172.21.15.17:0/909922046 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8138007320 con 0x7f81500ccfc0 2023-10-06T04:44:45.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.755+0000 7f814f59e700 1 -- 172.21.15.17:0/909922046 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81500b35a0 con 0x7f81500ccfc0 2023-10-06T04:44:45.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.755+0000 7f814f59e700 1 -- 172.21.15.17:0/909922046 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81500b3b60 con 0x7f81500ccfc0 2023-10-06T04:44:45.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.756+0000 7f814f59e700 1 -- 172.21.15.17:0/909922046 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f815004c380 con 0x7f81500ccfc0 2023-10-06T04:44:45.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.756+0000 7f81467fc700 1 -- 172.21.15.17:0/909922046 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f813801b3b0 con 0x7f81500ccfc0 2023-10-06T04:44:45.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.757+0000 7f81467fc700 1 --2- 172.21.15.17:0/909922046 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8130066f30 0x7f81300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:45.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.757+0000 7f814e59c700 1 --2- 172.21.15.17:0/909922046 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8130066f30 0x7f81300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:45.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.757+0000 7f81467fc700 1 -- 172.21.15.17:0/909922046 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f81380837c0 con 0x7f81500ccfc0 2023-10-06T04:44:45.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.757+0000 7f814e59c700 1 --2- 172.21.15.17:0/909922046 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8130066f30 0x7f81300693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f81480093f0 tx=0x7f8148017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:45.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.761+0000 7f81467fc700 1 -- 172.21.15.17:0/909922046 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8138050bd0 con 0x7f81500ccfc0 2023-10-06T04:44:45.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.950+0000 7f814f59e700 1 -- 172.21.15.17:0/909922046 --> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8150159c20 con 0x7f8130066f30 2023-10-06T04:44:45.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.953+0000 7f81467fc700 1 -- 172.21.15.17:0/909922046 <== mgr.4104 v2:172.21.15.17:6832/90424 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73006 (secure 0 0 0) 0x7f8150159c20 con 0x7f8130066f30 2023-10-06T04:44:45.956 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:45.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.955+0000 7f814f59e700 1 -- 172.21.15.17:0/909922046 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8130066f30 msgr2=0x7f81300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:45.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.955+0000 7f814f59e700 1 --2- 172.21.15.17:0/909922046 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8130066f30 0x7f81300693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f81480093f0 tx=0x7f8148017000 comp rx=0 tx=0).stop 2023-10-06T04:44:45.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.955+0000 7f814f59e700 1 -- 172.21.15.17:0/909922046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81500ccfc0 msgr2=0x7f8150169710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:45.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.955+0000 7f814f59e700 1 --2- 172.21.15.17:0/909922046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81500ccfc0 0x7f8150169710 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f813800c500 tx=0x7f8138007f60 comp rx=0 tx=0).stop 2023-10-06T04:44:45.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.955+0000 7f814f59e700 1 -- 172.21.15.17:0/909922046 shutdown_connections 2023-10-06T04:44:45.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.955+0000 7f814f59e700 1 --2- 172.21.15.17:0/909922046 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8130066f30 0x7f81300693e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.955+0000 7f814f59e700 1 --2- 172.21.15.17:0/909922046 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f81500c5d40 0x7f81500c61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.955+0000 7f814f59e700 1 --2- 172.21.15.17:0/909922046 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81500cc750 0x7f815016df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.955+0000 7f814f59e700 1 --2- 172.21.15.17:0/909922046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81500ccfc0 0x7f8150169710 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:45.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.955+0000 7f814f59e700 1 -- 172.21.15.17:0/909922046 >> 172.21.15.17:0/909922046 conn(0x7f815006cff0 msgr2=0x7f815014efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:45.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.955+0000 7f814f59e700 1 -- 172.21.15.17:0/909922046 shutdown_connections 2023-10-06T04:44:45.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:45.955+0000 7f814f59e700 1 -- 172.21.15.17:0/909922046 wait complete. 2023-10-06T04:44:45.959 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-06T04:44:45.969 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2023-10-06T04:44:44.350430+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":237,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2390984,"kb_used_data":4488,"kb_used_omap":0,"kb_used_meta":2386432,"kb_avail":752583736,"statfs":{"total":773094113280,"available":770645745664,"internally_reserved":0,"allocated":4595712,"data_stored":2624336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2443706368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-58022,"num_objects":-33,"num_object_clones":0,"num_object_copies":-66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-33,"num_whiteouts":0,"num_read":-22,"num_read_kb":-11,"num_write":-185,"num_write_kb":-131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000968"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T04:44:38.190549+0000","last_change":"2023-10-06T04:43:24.001927+0000","last_active":"2023-10-06T04:44:38.190549+0000","last_peered":"2023-10-06T04:44:38.190549+0000","last_clean":"2023-10-06T04:44:38.190549+0000","last_became_active":"2023-10-06T04:43:24.001591+0000","last_became_peered":"2023-10-06T04:43:24.001591+0000","last_unstale":"2023-10-06T04:44:38.190549+0000","last_undegraded":"2023-10-06T04:44:38.190549+0000","last_fullsized":"2023-10-06T04:44:38.190549+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:47.262845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T04:44:38.515595+0000","last_change":"2023-10-06T04:43:23.708597+0000","last_active":"2023-10-06T04:44:38.515595+0000","last_peered":"2023-10-06T04:44:38.515595+0000","last_clean":"2023-10-06T04:44:38.515595+0000","last_became_active":"2023-10-06T04:43:23.708317+0000","last_became_peered":"2023-10-06T04:43:23.708317+0000","last_unstale":"2023-10-06T04:44:38.515595+0000","last_undegraded":"2023-10-06T04:44:38.515595+0000","last_fullsized":"2023-10-06T04:44:38.515595+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:56.213068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T04:44:39.056162+0000","last_change":"2023-10-06T04:43:23.708753+0000","last_active":"2023-10-06T04:44:39.056162+0000","last_peered":"2023-10-06T04:44:39.056162+0000","last_clean":"2023-10-06T04:44:39.056162+0000","last_became_active":"2023-10-06T04:43:23.708483+0000","last_became_peered":"2023-10-06T04:43:23.708483+0000","last_unstale":"2023-10-06T04:44:39.056162+0000","last_undegraded":"2023-10-06T04:44:39.056162+0000","last_fullsized":"2023-10-06T04:44:39.056162+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:47.262845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":179,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T04:44:38.189836+0000","last_change":"2023-10-06T04:43:23.706116+0000","last_active":"2023-10-06T04:44:38.189836+0000","last_peered":"2023-10-06T04:44:38.189836+0000","last_clean":"2023-10-06T04:44:38.189836+0000","last_became_active":"2023-10-06T04:43:23.705090+0000","last_became_peered":"2023-10-06T04:43:23.705090+0000","last_unstale":"2023-10-06T04:44:38.189836+0000","last_undegraded":"2023-10-06T04:44:38.189836+0000","last_fullsized":"2023-10-06T04:44:38.189836+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:29.869173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T04:44:38.190417+0000","last_change":"2023-10-06T04:43:24.002162+0000","last_active":"2023-10-06T04:44:38.190417+0000","last_peered":"2023-10-06T04:44:38.190417+0000","last_clean":"2023-10-06T04:44:38.190417+0000","last_became_active":"2023-10-06T04:43:24.001883+0000","last_became_peered":"2023-10-06T04:43:24.001883+0000","last_unstale":"2023-10-06T04:44:38.190417+0000","last_undegraded":"2023-10-06T04:44:38.190417+0000","last_fullsized":"2023-10-06T04:44:38.190417+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:51:11.168258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T04:44:38.189911+0000","last_change":"2023-10-06T04:43:24.002057+0000","last_active":"2023-10-06T04:44:38.189911+0000","last_peered":"2023-10-06T04:44:38.189911+0000","last_clean":"2023-10-06T04:44:38.189911+0000","last_became_active":"2023-10-06T04:43:24.001809+0000","last_became_peered":"2023-10-06T04:43:24.001809+0000","last_unstale":"2023-10-06T04:44:38.189911+0000","last_undegraded":"2023-10-06T04:44:38.189911+0000","last_fullsized":"2023-10-06T04:44:38.189911+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:49.693980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T04:44:39.056416+0000","last_change":"2023-10-06T04:43:24.002394+0000","last_active":"2023-10-06T04:44:39.056416+0000","last_peered":"2023-10-06T04:44:39.056416+0000","last_clean":"2023-10-06T04:44:39.056416+0000","last_became_active":"2023-10-06T04:43:24.001915+0000","last_became_peered":"2023-10-06T04:43:24.001915+0000","last_unstale":"2023-10-06T04:44:39.056416+0000","last_undegraded":"2023-10-06T04:44:39.056416+0000","last_fullsized":"2023-10-06T04:44:39.056416+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:45.031820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T04:44:38.897993+0000","last_change":"2023-10-06T04:43:24.002424+0000","last_active":"2023-10-06T04:44:38.897993+0000","last_peered":"2023-10-06T04:44:38.897993+0000","last_clean":"2023-10-06T04:44:38.897993+0000","last_became_active":"2023-10-06T04:43:24.002147+0000","last_became_peered":"2023-10-06T04:43:24.002147+0000","last_unstale":"2023-10-06T04:44:38.897993+0000","last_undegraded":"2023-10-06T04:44:38.897993+0000","last_fullsized":"2023-10-06T04:44:38.897993+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:45.031820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T04:44:38.898103+0000","last_change":"2023-10-06T04:43:23.707408+0000","last_active":"2023-10-06T04:44:38.898103+0000","last_peered":"2023-10-06T04:44:38.898103+0000","last_clean":"2023-10-06T04:44:38.898103+0000","last_became_active":"2023-10-06T04:43:23.707115+0000","last_became_peered":"2023-10-06T04:43:23.707115+0000","last_unstale":"2023-10-06T04:44:38.898103+0000","last_undegraded":"2023-10-06T04:44:38.898103+0000","last_fullsized":"2023-10-06T04:44:38.898103+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:56.213068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298284,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073556,"statfs":{"total":96636764160,"available":96331321344,"internally_reserved":0,"allocated":1019904,"data_stored":770818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.42799999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.52000000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":7.9580000000000002,"5min":7.9580000000000002,"15min":7.9580000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":8.0519999999999996,"5min":8.0519999999999996,"15min":8.0519999999999996},"last":0.49299999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.441}]},{"osd":4,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.40999999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.47499999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.46300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":425984,"data_stored":180450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.55000000000000004}]},{"osd":1,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.41499999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.39300000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.49099999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.50700000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.373},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.56599999999999995}]},{"osd":7,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.54000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302380,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069460,"statfs":{"total":96636764160,"available":96327127040,"internally_reserved":0,"allocated":1019904,"data_stored":770818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.45900000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.36899999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.38800000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.43099999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.56999999999999995}]},{"osd":6,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.624}]},{"osd":7,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.53600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":425984,"data_stored":180450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.307,"15min":0.307},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":0.39300000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":2.8900000000000001,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":0.34599999999999997}]},{"osd":3,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":4.3120000000000003,"5min":4.3120000000000003,"15min":4.3120000000000003},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":4.1980000000000004,"5min":4.1980000000000004,"15min":4.1980000000000004},"last":0.45200000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.8220000000000001,"5min":2.8220000000000001,"15min":2.8220000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.48699999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.51600000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":2.7850000000000001,"5min":2.7850000000000001,"15min":2.7850000000000001},"last":0.63700000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":2.8570000000000002,"5min":2.8570000000000002,"15min":2.8570000000000002},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.65200000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301800,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070040,"statfs":{"total":96636764160,"available":96327720960,"internally_reserved":0,"allocated":425984,"data_stored":180450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.29199999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":6.1280000000000001,"5min":6.1280000000000001,"15min":6.1280000000000001},"last":0.26500000000000001},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":19.983000000000001,"5min":19.983000000000001,"15min":19.983000000000001},"last":0.34599999999999997}]},{"osd":3,"last update":"Fri Oct 6 04:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.36699999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.436}]},{"osd":5,"last update":"Fri Oct 6 04:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.45300000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":6.0499999999999998,"5min":6.0499999999999998,"15min":6.0499999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.627}]},{"osd":7,"last update":"Fri Oct 6 04:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":6.0949999999999998,"5min":6.0949999999999998,"15min":6.0949999999999998},"last":0.54000000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":425984,"data_stored":180450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":11.978,"5min":11.978,"15min":11.978},"last":0.33400000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":12.920999999999999,"5min":12.920999999999999,"15min":12.920999999999999},"last":0.311},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.32200000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.439}]},{"osd":4,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":0.51800000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.504},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.57899999999999996}]},{"osd":6,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":0.47899999999999998}]},{"osd":7,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.41599999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":425984,"data_stored":180450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.57199999999999995}]},{"osd":1,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.499}]},{"osd":2,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.53700000000000003}]},{"osd":3,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.68400000000000005}]},{"osd":5,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.60999999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.59999999999999998}]},{"osd":7,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.70699999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":425984,"data_stored":180450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.78900000000000003}]},{"osd":1,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.624}]},{"osd":2,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.77200000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.73599999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.69299999999999995}]},{"osd":6,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.59099999999999997}]},{"osd":7,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.755},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.83099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:44:45.973 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:44:46.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.090+0000 7fca448cd700 1 Processor -- start 2023-10-06T04:44:46.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.090+0000 7fca448cd700 1 -- start start 2023-10-06T04:44:46.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.091+0000 7fca448cd700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fca401572e0 0x7fca401576b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:46.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.091+0000 7fca448cd700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca400b3000 con 0x7fca400b1d90 2023-10-06T04:44:46.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.091+0000 7fca448cd700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca400b23f0 con 0x7fca4015b1c0 2023-10-06T04:44:46.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.091+0000 7fca448cd700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca400b2210 con 0x7fca401572e0 2023-10-06T04:44:46.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.092+0000 7fca3ed9d700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fca400b1d90 0x7fca400b3490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37872/0 (socket says 172.21.15.17:37872) 2023-10-06T04:44:46.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.092+0000 7fca3ed9d700 1 -- 172.21.15.17:0/739029297 learned_addr learned my addr 172.21.15.17:0/739029297 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:46.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.092+0000 7fca3e59c700 1 --2- 172.21.15.17:0/739029297 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fca401572e0 0x7fca401576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:46.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.092+0000 7fca3d59a700 1 -- 172.21.15.17:0/739029297 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3186912735 0 0) 0x7fca400b3000 con 0x7fca400b1d90 2023-10-06T04:44:46.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.092+0000 7fca3d59a700 1 -- 172.21.15.17:0/739029297 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca2c003570 con 0x7fca400b1d90 2023-10-06T04:44:46.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.092+0000 7fca3d59a700 1 -- 172.21.15.17:0/739029297 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2384156110 0 0) 0x7fca2c003570 con 0x7fca400b1d90 2023-10-06T04:44:46.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.092+0000 7fca3d59a700 1 -- 172.21.15.17:0/739029297 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fca401572e0 msgr2=0x7fca401576b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:46.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.092+0000 7fca3d59a700 1 --2- 172.21.15.17:0/739029297 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fca401572e0 0x7fca401576b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:46.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.092+0000 7fca3d59a700 1 -- 172.21.15.17:0/739029297 >> v1:172.21.15.136:6789/0 conn(0x7fca4015b1c0 legacy=0x7fca400b1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:46.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.092+0000 7fca3d59a700 1 -- 172.21.15.17:0/739029297 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca400b26d0 con 0x7fca400b1d90 2023-10-06T04:44:46.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.092+0000 7fca3d59a700 1 -- 172.21.15.17:0/739029297 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4268781140 0 0) 0x7fca300017f0 con 0x7fca400b1d90 2023-10-06T04:44:46.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.092+0000 7fca3d59a700 1 -- 172.21.15.17:0/739029297 >> v1:172.21.15.17:6789/0 conn(0x7fca400b1d90 legacy=0x7fca400b3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:46.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.092+0000 7fca3d59a700 1 --2- 172.21.15.17:0/739029297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca2c003a90 0x7fca2c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:46.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.092+0000 7fca3d59a700 1 --2- 172.21.15.17:0/739029297 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca2c004810 0x7fca2c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:46.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.092+0000 7fca3d59a700 1 --2- 172.21.15.17:0/739029297 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fca401572e0 0x7fca2c0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:46.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.092+0000 7fca3d59a700 1 -- 172.21.15.17:0/739029297 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca400b2210 con 0x7fca2c003a90 2023-10-06T04:44:46.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.092+0000 7fca3d59a700 1 -- 172.21.15.17:0/739029297 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c00bb60 con 0x7fca2c004810 2023-10-06T04:44:46.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.092+0000 7fca3d59a700 1 -- 172.21.15.17:0/739029297 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c00bd20 con 0x7fca401572e0 2023-10-06T04:44:46.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.092+0000 7fca3e59c700 1 --2- 172.21.15.17:0/739029297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca2c003a90 0x7fca2c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:46.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.092+0000 7fca3dd9b700 1 --2- 172.21.15.17:0/739029297 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca2c004810 0x7fca2c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:46.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.092+0000 7fca3ed9d700 1 --2- 172.21.15.17:0/739029297 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fca401572e0 0x7fca2c0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:46.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.093+0000 7fca3e59c700 1 -- 172.21.15.17:0/739029297 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fca401572e0 msgr2=0x7fca2c0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:46.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.093+0000 7fca3e59c700 1 --2- 172.21.15.17:0/739029297 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fca401572e0 0x7fca2c0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:46.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.093+0000 7fca3e59c700 1 -- 172.21.15.17:0/739029297 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca2c004810 msgr2=0x7fca2c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:46.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.093+0000 7fca3e59c700 1 --2- 172.21.15.17:0/739029297 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca2c004810 0x7fca2c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:46.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.093+0000 7fca3e59c700 1 -- 172.21.15.17:0/739029297 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca2c003570 con 0x7fca2c003a90 2023-10-06T04:44:46.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.093+0000 7fca3e59c700 1 --2- 172.21.15.17:0/739029297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca2c003a90 0x7fca2c003ea0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fca38009c00 tx=0x7fca380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c45ebc6ebdd25d5b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:46.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.093+0000 7fca3d59a700 1 -- 172.21.15.17:0/739029297 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3800e710 con 0x7fca2c003a90 2023-10-06T04:44:46.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.093+0000 7fca3d59a700 1 -- 172.21.15.17:0/739029297 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3800e870 con 0x7fca2c003a90 2023-10-06T04:44:46.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.093+0000 7fca3d59a700 1 -- 172.21.15.17:0/739029297 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3800ec30 con 0x7fca2c003a90 2023-10-06T04:44:46.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.093+0000 7fca448cd700 1 -- 172.21.15.17:0/739029297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca2c003a90 msgr2=0x7fca2c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:46.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.093+0000 7fca448cd700 1 --2- 172.21.15.17:0/739029297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca2c003a90 0x7fca2c003ea0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fca38009c00 tx=0x7fca380091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:46.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.093+0000 7fca3ed9d700 1 -- 172.21.15.17:0/739029297 reap_dead start 2023-10-06T04:44:46.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.093+0000 7fca448cd700 1 -- 172.21.15.17:0/739029297 shutdown_connections 2023-10-06T04:44:46.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.093+0000 7fca448cd700 1 -- 172.21.15.17:0/739029297 >> 172.21.15.17:0/739029297 conn(0x7fca4006cd40 msgr2=0x7fca40087fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:46.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.094+0000 7fca448cd700 1 -- 172.21.15.17:0/739029297 shutdown_connections 2023-10-06T04:44:46.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.094+0000 7fca448cd700 1 -- 172.21.15.17:0/739029297 wait complete. 2023-10-06T04:44:46.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.095+0000 7fca448cd700 1 Processor -- start 2023-10-06T04:44:46.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.095+0000 7fca448cd700 1 -- start start 2023-10-06T04:44:46.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.095+0000 7fca448cd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca2c003a90 0x7fca40099540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:46.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.095+0000 7fca448cd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca40069290 0x7fca40150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:46.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.095+0000 7fca448cd700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fca40069700 0x7fca401514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:46.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.095+0000 7fca448cd700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4009c180 con 0x7fca2c003a90 2023-10-06T04:44:46.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.095+0000 7fca448cd700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca400990b0 con 0x7fca40069290 2023-10-06T04:44:46.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.095+0000 7fca448cd700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca40099a80 con 0x7fca40069700 2023-10-06T04:44:46.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.095+0000 7fca3e59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca2c003a90 0x7fca40099540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:46.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.095+0000 7fca3e59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca2c003a90 0x7fca40099540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46182/0 (socket says 172.21.15.17:46182) 2023-10-06T04:44:46.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.095+0000 7fca3e59c700 1 -- 172.21.15.17:0/4002508048 learned_addr learned my addr 172.21.15.17:0/4002508048 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:46.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.096+0000 7fca3dd9b700 1 --2- 172.21.15.17:0/4002508048 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca40069290 0x7fca40150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:46.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.096+0000 7fca3ed9d700 1 --2- 172.21.15.17:0/4002508048 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fca40069700 0x7fca401514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:46.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.096+0000 7fca3e59c700 1 -- 172.21.15.17:0/4002508048 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fca40069700 msgr2=0x7fca401514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:46.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.096+0000 7fca3e59c700 1 --2- 172.21.15.17:0/4002508048 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fca40069700 0x7fca401514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:46.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.096+0000 7fca3e59c700 1 -- 172.21.15.17:0/4002508048 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca40069290 msgr2=0x7fca40150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:46.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.096+0000 7fca3e59c700 1 --2- 172.21.15.17:0/4002508048 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca40069290 0x7fca40150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:46.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.096+0000 7fca3e59c700 1 -- 172.21.15.17:0/4002508048 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca4009bea0 con 0x7fca2c003a90 2023-10-06T04:44:46.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.096+0000 7fca3ed9d700 1 --2- 172.21.15.17:0/4002508048 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fca40069700 0x7fca401514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:46.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.096+0000 7fca3dd9b700 1 --2- 172.21.15.17:0/4002508048 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca40069290 0x7fca40150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:46.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.096+0000 7fca3e59c700 1 --2- 172.21.15.17:0/4002508048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca2c003a90 0x7fca40099540 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fca3800e4b0 tx=0x7fca3801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:46.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.096+0000 7fca367fc700 1 -- 172.21.15.17:0/4002508048 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca38022070 con 0x7fca2c003a90 2023-10-06T04:44:46.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.096+0000 7fca367fc700 1 -- 172.21.15.17:0/4002508048 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3800ebf0 con 0x7fca2c003a90 2023-10-06T04:44:46.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.096+0000 7fca448cd700 1 -- 172.21.15.17:0/4002508048 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca40098a60 con 0x7fca2c003a90 2023-10-06T04:44:46.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.096+0000 7fca367fc700 1 -- 172.21.15.17:0/4002508048 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3801c6c0 con 0x7fca2c003a90 2023-10-06T04:44:46.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.096+0000 7fca448cd700 1 -- 172.21.15.17:0/4002508048 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca4009b130 con 0x7fca2c003a90 2023-10-06T04:44:46.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.097+0000 7fca448cd700 1 -- 172.21.15.17:0/4002508048 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca40063ff0 con 0x7fca2c003a90 2023-10-06T04:44:46.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.097+0000 7fca367fc700 1 -- 172.21.15.17:0/4002508048 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fca3801cab0 con 0x7fca2c003a90 2023-10-06T04:44:46.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.098+0000 7fca367fc700 1 --2- 172.21.15.17:0/4002508048 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fca20066f30 0x7fca200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:46.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.098+0000 7fca367fc700 1 -- 172.21.15.17:0/4002508048 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fca38085ae0 con 0x7fca2c003a90 2023-10-06T04:44:46.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.098+0000 7fca3dd9b700 1 --2- 172.21.15.17:0/4002508048 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fca20066f30 0x7fca200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:46.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.098+0000 7fca3dd9b700 1 --2- 172.21.15.17:0/4002508048 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fca20066f30 0x7fca200693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fca28000f60 tx=0x7fca28009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:46.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.102+0000 7fca367fc700 1 -- 172.21.15.17:0/4002508048 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca38052ef0 con 0x7fca2c003a90 2023-10-06T04:44:46.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.291+0000 7fca448cd700 1 -- 172.21.15.17:0/4002508048 --> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fca4009c180 con 0x7fca20066f30 2023-10-06T04:44:46.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.294+0000 7fca367fc700 1 -- 172.21.15.17:0/4002508048 <== mgr.4104 v2:172.21.15.17:6832/90424 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73006 (secure 0 0 0) 0x7fca4009c180 con 0x7fca20066f30 2023-10-06T04:44:46.297 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:46.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.296+0000 7fca448cd700 1 -- 172.21.15.17:0/4002508048 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fca20066f30 msgr2=0x7fca200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:46.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.296+0000 7fca448cd700 1 --2- 172.21.15.17:0/4002508048 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fca20066f30 0x7fca200693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fca28000f60 tx=0x7fca28009040 comp rx=0 tx=0).stop 2023-10-06T04:44:46.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.296+0000 7fca448cd700 1 -- 172.21.15.17:0/4002508048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca2c003a90 msgr2=0x7fca40099540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:46.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.296+0000 7fca448cd700 1 --2- 172.21.15.17:0/4002508048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca2c003a90 0x7fca40099540 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fca3800e4b0 tx=0x7fca3801a000 comp rx=0 tx=0).stop 2023-10-06T04:44:46.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.296+0000 7fca448cd700 1 -- 172.21.15.17:0/4002508048 shutdown_connections 2023-10-06T04:44:46.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.296+0000 7fca448cd700 1 --2- 172.21.15.17:0/4002508048 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fca20066f30 0x7fca200693e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:46.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.296+0000 7fca448cd700 1 --2- 172.21.15.17:0/4002508048 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fca40069700 0x7fca401514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:46.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.296+0000 7fca448cd700 1 --2- 172.21.15.17:0/4002508048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca2c003a90 0x7fca40099540 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:46.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.296+0000 7fca448cd700 1 --2- 172.21.15.17:0/4002508048 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca40069290 0x7fca40150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:46.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.296+0000 7fca448cd700 1 -- 172.21.15.17:0/4002508048 >> 172.21.15.17:0/4002508048 conn(0x7fca4006cd40 msgr2=0x7fca400af360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:46.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.296+0000 7fca448cd700 1 -- 172.21.15.17:0/4002508048 shutdown_connections 2023-10-06T04:44:46.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.296+0000 7fca448cd700 1 -- 172.21.15.17:0/4002508048 wait complete. 2023-10-06T04:44:46.299 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-06T04:44:46.310 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2023-10-06T04:44:44.350430+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":237,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2390984,"kb_used_data":4488,"kb_used_omap":0,"kb_used_meta":2386432,"kb_avail":752583736,"statfs":{"total":773094113280,"available":770645745664,"internally_reserved":0,"allocated":4595712,"data_stored":2624336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2443706368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-58022,"num_objects":-33,"num_object_clones":0,"num_object_copies":-66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-33,"num_whiteouts":0,"num_read":-22,"num_read_kb":-11,"num_write":-185,"num_write_kb":-131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000968"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T04:44:38.190549+0000","last_change":"2023-10-06T04:43:24.001927+0000","last_active":"2023-10-06T04:44:38.190549+0000","last_peered":"2023-10-06T04:44:38.190549+0000","last_clean":"2023-10-06T04:44:38.190549+0000","last_became_active":"2023-10-06T04:43:24.001591+0000","last_became_peered":"2023-10-06T04:43:24.001591+0000","last_unstale":"2023-10-06T04:44:38.190549+0000","last_undegraded":"2023-10-06T04:44:38.190549+0000","last_fullsized":"2023-10-06T04:44:38.190549+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:47.262845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T04:44:38.515595+0000","last_change":"2023-10-06T04:43:23.708597+0000","last_active":"2023-10-06T04:44:38.515595+0000","last_peered":"2023-10-06T04:44:38.515595+0000","last_clean":"2023-10-06T04:44:38.515595+0000","last_became_active":"2023-10-06T04:43:23.708317+0000","last_became_peered":"2023-10-06T04:43:23.708317+0000","last_unstale":"2023-10-06T04:44:38.515595+0000","last_undegraded":"2023-10-06T04:44:38.515595+0000","last_fullsized":"2023-10-06T04:44:38.515595+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:56.213068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T04:44:39.056162+0000","last_change":"2023-10-06T04:43:23.708753+0000","last_active":"2023-10-06T04:44:39.056162+0000","last_peered":"2023-10-06T04:44:39.056162+0000","last_clean":"2023-10-06T04:44:39.056162+0000","last_became_active":"2023-10-06T04:43:23.708483+0000","last_became_peered":"2023-10-06T04:43:23.708483+0000","last_unstale":"2023-10-06T04:44:39.056162+0000","last_undegraded":"2023-10-06T04:44:39.056162+0000","last_fullsized":"2023-10-06T04:44:39.056162+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:47.262845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":179,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T04:44:38.189836+0000","last_change":"2023-10-06T04:43:23.706116+0000","last_active":"2023-10-06T04:44:38.189836+0000","last_peered":"2023-10-06T04:44:38.189836+0000","last_clean":"2023-10-06T04:44:38.189836+0000","last_became_active":"2023-10-06T04:43:23.705090+0000","last_became_peered":"2023-10-06T04:43:23.705090+0000","last_unstale":"2023-10-06T04:44:38.189836+0000","last_undegraded":"2023-10-06T04:44:38.189836+0000","last_fullsized":"2023-10-06T04:44:38.189836+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:29.869173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T04:44:38.190417+0000","last_change":"2023-10-06T04:43:24.002162+0000","last_active":"2023-10-06T04:44:38.190417+0000","last_peered":"2023-10-06T04:44:38.190417+0000","last_clean":"2023-10-06T04:44:38.190417+0000","last_became_active":"2023-10-06T04:43:24.001883+0000","last_became_peered":"2023-10-06T04:43:24.001883+0000","last_unstale":"2023-10-06T04:44:38.190417+0000","last_undegraded":"2023-10-06T04:44:38.190417+0000","last_fullsized":"2023-10-06T04:44:38.190417+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:51:11.168258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T04:44:38.189911+0000","last_change":"2023-10-06T04:43:24.002057+0000","last_active":"2023-10-06T04:44:38.189911+0000","last_peered":"2023-10-06T04:44:38.189911+0000","last_clean":"2023-10-06T04:44:38.189911+0000","last_became_active":"2023-10-06T04:43:24.001809+0000","last_became_peered":"2023-10-06T04:43:24.001809+0000","last_unstale":"2023-10-06T04:44:38.189911+0000","last_undegraded":"2023-10-06T04:44:38.189911+0000","last_fullsized":"2023-10-06T04:44:38.189911+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:49.693980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T04:44:39.056416+0000","last_change":"2023-10-06T04:43:24.002394+0000","last_active":"2023-10-06T04:44:39.056416+0000","last_peered":"2023-10-06T04:44:39.056416+0000","last_clean":"2023-10-06T04:44:39.056416+0000","last_became_active":"2023-10-06T04:43:24.001915+0000","last_became_peered":"2023-10-06T04:43:24.001915+0000","last_unstale":"2023-10-06T04:44:39.056416+0000","last_undegraded":"2023-10-06T04:44:39.056416+0000","last_fullsized":"2023-10-06T04:44:39.056416+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:45.031820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T04:44:38.897993+0000","last_change":"2023-10-06T04:43:24.002424+0000","last_active":"2023-10-06T04:44:38.897993+0000","last_peered":"2023-10-06T04:44:38.897993+0000","last_clean":"2023-10-06T04:44:38.897993+0000","last_became_active":"2023-10-06T04:43:24.002147+0000","last_became_peered":"2023-10-06T04:43:24.002147+0000","last_unstale":"2023-10-06T04:44:38.897993+0000","last_undegraded":"2023-10-06T04:44:38.897993+0000","last_fullsized":"2023-10-06T04:44:38.897993+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:45.031820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T04:44:38.898103+0000","last_change":"2023-10-06T04:43:23.707408+0000","last_active":"2023-10-06T04:44:38.898103+0000","last_peered":"2023-10-06T04:44:38.898103+0000","last_clean":"2023-10-06T04:44:38.898103+0000","last_became_active":"2023-10-06T04:43:23.707115+0000","last_became_peered":"2023-10-06T04:43:23.707115+0000","last_unstale":"2023-10-06T04:44:38.898103+0000","last_undegraded":"2023-10-06T04:44:38.898103+0000","last_fullsized":"2023-10-06T04:44:38.898103+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:56.213068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298284,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073556,"statfs":{"total":96636764160,"available":96331321344,"internally_reserved":0,"allocated":1019904,"data_stored":770818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.42799999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.52000000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":7.9580000000000002,"5min":7.9580000000000002,"15min":7.9580000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":8.0519999999999996,"5min":8.0519999999999996,"15min":8.0519999999999996},"last":0.49299999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.441}]},{"osd":4,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.40999999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.47499999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.46300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":425984,"data_stored":180450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.55000000000000004}]},{"osd":1,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.41499999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.39300000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.49099999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.50700000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.373},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.56599999999999995}]},{"osd":7,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.54000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302380,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069460,"statfs":{"total":96636764160,"available":96327127040,"internally_reserved":0,"allocated":1019904,"data_stored":770818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.45900000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.36899999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.38800000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.43099999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.56999999999999995}]},{"osd":6,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.624}]},{"osd":7,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.53600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":425984,"data_stored":180450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.307,"15min":0.307},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":0.39300000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":2.8900000000000001,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":0.34599999999999997}]},{"osd":3,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":4.3120000000000003,"5min":4.3120000000000003,"15min":4.3120000000000003},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":4.1980000000000004,"5min":4.1980000000000004,"15min":4.1980000000000004},"last":0.45200000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.8220000000000001,"5min":2.8220000000000001,"15min":2.8220000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.48699999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.51600000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":2.7850000000000001,"5min":2.7850000000000001,"15min":2.7850000000000001},"last":0.63700000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":2.8570000000000002,"5min":2.8570000000000002,"15min":2.8570000000000002},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.65200000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301800,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070040,"statfs":{"total":96636764160,"available":96327720960,"internally_reserved":0,"allocated":425984,"data_stored":180450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.29199999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":6.1280000000000001,"5min":6.1280000000000001,"15min":6.1280000000000001},"last":0.26500000000000001},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":19.983000000000001,"5min":19.983000000000001,"15min":19.983000000000001},"last":0.34599999999999997}]},{"osd":3,"last update":"Fri Oct 6 04:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.36699999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.436}]},{"osd":5,"last update":"Fri Oct 6 04:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.45300000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":6.0499999999999998,"5min":6.0499999999999998,"15min":6.0499999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.627}]},{"osd":7,"last update":"Fri Oct 6 04:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":6.0949999999999998,"5min":6.0949999999999998,"15min":6.0949999999999998},"last":0.54000000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":425984,"data_stored":180450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":11.978,"5min":11.978,"15min":11.978},"last":0.33400000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":12.920999999999999,"5min":12.920999999999999,"15min":12.920999999999999},"last":0.311},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.32200000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.439}]},{"osd":4,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":0.51800000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.504},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.57899999999999996}]},{"osd":6,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":0.47899999999999998}]},{"osd":7,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.41599999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":425984,"data_stored":180450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.57199999999999995}]},{"osd":1,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.499}]},{"osd":2,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.53700000000000003}]},{"osd":3,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.68400000000000005}]},{"osd":5,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.60999999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.59999999999999998}]},{"osd":7,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.70699999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":425984,"data_stored":180450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.78900000000000003}]},{"osd":1,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.624}]},{"osd":2,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.77200000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.73599999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.69299999999999995}]},{"osd":6,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.59099999999999997}]},{"osd":7,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.755},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.83099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:44:46.313 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T04:44:46.313 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:44:46.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.430+0000 7f394f616700 1 Processor -- start 2023-10-06T04:44:46.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.431+0000 7f394f616700 1 -- start start 2023-10-06T04:44:46.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.431+0000 7f394f616700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f394806c560 0x7f394806c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:46.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.431+0000 7f394f616700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39480c3070 con 0x7f3948142d50 2023-10-06T04:44:46.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.431+0000 7f394f616700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f394806cef0 con 0x7f39480caf00 2023-10-06T04:44:46.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.431+0000 7f394f616700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39480cbb50 con 0x7f394806c560 2023-10-06T04:44:46.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.432+0000 7f394d3b2700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f3948142d50 0x7f39480c3500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37878/0 (socket says 172.21.15.17:37878) 2023-10-06T04:44:46.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.432+0000 7f394d3b2700 1 -- 172.21.15.17:0/3279716024 learned_addr learned my addr 172.21.15.17:0/3279716024 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:46.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.432+0000 7f394cbb1700 1 --2- 172.21.15.17:0/3279716024 >> v2:172.21.15.17:3300/0 conn(0x7f394806c560 0x7f394806c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:46.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.432+0000 7f3947fff700 1 -- 172.21.15.17:0/3279716024 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 194242804 0 0) 0x7f39480c3070 con 0x7f3948142d50 2023-10-06T04:44:46.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.432+0000 7f3947fff700 1 -- 172.21.15.17:0/3279716024 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3930003570 con 0x7f3948142d50 2023-10-06T04:44:46.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.432+0000 7f394cbb1700 1 -- 172.21.15.17:0/3279716024 >> v1:172.21.15.136:6789/0 conn(0x7f39480caf00 legacy=0x7f39480cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:46.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.432+0000 7f394cbb1700 1 -- 172.21.15.17:0/3279716024 >> v1:172.21.15.17:6789/0 conn(0x7f3948142d50 legacy=0x7f39480c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:46.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.432+0000 7f394cbb1700 1 -- 172.21.15.17:0/3279716024 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39480c2740 con 0x7f394806c560 2023-10-06T04:44:46.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.432+0000 7f394cbb1700 1 --2- 172.21.15.17:0/3279716024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f394806c560 0x7f394806c9b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f393c0098e0 tx=0x7f393c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1074449040e6e97 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:46.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.432+0000 7f3947fff700 1 -- 172.21.15.17:0/3279716024 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393c011630 con 0x7f394806c560 2023-10-06T04:44:46.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.432+0000 7f3947fff700 1 -- 172.21.15.17:0/3279716024 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393c011790 con 0x7f394806c560 2023-10-06T04:44:46.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.432+0000 7f3947fff700 1 -- 172.21.15.17:0/3279716024 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393c011b30 con 0x7f394806c560 2023-10-06T04:44:46.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.433+0000 7f394f616700 1 -- 172.21.15.17:0/3279716024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f394806c560 msgr2=0x7f394806c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:46.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.433+0000 7f394f616700 1 --2- 172.21.15.17:0/3279716024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f394806c560 0x7f394806c9b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f393c0098e0 tx=0x7f393c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:46.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.433+0000 7f394f616700 1 -- 172.21.15.17:0/3279716024 shutdown_connections 2023-10-06T04:44:46.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.433+0000 7f394f616700 1 --2- 172.21.15.17:0/3279716024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f394806c560 0x7f394806c9b0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:46.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.433+0000 7f394f616700 1 -- 172.21.15.17:0/3279716024 >> 172.21.15.17:0/3279716024 conn(0x7f394806e140 msgr2=0x7f39480cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:46.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.433+0000 7f394f616700 1 -- 172.21.15.17:0/3279716024 shutdown_connections 2023-10-06T04:44:46.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.433+0000 7f394f616700 1 -- 172.21.15.17:0/3279716024 wait complete. 2023-10-06T04:44:46.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.434+0000 7f394f616700 1 Processor -- start 2023-10-06T04:44:46.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.434+0000 7f394f616700 1 -- start start 2023-10-06T04:44:46.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.435+0000 7f394f616700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f394806c560 0x7f39480af170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:46.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.435+0000 7f394f616700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f39480caf00 0x7f3948140e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:46.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.435+0000 7f394f616700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3948142d50 0x7f39480c53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:46.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.435+0000 7f394f616700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394816a2f0 con 0x7f3948142d50 2023-10-06T04:44:46.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.435+0000 7f394f616700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3948142540 con 0x7f394806c560 2023-10-06T04:44:46.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.435+0000 7f394f616700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39480af800 con 0x7f39480caf00 2023-10-06T04:44:46.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.435+0000 7f394dbb3700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3948142d50 0x7f39480c53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:46.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.435+0000 7f394dbb3700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3948142d50 0x7f39480c53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46200/0 (socket says 172.21.15.17:46200) 2023-10-06T04:44:46.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.435+0000 7f394dbb3700 1 -- 172.21.15.17:0/1527021485 learned_addr learned my addr 172.21.15.17:0/1527021485 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:46.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.435+0000 7f394cbb1700 1 --2- 172.21.15.17:0/1527021485 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f39480caf00 0x7f3948140e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:46.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.435+0000 7f394d3b2700 1 --2- 172.21.15.17:0/1527021485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f394806c560 0x7f39480af170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:46.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.435+0000 7f394dbb3700 1 -- 172.21.15.17:0/1527021485 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f39480caf00 msgr2=0x7f3948140e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:46.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.435+0000 7f394dbb3700 1 --2- 172.21.15.17:0/1527021485 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f39480caf00 0x7f3948140e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:46.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.435+0000 7f394dbb3700 1 -- 172.21.15.17:0/1527021485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f394806c560 msgr2=0x7f39480af170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:46.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.435+0000 7f394dbb3700 1 --2- 172.21.15.17:0/1527021485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f394806c560 0x7f39480af170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:46.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.435+0000 7f394dbb3700 1 -- 172.21.15.17:0/1527021485 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f393c009420 con 0x7f3948142d50 2023-10-06T04:44:46.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.435+0000 7f394dbb3700 1 --2- 172.21.15.17:0/1527021485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3948142d50 0x7f39480c53b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f393800c5b0 tx=0x7f3938007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:46.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.436+0000 7f39457fa700 1 -- 172.21.15.17:0/1527021485 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3938011590 con 0x7f3948142d50 2023-10-06T04:44:46.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.436+0000 7f39457fa700 1 -- 172.21.15.17:0/1527021485 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3938011710 con 0x7f3948142d50 2023-10-06T04:44:46.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.436+0000 7f394f616700 1 -- 172.21.15.17:0/1527021485 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39480b1180 con 0x7f3948142d50 2023-10-06T04:44:46.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.436+0000 7f39457fa700 1 -- 172.21.15.17:0/1527021485 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3938011ad0 con 0x7f3948142d50 2023-10-06T04:44:46.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.436+0000 7f394f616700 1 -- 172.21.15.17:0/1527021485 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39480b1740 con 0x7f3948142d50 2023-10-06T04:44:46.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.437+0000 7f394f616700 1 -- 172.21.15.17:0/1527021485 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3948063ff0 con 0x7f3948142d50 2023-10-06T04:44:46.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.437+0000 7f39457fa700 1 -- 172.21.15.17:0/1527021485 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f393801c460 con 0x7f3948142d50 2023-10-06T04:44:46.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.437+0000 7f39457fa700 1 --2- 172.21.15.17:0/1527021485 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3934066f30 0x7f39340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:46.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.438+0000 7f39457fa700 1 -- 172.21.15.17:0/1527021485 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f3938084140 con 0x7f3948142d50 2023-10-06T04:44:46.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.438+0000 7f394d3b2700 1 --2- 172.21.15.17:0/1527021485 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3934066f30 0x7f39340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:46.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.438+0000 7f394d3b2700 1 --2- 172.21.15.17:0/1527021485 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3934066f30 0x7f39340693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3940005c50 tx=0x7f3940009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:46.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.442+0000 7f39457fa700 1 -- 172.21.15.17:0/1527021485 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f39380514b0 con 0x7f3948142d50 2023-10-06T04:44:46.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.631+0000 7f394f616700 1 -- 172.21.15.17:0/1527021485 --> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f39480c2a20 con 0x7f3934066f30 2023-10-06T04:44:46.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.634+0000 7f39457fa700 1 -- 172.21.15.17:0/1527021485 <== mgr.4104 v2:172.21.15.17:6832/90424 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73006 (secure 0 0 0) 0x7f39480c2a20 con 0x7f3934066f30 2023-10-06T04:44:46.637 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:46.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.636+0000 7f394f616700 1 -- 172.21.15.17:0/1527021485 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3934066f30 msgr2=0x7f39340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:46.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.636+0000 7f394f616700 1 --2- 172.21.15.17:0/1527021485 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3934066f30 0x7f39340693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3940005c50 tx=0x7f3940009040 comp rx=0 tx=0).stop 2023-10-06T04:44:46.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.636+0000 7f394f616700 1 -- 172.21.15.17:0/1527021485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3948142d50 msgr2=0x7f39480c53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:46.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.636+0000 7f394f616700 1 --2- 172.21.15.17:0/1527021485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3948142d50 0x7f39480c53b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f393800c5b0 tx=0x7f3938007f60 comp rx=0 tx=0).stop 2023-10-06T04:44:46.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.636+0000 7f394f616700 1 -- 172.21.15.17:0/1527021485 shutdown_connections 2023-10-06T04:44:46.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.636+0000 7f394f616700 1 --2- 172.21.15.17:0/1527021485 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f3934066f30 0x7f39340693e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:46.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.636+0000 7f394f616700 1 --2- 172.21.15.17:0/1527021485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3948142d50 0x7f39480c53b0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:46.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.636+0000 7f394f616700 1 --2- 172.21.15.17:0/1527021485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f394806c560 0x7f39480af170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:46.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.636+0000 7f394f616700 1 --2- 172.21.15.17:0/1527021485 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f39480caf00 0x7f3948140e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:46.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.636+0000 7f394f616700 1 -- 172.21.15.17:0/1527021485 >> 172.21.15.17:0/1527021485 conn(0x7f394806e140 msgr2=0x7f3948067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:46.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.636+0000 7f394f616700 1 -- 172.21.15.17:0/1527021485 shutdown_connections 2023-10-06T04:44:46.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.636+0000 7f394f616700 1 -- 172.21.15.17:0/1527021485 wait complete. 2023-10-06T04:44:46.641 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-06T04:44:46.649 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2023-10-06T04:44:46.350702+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":237,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2390984,"kb_used_data":4488,"kb_used_omap":0,"kb_used_meta":2386432,"kb_avail":752583736,"statfs":{"total":773094113280,"available":770645745664,"internally_reserved":0,"allocated":4595712,"data_stored":2624336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2443706368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-58022,"num_objects":-33,"num_object_clones":0,"num_object_copies":-66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-33,"num_whiteouts":0,"num_read":-22,"num_read_kb":-11,"num_write":-185,"num_write_kb":-131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000922"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T04:44:38.190549+0000","last_change":"2023-10-06T04:43:24.001927+0000","last_active":"2023-10-06T04:44:38.190549+0000","last_peered":"2023-10-06T04:44:38.190549+0000","last_clean":"2023-10-06T04:44:38.190549+0000","last_became_active":"2023-10-06T04:43:24.001591+0000","last_became_peered":"2023-10-06T04:43:24.001591+0000","last_unstale":"2023-10-06T04:44:38.190549+0000","last_undegraded":"2023-10-06T04:44:38.190549+0000","last_fullsized":"2023-10-06T04:44:38.190549+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:47.262845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T04:44:38.515595+0000","last_change":"2023-10-06T04:43:23.708597+0000","last_active":"2023-10-06T04:44:38.515595+0000","last_peered":"2023-10-06T04:44:38.515595+0000","last_clean":"2023-10-06T04:44:38.515595+0000","last_became_active":"2023-10-06T04:43:23.708317+0000","last_became_peered":"2023-10-06T04:43:23.708317+0000","last_unstale":"2023-10-06T04:44:38.515595+0000","last_undegraded":"2023-10-06T04:44:38.515595+0000","last_fullsized":"2023-10-06T04:44:38.515595+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:56.213068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T04:44:39.056162+0000","last_change":"2023-10-06T04:43:23.708753+0000","last_active":"2023-10-06T04:44:39.056162+0000","last_peered":"2023-10-06T04:44:39.056162+0000","last_clean":"2023-10-06T04:44:39.056162+0000","last_became_active":"2023-10-06T04:43:23.708483+0000","last_became_peered":"2023-10-06T04:43:23.708483+0000","last_unstale":"2023-10-06T04:44:39.056162+0000","last_undegraded":"2023-10-06T04:44:39.056162+0000","last_fullsized":"2023-10-06T04:44:39.056162+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:47.262845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":179,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T04:44:38.189836+0000","last_change":"2023-10-06T04:43:23.706116+0000","last_active":"2023-10-06T04:44:38.189836+0000","last_peered":"2023-10-06T04:44:38.189836+0000","last_clean":"2023-10-06T04:44:38.189836+0000","last_became_active":"2023-10-06T04:43:23.705090+0000","last_became_peered":"2023-10-06T04:43:23.705090+0000","last_unstale":"2023-10-06T04:44:38.189836+0000","last_undegraded":"2023-10-06T04:44:38.189836+0000","last_fullsized":"2023-10-06T04:44:38.189836+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:29.869173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T04:44:38.190417+0000","last_change":"2023-10-06T04:43:24.002162+0000","last_active":"2023-10-06T04:44:38.190417+0000","last_peered":"2023-10-06T04:44:38.190417+0000","last_clean":"2023-10-06T04:44:38.190417+0000","last_became_active":"2023-10-06T04:43:24.001883+0000","last_became_peered":"2023-10-06T04:43:24.001883+0000","last_unstale":"2023-10-06T04:44:38.190417+0000","last_undegraded":"2023-10-06T04:44:38.190417+0000","last_fullsized":"2023-10-06T04:44:38.190417+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:51:11.168258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T04:44:38.189911+0000","last_change":"2023-10-06T04:43:24.002057+0000","last_active":"2023-10-06T04:44:38.189911+0000","last_peered":"2023-10-06T04:44:38.189911+0000","last_clean":"2023-10-06T04:44:38.189911+0000","last_became_active":"2023-10-06T04:43:24.001809+0000","last_became_peered":"2023-10-06T04:43:24.001809+0000","last_unstale":"2023-10-06T04:44:38.189911+0000","last_undegraded":"2023-10-06T04:44:38.189911+0000","last_fullsized":"2023-10-06T04:44:38.189911+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:49.693980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T04:44:39.056416+0000","last_change":"2023-10-06T04:43:24.002394+0000","last_active":"2023-10-06T04:44:39.056416+0000","last_peered":"2023-10-06T04:44:39.056416+0000","last_clean":"2023-10-06T04:44:39.056416+0000","last_became_active":"2023-10-06T04:43:24.001915+0000","last_became_peered":"2023-10-06T04:43:24.001915+0000","last_unstale":"2023-10-06T04:44:39.056416+0000","last_undegraded":"2023-10-06T04:44:39.056416+0000","last_fullsized":"2023-10-06T04:44:39.056416+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:45.031820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T04:44:38.897993+0000","last_change":"2023-10-06T04:43:24.002424+0000","last_active":"2023-10-06T04:44:38.897993+0000","last_peered":"2023-10-06T04:44:38.897993+0000","last_clean":"2023-10-06T04:44:38.897993+0000","last_became_active":"2023-10-06T04:43:24.002147+0000","last_became_peered":"2023-10-06T04:43:24.002147+0000","last_unstale":"2023-10-06T04:44:38.897993+0000","last_undegraded":"2023-10-06T04:44:38.897993+0000","last_fullsized":"2023-10-06T04:44:38.897993+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:45.031820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-06T04:44:38.898103+0000","last_change":"2023-10-06T04:43:23.707408+0000","last_active":"2023-10-06T04:44:38.898103+0000","last_peered":"2023-10-06T04:44:38.898103+0000","last_clean":"2023-10-06T04:44:38.898103+0000","last_became_active":"2023-10-06T04:43:23.707115+0000","last_became_peered":"2023-10-06T04:43:23.707115+0000","last_unstale":"2023-10-06T04:44:38.898103+0000","last_undegraded":"2023-10-06T04:44:38.898103+0000","last_fullsized":"2023-10-06T04:44:38.898103+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:56.213068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298284,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073556,"statfs":{"total":96636764160,"available":96331321344,"internally_reserved":0,"allocated":1019904,"data_stored":770818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.42799999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.52000000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":7.9580000000000002,"5min":7.9580000000000002,"15min":7.9580000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":8.0519999999999996,"5min":8.0519999999999996,"15min":8.0519999999999996},"last":0.49299999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.441}]},{"osd":4,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.40999999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.47499999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.46300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":425984,"data_stored":180450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.55000000000000004}]},{"osd":1,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.41499999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.39300000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.49099999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.50700000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.373},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.56599999999999995}]},{"osd":7,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.54000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302380,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069460,"statfs":{"total":96636764160,"available":96327127040,"internally_reserved":0,"allocated":1019904,"data_stored":770818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.45900000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.36899999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.38800000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.43099999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.56999999999999995}]},{"osd":6,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.624}]},{"osd":7,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.53600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":425984,"data_stored":180450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.307,"15min":0.307},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":0.39300000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":2.8900000000000001,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":0.34599999999999997}]},{"osd":3,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":4.3120000000000003,"5min":4.3120000000000003,"15min":4.3120000000000003},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":4.1980000000000004,"5min":4.1980000000000004,"15min":4.1980000000000004},"last":0.45200000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.8220000000000001,"5min":2.8220000000000001,"15min":2.8220000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.48699999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.51600000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":2.7850000000000001,"5min":2.7850000000000001,"15min":2.7850000000000001},"last":0.63700000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":2.8570000000000002,"5min":2.8570000000000002,"15min":2.8570000000000002},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.65200000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301800,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070040,"statfs":{"total":96636764160,"available":96327720960,"internally_reserved":0,"allocated":425984,"data_stored":180450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.29199999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":6.1280000000000001,"5min":6.1280000000000001,"15min":6.1280000000000001},"last":0.26500000000000001},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":19.983000000000001,"5min":19.983000000000001,"15min":19.983000000000001},"last":0.34599999999999997}]},{"osd":3,"last update":"Fri Oct 6 04:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.36699999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.436}]},{"osd":5,"last update":"Fri Oct 6 04:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.45300000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":6.0499999999999998,"5min":6.0499999999999998,"15min":6.0499999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.627}]},{"osd":7,"last update":"Fri Oct 6 04:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":6.0949999999999998,"5min":6.0949999999999998,"15min":6.0949999999999998},"last":0.54000000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":425984,"data_stored":180450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":11.978,"5min":11.978,"15min":11.978},"last":0.33400000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":12.920999999999999,"5min":12.920999999999999,"15min":12.920999999999999},"last":0.311},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.32200000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.439}]},{"osd":4,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":0.51800000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.504},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.57899999999999996}]},{"osd":6,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":0.47899999999999998}]},{"osd":7,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.41599999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":425984,"data_stored":180450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.57199999999999995}]},{"osd":1,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.499}]},{"osd":2,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.53700000000000003}]},{"osd":3,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.68400000000000005}]},{"osd":5,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.60999999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.59999999999999998}]},{"osd":7,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.70699999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":425984,"data_stored":180450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.78900000000000003}]},{"osd":1,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.624}]},{"osd":2,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.77200000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.73599999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.69299999999999995}]},{"osd":6,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.59099999999999997}]},{"osd":7,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.755},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.83099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:44:46.653 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:44:46.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.769+0000 7faf40510700 1 Processor -- start 2023-10-06T04:44:46.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.769+0000 7faf40510700 1 -- start start 2023-10-06T04:44:46.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.770+0000 7faf40510700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7faf3815ca80 0x7faf3806e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:46.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.770+0000 7faf40510700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7faf3815ce50 0x7faf3815d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:46.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.770+0000 7faf40510700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf380ab250 con 0x7faf3815d910 2023-10-06T04:44:46.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.770+0000 7faf40510700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf3806e660 con 0x7faf3815ca80 2023-10-06T04:44:46.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.770+0000 7faf40510700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf3806e940 con 0x7faf3815ce50 2023-10-06T04:44:46.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.771+0000 7faf3e2ac700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7faf3815ca80 0x7faf3806e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:46.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.771+0000 7faf3eaad700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7faf3815d910 0x7faf380aefa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37888/0 (socket says 172.21.15.17:37888) 2023-10-06T04:44:46.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.771+0000 7faf3eaad700 1 -- 172.21.15.17:0/2779985369 learned_addr learned my addr 172.21.15.17:0/2779985369 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:46.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.771+0000 7faf3daab700 1 --2- 172.21.15.17:0/2779985369 >> v2:172.21.15.136:3300/0 conn(0x7faf3815ce50 0x7faf3815d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:46.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.771+0000 7faf3e2ac700 1 -- 172.21.15.17:0/2779985369 >> v2:172.21.15.136:3300/0 conn(0x7faf3815ce50 msgr2=0x7faf3815d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:46.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.771+0000 7faf3e2ac700 1 --2- 172.21.15.17:0/2779985369 >> v2:172.21.15.136:3300/0 conn(0x7faf3815ce50 0x7faf3815d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:46.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.771+0000 7faf3e2ac700 1 -- 172.21.15.17:0/2779985369 >> v1:172.21.15.17:6789/0 conn(0x7faf3815d910 legacy=0x7faf380aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:46.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.771+0000 7faf3e2ac700 1 -- 172.21.15.17:0/2779985369 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3806ec20 con 0x7faf3815ca80 2023-10-06T04:44:46.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.771+0000 7faf3d2aa700 1 -- 172.21.15.17:0/2779985369 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3506959418 0 0) 0x7faf380ab250 con 0x7faf3815d910 2023-10-06T04:44:46.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.771+0000 7faf3e2ac700 1 --2- 172.21.15.17:0/2779985369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf3815ca80 0x7faf3806e050 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7faf380ce4e0 tx=0x7faf300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16c79e003b8e46aa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:46.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.771+0000 7faf3d2aa700 1 -- 172.21.15.17:0/2779985369 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf30011630 con 0x7faf3815ca80 2023-10-06T04:44:46.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.771+0000 7faf3d2aa700 1 -- 172.21.15.17:0/2779985369 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf30011790 con 0x7faf3815ca80 2023-10-06T04:44:46.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.771+0000 7faf3d2aa700 1 -- 172.21.15.17:0/2779985369 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf30011b30 con 0x7faf3815ca80 2023-10-06T04:44:46.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.772+0000 7faf40510700 1 -- 172.21.15.17:0/2779985369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf3815ca80 msgr2=0x7faf3806e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:46.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.772+0000 7faf40510700 1 --2- 172.21.15.17:0/2779985369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf3815ca80 0x7faf3806e050 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7faf380ce4e0 tx=0x7faf300091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:46.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.772+0000 7faf40510700 1 -- 172.21.15.17:0/2779985369 shutdown_connections 2023-10-06T04:44:46.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.772+0000 7faf40510700 1 --2- 172.21.15.17:0/2779985369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf3815ca80 0x7faf3806e050 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:46.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.772+0000 7faf40510700 1 --2- 172.21.15.17:0/2779985369 >> v2:172.21.15.136:3300/0 conn(0x7faf3815ce50 0x7faf3815d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:46.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.772+0000 7faf40510700 1 -- 172.21.15.17:0/2779985369 >> 172.21.15.17:0/2779985369 conn(0x7faf3806cd40 msgr2=0x7faf38087fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:46.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.772+0000 7faf40510700 1 -- 172.21.15.17:0/2779985369 shutdown_connections 2023-10-06T04:44:46.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.772+0000 7faf40510700 1 -- 172.21.15.17:0/2779985369 wait complete. 2023-10-06T04:44:46.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.773+0000 7faf40510700 1 Processor -- start 2023-10-06T04:44:46.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.773+0000 7faf40510700 1 -- start start 2023-10-06T04:44:46.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.774+0000 7faf40510700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faf3815ca80 0x7faf380b3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:46.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.774+0000 7faf40510700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf3815ce50 0x7faf3816d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:46.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.774+0000 7faf40510700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faf3815d910 0x7faf3816d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:46.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.774+0000 7faf40510700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf380b30b0 con 0x7faf3815ce50 2023-10-06T04:44:46.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.774+0000 7faf40510700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf380b2240 con 0x7faf3815d910 2023-10-06T04:44:46.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.774+0000 7faf40510700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf380ca690 con 0x7faf3815ca80 2023-10-06T04:44:46.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.774+0000 7faf3daab700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf3815ce50 0x7faf3816d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:46.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.774+0000 7faf3daab700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf3815ce50 0x7faf3816d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46226/0 (socket says 172.21.15.17:46226) 2023-10-06T04:44:46.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.774+0000 7faf3daab700 1 -- 172.21.15.17:0/898296820 learned_addr learned my addr 172.21.15.17:0/898296820 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:46.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.774+0000 7faf3e2ac700 1 --2- 172.21.15.17:0/898296820 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faf3815ca80 0x7faf380b3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:46.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.774+0000 7faf3eaad700 1 --2- 172.21.15.17:0/898296820 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faf3815d910 0x7faf3816d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:46.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.774+0000 7faf3daab700 1 -- 172.21.15.17:0/898296820 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faf3815ca80 msgr2=0x7faf380b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:46.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.774+0000 7faf3daab700 1 --2- 172.21.15.17:0/898296820 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faf3815ca80 0x7faf380b3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:46.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.774+0000 7faf3daab700 1 -- 172.21.15.17:0/898296820 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faf3815d910 msgr2=0x7faf3816d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:46.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.774+0000 7faf3daab700 1 --2- 172.21.15.17:0/898296820 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faf3815d910 0x7faf3816d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:46.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.774+0000 7faf3daab700 1 -- 172.21.15.17:0/898296820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf30009420 con 0x7faf3815ce50 2023-10-06T04:44:46.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.774+0000 7faf3eaad700 1 --2- 172.21.15.17:0/898296820 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faf3815d910 0x7faf3816d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:46.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.774+0000 7faf3daab700 1 --2- 172.21.15.17:0/898296820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf3815ce50 0x7faf3816d2f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00ec80 tx=0x7faf2c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:46.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.775+0000 7faf367fc700 1 -- 172.21.15.17:0/898296820 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c00c850 con 0x7faf3815ce50 2023-10-06T04:44:46.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.775+0000 7faf367fc700 1 -- 172.21.15.17:0/898296820 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2c00c9b0 con 0x7faf3815ce50 2023-10-06T04:44:46.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.775+0000 7faf40510700 1 -- 172.21.15.17:0/898296820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf380b24a0 con 0x7faf3815ce50 2023-10-06T04:44:46.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.775+0000 7faf367fc700 1 -- 172.21.15.17:0/898296820 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c00cd50 con 0x7faf3815ce50 2023-10-06T04:44:46.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.775+0000 7faf40510700 1 -- 172.21.15.17:0/898296820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf380b2a60 con 0x7faf3815ce50 2023-10-06T04:44:46.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.775+0000 7faf40510700 1 -- 172.21.15.17:0/898296820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf380cbcb0 con 0x7faf3815ce50 2023-10-06T04:44:46.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.776+0000 7faf367fc700 1 -- 172.21.15.17:0/898296820 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faf2c013680 con 0x7faf3815ce50 2023-10-06T04:44:46.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.776+0000 7faf367fc700 1 --2- 172.21.15.17:0/898296820 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7faf24066f30 0x7faf240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:46.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.776+0000 7faf367fc700 1 -- 172.21.15.17:0/898296820 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7faf2c084970 con 0x7faf3815ce50 2023-10-06T04:44:46.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.776+0000 7faf3e2ac700 1 --2- 172.21.15.17:0/898296820 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7faf24066f30 0x7faf240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:46.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.777+0000 7faf3e2ac700 1 --2- 172.21.15.17:0/898296820 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7faf24066f30 0x7faf240693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7faf300093f0 tx=0x7faf30017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:46.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.781+0000 7faf367fc700 1 -- 172.21.15.17:0/898296820 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf380cbcb0 con 0x7faf3815ce50 2023-10-06T04:44:46.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.979+0000 7faf40510700 1 -- 172.21.15.17:0/898296820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf380cbcb0 con 0x7faf3815ce50 2023-10-06T04:44:46.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.980+0000 7faf367fc700 1 -- 172.21.15.17:0/898296820 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+13777 (secure 0 0 0) 0x7faf380cbcb0 con 0x7faf3815ce50 2023-10-06T04:44:46.981 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:46.982 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":39,"fsid":"780777c4-2b25-4d35-9058-c9f2d62e3ad9","created":"2023-10-06T04:43:10.578520+0000","modified":"2023-10-06T04:44:42.469110+0000","last_up_change":"2023-10-06T04:43:20.682958+0000","last_in_change":"2023-10-06T04:43:12.978917+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:43:21.795733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:43:22.389592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"84737b08-575c-46dd-9488-073ae8504494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6809","nonce":90656},{"type":"v1","addr":"172.21.15.17:6811","nonce":90656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":90656},{"type":"v1","addr":"172.21.15.17:6814","nonce":90656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":90656},{"type":"v1","addr":"172.21.15.17:6822","nonce":90656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":90656},{"type":"v1","addr":"172.21.15.17:6818","nonce":90656}]},"public_addr":"172.21.15.17:6811/90656","cluster_addr":"172.21.15.17:6814/90656","heartbeat_back_addr":"172.21.15.17:6822/90656","heartbeat_front_addr":"172.21.15.17:6818/90656","state":["exists","up"]},{"osd":1,"uuid":"dffeb740-58a2-4fd6-8ff1-a0a11a2cc709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":90655},{"type":"v1","addr":"172.21.15.17:6801","nonce":90655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":90655},{"type":"v1","addr":"172.21.15.17:6803","nonce":90655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":90655},{"type":"v1","addr":"172.21.15.17:6807","nonce":90655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":90655},{"type":"v1","addr":"172.21.15.17:6805","nonce":90655}]},"public_addr":"172.21.15.17:6801/90655","cluster_addr":"172.21.15.17:6803/90655","heartbeat_back_addr":"172.21.15.17:6807/90655","heartbeat_front_addr":"172.21.15.17:6805/90655","state":["exists","up"]},{"osd":2,"uuid":"48bd6831-763d-48c2-b515-e02c216d608b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":90657},{"type":"v1","addr":"172.21.15.17:6810","nonce":90657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":90657},{"type":"v1","addr":"172.21.15.17:6815","nonce":90657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":90657},{"type":"v1","addr":"172.21.15.17:6823","nonce":90657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":90657},{"type":"v1","addr":"172.21.15.17:6819","nonce":90657}]},"public_addr":"172.21.15.17:6810/90657","cluster_addr":"172.21.15.17:6815/90657","heartbeat_back_addr":"172.21.15.17:6823/90657","heartbeat_front_addr":"172.21.15.17:6819/90657","state":["exists","up"]},{"osd":3,"uuid":"ae7dbb23-abe7-4bd3-a4df-6f5963d6804c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":90688},{"type":"v1","addr":"172.21.15.17:6825","nonce":90688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":90688},{"type":"v1","addr":"172.21.15.17:6827","nonce":90688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":90688},{"type":"v1","addr":"172.21.15.17:6831","nonce":90688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":90688},{"type":"v1","addr":"172.21.15.17:6829","nonce":90688}]},"public_addr":"172.21.15.17:6825/90688","cluster_addr":"172.21.15.17:6827/90688","heartbeat_back_addr":"172.21.15.17:6831/90688","heartbeat_front_addr":"172.21.15.17:6829/90688","state":["exists","up"]},{"osd":4,"uuid":"29991fb4-1667-4ea3-aca0-d55db27f3bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":90902},{"type":"v1","addr":"172.21.15.136:6801","nonce":90902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":90902},{"type":"v1","addr":"172.21.15.136:6803","nonce":90902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":90902},{"type":"v1","addr":"172.21.15.136:6807","nonce":90902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":90902},{"type":"v1","addr":"172.21.15.136:6805","nonce":90902}]},"public_addr":"172.21.15.136:6801/90902","cluster_addr":"172.21.15.136:6803/90902","heartbeat_back_addr":"172.21.15.136:6807/90902","heartbeat_front_addr":"172.21.15.136:6805/90902","state":["exists","up"]},{"osd":5,"uuid":"398b4ff9-03fc-421f-882c-ba12aa088eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":90901},{"type":"v1","addr":"172.21.15.136:6809","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":90901},{"type":"v1","addr":"172.21.15.136:6811","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":90901},{"type":"v1","addr":"172.21.15.136:6815","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":90901},{"type":"v1","addr":"172.21.15.136:6813","nonce":90901}]},"public_addr":"172.21.15.136:6809/90901","cluster_addr":"172.21.15.136:6811/90901","heartbeat_back_addr":"172.21.15.136:6815/90901","heartbeat_front_addr":"172.21.15.136:6813/90901","state":["exists","up"]},{"osd":6,"uuid":"1bb91a72-4dab-4cdb-aa1d-2b8a9edf1ad0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6823","nonce":90927},{"type":"v1","addr":"172.21.15.136:6825","nonce":90927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":90927},{"type":"v1","addr":"172.21.15.136:6827","nonce":90927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":90927},{"type":"v1","addr":"172.21.15.136:6831","nonce":90927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":90927},{"type":"v1","addr":"172.21.15.136:6829","nonce":90927}]},"public_addr":"172.21.15.136:6825/90927","cluster_addr":"172.21.15.136:6827/90927","heartbeat_back_addr":"172.21.15.136:6831/90927","heartbeat_front_addr":"172.21.15.136:6829/90927","state":["exists","up"]},{"osd":7,"uuid":"719b654e-010d-4aa4-8c13-83fdde242b47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":90934},{"type":"v1","addr":"172.21.15.136:6817","nonce":90934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":90934},{"type":"v1","addr":"172.21.15.136:6819","nonce":90934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":90934},{"type":"v1","addr":"172.21.15.136:6824","nonce":90934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":90934},{"type":"v1","addr":"172.21.15.136:6821","nonce":90934}]},"public_addr":"172.21.15.136:6817/90934","cluster_addr":"172.21.15.136:6819/90934","heartbeat_back_addr":"172.21.15.136:6824/90934","heartbeat_front_addr":"172.21.15.136:6821/90934","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.157479+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.140520+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.190743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.231396+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.156510+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.145822+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.202888+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:43:18.139532+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6837/460551791":"2023-10-07T04:44:38.185021+0000","172.21.15.17:6835/460551791":"2023-10-07T04:44:38.185021+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:44:46.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.982+0000 7faf40510700 1 -- 172.21.15.17:0/898296820 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7faf24066f30 msgr2=0x7faf240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:46.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.982+0000 7faf40510700 1 --2- 172.21.15.17:0/898296820 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7faf24066f30 0x7faf240693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7faf300093f0 tx=0x7faf30017000 comp rx=0 tx=0).stop 2023-10-06T04:44:46.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.982+0000 7faf40510700 1 -- 172.21.15.17:0/898296820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf3815ce50 msgr2=0x7faf3816d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:46.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.982+0000 7faf40510700 1 --2- 172.21.15.17:0/898296820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf3815ce50 0x7faf3816d2f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00ec80 tx=0x7faf2c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:46.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.982+0000 7faf40510700 1 -- 172.21.15.17:0/898296820 shutdown_connections 2023-10-06T04:44:46.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.982+0000 7faf40510700 1 --2- 172.21.15.17:0/898296820 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7faf24066f30 0x7faf240693e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:46.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.982+0000 7faf40510700 1 --2- 172.21.15.17:0/898296820 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faf3815d910 0x7faf3816d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:46.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.982+0000 7faf40510700 1 --2- 172.21.15.17:0/898296820 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faf3815ca80 0x7faf380b3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:46.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.982+0000 7faf40510700 1 --2- 172.21.15.17:0/898296820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf3815ce50 0x7faf3816d2f0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:46.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.982+0000 7faf40510700 1 -- 172.21.15.17:0/898296820 >> 172.21.15.17:0/898296820 conn(0x7faf3806cd40 msgr2=0x7faf38068040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:46.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.982+0000 7faf40510700 1 -- 172.21.15.17:0/898296820 shutdown_connections 2023-10-06T04:44:46.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:46.982+0000 7faf40510700 1 -- 172.21.15.17:0/898296820 wait complete. 2023-10-06T04:44:47.997 INFO:tasks.ceph:Scrubbing osd.0 2023-10-06T04:44:47.997 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:44:48.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.131+0000 7f9585d15700 1 Processor -- start 2023-10-06T04:44:48.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.131+0000 7f9585d15700 1 -- start start 2023-10-06T04:44:48.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.131+0000 7f9585d15700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9580150360 0x7f9580150730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:48.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.131+0000 7f9585d15700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f95800cb6b0 0x7f95800cd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:48.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.131+0000 7f9585d15700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f95800cbb50 0x7f95800cd590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:48.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.131+0000 7f9585d15700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95800cc330 con 0x7f95800cb6b0 2023-10-06T04:44:48.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.131+0000 7f9585d15700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95800cdad0 con 0x7f95800cbb50 2023-10-06T04:44:48.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.131+0000 7f9585d15700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95800cc050 con 0x7f9580150360 2023-10-06T04:44:48.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.132+0000 7f957effd700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f95800cb6b0 0x7f95800cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:48.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.132+0000 7f957effd700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f95800cb6b0 0x7f95800cd050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46232/0 (socket says 172.21.15.17:46232) 2023-10-06T04:44:48.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.132+0000 7f957effd700 1 -- 172.21.15.17:0/2559437797 learned_addr learned my addr 172.21.15.17:0/2559437797 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:48.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.132+0000 7f957f7fe700 1 --2- 172.21.15.17:0/2559437797 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9580150360 0x7f9580150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:48.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.132+0000 7f957ffff700 1 --2- 172.21.15.17:0/2559437797 >> v2:172.21.15.136:3300/0 conn(0x7f95800cbb50 0x7f95800cd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:48.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.132+0000 7f957effd700 1 -- 172.21.15.17:0/2559437797 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9580150360 msgr2=0x7f9580150730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:48.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.132+0000 7f957effd700 1 --2- 172.21.15.17:0/2559437797 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9580150360 0x7f9580150730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:48.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.132+0000 7f957effd700 1 -- 172.21.15.17:0/2559437797 >> v2:172.21.15.136:3300/0 conn(0x7f95800cbb50 msgr2=0x7f95800cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:48.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.132+0000 7f957effd700 1 --2- 172.21.15.17:0/2559437797 >> v2:172.21.15.136:3300/0 conn(0x7f95800cbb50 0x7f95800cd590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:48.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.132+0000 7f957effd700 1 -- 172.21.15.17:0/2559437797 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f958015b130 con 0x7f95800cb6b0 2023-10-06T04:44:48.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.132+0000 7f957effd700 1 --2- 172.21.15.17:0/2559437797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95800cb6b0 0x7f95800cd050 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f9580154400 tx=0x7f9568009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71316f26042c4f56 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:48.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.132+0000 7f957e7fc700 1 -- 172.21.15.17:0/2559437797 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956800b860 con 0x7f95800cb6b0 2023-10-06T04:44:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.132+0000 7f957e7fc700 1 -- 172.21.15.17:0/2559437797 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f956800b9c0 con 0x7f95800cb6b0 2023-10-06T04:44:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.132+0000 7f957e7fc700 1 -- 172.21.15.17:0/2559437797 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956800bd60 con 0x7f95800cb6b0 2023-10-06T04:44:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.133+0000 7f9585d15700 1 -- 172.21.15.17:0/2559437797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95800cb6b0 msgr2=0x7f95800cd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.133+0000 7f9585d15700 1 --2- 172.21.15.17:0/2559437797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95800cb6b0 0x7f95800cd050 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f9580154400 tx=0x7f9568009250 comp rx=0 tx=0).stop 2023-10-06T04:44:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.133+0000 7f9585d15700 1 -- 172.21.15.17:0/2559437797 shutdown_connections 2023-10-06T04:44:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.133+0000 7f9585d15700 1 --2- 172.21.15.17:0/2559437797 >> v2:172.21.15.136:3300/0 conn(0x7f95800cbb50 0x7f95800cd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.133+0000 7f9585d15700 1 --2- 172.21.15.17:0/2559437797 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9580150360 0x7f9580150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.133+0000 7f9585d15700 1 --2- 172.21.15.17:0/2559437797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95800cb6b0 0x7f95800cd050 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.133+0000 7f9585d15700 1 -- 172.21.15.17:0/2559437797 >> 172.21.15.17:0/2559437797 conn(0x7f958008a180 msgr2=0x7f9580099aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.133+0000 7f9585d15700 1 -- 172.21.15.17:0/2559437797 shutdown_connections 2023-10-06T04:44:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.133+0000 7f9585d15700 1 -- 172.21.15.17:0/2559437797 wait complete. 2023-10-06T04:44:48.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.134+0000 7f9585d15700 1 Processor -- start 2023-10-06T04:44:48.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.134+0000 7f9585d15700 1 -- start start 2023-10-06T04:44:48.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.135+0000 7f9585d15700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95800cb6b0 0x7f95800c9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:48.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.135+0000 7f9585d15700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95800cbb50 0x7f95800c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:48.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.135+0000 7f9585d15700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9580150360 0x7f95800c9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:48.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.135+0000 7f9585d15700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95800c8ba0 con 0x7f95800cb6b0 2023-10-06T04:44:48.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.135+0000 7f9585d15700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95800c7cf0 con 0x7f95800cbb50 2023-10-06T04:44:48.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.135+0000 7f9585d15700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95800c7f90 con 0x7f9580150360 2023-10-06T04:44:48.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.135+0000 7f957f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95800cb6b0 0x7f95800c9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:48.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.135+0000 7f957f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95800cb6b0 0x7f95800c9030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46244/0 (socket says 172.21.15.17:46244) 2023-10-06T04:44:48.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.135+0000 7f957f7fe700 1 -- 172.21.15.17:0/1798896935 learned_addr learned my addr 172.21.15.17:0/1798896935 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:48.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.135+0000 7f957ffff700 1 --2- 172.21.15.17:0/1798896935 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9580150360 0x7f95800c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:48.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.135+0000 7f957effd700 1 --2- 172.21.15.17:0/1798896935 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95800cbb50 0x7f95800c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:48.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.135+0000 7f957f7fe700 1 -- 172.21.15.17:0/1798896935 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9580150360 msgr2=0x7f95800c9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:48.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.135+0000 7f957f7fe700 1 --2- 172.21.15.17:0/1798896935 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9580150360 0x7f95800c9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:48.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.135+0000 7f957f7fe700 1 -- 172.21.15.17:0/1798896935 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95800cbb50 msgr2=0x7f95800c77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:48.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.135+0000 7f957f7fe700 1 --2- 172.21.15.17:0/1798896935 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95800cbb50 0x7f95800c77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:48.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.135+0000 7f957f7fe700 1 -- 172.21.15.17:0/1798896935 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95680094f0 con 0x7f95800cb6b0 2023-10-06T04:44:48.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.135+0000 7f957f7fe700 1 --2- 172.21.15.17:0/1798896935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95800cb6b0 0x7f95800c9030 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f957000d890 tx=0x7f9570008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:48.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.136+0000 7f95777fe700 1 -- 172.21.15.17:0/1798896935 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95700125f0 con 0x7f95800cb6b0 2023-10-06T04:44:48.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.136+0000 7f95777fe700 1 -- 172.21.15.17:0/1798896935 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9570012750 con 0x7f95800cb6b0 2023-10-06T04:44:48.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.136+0000 7f95777fe700 1 -- 172.21.15.17:0/1798896935 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9570012af0 con 0x7f95800cb6b0 2023-10-06T04:44:48.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.136+0000 7f9585d15700 1 -- 172.21.15.17:0/1798896935 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95800c8270 con 0x7f95800cb6b0 2023-10-06T04:44:48.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.136+0000 7f9585d15700 1 -- 172.21.15.17:0/1798896935 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95800c8830 con 0x7f95800cb6b0 2023-10-06T04:44:48.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.136+0000 7f9585d15700 1 -- 172.21.15.17:0/1798896935 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f95800718b0 con 0x7f95800cb6b0 2023-10-06T04:44:48.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.137+0000 7f95777fe700 1 -- 172.21.15.17:0/1798896935 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f957001e460 con 0x7f95800cb6b0 2023-10-06T04:44:48.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.138+0000 7f95777fe700 1 --2- 172.21.15.17:0/1798896935 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9560066f30 0x7f95600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:48.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.138+0000 7f95777fe700 1 -- 172.21.15.17:0/1798896935 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f9570085310 con 0x7f95800cb6b0 2023-10-06T04:44:48.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.138+0000 7f957effd700 1 --2- 172.21.15.17:0/1798896935 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9560066f30 0x7f95600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:48.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.138+0000 7f95777fe700 1 --2- 172.21.15.17:0/1798896935 >> [v2:172.21.15.17:6809/90656,v1:172.21.15.17:6811/90656] conn(0x7f956006d3a0 0x7f956006f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:48.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.138+0000 7f95777fe700 1 -- 172.21.15.17:0/1798896935 --> [v2:172.21.15.17:6809/90656,v1:172.21.15.17:6811/90656] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f956006fe80 con 0x7f956006d3a0 2023-10-06T04:44:48.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.138+0000 7f95777fe700 1 -- 172.21.15.17:0/1798896935 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95700856e0 con 0x7f95800cb6b0 2023-10-06T04:44:48.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.138+0000 7f957ffff700 1 --2- 172.21.15.17:0/1798896935 >> [v2:172.21.15.17:6809/90656,v1:172.21.15.17:6811/90656] conn(0x7f956006d3a0 0x7f956006f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:48.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.138+0000 7f957effd700 1 --2- 172.21.15.17:0/1798896935 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9560066f30 0x7f95600693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9580154400 tx=0x7f9568017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:48.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.138+0000 7f957ffff700 1 --2- 172.21.15.17:0/1798896935 >> [v2:172.21.15.17:6809/90656,v1:172.21.15.17:6811/90656] conn(0x7f956006d3a0 0x7f956006f7b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:48.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.139+0000 7f95777fe700 1 -- 172.21.15.17:0/1798896935 <== osd.0 v2:172.21.15.17:6809/90656 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f956006fe80 con 0x7f956006d3a0 2023-10-06T04:44:48.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.153+0000 7f9585d15700 1 -- 172.21.15.17:0/1798896935 --> [v2:172.21.15.17:6809/90656,v1:172.21.15.17:6811/90656] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f958006ce80 con 0x7f956006d3a0 2023-10-06T04:44:48.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.153+0000 7f95777fe700 1 -- 172.21.15.17:0/1798896935 <== osd.0 v2:172.21.15.17:6809/90656 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f958006ce80 con 0x7f956006d3a0 2023-10-06T04:44:48.155 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-06T04:44:48.155 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:44:48.155 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-06T04:44:48.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.153+0000 7f9585d15700 1 -- 172.21.15.17:0/1798896935 >> [v2:172.21.15.17:6809/90656,v1:172.21.15.17:6811/90656] conn(0x7f956006d3a0 msgr2=0x7f956006f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:48.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.153+0000 7f9585d15700 1 --2- 172.21.15.17:0/1798896935 >> [v2:172.21.15.17:6809/90656,v1:172.21.15.17:6811/90656] conn(0x7f956006d3a0 0x7f956006f7b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:48.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.153+0000 7f9585d15700 1 -- 172.21.15.17:0/1798896935 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9560066f30 msgr2=0x7f95600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:48.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.153+0000 7f9585d15700 1 --2- 172.21.15.17:0/1798896935 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9560066f30 0x7f95600693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9580154400 tx=0x7f9568017000 comp rx=0 tx=0).stop 2023-10-06T04:44:48.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.153+0000 7f9585d15700 1 -- 172.21.15.17:0/1798896935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95800cb6b0 msgr2=0x7f95800c9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:48.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.153+0000 7f9585d15700 1 --2- 172.21.15.17:0/1798896935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95800cb6b0 0x7f95800c9030 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f957000d890 tx=0x7f9570008040 comp rx=0 tx=0).stop 2023-10-06T04:44:48.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.153+0000 7f957ffff700 1 -- 172.21.15.17:0/1798896935 reap_dead start 2023-10-06T04:44:48.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.154+0000 7f9585d15700 1 -- 172.21.15.17:0/1798896935 shutdown_connections 2023-10-06T04:44:48.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.154+0000 7f9585d15700 1 -- 172.21.15.17:0/1798896935 >> 172.21.15.17:0/1798896935 conn(0x7f958008a180 msgr2=0x7f95800d0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:48.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.154+0000 7f9585d15700 1 -- 172.21.15.17:0/1798896935 shutdown_connections 2023-10-06T04:44:48.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.154+0000 7f9585d15700 1 -- 172.21.15.17:0/1798896935 wait complete. 2023-10-06T04:44:48.167 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-06T04:44:48.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.285+0000 7fed94a4a700 1 Processor -- start 2023-10-06T04:44:48.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.285+0000 7fed94a4a700 1 -- start start 2023-10-06T04:44:48.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.286+0000 7fed94a4a700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fed9015d610 0x7fed900cac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:48.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.286+0000 7fed94a4a700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fed901509a0 0x7fed9015b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:48.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.286+0000 7fed94a4a700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed9015aed0 con 0x7fed900cb1b0 2023-10-06T04:44:48.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.286+0000 7fed94a4a700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed900cb680 con 0x7fed901509a0 2023-10-06T04:44:48.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.286+0000 7fed94a4a700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed900cb960 con 0x7fed9015d610 2023-10-06T04:44:48.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.286+0000 7fed8ed9d700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fed901509a0 0x7fed9015b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:48.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.286+0000 7fed8dd9b700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fed900cb1b0 0x7fed90150290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37890/0 (socket says 172.21.15.17:37890) 2023-10-06T04:44:48.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.286+0000 7fed8dd9b700 1 -- 172.21.15.17:0/2780082577 learned_addr learned my addr 172.21.15.17:0/2780082577 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:48.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.286+0000 7fed8e59c700 1 --2- 172.21.15.17:0/2780082577 >> v2:172.21.15.136:3300/0 conn(0x7fed9015d610 0x7fed900cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:48.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.286+0000 7fed8ed9d700 1 -- 172.21.15.17:0/2780082577 >> v2:172.21.15.136:3300/0 conn(0x7fed9015d610 msgr2=0x7fed900cac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:48.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.286+0000 7fed8ed9d700 1 --2- 172.21.15.17:0/2780082577 >> v2:172.21.15.136:3300/0 conn(0x7fed9015d610 0x7fed900cac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:48.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.286+0000 7fed8ed9d700 1 -- 172.21.15.17:0/2780082577 >> v1:172.21.15.17:6789/0 conn(0x7fed900cb1b0 legacy=0x7fed90150290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:48.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.286+0000 7fed8d59a700 1 -- 172.21.15.17:0/2780082577 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3053409552 0 0) 0x7fed9015aed0 con 0x7fed900cb1b0 2023-10-06T04:44:48.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.286+0000 7fed8ed9d700 1 -- 172.21.15.17:0/2780082577 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed900cbc40 con 0x7fed901509a0 2023-10-06T04:44:48.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.287+0000 7fed8ed9d700 1 --2- 172.21.15.17:0/2780082577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed901509a0 0x7fed9015b380 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fed90088a80 tx=0x7fed88009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ebdf1dc75ad169b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:48.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.287+0000 7fed8d59a700 1 -- 172.21.15.17:0/2780082577 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8800e070 con 0x7fed901509a0 2023-10-06T04:44:48.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.287+0000 7fed8d59a700 1 -- 172.21.15.17:0/2780082577 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed8800bc30 con 0x7fed901509a0 2023-10-06T04:44:48.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.287+0000 7fed8d59a700 1 -- 172.21.15.17:0/2780082577 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed88012430 con 0x7fed901509a0 2023-10-06T04:44:48.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.287+0000 7fed94a4a700 1 -- 172.21.15.17:0/2780082577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed901509a0 msgr2=0x7fed9015b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:48.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.287+0000 7fed94a4a700 1 --2- 172.21.15.17:0/2780082577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed901509a0 0x7fed9015b380 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fed90088a80 tx=0x7fed88009780 comp rx=0 tx=0).stop 2023-10-06T04:44:48.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.287+0000 7fed94a4a700 1 -- 172.21.15.17:0/2780082577 shutdown_connections 2023-10-06T04:44:48.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.287+0000 7fed94a4a700 1 --2- 172.21.15.17:0/2780082577 >> v2:172.21.15.136:3300/0 conn(0x7fed9015d610 0x7fed900cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:48.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.287+0000 7fed94a4a700 1 --2- 172.21.15.17:0/2780082577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed901509a0 0x7fed9015b380 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:48.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.287+0000 7fed94a4a700 1 -- 172.21.15.17:0/2780082577 >> 172.21.15.17:0/2780082577 conn(0x7fed90099960 msgr2=0x7fed9006cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:48.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.287+0000 7fed94a4a700 1 -- 172.21.15.17:0/2780082577 shutdown_connections 2023-10-06T04:44:48.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.287+0000 7fed94a4a700 1 -- 172.21.15.17:0/2780082577 wait complete. 2023-10-06T04:44:48.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.288+0000 7fed94a4a700 1 Processor -- start 2023-10-06T04:44:48.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.288+0000 7fed94a4a700 1 -- start start 2023-10-06T04:44:48.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.289+0000 7fed94a4a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed900cb1b0 0x7fed90169d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:48.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.289+0000 7fed94a4a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fed901509a0 0x7fed90153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:48.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.289+0000 7fed94a4a700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fed9015d610 0x7fed900c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:48.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.289+0000 7fed94a4a700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed900c4240 con 0x7fed900cb1b0 2023-10-06T04:44:48.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.289+0000 7fed94a4a700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9016a400 con 0x7fed901509a0 2023-10-06T04:44:48.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.289+0000 7fed94a4a700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9016a6e0 con 0x7fed9015d610 2023-10-06T04:44:48.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.289+0000 7fed8e59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed900cb1b0 0x7fed90169d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:48.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.289+0000 7fed8e59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed900cb1b0 0x7fed90169d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46252/0 (socket says 172.21.15.17:46252) 2023-10-06T04:44:48.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.289+0000 7fed8e59c700 1 -- 172.21.15.17:0/72254277 learned_addr learned my addr 172.21.15.17:0/72254277 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:48.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.289+0000 7fed8ed9d700 1 --2- 172.21.15.17:0/72254277 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fed9015d610 0x7fed900c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:48.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.289+0000 7fed8dd9b700 1 --2- 172.21.15.17:0/72254277 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fed901509a0 0x7fed90153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:48.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.290+0000 7fed8e59c700 1 -- 172.21.15.17:0/72254277 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fed9015d610 msgr2=0x7fed900c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:48.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.290+0000 7fed8e59c700 1 --2- 172.21.15.17:0/72254277 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fed9015d610 0x7fed900c5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:48.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.290+0000 7fed8e59c700 1 -- 172.21.15.17:0/72254277 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fed901509a0 msgr2=0x7fed90153690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:48.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.290+0000 7fed8e59c700 1 --2- 172.21.15.17:0/72254277 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fed901509a0 0x7fed90153690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:48.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.290+0000 7fed8e59c700 1 -- 172.21.15.17:0/72254277 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed88009a20 con 0x7fed900cb1b0 2023-10-06T04:44:48.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.290+0000 7fed8ed9d700 1 --2- 172.21.15.17:0/72254277 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fed9015d610 0x7fed900c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:48.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.290+0000 7fed8dd9b700 1 --2- 172.21.15.17:0/72254277 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fed901509a0 0x7fed90153690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:48.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.290+0000 7fed8e59c700 1 --2- 172.21.15.17:0/72254277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed900cb1b0 0x7fed90169d90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fed8000d840 tx=0x7fed80008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:48.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.290+0000 7fed7e7fc700 1 -- 172.21.15.17:0/72254277 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed80014620 con 0x7fed900cb1b0 2023-10-06T04:44:48.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.290+0000 7fed7e7fc700 1 -- 172.21.15.17:0/72254277 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed80014780 con 0x7fed900cb1b0 2023-10-06T04:44:48.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.290+0000 7fed7e7fc700 1 -- 172.21.15.17:0/72254277 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed80014b40 con 0x7fed900cb1b0 2023-10-06T04:44:48.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.290+0000 7fed94a4a700 1 -- 172.21.15.17:0/72254277 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed9016a9c0 con 0x7fed900cb1b0 2023-10-06T04:44:48.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.290+0000 7fed94a4a700 1 -- 172.21.15.17:0/72254277 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed90153bd0 con 0x7fed900cb1b0 2023-10-06T04:44:48.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.291+0000 7fed94a4a700 1 -- 172.21.15.17:0/72254277 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed900c44e0 con 0x7fed900cb1b0 2023-10-06T04:44:48.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.291+0000 7fed7e7fc700 1 -- 172.21.15.17:0/72254277 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fed8001d400 con 0x7fed900cb1b0 2023-10-06T04:44:48.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.292+0000 7fed7e7fc700 1 --2- 172.21.15.17:0/72254277 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fed70066f30 0x7fed700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:48.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.292+0000 7fed7e7fc700 1 -- 172.21.15.17:0/72254277 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fed80084cf0 con 0x7fed900cb1b0 2023-10-06T04:44:48.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.292+0000 7fed8dd9b700 1 --2- 172.21.15.17:0/72254277 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fed70066f30 0x7fed700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:48.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.292+0000 7fed8dd9b700 1 --2- 172.21.15.17:0/72254277 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fed70066f30 0x7fed700693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fed900b53b0 tx=0x7fed84009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:48.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.296+0000 7fed7e7fc700 1 -- 172.21.15.17:0/72254277 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fed80089070 con 0x7fed900cb1b0 2023-10-06T04:44:48.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.488+0000 7fed94a4a700 1 -- 172.21.15.17:0/72254277 --> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fed90063ff0 con 0x7fed70066f30 2023-10-06T04:44:48.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.488+0000 7fed7e7fc700 1 -- 172.21.15.17:0/72254277 <== mgr.4104 v2:172.21.15.17:6832/90424 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fed90063ff0 con 0x7fed70066f30 2023-10-06T04:44:48.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.491+0000 7fed94a4a700 1 -- 172.21.15.17:0/72254277 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fed70066f30 msgr2=0x7fed700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:48.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.491+0000 7fed94a4a700 1 --2- 172.21.15.17:0/72254277 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fed70066f30 0x7fed700693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fed900b53b0 tx=0x7fed84009040 comp rx=0 tx=0).stop 2023-10-06T04:44:48.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.491+0000 7fed94a4a700 1 -- 172.21.15.17:0/72254277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed900cb1b0 msgr2=0x7fed90169d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:48.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.491+0000 7fed94a4a700 1 --2- 172.21.15.17:0/72254277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed900cb1b0 0x7fed90169d90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fed8000d840 tx=0x7fed80008040 comp rx=0 tx=0).stop 2023-10-06T04:44:48.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.491+0000 7fed94a4a700 1 -- 172.21.15.17:0/72254277 shutdown_connections 2023-10-06T04:44:48.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.491+0000 7fed94a4a700 1 --2- 172.21.15.17:0/72254277 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fed70066f30 0x7fed700693e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:48.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.491+0000 7fed94a4a700 1 --2- 172.21.15.17:0/72254277 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fed9015d610 0x7fed900c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:48.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.491+0000 7fed94a4a700 1 --2- 172.21.15.17:0/72254277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed900cb1b0 0x7fed90169d90 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:48.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.491+0000 7fed94a4a700 1 --2- 172.21.15.17:0/72254277 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fed901509a0 0x7fed90153690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:48.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.491+0000 7fed94a4a700 1 -- 172.21.15.17:0/72254277 >> 172.21.15.17:0/72254277 conn(0x7fed90099960 msgr2=0x7fed900af130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:48.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.491+0000 7fed94a4a700 1 -- 172.21.15.17:0/72254277 shutdown_connections 2023-10-06T04:44:48.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.491+0000 7fed94a4a700 1 -- 172.21.15.17:0/72254277 wait complete. 2023-10-06T04:44:48.494 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 0 to deep-scrub 2023-10-06T04:44:48.505 INFO:tasks.ceph:Scrubbing osd.1 2023-10-06T04:44:48.505 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:44:48.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.626+0000 7f62459b1700 1 Processor -- start 2023-10-06T04:44:48.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.626+0000 7f62459b1700 1 -- start start 2023-10-06T04:44:48.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.627+0000 7f62459b1700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f62400ce720 0x7f62400ceaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:48.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.627+0000 7f62459b1700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f62400b0000 0x7f62400cb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:48.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.627+0000 7f62459b1700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62400b14d0 con 0x7f62400b3e60 2023-10-06T04:44:48.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.627+0000 7f62459b1700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62400b04e0 con 0x7f62400b0000 2023-10-06T04:44:48.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.627+0000 7f62459b1700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62400b07c0 con 0x7f62400ce720 2023-10-06T04:44:48.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.628+0000 7f623e7fc700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f62400b0000 0x7f62400cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:48.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.628+0000 7f623effd700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f62400ce720 0x7f62400ceaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:48.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.628+0000 7f623effd700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f62400ce720 0x7f62400ceaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.17:35064/0 (socket says 172.21.15.17:35064) 2023-10-06T04:44:48.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.628+0000 7f623effd700 1 -- 172.21.15.17:0/244330738 learned_addr learned my addr 172.21.15.17:0/244330738 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:48.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.628+0000 7f623f7fe700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f62400b3e60 0x7f624015b470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.17:43456/0 (socket says 172.21.15.17:43456) 2023-10-06T04:44:48.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.628+0000 7f623effd700 1 -- 172.21.15.17:0/244330738 >> v2:172.21.15.136:3300/0 conn(0x7f62400b0000 msgr2=0x7f62400cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:48.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.628+0000 7f623effd700 1 --2- 172.21.15.17:0/244330738 >> v2:172.21.15.136:3300/0 conn(0x7f62400b0000 0x7f62400cb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:48.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.628+0000 7f623effd700 1 -- 172.21.15.17:0/244330738 >> v1:172.21.15.136:6789/0 conn(0x7f62400b3e60 legacy=0x7f624015b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:48.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.628+0000 7f623effd700 1 -- 172.21.15.17:0/244330738 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62400b0aa0 con 0x7f62400ce720 2023-10-06T04:44:48.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.628+0000 7f623e7fc700 1 --2- 172.21.15.17:0/244330738 >> v2:172.21.15.136:3300/0 conn(0x7f62400b0000 0x7f62400cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:44:48.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.628+0000 7f623effd700 1 --2- 172.21.15.17:0/244330738 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f62400ce720 0x7f62400ceaf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f62380099b0 tx=0x7f6238009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4af33aa5a152f7d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:48.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.628+0000 7f623dffb700 1 -- 172.21.15.17:0/244330738 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6238009ea0 con 0x7f62400ce720 2023-10-06T04:44:48.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.628+0000 7f623dffb700 1 -- 172.21.15.17:0/244330738 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623800b760 con 0x7f62400ce720 2023-10-06T04:44:48.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.628+0000 7f623dffb700 1 -- 172.21.15.17:0/244330738 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623800bb00 con 0x7f62400ce720 2023-10-06T04:44:48.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.629+0000 7f62459b1700 1 -- 172.21.15.17:0/244330738 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f62400ce720 msgr2=0x7f62400ceaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:48.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.629+0000 7f62459b1700 1 --2- 172.21.15.17:0/244330738 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f62400ce720 0x7f62400ceaf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f62380099b0 tx=0x7f6238009250 comp rx=0 tx=0).stop 2023-10-06T04:44:48.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.629+0000 7f62459b1700 1 -- 172.21.15.17:0/244330738 shutdown_connections 2023-10-06T04:44:48.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.629+0000 7f62459b1700 1 --2- 172.21.15.17:0/244330738 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f62400ce720 0x7f62400ceaf0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:48.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.629+0000 7f62459b1700 1 --2- 172.21.15.17:0/244330738 >> v2:172.21.15.136:3300/0 conn(0x7f62400b0000 0x7f62400cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:48.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.629+0000 7f62459b1700 1 -- 172.21.15.17:0/244330738 >> 172.21.15.17:0/244330738 conn(0x7f6240070440 msgr2=0x7f6240070840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:48.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.629+0000 7f62459b1700 1 -- 172.21.15.17:0/244330738 shutdown_connections 2023-10-06T04:44:48.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.629+0000 7f62459b1700 1 -- 172.21.15.17:0/244330738 wait complete. 2023-10-06T04:44:48.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.630+0000 7f62459b1700 1 Processor -- start 2023-10-06T04:44:48.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.630+0000 7f62459b1700 1 -- start start 2023-10-06T04:44:48.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.631+0000 7f62459b1700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62400b0000 0x7f62400c7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:48.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.631+0000 7f62459b1700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f62400b3e60 0x7f62400b2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:48.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.631+0000 7f62459b1700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f62400ce720 0x7f6240157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:48.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.631+0000 7f62459b1700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62400c5ba0 con 0x7f62400b0000 2023-10-06T04:44:48.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.631+0000 7f62459b1700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62400c5e80 con 0x7f62400b3e60 2023-10-06T04:44:48.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.631+0000 7f62459b1700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62400c6160 con 0x7f62400ce720 2023-10-06T04:44:48.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.631+0000 7f623effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62400b0000 0x7f62400c7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:48.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.631+0000 7f623effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62400b0000 0x7f62400c7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46268/0 (socket says 172.21.15.17:46268) 2023-10-06T04:44:48.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.631+0000 7f623effd700 1 -- 172.21.15.17:0/1020072595 learned_addr learned my addr 172.21.15.17:0/1020072595 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:48.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.631+0000 7f623f7fe700 1 --2- 172.21.15.17:0/1020072595 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f62400ce720 0x7f6240157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:48.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.631+0000 7f623e7fc700 1 --2- 172.21.15.17:0/1020072595 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f62400b3e60 0x7f62400b2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:48.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.631+0000 7f623effd700 1 -- 172.21.15.17:0/1020072595 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f62400ce720 msgr2=0x7f6240157700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:48.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.631+0000 7f623effd700 1 --2- 172.21.15.17:0/1020072595 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f62400ce720 0x7f6240157700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:48.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.631+0000 7f623effd700 1 -- 172.21.15.17:0/1020072595 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f62400b3e60 msgr2=0x7f62400b2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:48.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.631+0000 7f623effd700 1 --2- 172.21.15.17:0/1020072595 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f62400b3e60 0x7f62400b2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:48.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.631+0000 7f623effd700 1 -- 172.21.15.17:0/1020072595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6234009420 con 0x7f62400b0000 2023-10-06T04:44:48.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.631+0000 7f623f7fe700 1 --2- 172.21.15.17:0/1020072595 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f62400ce720 0x7f6240157700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:48.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.631+0000 7f623e7fc700 1 --2- 172.21.15.17:0/1020072595 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f62400b3e60 0x7f62400b2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:48.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.632+0000 7f623effd700 1 --2- 172.21.15.17:0/1020072595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62400b0000 0x7f62400c7650 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f6238009290 tx=0x7f6238016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:48.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.632+0000 7f6226ffd700 1 -- 172.21.15.17:0/1020072595 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6238011d90 con 0x7f62400b0000 2023-10-06T04:44:48.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.632+0000 7f6226ffd700 1 -- 172.21.15.17:0/1020072595 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623801c460 con 0x7f62400b0000 2023-10-06T04:44:48.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.632+0000 7f62459b1700 1 -- 172.21.15.17:0/1020072595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62380094f0 con 0x7f62400b0000 2023-10-06T04:44:48.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.632+0000 7f6226ffd700 1 -- 172.21.15.17:0/1020072595 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623801c820 con 0x7f62400b0000 2023-10-06T04:44:48.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.632+0000 7f62459b1700 1 -- 172.21.15.17:0/1020072595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62400b32d0 con 0x7f62400b0000 2023-10-06T04:44:48.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.633+0000 7f62459b1700 1 -- 172.21.15.17:0/1020072595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6240167c40 con 0x7f62400b0000 2023-10-06T04:44:48.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.633+0000 7f6226ffd700 1 -- 172.21.15.17:0/1020072595 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f623801cc50 con 0x7f62400b0000 2023-10-06T04:44:48.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.634+0000 7f6226ffd700 1 --2- 172.21.15.17:0/1020072595 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f622c066fb0 0x7f622c069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:48.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.634+0000 7f6226ffd700 1 -- 172.21.15.17:0/1020072595 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f62380867b0 con 0x7f62400b0000 2023-10-06T04:44:48.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.634+0000 7f623e7fc700 1 --2- 172.21.15.17:0/1020072595 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f622c066fb0 0x7f622c069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:48.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.634+0000 7f6226ffd700 1 --2- 172.21.15.17:0/1020072595 >> [v2:172.21.15.17:6800/90655,v1:172.21.15.17:6801/90655] conn(0x7f622c06d420 0x7f622c06f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:48.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.634+0000 7f6226ffd700 1 -- 172.21.15.17:0/1020072595 --> [v2:172.21.15.17:6800/90655,v1:172.21.15.17:6801/90655] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f622c06ff00 con 0x7f622c06d420 2023-10-06T04:44:48.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.634+0000 7f6226ffd700 1 -- 172.21.15.17:0/1020072595 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6238088c90 con 0x7f62400b0000 2023-10-06T04:44:48.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.634+0000 7f623f7fe700 1 --2- 172.21.15.17:0/1020072595 >> [v2:172.21.15.17:6800/90655,v1:172.21.15.17:6801/90655] conn(0x7f622c06d420 0x7f622c06f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:48.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.634+0000 7f623e7fc700 1 --2- 172.21.15.17:0/1020072595 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f622c066fb0 0x7f622c069460 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f62340093f0 tx=0x7f6234008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:48.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.634+0000 7f623f7fe700 1 --2- 172.21.15.17:0/1020072595 >> [v2:172.21.15.17:6800/90655,v1:172.21.15.17:6801/90655] conn(0x7f622c06d420 0x7f622c06f830 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:48.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.635+0000 7f6226ffd700 1 -- 172.21.15.17:0/1020072595 <== osd.1 v2:172.21.15.17:6800/90655 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f622c06ff00 con 0x7f622c06d420 2023-10-06T04:44:48.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.649+0000 7f62459b1700 1 -- 172.21.15.17:0/1020072595 --> [v2:172.21.15.17:6800/90655,v1:172.21.15.17:6801/90655] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f62400718b0 con 0x7f622c06d420 2023-10-06T04:44:48.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.649+0000 7f6226ffd700 1 -- 172.21.15.17:0/1020072595 <== osd.1 v2:172.21.15.17:6800/90655 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f62400718b0 con 0x7f622c06d420 2023-10-06T04:44:48.651 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-06T04:44:48.651 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:44:48.651 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-06T04:44:48.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.649+0000 7f62459b1700 1 -- 172.21.15.17:0/1020072595 >> [v2:172.21.15.17:6800/90655,v1:172.21.15.17:6801/90655] conn(0x7f622c06d420 msgr2=0x7f622c06f830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:48.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.649+0000 7f62459b1700 1 --2- 172.21.15.17:0/1020072595 >> [v2:172.21.15.17:6800/90655,v1:172.21.15.17:6801/90655] conn(0x7f622c06d420 0x7f622c06f830 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:48.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.649+0000 7f62459b1700 1 -- 172.21.15.17:0/1020072595 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f622c066fb0 msgr2=0x7f622c069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:48.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.649+0000 7f62459b1700 1 --2- 172.21.15.17:0/1020072595 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f622c066fb0 0x7f622c069460 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f62340093f0 tx=0x7f6234008040 comp rx=0 tx=0).stop 2023-10-06T04:44:48.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.649+0000 7f62459b1700 1 -- 172.21.15.17:0/1020072595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62400b0000 msgr2=0x7f62400c7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:48.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.649+0000 7f62459b1700 1 --2- 172.21.15.17:0/1020072595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62400b0000 0x7f62400c7650 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f6238009290 tx=0x7f6238016000 comp rx=0 tx=0).stop 2023-10-06T04:44:48.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.649+0000 7f623f7fe700 1 -- 172.21.15.17:0/1020072595 reap_dead start 2023-10-06T04:44:48.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.649+0000 7f62459b1700 1 -- 172.21.15.17:0/1020072595 shutdown_connections 2023-10-06T04:44:48.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.649+0000 7f62459b1700 1 -- 172.21.15.17:0/1020072595 >> 172.21.15.17:0/1020072595 conn(0x7f6240070440 msgr2=0x7f62400c4240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:48.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.650+0000 7f62459b1700 1 -- 172.21.15.17:0/1020072595 shutdown_connections 2023-10-06T04:44:48.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.650+0000 7f62459b1700 1 -- 172.21.15.17:0/1020072595 wait complete. 2023-10-06T04:44:48.663 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-06T04:44:48.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.780+0000 7f8f07bf7700 1 Processor -- start 2023-10-06T04:44:48.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.781+0000 7f8f07bf7700 1 -- start start 2023-10-06T04:44:48.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.781+0000 7f8f07bf7700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f8f0015d9e0 0x7f8f00150290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:48.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.781+0000 7f8f07bf7700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f0015aed0 con 0x7f8f0015d610 2023-10-06T04:44:48.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.781+0000 7f8f07bf7700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f00150c30 con 0x7f8f001507d0 2023-10-06T04:44:48.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.781+0000 7f8f07bf7700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f000cb680 con 0x7f8f0015d9e0 2023-10-06T04:44:48.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.782+0000 7f8f05993700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f8f0015d610 0x7f8f000cac70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37896/0 (socket says 172.21.15.17:37896) 2023-10-06T04:44:48.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.782+0000 7f8f05993700 1 -- 172.21.15.17:0/716950334 learned_addr learned my addr 172.21.15.17:0/716950334 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:48.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.782+0000 7f8f04991700 1 -- 172.21.15.17:0/716950334 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1877518557 0 0) 0x7f8f0015aed0 con 0x7f8f0015d610 2023-10-06T04:44:48.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.782+0000 7f8f05192700 1 --2- 172.21.15.17:0/716950334 >> v2:172.21.15.136:3300/0 conn(0x7f8f0015d9e0 0x7f8f00150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:48.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.782+0000 7f8f04991700 1 -- 172.21.15.17:0/716950334 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ee8003570 con 0x7f8f0015d610 2023-10-06T04:44:48.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.782+0000 7f8f04991700 1 -- 172.21.15.17:0/716950334 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2077274925 0 0) 0x7f8ee8003570 con 0x7f8f0015d610 2023-10-06T04:44:48.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.782+0000 7f8f04991700 1 -- 172.21.15.17:0/716950334 >> v2:172.21.15.136:3300/0 conn(0x7f8f0015d9e0 msgr2=0x7f8f00150290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:48.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.782+0000 7f8f04991700 1 --2- 172.21.15.17:0/716950334 >> v2:172.21.15.136:3300/0 conn(0x7f8f0015d9e0 0x7f8f00150290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:48.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.782+0000 7f8f04991700 1 -- 172.21.15.17:0/716950334 >> v1:172.21.15.136:6789/0 conn(0x7f8f001507d0 legacy=0x7f8f0015b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:48.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.782+0000 7f8f04991700 1 -- 172.21.15.17:0/716950334 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f000cb960 con 0x7f8f0015d610 2023-10-06T04:44:48.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.782+0000 7f8f04991700 1 -- 172.21.15.17:0/716950334 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4268781140 0 0) 0x7f8ef8001970 con 0x7f8f0015d610 2023-10-06T04:44:48.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.782+0000 7f8f04991700 1 -- 172.21.15.17:0/716950334 >> v1:172.21.15.17:6789/0 conn(0x7f8f0015d610 legacy=0x7f8f000cac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:48.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.782+0000 7f8f04991700 1 --2- 172.21.15.17:0/716950334 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ee8003a60 0x7f8ee8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:48.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.782+0000 7f8f04991700 1 --2- 172.21.15.17:0/716950334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ee8004810 0x7f8ee8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:48.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.782+0000 7f8f04991700 1 --2- 172.21.15.17:0/716950334 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8ee80051c0 0x7f8ee800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:48.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.782+0000 7f8f04991700 1 -- 172.21.15.17:0/716950334 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f000cb680 con 0x7f8ee8004810 2023-10-06T04:44:48.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.782+0000 7f8f04991700 1 -- 172.21.15.17:0/716950334 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee800c0d0 con 0x7f8ee8003a60 2023-10-06T04:44:48.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.782+0000 7f8f04991700 1 -- 172.21.15.17:0/716950334 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee800c290 con 0x7f8ee80051c0 2023-10-06T04:44:48.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.782+0000 7f8f05192700 1 --2- 172.21.15.17:0/716950334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ee8004810 0x7f8ee8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:48.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.782+0000 7f8f05993700 1 --2- 172.21.15.17:0/716950334 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ee8003a60 0x7f8ee8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:48.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.783+0000 7f8f06194700 1 --2- 172.21.15.17:0/716950334 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8ee80051c0 0x7f8ee800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:48.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.783+0000 7f8f05192700 1 -- 172.21.15.17:0/716950334 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8ee80051c0 msgr2=0x7f8ee800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:48.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.783+0000 7f8f05192700 1 --2- 172.21.15.17:0/716950334 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8ee80051c0 0x7f8ee800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:48.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.783+0000 7f8f05192700 1 -- 172.21.15.17:0/716950334 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ee8003a60 msgr2=0x7f8ee8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:48.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.783+0000 7f8f05192700 1 --2- 172.21.15.17:0/716950334 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ee8003a60 0x7f8ee8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:48.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.783+0000 7f8f05192700 1 -- 172.21.15.17:0/716950334 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee8003570 con 0x7f8ee8004810 2023-10-06T04:44:48.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.783+0000 7f8f06194700 1 --2- 172.21.15.17:0/716950334 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8ee80051c0 0x7f8ee800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:48.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.783+0000 7f8f06194700 1 -- 172.21.15.17:0/716950334 reap_dead start 2023-10-06T04:44:48.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.783+0000 7f8f05192700 1 --2- 172.21.15.17:0/716950334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ee8004810 0x7f8ee8004c80 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4009c00 tx=0x7f8ef40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad5cbb1c90906ac1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:48.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.783+0000 7f8f04991700 1 -- 172.21.15.17:0/716950334 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef400e710 con 0x7f8ee8004810 2023-10-06T04:44:48.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.783+0000 7f8f04991700 1 -- 172.21.15.17:0/716950334 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef400e870 con 0x7f8ee8004810 2023-10-06T04:44:48.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.783+0000 7f8f04991700 1 -- 172.21.15.17:0/716950334 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef400ec30 con 0x7f8ee8004810 2023-10-06T04:44:48.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.783+0000 7f8f07bf7700 1 -- 172.21.15.17:0/716950334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ee8004810 msgr2=0x7f8ee8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:48.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.783+0000 7f8f07bf7700 1 --2- 172.21.15.17:0/716950334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ee8004810 0x7f8ee8004c80 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4009c00 tx=0x7f8ef40091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:48.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.784+0000 7f8f07bf7700 1 -- 172.21.15.17:0/716950334 shutdown_connections 2023-10-06T04:44:48.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.784+0000 7f8f07bf7700 1 --2- 172.21.15.17:0/716950334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ee8004810 0x7f8ee8004c80 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:48.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.784+0000 7f8f07bf7700 1 -- 172.21.15.17:0/716950334 >> 172.21.15.17:0/716950334 conn(0x7f8f00099960 msgr2=0x7f8f0006cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:48.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.784+0000 7f8f07bf7700 1 -- 172.21.15.17:0/716950334 shutdown_connections 2023-10-06T04:44:48.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.784+0000 7f8f07bf7700 1 -- 172.21.15.17:0/716950334 wait complete. 2023-10-06T04:44:48.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.785+0000 7f8f07bf7700 1 Processor -- start 2023-10-06T04:44:48.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.785+0000 7f8f07bf7700 1 -- start start 2023-10-06T04:44:48.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.785+0000 7f8f07bf7700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ee8004810 0x7f8f00150e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:48.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.785+0000 7f8f07bf7700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8f00153b20 0x7f8f000c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:48.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.785+0000 7f8f07bf7700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f00152820 0x7f8f000b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:48.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.785+0000 7f8f07bf7700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f000ce9f0 con 0x7f8f00152820 2023-10-06T04:44:48.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.785+0000 7f8f07bf7700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f000c6f30 con 0x7f8ee8004810 2023-10-06T04:44:48.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.786+0000 7f8f07bf7700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f000ce3a0 con 0x7f8f00153b20 2023-10-06T04:44:48.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.786+0000 7f8f06194700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f00152820 0x7f8f000b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:48.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.786+0000 7f8f06194700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f00152820 0x7f8f000b4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46286/0 (socket says 172.21.15.17:46286) 2023-10-06T04:44:48.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.786+0000 7f8f06194700 1 -- 172.21.15.17:0/3835033970 learned_addr learned my addr 172.21.15.17:0/3835033970 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:48.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.786+0000 7f8f05192700 1 --2- 172.21.15.17:0/3835033970 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8f00153b20 0x7f8f000c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:48.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.786+0000 7f8f05993700 1 --2- 172.21.15.17:0/3835033970 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ee8004810 0x7f8f00150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:48.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.786+0000 7f8f06194700 1 -- 172.21.15.17:0/3835033970 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8f00153b20 msgr2=0x7f8f000c65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:48.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.786+0000 7f8f06194700 1 --2- 172.21.15.17:0/3835033970 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8f00153b20 0x7f8f000c65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:48.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.786+0000 7f8f06194700 1 -- 172.21.15.17:0/3835033970 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ee8004810 msgr2=0x7f8f00150e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:48.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.786+0000 7f8f06194700 1 --2- 172.21.15.17:0/3835033970 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ee8004810 0x7f8f00150e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:48.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.786+0000 7f8f06194700 1 -- 172.21.15.17:0/3835033970 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f000ce680 con 0x7f8f00152820 2023-10-06T04:44:48.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.786+0000 7f8f06194700 1 --2- 172.21.15.17:0/3835033970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f00152820 0x7f8f000b4d60 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f8f00089230 tx=0x7f8ef0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:48.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.786+0000 7f8efdffb700 1 -- 172.21.15.17:0/3835033970 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef0014480 con 0x7f8f00152820 2023-10-06T04:44:48.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.786+0000 7f8efdffb700 1 -- 172.21.15.17:0/3835033970 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef0014600 con 0x7f8f00152820 2023-10-06T04:44:48.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.786+0000 7f8f07bf7700 1 -- 172.21.15.17:0/3835033970 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f000c6b20 con 0x7f8f00152820 2023-10-06T04:44:48.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.786+0000 7f8efdffb700 1 -- 172.21.15.17:0/3835033970 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef00149c0 con 0x7f8f00152820 2023-10-06T04:44:48.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.786+0000 7f8f07bf7700 1 -- 172.21.15.17:0/3835033970 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f00152e50 con 0x7f8f00152820 2023-10-06T04:44:48.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.787+0000 7f8f07bf7700 1 -- 172.21.15.17:0/3835033970 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f000ce1e0 con 0x7f8f00152820 2023-10-06T04:44:48.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.788+0000 7f8efdffb700 1 -- 172.21.15.17:0/3835033970 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ef00133e0 con 0x7f8f00152820 2023-10-06T04:44:48.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.788+0000 7f8efdffb700 1 --2- 172.21.15.17:0/3835033970 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8eec066f60 0x7f8eec069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:48.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.788+0000 7f8efdffb700 1 -- 172.21.15.17:0/3835033970 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f8ef0083f10 con 0x7f8f00152820 2023-10-06T04:44:48.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.788+0000 7f8f05993700 1 --2- 172.21.15.17:0/3835033970 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8eec066f60 0x7f8eec069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:48.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.789+0000 7f8f05993700 1 --2- 172.21.15.17:0/3835033970 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8eec066f60 0x7f8eec069410 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8001aa0 tx=0x7f8ef8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:48.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.793+0000 7f8efdffb700 1 -- 172.21.15.17:0/3835033970 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ef0051280 con 0x7f8f00152820 2023-10-06T04:44:48.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.985+0000 7f8f07bf7700 1 -- 172.21.15.17:0/3835033970 --> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f000c6d10 con 0x7f8eec066f60 2023-10-06T04:44:48.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.986+0000 7f8efdffb700 1 -- 172.21.15.17:0/3835033970 <== mgr.4104 v2:172.21.15.17:6832/90424 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8ef8005dd0 con 0x7f8eec066f60 2023-10-06T04:44:48.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.988+0000 7f8f07bf7700 1 -- 172.21.15.17:0/3835033970 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8eec066f60 msgr2=0x7f8eec069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:48.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.988+0000 7f8f07bf7700 1 --2- 172.21.15.17:0/3835033970 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8eec066f60 0x7f8eec069410 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8001aa0 tx=0x7f8ef8009040 comp rx=0 tx=0).stop 2023-10-06T04:44:48.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.988+0000 7f8f07bf7700 1 -- 172.21.15.17:0/3835033970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f00152820 msgr2=0x7f8f000b4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:48.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.988+0000 7f8f07bf7700 1 --2- 172.21.15.17:0/3835033970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f00152820 0x7f8f000b4d60 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f8f00089230 tx=0x7f8ef0009040 comp rx=0 tx=0).stop 2023-10-06T04:44:48.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.988+0000 7f8f07bf7700 1 -- 172.21.15.17:0/3835033970 shutdown_connections 2023-10-06T04:44:48.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.988+0000 7f8f07bf7700 1 --2- 172.21.15.17:0/3835033970 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f8eec066f60 0x7f8eec069410 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:48.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.988+0000 7f8f07bf7700 1 --2- 172.21.15.17:0/3835033970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f00152820 0x7f8f000b4d60 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:48.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.988+0000 7f8f07bf7700 1 --2- 172.21.15.17:0/3835033970 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ee8004810 0x7f8f00150e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:48.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.988+0000 7f8f07bf7700 1 --2- 172.21.15.17:0/3835033970 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8f00153b20 0x7f8f000c65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:48.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.988+0000 7f8f07bf7700 1 -- 172.21.15.17:0/3835033970 >> 172.21.15.17:0/3835033970 conn(0x7f8f00099960 msgr2=0x7f8f000cace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:48.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.988+0000 7f8f07bf7700 1 -- 172.21.15.17:0/3835033970 shutdown_connections 2023-10-06T04:44:48.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:48.988+0000 7f8f07bf7700 1 -- 172.21.15.17:0/3835033970 wait complete. 2023-10-06T04:44:48.991 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 1 to deep-scrub 2023-10-06T04:44:49.001 INFO:tasks.ceph:Scrubbing osd.2 2023-10-06T04:44:49.002 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:44:49.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.123+0000 7f5926428700 1 Processor -- start 2023-10-06T04:44:49.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.123+0000 7f5926428700 1 -- start start 2023-10-06T04:44:49.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.124+0000 7f5926428700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f59200cb6b0 0x7f59200cd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:49.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.124+0000 7f5926428700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59200cc050 con 0x7f59200cbb30 2023-10-06T04:44:49.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.124+0000 7f5926428700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f592015b130 con 0x7f5920150360 2023-10-06T04:44:49.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.124+0000 7f5926428700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59200cc330 con 0x7f59200cb6b0 2023-10-06T04:44:49.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.124+0000 7f59249c5700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f59200cbb30 0x7f5920159e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37898/0 (socket says 172.21.15.17:37898) 2023-10-06T04:44:49.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.124+0000 7f59249c5700 1 -- 172.21.15.17:0/4034960126 learned_addr learned my addr 172.21.15.17:0/4034960126 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:49.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.124+0000 7f591f7fe700 1 --2- 172.21.15.17:0/4034960126 >> v2:172.21.15.136:3300/0 conn(0x7f59200cb6b0 0x7f59200cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:49.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.124+0000 7f591effd700 1 -- 172.21.15.17:0/4034960126 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 819687738 0 0) 0x7f59200cc050 con 0x7f59200cbb30 2023-10-06T04:44:49.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.124+0000 7f591effd700 1 -- 172.21.15.17:0/4034960126 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f590c003570 con 0x7f59200cbb30 2023-10-06T04:44:49.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.124+0000 7f591f7fe700 1 -- 172.21.15.17:0/4034960126 >> v1:172.21.15.136:6789/0 conn(0x7f5920150360 legacy=0x7f5920150730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:49.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.124+0000 7f591effd700 1 -- 172.21.15.17:0/4034960126 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2027349953 0 0) 0x7f590c003570 con 0x7f59200cbb30 2023-10-06T04:44:49.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.124+0000 7f591f7fe700 1 -- 172.21.15.17:0/4034960126 >> v1:172.21.15.17:6789/0 conn(0x7f59200cbb30 legacy=0x7f5920159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:49.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.124+0000 7f591f7fe700 1 -- 172.21.15.17:0/4034960126 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592015b410 con 0x7f59200cb6b0 2023-10-06T04:44:49.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.125+0000 7f591f7fe700 1 --2- 172.21.15.17:0/4034960126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59200cb6b0 0x7f59200cd050 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5910009910 tx=0x7f59100091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b754ac0d529b2ca server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:49.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.125+0000 7f591effd700 1 -- 172.21.15.17:0/4034960126 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59180017f0 con 0x7f59200cb6b0 2023-10-06T04:44:49.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.125+0000 7f591effd700 1 -- 172.21.15.17:0/4034960126 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5910011420 con 0x7f59200cb6b0 2023-10-06T04:44:49.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.125+0000 7f591effd700 1 -- 172.21.15.17:0/4034960126 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59100117c0 con 0x7f59200cb6b0 2023-10-06T04:44:49.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.125+0000 7f5926428700 1 -- 172.21.15.17:0/4034960126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59200cb6b0 msgr2=0x7f59200cd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:49.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.125+0000 7f5926428700 1 --2- 172.21.15.17:0/4034960126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59200cb6b0 0x7f59200cd050 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5910009910 tx=0x7f59100091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:49.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.125+0000 7f5926428700 1 -- 172.21.15.17:0/4034960126 shutdown_connections 2023-10-06T04:44:49.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.125+0000 7f5926428700 1 --2- 172.21.15.17:0/4034960126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59200cb6b0 0x7f59200cd050 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:49.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.125+0000 7f5926428700 1 -- 172.21.15.17:0/4034960126 >> 172.21.15.17:0/4034960126 conn(0x7f592008a180 msgr2=0x7f5920099aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:49.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.125+0000 7f5926428700 1 -- 172.21.15.17:0/4034960126 shutdown_connections 2023-10-06T04:44:49.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.125+0000 7f5926428700 1 -- 172.21.15.17:0/4034960126 wait complete. 2023-10-06T04:44:49.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.126+0000 7f5926428700 1 Processor -- start 2023-10-06T04:44:49.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.127+0000 7f5926428700 1 -- start start 2023-10-06T04:44:49.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.127+0000 7f5926428700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f59200cb6b0 0x7f592014dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:49.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.127+0000 7f5926428700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59200cbb30 0x7f59200b52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:49.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.127+0000 7f5926428700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5920150360 0x7f59200ce990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:49.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.127+0000 7f5926428700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5920155320 con 0x7f5920150360 2023-10-06T04:44:49.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.127+0000 7f5926428700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5920154430 con 0x7f59200cbb30 2023-10-06T04:44:49.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.127+0000 7f5926428700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5920154710 con 0x7f59200cb6b0 2023-10-06T04:44:49.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.127+0000 7f59249c5700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5920150360 0x7f59200ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:49.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.127+0000 7f59249c5700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5920150360 0x7f59200ce990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46294/0 (socket says 172.21.15.17:46294) 2023-10-06T04:44:49.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.127+0000 7f59249c5700 1 -- 172.21.15.17:0/4258627580 learned_addr learned my addr 172.21.15.17:0/4258627580 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:49.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.128+0000 7f591f7fe700 1 --2- 172.21.15.17:0/4258627580 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59200cbb30 0x7f59200b52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:49.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.128+0000 7f591ffff700 1 --2- 172.21.15.17:0/4258627580 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f59200cb6b0 0x7f592014dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:49.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.128+0000 7f59249c5700 1 -- 172.21.15.17:0/4258627580 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f59200cb6b0 msgr2=0x7f592014dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:49.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.128+0000 7f59249c5700 1 --2- 172.21.15.17:0/4258627580 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f59200cb6b0 0x7f592014dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:49.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.128+0000 7f59249c5700 1 -- 172.21.15.17:0/4258627580 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59200cbb30 msgr2=0x7f59200b52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:49.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.128+0000 7f59249c5700 1 --2- 172.21.15.17:0/4258627580 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59200cbb30 0x7f59200b52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:49.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.128+0000 7f59249c5700 1 -- 172.21.15.17:0/4258627580 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5910009420 con 0x7f5920150360 2023-10-06T04:44:49.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.128+0000 7f591ffff700 1 --2- 172.21.15.17:0/4258627580 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f59200cb6b0 0x7f592014dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:49.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.128+0000 7f59249c5700 1 --2- 172.21.15.17:0/4258627580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5920150360 0x7f59200ce990 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f591800cc10 tx=0x7f5918001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:49.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.128+0000 7f5917fff700 1 -- 172.21.15.17:0/4258627580 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5918004dc0 con 0x7f5920150360 2023-10-06T04:44:49.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.128+0000 7f5917fff700 1 -- 172.21.15.17:0/4258627580 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591800a600 con 0x7f5920150360 2023-10-06T04:44:49.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.128+0000 7f5926428700 1 -- 172.21.15.17:0/4258627580 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59201549f0 con 0x7f5920150360 2023-10-06T04:44:49.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.128+0000 7f5917fff700 1 -- 172.21.15.17:0/4258627580 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591800a9c0 con 0x7f5920150360 2023-10-06T04:44:49.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.128+0000 7f5926428700 1 -- 172.21.15.17:0/4258627580 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5920154fb0 con 0x7f5920150360 2023-10-06T04:44:49.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.129+0000 7f5926428700 1 -- 172.21.15.17:0/4258627580 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f59200718b0 con 0x7f5920150360 2023-10-06T04:44:49.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.129+0000 7f5917fff700 1 -- 172.21.15.17:0/4258627580 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5918007150 con 0x7f5920150360 2023-10-06T04:44:49.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.130+0000 7f5917fff700 1 --2- 172.21.15.17:0/4258627580 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5900066f30 0x7f59000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:49.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.130+0000 7f5917fff700 1 -- 172.21.15.17:0/4258627580 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f5918083ff0 con 0x7f5920150360 2023-10-06T04:44:49.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.130+0000 7f591ffff700 1 --2- 172.21.15.17:0/4258627580 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5900066f30 0x7f59000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:49.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.130+0000 7f5917fff700 1 --2- 172.21.15.17:0/4258627580 >> [v2:172.21.15.17:6808/90657,v1:172.21.15.17:6810/90657] conn(0x7f590006d3a0 0x7f590006f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:49.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.130+0000 7f5917fff700 1 -- 172.21.15.17:0/4258627580 --> [v2:172.21.15.17:6808/90657,v1:172.21.15.17:6810/90657] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f590006fe80 con 0x7f590006d3a0 2023-10-06T04:44:49.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.130+0000 7f5917fff700 1 -- 172.21.15.17:0/4258627580 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5918086570 con 0x7f5920150360 2023-10-06T04:44:49.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.130+0000 7f591f7fe700 1 --2- 172.21.15.17:0/4258627580 >> [v2:172.21.15.17:6808/90657,v1:172.21.15.17:6810/90657] conn(0x7f590006d3a0 0x7f590006f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:49.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.130+0000 7f591ffff700 1 --2- 172.21.15.17:0/4258627580 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5900066f30 0x7f59000693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f59080018c0 tx=0x7f5908009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:49.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.130+0000 7f591f7fe700 1 --2- 172.21.15.17:0/4258627580 >> [v2:172.21.15.17:6808/90657,v1:172.21.15.17:6810/90657] conn(0x7f590006d3a0 0x7f590006f7b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:49.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.131+0000 7f5917fff700 1 -- 172.21.15.17:0/4258627580 <== osd.2 v2:172.21.15.17:6808/90657 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f590006fe80 con 0x7f590006d3a0 2023-10-06T04:44:49.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.145+0000 7f5926428700 1 -- 172.21.15.17:0/4258627580 --> [v2:172.21.15.17:6808/90657,v1:172.21.15.17:6810/90657] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f59200b5a40 con 0x7f590006d3a0 2023-10-06T04:44:49.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.145+0000 7f5917fff700 1 -- 172.21.15.17:0/4258627580 <== osd.2 v2:172.21.15.17:6808/90657 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f59200b5a40 con 0x7f590006d3a0 2023-10-06T04:44:49.147 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-06T04:44:49.147 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:44:49.147 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-06T04:44:49.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.145+0000 7f5926428700 1 -- 172.21.15.17:0/4258627580 >> [v2:172.21.15.17:6808/90657,v1:172.21.15.17:6810/90657] conn(0x7f590006d3a0 msgr2=0x7f590006f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:49.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.145+0000 7f5926428700 1 --2- 172.21.15.17:0/4258627580 >> [v2:172.21.15.17:6808/90657,v1:172.21.15.17:6810/90657] conn(0x7f590006d3a0 0x7f590006f7b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:49.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.145+0000 7f5926428700 1 -- 172.21.15.17:0/4258627580 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5900066f30 msgr2=0x7f59000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:49.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.145+0000 7f5926428700 1 --2- 172.21.15.17:0/4258627580 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f5900066f30 0x7f59000693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f59080018c0 tx=0x7f5908009040 comp rx=0 tx=0).stop 2023-10-06T04:44:49.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.145+0000 7f5926428700 1 -- 172.21.15.17:0/4258627580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5920150360 msgr2=0x7f59200ce990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:49.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.146+0000 7f5926428700 1 --2- 172.21.15.17:0/4258627580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5920150360 0x7f59200ce990 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f591800cc10 tx=0x7f5918001640 comp rx=0 tx=0).stop 2023-10-06T04:44:49.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.146+0000 7f59249c5700 1 -- 172.21.15.17:0/4258627580 reap_dead start 2023-10-06T04:44:49.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.146+0000 7f5926428700 1 -- 172.21.15.17:0/4258627580 shutdown_connections 2023-10-06T04:44:49.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.146+0000 7f5926428700 1 -- 172.21.15.17:0/4258627580 >> 172.21.15.17:0/4258627580 conn(0x7f592008a180 msgr2=0x7f592006ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:49.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.146+0000 7f5926428700 1 -- 172.21.15.17:0/4258627580 shutdown_connections 2023-10-06T04:44:49.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.146+0000 7f5926428700 1 -- 172.21.15.17:0/4258627580 wait complete. 2023-10-06T04:44:49.159 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-06T04:44:49.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.276+0000 7fd648b84700 1 Processor -- start 2023-10-06T04:44:49.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.276+0000 7fd648b84700 1 -- start start 2023-10-06T04:44:49.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.277+0000 7fd648b84700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd64415ace0 0x7fd6440b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:49.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.277+0000 7fd648b84700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd6440682a0 0x7fd6440675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:49.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.277+0000 7fd648b84700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd644068740 0x7fd644067b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:49.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.277+0000 7fd648b84700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd64406c560 con 0x7fd6440682a0 2023-10-06T04:44:49.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.277+0000 7fd648b84700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6440b1f40 con 0x7fd64415ace0 2023-10-06T04:44:49.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.277+0000 7fd648b84700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6440afd00 con 0x7fd644068740 2023-10-06T04:44:49.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.278+0000 7fd641d9b700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd6440682a0 0x7fd6440675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:49.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.278+0000 7fd641d9b700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd6440682a0 0x7fd6440675f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46308/0 (socket says 172.21.15.17:46308) 2023-10-06T04:44:49.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.278+0000 7fd641d9b700 1 -- 172.21.15.17:0/3324656230 learned_addr learned my addr 172.21.15.17:0/3324656230 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:49.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.278+0000 7fd64259c700 1 --2- 172.21.15.17:0/3324656230 >> v2:172.21.15.136:3300/0 conn(0x7fd64415ace0 0x7fd6440b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:49.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.278+0000 7fd642d9d700 1 --2- 172.21.15.17:0/3324656230 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd644068740 0x7fd644067b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:49.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.278+0000 7fd641d9b700 1 -- 172.21.15.17:0/3324656230 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd644068740 msgr2=0x7fd644067b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:49.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.278+0000 7fd641d9b700 1 --2- 172.21.15.17:0/3324656230 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd644068740 0x7fd644067b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:49.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.278+0000 7fd641d9b700 1 -- 172.21.15.17:0/3324656230 >> v2:172.21.15.136:3300/0 conn(0x7fd64415ace0 msgr2=0x7fd6440b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:49.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.278+0000 7fd641d9b700 1 --2- 172.21.15.17:0/3324656230 >> v2:172.21.15.136:3300/0 conn(0x7fd64415ace0 0x7fd6440b1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:49.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.278+0000 7fd641d9b700 1 -- 172.21.15.17:0/3324656230 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd64406d3c0 con 0x7fd6440682a0 2023-10-06T04:44:49.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.278+0000 7fd641d9b700 1 --2- 172.21.15.17:0/3324656230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6440682a0 0x7fd6440675f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd6440b0000 tx=0x7fd62c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfa05847f1892e90 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:49.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.278+0000 7fd64159a700 1 -- 172.21.15.17:0/3324656230 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c00b860 con 0x7fd6440682a0 2023-10-06T04:44:49.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.278+0000 7fd64159a700 1 -- 172.21.15.17:0/3324656230 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62c00b9c0 con 0x7fd6440682a0 2023-10-06T04:44:49.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.278+0000 7fd64159a700 1 -- 172.21.15.17:0/3324656230 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c00bd60 con 0x7fd6440682a0 2023-10-06T04:44:49.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.279+0000 7fd648b84700 1 -- 172.21.15.17:0/3324656230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6440682a0 msgr2=0x7fd6440675f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:49.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.279+0000 7fd648b84700 1 --2- 172.21.15.17:0/3324656230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6440682a0 0x7fd6440675f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd6440b0000 tx=0x7fd62c009250 comp rx=0 tx=0).stop 2023-10-06T04:44:49.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.279+0000 7fd648b84700 1 -- 172.21.15.17:0/3324656230 shutdown_connections 2023-10-06T04:44:49.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.279+0000 7fd648b84700 1 --2- 172.21.15.17:0/3324656230 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd644068740 0x7fd644067b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:49.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.279+0000 7fd648b84700 1 --2- 172.21.15.17:0/3324656230 >> v2:172.21.15.136:3300/0 conn(0x7fd64415ace0 0x7fd6440b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:49.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.279+0000 7fd648b84700 1 --2- 172.21.15.17:0/3324656230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6440682a0 0x7fd6440675f0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:49.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.279+0000 7fd648b84700 1 -- 172.21.15.17:0/3324656230 >> 172.21.15.17:0/3324656230 conn(0x7fd6440cd420 msgr2=0x7fd6440cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:49.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.279+0000 7fd648b84700 1 -- 172.21.15.17:0/3324656230 shutdown_connections 2023-10-06T04:44:49.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.279+0000 7fd648b84700 1 -- 172.21.15.17:0/3324656230 wait complete. 2023-10-06T04:44:49.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.280+0000 7fd648b84700 1 Processor -- start 2023-10-06T04:44:49.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.280+0000 7fd648b84700 1 -- start start 2023-10-06T04:44:49.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.281+0000 7fd648b84700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6440682a0 0x7fd6440c3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:49.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.281+0000 7fd648b84700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd644068740 0x7fd64415cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:49.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.281+0000 7fd648b84700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd64415ace0 0x7fd6440c6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:49.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.281+0000 7fd648b84700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6440c2250 con 0x7fd6440682a0 2023-10-06T04:44:49.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.281+0000 7fd648b84700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6440c42c0 con 0x7fd644068740 2023-10-06T04:44:49.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.281+0000 7fd648b84700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6440c45a0 con 0x7fd64415ace0 2023-10-06T04:44:49.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.281+0000 7fd64259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6440682a0 0x7fd6440c3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:49.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.281+0000 7fd64259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6440682a0 0x7fd6440c3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46320/0 (socket says 172.21.15.17:46320) 2023-10-06T04:44:49.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.281+0000 7fd64259c700 1 -- 172.21.15.17:0/3366475337 learned_addr learned my addr 172.21.15.17:0/3366475337 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:49.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.281+0000 7fd642d9d700 1 --2- 172.21.15.17:0/3366475337 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd64415ace0 0x7fd6440c6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:49.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.281+0000 7fd641d9b700 1 --2- 172.21.15.17:0/3366475337 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd644068740 0x7fd64415cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:49.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.281+0000 7fd64259c700 1 -- 172.21.15.17:0/3366475337 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd64415ace0 msgr2=0x7fd6440c6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:49.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.281+0000 7fd64259c700 1 --2- 172.21.15.17:0/3366475337 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd64415ace0 0x7fd6440c6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:49.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.281+0000 7fd64259c700 1 -- 172.21.15.17:0/3366475337 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd644068740 msgr2=0x7fd64415cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:49.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.281+0000 7fd64259c700 1 --2- 172.21.15.17:0/3366475337 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd644068740 0x7fd64415cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:49.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.281+0000 7fd64259c700 1 -- 172.21.15.17:0/3366475337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd62c0094f0 con 0x7fd6440682a0 2023-10-06T04:44:49.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.281+0000 7fd641d9b700 1 --2- 172.21.15.17:0/3366475337 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd644068740 0x7fd64415cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:49.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.281+0000 7fd64259c700 1 --2- 172.21.15.17:0/3366475337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6440682a0 0x7fd6440c3ca0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd63c00e190 tx=0x7fd63c009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:49.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.281+0000 7fd63a7fc700 1 -- 172.21.15.17:0/3366475337 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63c00ee30 con 0x7fd6440682a0 2023-10-06T04:44:49.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.282+0000 7fd63a7fc700 1 -- 172.21.15.17:0/3366475337 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd63c014420 con 0x7fd6440682a0 2023-10-06T04:44:49.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.282+0000 7fd63a7fc700 1 -- 172.21.15.17:0/3366475337 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63c0147e0 con 0x7fd6440682a0 2023-10-06T04:44:49.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.282+0000 7fd648b84700 1 -- 172.21.15.17:0/3366475337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6440c4880 con 0x7fd6440682a0 2023-10-06T04:44:49.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.282+0000 7fd648b84700 1 -- 172.21.15.17:0/3366475337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6440c66d0 con 0x7fd6440682a0 2023-10-06T04:44:49.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.282+0000 7fd648b84700 1 -- 172.21.15.17:0/3366475337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6440c2530 con 0x7fd6440682a0 2023-10-06T04:44:49.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.283+0000 7fd63a7fc700 1 -- 172.21.15.17:0/3366475337 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd63c014b90 con 0x7fd6440682a0 2023-10-06T04:44:49.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.283+0000 7fd63a7fc700 1 --2- 172.21.15.17:0/3366475337 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd624066f30 0x7fd6240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:49.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.283+0000 7fd63a7fc700 1 -- 172.21.15.17:0/3366475337 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fd63c084cc0 con 0x7fd6440682a0 2023-10-06T04:44:49.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.283+0000 7fd641d9b700 1 --2- 172.21.15.17:0/3366475337 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd624066f30 0x7fd6240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:49.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.284+0000 7fd641d9b700 1 --2- 172.21.15.17:0/3366475337 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd624066f30 0x7fd6240693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd6440b0000 tx=0x7fd62c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:49.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.288+0000 7fd63a7fc700 1 -- 172.21.15.17:0/3366475337 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd63c08b080 con 0x7fd6440682a0 2023-10-06T04:44:49.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.480+0000 7fd648b84700 1 -- 172.21.15.17:0/3366475337 --> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6440c2390 con 0x7fd624066f30 2023-10-06T04:44:49.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.480+0000 7fd63a7fc700 1 -- 172.21.15.17:0/3366475337 <== mgr.4104 v2:172.21.15.17:6832/90424 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd62c00bc50 con 0x7fd624066f30 2023-10-06T04:44:49.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.482+0000 7fd648b84700 1 -- 172.21.15.17:0/3366475337 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd624066f30 msgr2=0x7fd6240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:49.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.482+0000 7fd648b84700 1 --2- 172.21.15.17:0/3366475337 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd624066f30 0x7fd6240693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd6440b0000 tx=0x7fd62c017000 comp rx=0 tx=0).stop 2023-10-06T04:44:49.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.482+0000 7fd648b84700 1 -- 172.21.15.17:0/3366475337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6440682a0 msgr2=0x7fd6440c3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:49.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.482+0000 7fd648b84700 1 --2- 172.21.15.17:0/3366475337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6440682a0 0x7fd6440c3ca0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd63c00e190 tx=0x7fd63c009920 comp rx=0 tx=0).stop 2023-10-06T04:44:49.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.482+0000 7fd648b84700 1 -- 172.21.15.17:0/3366475337 shutdown_connections 2023-10-06T04:44:49.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.482+0000 7fd648b84700 1 --2- 172.21.15.17:0/3366475337 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fd624066f30 0x7fd6240693e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:49.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.482+0000 7fd648b84700 1 --2- 172.21.15.17:0/3366475337 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd64415ace0 0x7fd6440c6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:49.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.482+0000 7fd648b84700 1 --2- 172.21.15.17:0/3366475337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6440682a0 0x7fd6440c3ca0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:49.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.482+0000 7fd648b84700 1 --2- 172.21.15.17:0/3366475337 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd644068740 0x7fd64415cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:49.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.482+0000 7fd648b84700 1 -- 172.21.15.17:0/3366475337 >> 172.21.15.17:0/3366475337 conn(0x7fd6440cd420 msgr2=0x7fd6440af0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:49.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.482+0000 7fd648b84700 1 -- 172.21.15.17:0/3366475337 shutdown_connections 2023-10-06T04:44:49.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.482+0000 7fd648b84700 1 -- 172.21.15.17:0/3366475337 wait complete. 2023-10-06T04:44:49.485 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 2 to deep-scrub 2023-10-06T04:44:49.495 INFO:tasks.ceph:Scrubbing osd.3 2023-10-06T04:44:49.496 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:44:49.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.617+0000 7f51c0fb4700 1 Processor -- start 2023-10-06T04:44:49.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.617+0000 7f51c0fb4700 1 -- start start 2023-10-06T04:44:49.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.618+0000 7f51c0fb4700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f51bc0cb6b0 0x7f51bc0cd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:49.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.618+0000 7f51c0fb4700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51bc0cc050 con 0x7f51bc0cbb30 2023-10-06T04:44:49.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.618+0000 7f51c0fb4700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51bc15b130 con 0x7f51bc150360 2023-10-06T04:44:49.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.618+0000 7f51c0fb4700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51bc0cc330 con 0x7f51bc0cb6b0 2023-10-06T04:44:49.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.618+0000 7f51bad9d700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f51bc0cbb30 0x7f51bc159e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37900/0 (socket says 172.21.15.17:37900) 2023-10-06T04:44:49.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.618+0000 7f51bad9d700 1 -- 172.21.15.17:0/2702018091 learned_addr learned my addr 172.21.15.17:0/2702018091 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:49.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.618+0000 7f51b9d9b700 1 --2- 172.21.15.17:0/2702018091 >> v2:172.21.15.136:3300/0 conn(0x7f51bc0cb6b0 0x7f51bc0cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:49.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.618+0000 7f51b959a700 1 -- 172.21.15.17:0/2702018091 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3829790594 0 0) 0x7f51bc0cc050 con 0x7f51bc0cbb30 2023-10-06T04:44:49.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.618+0000 7f51b959a700 1 -- 172.21.15.17:0/2702018091 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51a8003570 con 0x7f51bc0cbb30 2023-10-06T04:44:49.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.619+0000 7f51b9d9b700 1 -- 172.21.15.17:0/2702018091 >> v1:172.21.15.136:6789/0 conn(0x7f51bc150360 legacy=0x7f51bc150730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:49.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.619+0000 7f51b9d9b700 1 -- 172.21.15.17:0/2702018091 >> v1:172.21.15.17:6789/0 conn(0x7f51bc0cbb30 legacy=0x7f51bc159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:49.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.619+0000 7f51b9d9b700 1 -- 172.21.15.17:0/2702018091 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51bc15b410 con 0x7f51bc0cb6b0 2023-10-06T04:44:49.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.619+0000 7f51b9d9b700 1 --2- 172.21.15.17:0/2702018091 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51bc0cb6b0 0x7f51bc0cd050 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f51a4009910 tx=0x7f51a40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4bc55cd9e5cc313 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:49.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.619+0000 7f51b959a700 1 -- 172.21.15.17:0/2702018091 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a400b640 con 0x7f51bc0cb6b0 2023-10-06T04:44:49.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.619+0000 7f51b959a700 1 -- 172.21.15.17:0/2702018091 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a400b7a0 con 0x7f51bc0cb6b0 2023-10-06T04:44:49.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.619+0000 7f51b959a700 1 -- 172.21.15.17:0/2702018091 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a400bb20 con 0x7f51bc0cb6b0 2023-10-06T04:44:49.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.620+0000 7f51c0fb4700 1 -- 172.21.15.17:0/2702018091 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51bc0cb6b0 msgr2=0x7f51bc0cd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:49.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.620+0000 7f51c0fb4700 1 --2- 172.21.15.17:0/2702018091 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51bc0cb6b0 0x7f51bc0cd050 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f51a4009910 tx=0x7f51a40091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:49.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.620+0000 7f51c0fb4700 1 -- 172.21.15.17:0/2702018091 shutdown_connections 2023-10-06T04:44:49.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.620+0000 7f51c0fb4700 1 --2- 172.21.15.17:0/2702018091 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51bc0cb6b0 0x7f51bc0cd050 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:49.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.620+0000 7f51c0fb4700 1 -- 172.21.15.17:0/2702018091 >> 172.21.15.17:0/2702018091 conn(0x7f51bc08a180 msgr2=0x7f51bc099aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:49.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.620+0000 7f51c0fb4700 1 -- 172.21.15.17:0/2702018091 shutdown_connections 2023-10-06T04:44:49.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.620+0000 7f51c0fb4700 1 -- 172.21.15.17:0/2702018091 wait complete. 2023-10-06T04:44:49.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.621+0000 7f51c0fb4700 1 Processor -- start 2023-10-06T04:44:49.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.621+0000 7f51c0fb4700 1 -- start start 2023-10-06T04:44:49.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.621+0000 7f51c0fb4700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51bc0cb6b0 0x7f51bc16ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:49.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.621+0000 7f51c0fb4700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51bc0cbb30 0x7f51bc15fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:49.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.622+0000 7f51c0fb4700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f51bc150360 0x7f51bc14da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:49.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.622+0000 7f51c0fb4700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc155990 con 0x7f51bc0cbb30 2023-10-06T04:44:49.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.622+0000 7f51c0fb4700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc15f7c0 con 0x7f51bc0cb6b0 2023-10-06T04:44:49.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.622+0000 7f51c0fb4700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc1553d0 con 0x7f51bc150360 2023-10-06T04:44:49.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.622+0000 7f51b9d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51bc0cbb30 0x7f51bc15fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:49.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.622+0000 7f51b9d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51bc0cbb30 0x7f51bc15fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46332/0 (socket says 172.21.15.17:46332) 2023-10-06T04:44:49.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.622+0000 7f51b9d9b700 1 -- 172.21.15.17:0/2586520195 learned_addr learned my addr 172.21.15.17:0/2586520195 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:49.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.622+0000 7f51bad9d700 1 --2- 172.21.15.17:0/2586520195 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f51bc150360 0x7f51bc14da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:49.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.622+0000 7f51ba59c700 1 --2- 172.21.15.17:0/2586520195 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51bc0cb6b0 0x7f51bc16ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:49.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.622+0000 7f51b9d9b700 1 -- 172.21.15.17:0/2586520195 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f51bc150360 msgr2=0x7f51bc14da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:49.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.622+0000 7f51b9d9b700 1 --2- 172.21.15.17:0/2586520195 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f51bc150360 0x7f51bc14da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:49.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.622+0000 7f51b9d9b700 1 -- 172.21.15.17:0/2586520195 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51bc0cb6b0 msgr2=0x7f51bc16ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:49.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.622+0000 7f51b9d9b700 1 --2- 172.21.15.17:0/2586520195 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51bc0cb6b0 0x7f51bc16ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:49.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.622+0000 7f51b9d9b700 1 -- 172.21.15.17:0/2586520195 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a4009420 con 0x7f51bc0cbb30 2023-10-06T04:44:49.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.622+0000 7f51b9d9b700 1 --2- 172.21.15.17:0/2586520195 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51bc0cbb30 0x7f51bc15fc50 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f51bc0ad8e0 tx=0x7f51a4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:49.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.622+0000 7f51b27fc700 1 -- 172.21.15.17:0/2586520195 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a401f070 con 0x7f51bc0cbb30 2023-10-06T04:44:49.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.622+0000 7f51b27fc700 1 -- 172.21.15.17:0/2586520195 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a400b910 con 0x7f51bc0cbb30 2023-10-06T04:44:49.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.622+0000 7f51c0fb4700 1 -- 172.21.15.17:0/2586520195 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51bc1556b0 con 0x7f51bc0cbb30 2023-10-06T04:44:49.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.622+0000 7f51b27fc700 1 -- 172.21.15.17:0/2586520195 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a4023680 con 0x7f51bc0cbb30 2023-10-06T04:44:49.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.622+0000 7f51c0fb4700 1 -- 172.21.15.17:0/2586520195 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51bc16e330 con 0x7f51bc0cbb30 2023-10-06T04:44:49.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.623+0000 7f51c0fb4700 1 -- 172.21.15.17:0/2586520195 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f51bc0718b0 con 0x7f51bc0cbb30 2023-10-06T04:44:49.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.624+0000 7f51b27fc700 1 -- 172.21.15.17:0/2586520195 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f51a4023a70 con 0x7f51bc0cbb30 2023-10-06T04:44:49.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.624+0000 7f51b27fc700 1 --2- 172.21.15.17:0/2586520195 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f519c066f30 0x7f519c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:49.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.624+0000 7f51b27fc700 1 -- 172.21.15.17:0/2586520195 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f51a4085820 con 0x7f51bc0cbb30 2023-10-06T04:44:49.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.624+0000 7f51ba59c700 1 --2- 172.21.15.17:0/2586520195 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f519c066f30 0x7f519c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:49.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.624+0000 7f51b27fc700 1 --2- 172.21.15.17:0/2586520195 >> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] conn(0x7f519c06d3a0 0x7f519c06f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:49.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.624+0000 7f51b27fc700 1 -- 172.21.15.17:0/2586520195 --> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f519c06fe80 con 0x7f519c06d3a0 2023-10-06T04:44:49.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.624+0000 7f51b27fc700 1 -- 172.21.15.17:0/2586520195 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f51a4087e00 con 0x7f51bc0cbb30 2023-10-06T04:44:49.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.624+0000 7f51bad9d700 1 --2- 172.21.15.17:0/2586520195 >> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] conn(0x7f519c06d3a0 0x7f519c06f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:49.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.624+0000 7f51ba59c700 1 --2- 172.21.15.17:0/2586520195 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f519c066f30 0x7f519c0693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f51b4000c00 tx=0x7f51b4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:49.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.625+0000 7f51bad9d700 1 --2- 172.21.15.17:0/2586520195 >> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] conn(0x7f519c06d3a0 0x7f519c06f7b0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:49.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.625+0000 7f51b27fc700 1 -- 172.21.15.17:0/2586520195 <== osd.3 v2:172.21.15.17:6824/90688 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f519c06fe80 con 0x7f519c06d3a0 2023-10-06T04:44:49.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.639+0000 7f51c0fb4700 1 -- 172.21.15.17:0/2586520195 --> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f51bc06ce80 con 0x7f519c06d3a0 2023-10-06T04:44:49.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.639+0000 7f51b27fc700 1 -- 172.21.15.17:0/2586520195 <== osd.3 v2:172.21.15.17:6824/90688 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f51bc06ce80 con 0x7f519c06d3a0 2023-10-06T04:44:49.641 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-06T04:44:49.641 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:44:49.641 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-06T04:44:49.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.639+0000 7f51c0fb4700 1 -- 172.21.15.17:0/2586520195 >> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] conn(0x7f519c06d3a0 msgr2=0x7f519c06f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:49.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.639+0000 7f51c0fb4700 1 --2- 172.21.15.17:0/2586520195 >> [v2:172.21.15.17:6824/90688,v1:172.21.15.17:6825/90688] conn(0x7f519c06d3a0 0x7f519c06f7b0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:49.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.640+0000 7f51c0fb4700 1 -- 172.21.15.17:0/2586520195 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f519c066f30 msgr2=0x7f519c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:49.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.640+0000 7f51c0fb4700 1 --2- 172.21.15.17:0/2586520195 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f519c066f30 0x7f519c0693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f51b4000c00 tx=0x7f51b4009040 comp rx=0 tx=0).stop 2023-10-06T04:44:49.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.640+0000 7f51c0fb4700 1 -- 172.21.15.17:0/2586520195 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51bc0cbb30 msgr2=0x7f51bc15fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:49.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.640+0000 7f51c0fb4700 1 --2- 172.21.15.17:0/2586520195 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51bc0cbb30 0x7f51bc15fc50 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f51bc0ad8e0 tx=0x7f51a4017000 comp rx=0 tx=0).stop 2023-10-06T04:44:49.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.640+0000 7f51bad9d700 1 -- 172.21.15.17:0/2586520195 reap_dead start 2023-10-06T04:44:49.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.640+0000 7f51c0fb4700 1 -- 172.21.15.17:0/2586520195 shutdown_connections 2023-10-06T04:44:49.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.640+0000 7f51c0fb4700 1 -- 172.21.15.17:0/2586520195 >> 172.21.15.17:0/2586520195 conn(0x7f51bc08a180 msgr2=0x7f51bc06f440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:49.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.640+0000 7f51c0fb4700 1 -- 172.21.15.17:0/2586520195 shutdown_connections 2023-10-06T04:44:49.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.640+0000 7f51c0fb4700 1 -- 172.21.15.17:0/2586520195 wait complete. 2023-10-06T04:44:49.653 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-06T04:44:49.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.771+0000 7ff71905f700 1 Processor -- start 2023-10-06T04:44:49.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.771+0000 7ff71905f700 1 -- start start 2023-10-06T04:44:49.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.772+0000 7ff71905f700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff7140b0440 0x7ff7140ae610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:49.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.772+0000 7ff71905f700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff714158f60 0x7ff71415a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:49.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.772+0000 7ff71905f700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7140af930 con 0x7ff714157600 2023-10-06T04:44:49.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.772+0000 7ff71905f700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7140aed20 con 0x7ff7140b0440 2023-10-06T04:44:49.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.772+0000 7ff71905f700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7140af000 con 0x7ff714158f60 2023-10-06T04:44:49.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.772+0000 7ff713fff700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7ff714157600 0x7ff7140afd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37902/0 (socket says 172.21.15.17:37902) 2023-10-06T04:44:49.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.772+0000 7ff713fff700 1 -- 172.21.15.17:0/37106589 learned_addr learned my addr 172.21.15.17:0/37106589 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:49.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.772+0000 7ff712ffd700 1 -- 172.21.15.17:0/37106589 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3793533019 0 0) 0x7ff7140af930 con 0x7ff714157600 2023-10-06T04:44:49.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.772+0000 7ff7137fe700 1 --2- 172.21.15.17:0/37106589 >> v2:172.21.15.136:3300/0 conn(0x7ff7140b0440 0x7ff7140ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:49.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.772+0000 7ff71885e700 1 --2- 172.21.15.17:0/37106589 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff714158f60 0x7ff71415a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:49.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.772+0000 7ff712ffd700 1 -- 172.21.15.17:0/37106589 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff700003570 con 0x7ff714157600 2023-10-06T04:44:49.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.773+0000 7ff712ffd700 1 -- 172.21.15.17:0/37106589 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1482213614 0 0) 0x7ff700003570 con 0x7ff714157600 2023-10-06T04:44:49.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.773+0000 7ff712ffd700 1 -- 172.21.15.17:0/37106589 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff714158f60 msgr2=0x7ff71415a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:49.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.773+0000 7ff712ffd700 1 --2- 172.21.15.17:0/37106589 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff714158f60 0x7ff71415a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:49.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.773+0000 7ff712ffd700 1 -- 172.21.15.17:0/37106589 >> v2:172.21.15.136:3300/0 conn(0x7ff7140b0440 msgr2=0x7ff7140ae610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:49.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.773+0000 7ff712ffd700 1 --2- 172.21.15.17:0/37106589 >> v2:172.21.15.136:3300/0 conn(0x7ff7140b0440 0x7ff7140ae610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:49.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.773+0000 7ff712ffd700 1 -- 172.21.15.17:0/37106589 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7140af2e0 con 0x7ff714157600 2023-10-06T04:44:49.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.773+0000 7ff712ffd700 1 -- 172.21.15.17:0/37106589 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4268781140 0 0) 0x7ff704001470 con 0x7ff714157600 2023-10-06T04:44:49.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.773+0000 7ff71885e700 1 --2- 172.21.15.17:0/37106589 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff714158f60 0x7ff71415a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:49.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.773+0000 7ff712ffd700 1 -- 172.21.15.17:0/37106589 >> v1:172.21.15.17:6789/0 conn(0x7ff714157600 legacy=0x7ff7140afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:49.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.773+0000 7ff712ffd700 1 --2- 172.21.15.17:0/37106589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff700003a60 0x7ff700003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:49.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.773+0000 7ff712ffd700 1 --2- 172.21.15.17:0/37106589 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff700004810 0x7ff700004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:49.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.773+0000 7ff712ffd700 1 --2- 172.21.15.17:0/37106589 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff714158f60 0x7ff7000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:49.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.773+0000 7ff712ffd700 1 -- 172.21.15.17:0/37106589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7140aed20 con 0x7ff700003a60 2023-10-06T04:44:49.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.773+0000 7ff712ffd700 1 -- 172.21.15.17:0/37106589 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7140af000 con 0x7ff700004810 2023-10-06T04:44:49.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.773+0000 7ff712ffd700 1 -- 172.21.15.17:0/37106589 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff70000bb60 con 0x7ff714158f60 2023-10-06T04:44:49.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.773+0000 7ff713fff700 1 --2- 172.21.15.17:0/37106589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff700003a60 0x7ff700003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:49.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.773+0000 7ff7137fe700 1 --2- 172.21.15.17:0/37106589 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff700004810 0x7ff700004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:49.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.773+0000 7ff71885e700 1 --2- 172.21.15.17:0/37106589 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff714158f60 0x7ff7000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:49.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.773+0000 7ff713fff700 1 -- 172.21.15.17:0/37106589 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff714158f60 msgr2=0x7ff7000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:49.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.773+0000 7ff713fff700 1 --2- 172.21.15.17:0/37106589 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff714158f60 0x7ff7000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:49.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.773+0000 7ff713fff700 1 -- 172.21.15.17:0/37106589 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff700004810 msgr2=0x7ff700004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:49.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.773+0000 7ff713fff700 1 --2- 172.21.15.17:0/37106589 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff700004810 0x7ff700004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:49.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.773+0000 7ff713fff700 1 -- 172.21.15.17:0/37106589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff700003570 con 0x7ff700003a60 2023-10-06T04:44:49.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.773+0000 7ff71885e700 1 --2- 172.21.15.17:0/37106589 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff714158f60 0x7ff7000051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:49.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.773+0000 7ff713fff700 1 --2- 172.21.15.17:0/37106589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff700003a60 0x7ff700003e70 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ff70400c3f0 tx=0x7ff704001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ee172504aacab49 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:49.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.774+0000 7ff712ffd700 1 -- 172.21.15.17:0/37106589 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70400cc80 con 0x7ff700003a60 2023-10-06T04:44:49.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.774+0000 7ff712ffd700 1 -- 172.21.15.17:0/37106589 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70400cde0 con 0x7ff700003a60 2023-10-06T04:44:49.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.774+0000 7ff712ffd700 1 -- 172.21.15.17:0/37106589 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff704005b70 con 0x7ff700003a60 2023-10-06T04:44:49.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.774+0000 7ff71905f700 1 -- 172.21.15.17:0/37106589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff700003a60 msgr2=0x7ff700003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:49.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.774+0000 7ff71905f700 1 --2- 172.21.15.17:0/37106589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff700003a60 0x7ff700003e70 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ff70400c3f0 tx=0x7ff704001e90 comp rx=0 tx=0).stop 2023-10-06T04:44:49.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.774+0000 7ff71885e700 1 -- 172.21.15.17:0/37106589 reap_dead start 2023-10-06T04:44:49.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.774+0000 7ff71905f700 1 -- 172.21.15.17:0/37106589 shutdown_connections 2023-10-06T04:44:49.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.774+0000 7ff71905f700 1 -- 172.21.15.17:0/37106589 >> 172.21.15.17:0/37106589 conn(0x7ff714087fb0 msgr2=0x7ff7140883b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:49.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.774+0000 7ff71905f700 1 -- 172.21.15.17:0/37106589 shutdown_connections 2023-10-06T04:44:49.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.774+0000 7ff71905f700 1 -- 172.21.15.17:0/37106589 wait complete. 2023-10-06T04:44:49.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.775+0000 7ff71905f700 1 Processor -- start 2023-10-06T04:44:49.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.775+0000 7ff71905f700 1 -- start start 2023-10-06T04:44:49.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.776+0000 7ff71905f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff700003a60 0x7ff71414f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:49.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.776+0000 7ff71905f700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff714151260 0x7ff714098930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:49.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.776+0000 7ff71905f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7140992c0 0x7ff714099740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:49.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.776+0000 7ff71905f700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff714099c80 con 0x7ff7140992c0 2023-10-06T04:44:49.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.776+0000 7ff71905f700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7140aa4a0 con 0x7ff700003a60 2023-10-06T04:44:49.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.776+0000 7ff71905f700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff714151720 con 0x7ff714151260 2023-10-06T04:44:49.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.776+0000 7ff71885e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7140992c0 0x7ff714099740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:49.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.776+0000 7ff71885e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7140992c0 0x7ff714099740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46350/0 (socket says 172.21.15.17:46350) 2023-10-06T04:44:49.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.776+0000 7ff71885e700 1 -- 172.21.15.17:0/3394850502 learned_addr learned my addr 172.21.15.17:0/3394850502 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:49.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.776+0000 7ff713fff700 1 --2- 172.21.15.17:0/3394850502 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff700003a60 0x7ff71414f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:49.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.776+0000 7ff7137fe700 1 --2- 172.21.15.17:0/3394850502 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff714151260 0x7ff714098930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:49.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.777+0000 7ff71885e700 1 -- 172.21.15.17:0/3394850502 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff714151260 msgr2=0x7ff714098930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:49.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.777+0000 7ff71885e700 1 --2- 172.21.15.17:0/3394850502 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff714151260 0x7ff714098930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:49.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.777+0000 7ff71885e700 1 -- 172.21.15.17:0/3394850502 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff700003a60 msgr2=0x7ff71414f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:49.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.777+0000 7ff71885e700 1 --2- 172.21.15.17:0/3394850502 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff700003a60 0x7ff71414f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:49.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.777+0000 7ff71885e700 1 -- 172.21.15.17:0/3394850502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff714151a00 con 0x7ff7140992c0 2023-10-06T04:44:49.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.777+0000 7ff713fff700 1 --2- 172.21.15.17:0/3394850502 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff700003a60 0x7ff71414f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:49.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.777+0000 7ff71885e700 1 --2- 172.21.15.17:0/3394850502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7140992c0 0x7ff714099740 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff71406ae10 tx=0x7ff70c009870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:49.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.777+0000 7ff70bfff700 1 -- 172.21.15.17:0/3394850502 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c002ce0 con 0x7ff7140992c0 2023-10-06T04:44:49.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.777+0000 7ff70bfff700 1 -- 172.21.15.17:0/3394850502 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70c00f050 con 0x7ff7140992c0 2023-10-06T04:44:49.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.777+0000 7ff71905f700 1 -- 172.21.15.17:0/3394850502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff714151ce0 con 0x7ff7140992c0 2023-10-06T04:44:49.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.777+0000 7ff70bfff700 1 -- 172.21.15.17:0/3394850502 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c014660 con 0x7ff7140992c0 2023-10-06T04:44:49.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.777+0000 7ff71905f700 1 -- 172.21.15.17:0/3394850502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff714098e70 con 0x7ff7140992c0 2023-10-06T04:44:49.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.778+0000 7ff71905f700 1 -- 172.21.15.17:0/3394850502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7140aa6a0 con 0x7ff7140992c0 2023-10-06T04:44:49.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.778+0000 7ff70bfff700 1 -- 172.21.15.17:0/3394850502 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff70c003040 con 0x7ff7140992c0 2023-10-06T04:44:49.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.779+0000 7ff70bfff700 1 --2- 172.21.15.17:0/3394850502 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff6f4066f30 0x7ff6f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:49.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.779+0000 7ff70bfff700 1 -- 172.21.15.17:0/3394850502 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7ff70c0846b0 con 0x7ff7140992c0 2023-10-06T04:44:49.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.779+0000 7ff713fff700 1 --2- 172.21.15.17:0/3394850502 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff6f4066f30 0x7ff6f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:49.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.779+0000 7ff713fff700 1 --2- 172.21.15.17:0/3394850502 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff6f4066f30 0x7ff6f40693e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff70400c390 tx=0x7ff704015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:49.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.783+0000 7ff70bfff700 1 -- 172.21.15.17:0/3394850502 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff7140aa6a0 con 0x7ff7140992c0 2023-10-06T04:44:49.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.977+0000 7ff71905f700 1 -- 172.21.15.17:0/3394850502 --> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7ff714152330 con 0x7ff6f4066f30 2023-10-06T04:44:49.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.978+0000 7ff70bfff700 1 -- 172.21.15.17:0/3394850502 <== mgr.4104 v2:172.21.15.17:6832/90424 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff714152330 con 0x7ff6f4066f30 2023-10-06T04:44:49.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.979+0000 7ff71905f700 1 -- 172.21.15.17:0/3394850502 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff6f4066f30 msgr2=0x7ff6f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:49.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.979+0000 7ff71905f700 1 --2- 172.21.15.17:0/3394850502 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff6f4066f30 0x7ff6f40693e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff70400c390 tx=0x7ff704015000 comp rx=0 tx=0).stop 2023-10-06T04:44:49.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.979+0000 7ff71905f700 1 -- 172.21.15.17:0/3394850502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7140992c0 msgr2=0x7ff714099740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:49.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.979+0000 7ff71905f700 1 --2- 172.21.15.17:0/3394850502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7140992c0 0x7ff714099740 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff71406ae10 tx=0x7ff70c009870 comp rx=0 tx=0).stop 2023-10-06T04:44:49.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.979+0000 7ff71905f700 1 -- 172.21.15.17:0/3394850502 shutdown_connections 2023-10-06T04:44:49.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.979+0000 7ff71905f700 1 --2- 172.21.15.17:0/3394850502 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7ff6f4066f30 0x7ff6f40693e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:49.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.979+0000 7ff71905f700 1 --2- 172.21.15.17:0/3394850502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7140992c0 0x7ff714099740 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:49.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.979+0000 7ff71905f700 1 --2- 172.21.15.17:0/3394850502 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff700003a60 0x7ff71414f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:49.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.979+0000 7ff71905f700 1 --2- 172.21.15.17:0/3394850502 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff714151260 0x7ff714098930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:49.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.979+0000 7ff71905f700 1 -- 172.21.15.17:0/3394850502 >> 172.21.15.17:0/3394850502 conn(0x7ff714087fb0 msgr2=0x7ff714154dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:49.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.980+0000 7ff71905f700 1 -- 172.21.15.17:0/3394850502 shutdown_connections 2023-10-06T04:44:49.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:49.980+0000 7ff71905f700 1 -- 172.21.15.17:0/3394850502 wait complete. 2023-10-06T04:44:49.983 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 3 to deep-scrub 2023-10-06T04:44:49.992 INFO:tasks.ceph:Scrubbing osd.4 2023-10-06T04:44:49.993 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:44:50.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.113+0000 7f04d3398700 1 Processor -- start 2023-10-06T04:44:50.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.114+0000 7f04d3398700 1 -- start start 2023-10-06T04:44:50.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.114+0000 7f04d3398700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f04cc150360 0x7f04cc150730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:50.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.114+0000 7f04d3398700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f04cc0cb6b0 0x7f04cc0cd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:50.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.115+0000 7f04d3398700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04cc0cc050 con 0x7f04cc0cbb30 2023-10-06T04:44:50.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.115+0000 7f04d3398700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04cc0cc330 con 0x7f04cc150360 2023-10-06T04:44:50.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.115+0000 7f04d3398700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04cc15b130 con 0x7f04cc0cb6b0 2023-10-06T04:44:50.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.115+0000 7f04d1134700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f04cc150360 0x7f04cc150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:50.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.115+0000 7f04d1935700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f04cc0cbb30 0x7f04cc15d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37904/0 (socket says 172.21.15.17:37904) 2023-10-06T04:44:50.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.115+0000 7f04d1935700 1 -- 172.21.15.17:0/4169944846 learned_addr learned my addr 172.21.15.17:0/4169944846 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:50.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.115+0000 7f04d1134700 1 -- 172.21.15.17:0/4169944846 >> v2:172.21.15.136:3300/0 conn(0x7f04cc0cb6b0 msgr2=0x7f04cc0cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:50.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.115+0000 7f04d0933700 1 --2- 172.21.15.17:0/4169944846 >> v2:172.21.15.136:3300/0 conn(0x7f04cc0cb6b0 0x7f04cc0cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:50.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.115+0000 7f04cbfff700 1 -- 172.21.15.17:0/4169944846 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4100549262 0 0) 0x7f04cc0cc050 con 0x7f04cc0cbb30 2023-10-06T04:44:50.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.115+0000 7f04d1134700 1 --2- 172.21.15.17:0/4169944846 >> v2:172.21.15.136:3300/0 conn(0x7f04cc0cb6b0 0x7f04cc0cd050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:50.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.115+0000 7f04d1134700 1 -- 172.21.15.17:0/4169944846 >> v1:172.21.15.17:6789/0 conn(0x7f04cc0cbb30 legacy=0x7f04cc15d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:50.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.115+0000 7f04d1134700 1 -- 172.21.15.17:0/4169944846 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04cc15b410 con 0x7f04cc150360 2023-10-06T04:44:50.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.115+0000 7f04d0933700 1 --2- 172.21.15.17:0/4169944846 >> v2:172.21.15.136:3300/0 conn(0x7f04cc0cb6b0 0x7f04cc0cd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:50.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.115+0000 7f04d1134700 1 --2- 172.21.15.17:0/4169944846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04cc150360 0x7f04cc150730 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f04c40098e0 tx=0x7f04c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32de54be79a2b20b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:50.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.115+0000 7f04cbfff700 1 -- 172.21.15.17:0/4169944846 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c4009e80 con 0x7f04cc150360 2023-10-06T04:44:50.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.115+0000 7f04cbfff700 1 -- 172.21.15.17:0/4169944846 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c400b820 con 0x7f04cc150360 2023-10-06T04:44:50.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.115+0000 7f04cbfff700 1 -- 172.21.15.17:0/4169944846 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c400bba0 con 0x7f04cc150360 2023-10-06T04:44:50.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.116+0000 7f04d3398700 1 -- 172.21.15.17:0/4169944846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04cc150360 msgr2=0x7f04cc150730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:50.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.116+0000 7f04d3398700 1 --2- 172.21.15.17:0/4169944846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04cc150360 0x7f04cc150730 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f04c40098e0 tx=0x7f04c40091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:50.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.116+0000 7f04d3398700 1 -- 172.21.15.17:0/4169944846 shutdown_connections 2023-10-06T04:44:50.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.116+0000 7f04d3398700 1 --2- 172.21.15.17:0/4169944846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04cc150360 0x7f04cc150730 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:50.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.116+0000 7f04d3398700 1 --2- 172.21.15.17:0/4169944846 >> v2:172.21.15.136:3300/0 conn(0x7f04cc0cb6b0 0x7f04cc0cd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:50.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.116+0000 7f04d3398700 1 -- 172.21.15.17:0/4169944846 >> 172.21.15.17:0/4169944846 conn(0x7f04cc08a180 msgr2=0x7f04cc099aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:50.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.116+0000 7f04d3398700 1 -- 172.21.15.17:0/4169944846 shutdown_connections 2023-10-06T04:44:50.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.116+0000 7f04d3398700 1 -- 172.21.15.17:0/4169944846 wait complete. 2023-10-06T04:44:50.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.117+0000 7f04d3398700 1 Processor -- start 2023-10-06T04:44:50.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.117+0000 7f04d3398700 1 -- start start 2023-10-06T04:44:50.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.118+0000 7f04d3398700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04cc0cb6b0 0x7f04cc0c8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:50.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.118+0000 7f04d3398700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04cc0cbb30 0x7f04cc0c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:50.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.118+0000 7f04d3398700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f04cc150360 0x7f04cc0b3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:50.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.118+0000 7f04d3398700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc0ca120 con 0x7f04cc0cb6b0 2023-10-06T04:44:50.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.118+0000 7f04d3398700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc1500f0 con 0x7f04cc0cbb30 2023-10-06T04:44:50.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.118+0000 7f04d3398700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc0c9510 con 0x7f04cc150360 2023-10-06T04:44:50.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.118+0000 7f04d1134700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04cc0cb6b0 0x7f04cc0c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:50.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.118+0000 7f04d1134700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04cc0cb6b0 0x7f04cc0c8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46364/0 (socket says 172.21.15.17:46364) 2023-10-06T04:44:50.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.118+0000 7f04d1134700 1 -- 172.21.15.17:0/3357093288 learned_addr learned my addr 172.21.15.17:0/3357093288 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:50.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.118+0000 7f04d0933700 1 --2- 172.21.15.17:0/3357093288 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04cc0cbb30 0x7f04cc0c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:50.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.118+0000 7f04d1935700 1 --2- 172.21.15.17:0/3357093288 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f04cc150360 0x7f04cc0b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:50.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.118+0000 7f04d1134700 1 -- 172.21.15.17:0/3357093288 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f04cc150360 msgr2=0x7f04cc0b3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:50.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.118+0000 7f04d1134700 1 --2- 172.21.15.17:0/3357093288 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f04cc150360 0x7f04cc0b3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:50.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.118+0000 7f04d1134700 1 -- 172.21.15.17:0/3357093288 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04cc0cbb30 msgr2=0x7f04cc0c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:50.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.118+0000 7f04d1134700 1 --2- 172.21.15.17:0/3357093288 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04cc0cbb30 0x7f04cc0c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:50.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.118+0000 7f04d1134700 1 -- 172.21.15.17:0/3357093288 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c4009420 con 0x7f04cc0cb6b0 2023-10-06T04:44:50.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.118+0000 7f04d0933700 1 --2- 172.21.15.17:0/3357093288 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04cc0cbb30 0x7f04cc0c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:50.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.119+0000 7f04d1134700 1 --2- 172.21.15.17:0/3357093288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04cc0cb6b0 0x7f04cc0c8930 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f04cc088ed0 tx=0x7f04c4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:50.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.119+0000 7f04c97fa700 1 -- 172.21.15.17:0/3357093288 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c4011420 con 0x7f04cc0cb6b0 2023-10-06T04:44:50.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.119+0000 7f04c97fa700 1 -- 172.21.15.17:0/3357093288 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c4011580 con 0x7f04cc0cb6b0 2023-10-06T04:44:50.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.119+0000 7f04d3398700 1 -- 172.21.15.17:0/3357093288 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04cc0c97f0 con 0x7f04cc0cb6b0 2023-10-06T04:44:50.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.119+0000 7f04c97fa700 1 -- 172.21.15.17:0/3357093288 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c4011940 con 0x7f04cc0cb6b0 2023-10-06T04:44:50.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.119+0000 7f04d3398700 1 -- 172.21.15.17:0/3357093288 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04cc0c9db0 con 0x7f04cc0cb6b0 2023-10-06T04:44:50.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.119+0000 7f04d3398700 1 -- 172.21.15.17:0/3357093288 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f04cc0718b0 con 0x7f04cc0cb6b0 2023-10-06T04:44:50.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.120+0000 7f04c97fa700 1 -- 172.21.15.17:0/3357093288 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f04c4011cb0 con 0x7f04cc0cb6b0 2023-10-06T04:44:50.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.120+0000 7f04c97fa700 1 --2- 172.21.15.17:0/3357093288 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f04b8066f30 0x7f04b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:50.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.121+0000 7f04c97fa700 1 -- 172.21.15.17:0/3357093288 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f04c4086580 con 0x7f04cc0cb6b0 2023-10-06T04:44:50.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.121+0000 7f04d0933700 1 --2- 172.21.15.17:0/3357093288 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f04b8066f30 0x7f04b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:50.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.121+0000 7f04c97fa700 1 --2- 172.21.15.17:0/3357093288 >> [v2:172.21.15.136:6800/90902,v1:172.21.15.136:6801/90902] conn(0x7f04b806d3a0 0x7f04b806f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:50.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.121+0000 7f04c97fa700 1 -- 172.21.15.17:0/3357093288 --> [v2:172.21.15.136:6800/90902,v1:172.21.15.136:6801/90902] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f04b806fe80 con 0x7f04b806d3a0 2023-10-06T04:44:50.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.121+0000 7f04c97fa700 1 -- 172.21.15.17:0/3357093288 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04c4086950 con 0x7f04cc0cb6b0 2023-10-06T04:44:50.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.121+0000 7f04d0933700 1 --2- 172.21.15.17:0/3357093288 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f04b8066f30 0x7f04b80693e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f04c0006fd0 tx=0x7f04c0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:50.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.121+0000 7f04d1935700 1 --2- 172.21.15.17:0/3357093288 >> [v2:172.21.15.136:6800/90902,v1:172.21.15.136:6801/90902] conn(0x7f04b806d3a0 0x7f04b806f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:50.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.122+0000 7f04d1935700 1 --2- 172.21.15.17:0/3357093288 >> [v2:172.21.15.136:6800/90902,v1:172.21.15.136:6801/90902] conn(0x7f04b806d3a0 0x7f04b806f7b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:50.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.122+0000 7f04c97fa700 1 -- 172.21.15.17:0/3357093288 <== osd.4 v2:172.21.15.136:6800/90902 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f04b806fe80 con 0x7f04b806d3a0 2023-10-06T04:44:50.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.136+0000 7f04d3398700 1 -- 172.21.15.17:0/3357093288 --> [v2:172.21.15.136:6800/90902,v1:172.21.15.136:6801/90902] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f04cc154c80 con 0x7f04b806d3a0 2023-10-06T04:44:50.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.137+0000 7f04c97fa700 1 -- 172.21.15.17:0/3357093288 <== osd.4 v2:172.21.15.136:6800/90902 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f04cc154c80 con 0x7f04b806d3a0 2023-10-06T04:44:50.139 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-06T04:44:50.139 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:44:50.139 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-06T04:44:50.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.137+0000 7f04d3398700 1 -- 172.21.15.17:0/3357093288 >> [v2:172.21.15.136:6800/90902,v1:172.21.15.136:6801/90902] conn(0x7f04b806d3a0 msgr2=0x7f04b806f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:50.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.137+0000 7f04d3398700 1 --2- 172.21.15.17:0/3357093288 >> [v2:172.21.15.136:6800/90902,v1:172.21.15.136:6801/90902] conn(0x7f04b806d3a0 0x7f04b806f7b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:50.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.137+0000 7f04d3398700 1 -- 172.21.15.17:0/3357093288 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f04b8066f30 msgr2=0x7f04b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:50.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.137+0000 7f04d3398700 1 --2- 172.21.15.17:0/3357093288 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f04b8066f30 0x7f04b80693e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f04c0006fd0 tx=0x7f04c0008040 comp rx=0 tx=0).stop 2023-10-06T04:44:50.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.137+0000 7f04d3398700 1 -- 172.21.15.17:0/3357093288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04cc0cb6b0 msgr2=0x7f04cc0c8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:50.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.137+0000 7f04d3398700 1 --2- 172.21.15.17:0/3357093288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04cc0cb6b0 0x7f04cc0c8930 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f04cc088ed0 tx=0x7f04c4017000 comp rx=0 tx=0).stop 2023-10-06T04:44:50.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.137+0000 7f04d1935700 1 -- 172.21.15.17:0/3357093288 reap_dead start 2023-10-06T04:44:50.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.137+0000 7f04d3398700 1 -- 172.21.15.17:0/3357093288 shutdown_connections 2023-10-06T04:44:50.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.137+0000 7f04d3398700 1 -- 172.21.15.17:0/3357093288 >> 172.21.15.17:0/3357093288 conn(0x7f04cc08a180 msgr2=0x7f04cc0ce570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:50.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.137+0000 7f04d3398700 1 -- 172.21.15.17:0/3357093288 shutdown_connections 2023-10-06T04:44:50.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.137+0000 7f04d3398700 1 -- 172.21.15.17:0/3357093288 wait complete. 2023-10-06T04:44:50.150 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-06T04:44:50.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.268+0000 7f064c8e3700 1 Processor -- start 2023-10-06T04:44:50.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.268+0000 7f064c8e3700 1 -- start start 2023-10-06T04:44:50.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.269+0000 7f064c8e3700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f064815d9e0 0x7f0648150290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:50.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.269+0000 7f064c8e3700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f064815aed0 con 0x7f064815d610 2023-10-06T04:44:50.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.269+0000 7f064c8e3700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0648150c30 con 0x7f06481507d0 2023-10-06T04:44:50.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.269+0000 7f064c8e3700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06480cb680 con 0x7f064815d9e0 2023-10-06T04:44:50.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.269+0000 7f064659c700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f064815d610 0x7f06480cac70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37920/0 (socket says 172.21.15.17:37920) 2023-10-06T04:44:50.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.269+0000 7f064659c700 1 -- 172.21.15.17:0/3224817653 learned_addr learned my addr 172.21.15.17:0/3224817653 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:50.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.269+0000 7f0645d9b700 1 --2- 172.21.15.17:0/3224817653 >> v2:172.21.15.136:3300/0 conn(0x7f064815d9e0 0x7f0648150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:50.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.269+0000 7f064559a700 1 -- 172.21.15.17:0/3224817653 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 176661378 0 0) 0x7f064815aed0 con 0x7f064815d610 2023-10-06T04:44:50.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.269+0000 7f064559a700 1 -- 172.21.15.17:0/3224817653 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0634003570 con 0x7f064815d610 2023-10-06T04:44:50.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.269+0000 7f064559a700 1 -- 172.21.15.17:0/3224817653 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 692564696 0 0) 0x7f0634003570 con 0x7f064815d610 2023-10-06T04:44:50.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.269+0000 7f064559a700 1 -- 172.21.15.17:0/3224817653 >> v2:172.21.15.136:3300/0 conn(0x7f064815d9e0 msgr2=0x7f0648150290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:50.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.269+0000 7f064559a700 1 --2- 172.21.15.17:0/3224817653 >> v2:172.21.15.136:3300/0 conn(0x7f064815d9e0 0x7f0648150290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:50.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.269+0000 7f064559a700 1 -- 172.21.15.17:0/3224817653 >> v1:172.21.15.136:6789/0 conn(0x7f06481507d0 legacy=0x7f064815b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:50.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.269+0000 7f064559a700 1 -- 172.21.15.17:0/3224817653 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06480cb960 con 0x7f064815d610 2023-10-06T04:44:50.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.269+0000 7f0645d9b700 1 --2- 172.21.15.17:0/3224817653 >> v2:172.21.15.136:3300/0 conn(0x7f064815d9e0 0x7f0648150290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:44:50.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.269+0000 7f064559a700 1 -- 172.21.15.17:0/3224817653 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4268781140 0 0) 0x7f06380015f0 con 0x7f064815d610 2023-10-06T04:44:50.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.269+0000 7f064559a700 1 -- 172.21.15.17:0/3224817653 >> v1:172.21.15.17:6789/0 conn(0x7f064815d610 legacy=0x7f06480cac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:50.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.269+0000 7f064559a700 1 --2- 172.21.15.17:0/3224817653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0634003a60 0x7f0634003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:50.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.269+0000 7f064559a700 1 --2- 172.21.15.17:0/3224817653 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0634004810 0x7f0634004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:50.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.269+0000 7f064559a700 1 --2- 172.21.15.17:0/3224817653 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f06340051c0 0x7f063400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:50.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.270+0000 7f064559a700 1 -- 172.21.15.17:0/3224817653 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06480cb680 con 0x7f0634003a60 2023-10-06T04:44:50.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.270+0000 7f064559a700 1 -- 172.21.15.17:0/3224817653 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063400c050 con 0x7f06340051c0 2023-10-06T04:44:50.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.270+0000 7f064559a700 1 -- 172.21.15.17:0/3224817653 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063400c210 con 0x7f0634004810 2023-10-06T04:44:50.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.270+0000 7f064659c700 1 --2- 172.21.15.17:0/3224817653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0634003a60 0x7f0634003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:50.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.270+0000 7f0645d9b700 1 --2- 172.21.15.17:0/3224817653 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0634004810 0x7f0634004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:50.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.270+0000 7f0646d9d700 1 --2- 172.21.15.17:0/3224817653 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f06340051c0 0x7f063400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:50.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.270+0000 7f064659c700 1 -- 172.21.15.17:0/3224817653 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0634004810 msgr2=0x7f0634004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:50.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.270+0000 7f064659c700 1 --2- 172.21.15.17:0/3224817653 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0634004810 0x7f0634004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:50.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.270+0000 7f064659c700 1 -- 172.21.15.17:0/3224817653 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f06340051c0 msgr2=0x7f063400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:50.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.270+0000 7f064659c700 1 --2- 172.21.15.17:0/3224817653 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f06340051c0 0x7f063400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:50.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.270+0000 7f064659c700 1 -- 172.21.15.17:0/3224817653 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0634003570 con 0x7f0634003a60 2023-10-06T04:44:50.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.270+0000 7f0646d9d700 1 --2- 172.21.15.17:0/3224817653 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f06340051c0 0x7f063400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:50.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.270+0000 7f0646d9d700 1 -- 172.21.15.17:0/3224817653 reap_dead start 2023-10-06T04:44:50.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.270+0000 7f064659c700 1 --2- 172.21.15.17:0/3224817653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0634003a60 0x7f0634003e30 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f063800c300 tx=0x7f0638007920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee7a0b1f62feace server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:50.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.270+0000 7f064559a700 1 -- 172.21.15.17:0/3224817653 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063800cc30 con 0x7f0634003a60 2023-10-06T04:44:50.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.270+0000 7f064559a700 1 -- 172.21.15.17:0/3224817653 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063800cd90 con 0x7f0634003a60 2023-10-06T04:44:50.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.270+0000 7f064559a700 1 -- 172.21.15.17:0/3224817653 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0638007320 con 0x7f0634003a60 2023-10-06T04:44:50.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.271+0000 7f064c8e3700 1 -- 172.21.15.17:0/3224817653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0634003a60 msgr2=0x7f0634003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:50.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.271+0000 7f064c8e3700 1 --2- 172.21.15.17:0/3224817653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0634003a60 0x7f0634003e30 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f063800c300 tx=0x7f0638007920 comp rx=0 tx=0).stop 2023-10-06T04:44:50.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.271+0000 7f064c8e3700 1 -- 172.21.15.17:0/3224817653 shutdown_connections 2023-10-06T04:44:50.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.271+0000 7f064c8e3700 1 --2- 172.21.15.17:0/3224817653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0634003a60 0x7f0634003e30 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:50.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.271+0000 7f064c8e3700 1 -- 172.21.15.17:0/3224817653 >> 172.21.15.17:0/3224817653 conn(0x7f0648099960 msgr2=0x7f064806cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:50.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.271+0000 7f064c8e3700 1 -- 172.21.15.17:0/3224817653 shutdown_connections 2023-10-06T04:44:50.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.271+0000 7f064c8e3700 1 -- 172.21.15.17:0/3224817653 wait complete. 2023-10-06T04:44:50.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.272+0000 7f064c8e3700 1 Processor -- start 2023-10-06T04:44:50.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.272+0000 7f064c8e3700 1 -- start start 2023-10-06T04:44:50.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.273+0000 7f064c8e3700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0634003a60 0x7f06480c50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:50.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.273+0000 7f064c8e3700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f06480c5620 0x7f06480b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:50.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.273+0000 7f064c8e3700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f064814fe20 0x7f06480b39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:50.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.273+0000 7f064c8e3700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06480c67b0 con 0x7f0634003a60 2023-10-06T04:44:50.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.273+0000 7f064c8e3700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06480c5ba0 con 0x7f064814fe20 2023-10-06T04:44:50.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.273+0000 7f064c8e3700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06480c5e80 con 0x7f06480c5620 2023-10-06T04:44:50.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.273+0000 7f064659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0634003a60 0x7f06480c50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:50.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.273+0000 7f064659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0634003a60 0x7f06480c50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46376/0 (socket says 172.21.15.17:46376) 2023-10-06T04:44:50.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.273+0000 7f064659c700 1 -- 172.21.15.17:0/2966138834 learned_addr learned my addr 172.21.15.17:0/2966138834 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:50.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.273+0000 7f0645d9b700 1 --2- 172.21.15.17:0/2966138834 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f06480c5620 0x7f06480b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:50.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.273+0000 7f0646d9d700 1 --2- 172.21.15.17:0/2966138834 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f064814fe20 0x7f06480b39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:50.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.273+0000 7f064659c700 1 -- 172.21.15.17:0/2966138834 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f06480c5620 msgr2=0x7f06480b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:50.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.273+0000 7f064659c700 1 --2- 172.21.15.17:0/2966138834 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f06480c5620 0x7f06480b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:50.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.273+0000 7f064659c700 1 -- 172.21.15.17:0/2966138834 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f064814fe20 msgr2=0x7f06480b39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:50.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.273+0000 7f064659c700 1 --2- 172.21.15.17:0/2966138834 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f064814fe20 0x7f06480b39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:50.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.273+0000 7f064659c700 1 -- 172.21.15.17:0/2966138834 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06480c6160 con 0x7f0634003a60 2023-10-06T04:44:50.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.273+0000 7f0646d9d700 1 --2- 172.21.15.17:0/2966138834 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f064814fe20 0x7f06480b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:50.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.273+0000 7f064659c700 1 --2- 172.21.15.17:0/2966138834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0634003a60 0x7f06480c50e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f0638007490 tx=0x7f0638015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:50.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.273+0000 7f063e7fc700 1 -- 172.21.15.17:0/2966138834 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063800cc30 con 0x7f0634003a60 2023-10-06T04:44:50.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.273+0000 7f063e7fc700 1 -- 172.21.15.17:0/2966138834 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0638000f70 con 0x7f0634003a60 2023-10-06T04:44:50.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.273+0000 7f064c8e3700 1 -- 172.21.15.17:0/2966138834 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06480c6440 con 0x7f0634003a60 2023-10-06T04:44:50.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.273+0000 7f063e7fc700 1 -- 172.21.15.17:0/2966138834 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0638005c50 con 0x7f0634003a60 2023-10-06T04:44:50.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.273+0000 7f064c8e3700 1 -- 172.21.15.17:0/2966138834 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06480c8060 con 0x7f0634003a60 2023-10-06T04:44:50.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.274+0000 7f064c8e3700 1 -- 172.21.15.17:0/2966138834 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f064806cd40 con 0x7f0634003a60 2023-10-06T04:44:50.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.275+0000 7f063e7fc700 1 -- 172.21.15.17:0/2966138834 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0638019070 con 0x7f0634003a60 2023-10-06T04:44:50.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.275+0000 7f063e7fc700 1 --2- 172.21.15.17:0/2966138834 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0628066f30 0x7f06280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:50.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.275+0000 7f0645d9b700 1 --2- 172.21.15.17:0/2966138834 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0628066f30 0x7f06280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:50.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.275+0000 7f063e7fc700 1 -- 172.21.15.17:0/2966138834 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f06380851f0 con 0x7f0634003a60 2023-10-06T04:44:50.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.276+0000 7f0645d9b700 1 --2- 172.21.15.17:0/2966138834 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0628066f30 0x7f06280693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f06480cb520 tx=0x7f06300091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:50.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.280+0000 7f063e7fc700 1 -- 172.21.15.17:0/2966138834 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0638052600 con 0x7f0634003a60 2023-10-06T04:44:50.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.471+0000 7f064c8e3700 1 -- 172.21.15.17:0/2966138834 --> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f06480c5ff0 con 0x7f0628066f30 2023-10-06T04:44:50.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.472+0000 7f063e7fc700 1 -- 172.21.15.17:0/2966138834 <== mgr.4104 v2:172.21.15.17:6832/90424 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f06480c5ff0 con 0x7f0628066f30 2023-10-06T04:44:50.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.473+0000 7f064c8e3700 1 -- 172.21.15.17:0/2966138834 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0628066f30 msgr2=0x7f06280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:50.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.473+0000 7f064c8e3700 1 --2- 172.21.15.17:0/2966138834 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0628066f30 0x7f06280693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f06480cb520 tx=0x7f06300091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:50.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.473+0000 7f064c8e3700 1 -- 172.21.15.17:0/2966138834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0634003a60 msgr2=0x7f06480c50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:50.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.473+0000 7f064c8e3700 1 --2- 172.21.15.17:0/2966138834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0634003a60 0x7f06480c50e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f0638007490 tx=0x7f0638015000 comp rx=0 tx=0).stop 2023-10-06T04:44:50.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.473+0000 7f064c8e3700 1 -- 172.21.15.17:0/2966138834 shutdown_connections 2023-10-06T04:44:50.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.473+0000 7f064c8e3700 1 --2- 172.21.15.17:0/2966138834 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0628066f30 0x7f06280693e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:50.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.473+0000 7f064c8e3700 1 --2- 172.21.15.17:0/2966138834 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f064814fe20 0x7f06480b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:50.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.473+0000 7f064c8e3700 1 --2- 172.21.15.17:0/2966138834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0634003a60 0x7f06480c50e0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:50.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.473+0000 7f064c8e3700 1 --2- 172.21.15.17:0/2966138834 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f06480c5620 0x7f06480b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:50.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.473+0000 7f064c8e3700 1 -- 172.21.15.17:0/2966138834 >> 172.21.15.17:0/2966138834 conn(0x7f0648099960 msgr2=0x7f06480b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:50.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.474+0000 7f064c8e3700 1 -- 172.21.15.17:0/2966138834 shutdown_connections 2023-10-06T04:44:50.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.474+0000 7f064c8e3700 1 -- 172.21.15.17:0/2966138834 wait complete. 2023-10-06T04:44:50.477 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 4 to deep-scrub 2023-10-06T04:44:50.488 INFO:tasks.ceph:Scrubbing osd.5 2023-10-06T04:44:50.488 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:44:50.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.609+0000 7f0ab867e700 1 Processor -- start 2023-10-06T04:44:50.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.609+0000 7f0ab867e700 1 -- start start 2023-10-06T04:44:50.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.609+0000 7f0ab867e700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0ab0150360 0x7f0ab0150730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:50.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.610+0000 7f0ab867e700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0ab00cbb30 0x7f0ab0159e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:50.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.610+0000 7f0ab867e700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ab00cc050 con 0x7f0ab00cb6b0 2023-10-06T04:44:50.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.610+0000 7f0ab867e700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ab00cc330 con 0x7f0ab0150360 2023-10-06T04:44:50.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.610+0000 7f0ab867e700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ab015b130 con 0x7f0ab00cbb30 2023-10-06T04:44:50.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.610+0000 7f0ab641a700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0ab0150360 0x7f0ab0150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:50.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.610+0000 7f0ab641a700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0ab0150360 0x7f0ab0150730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46392/0 (socket says 172.21.15.17:46392) 2023-10-06T04:44:50.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.610+0000 7f0ab641a700 1 -- 172.21.15.17:0/4233539839 learned_addr learned my addr 172.21.15.17:0/4233539839 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:50.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.610+0000 7f0ab641a700 1 -- 172.21.15.17:0/4233539839 >> v2:172.21.15.136:3300/0 conn(0x7f0ab00cbb30 msgr2=0x7f0ab0159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:50.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.610+0000 7f0ab6c1b700 1 --2- 172.21.15.17:0/4233539839 >> v2:172.21.15.136:3300/0 conn(0x7f0ab00cbb30 0x7f0ab0159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:50.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.610+0000 7f0ab641a700 1 --2- 172.21.15.17:0/4233539839 >> v2:172.21.15.136:3300/0 conn(0x7f0ab00cbb30 0x7f0ab0159e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:50.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.610+0000 7f0ab641a700 1 -- 172.21.15.17:0/4233539839 >> v1:172.21.15.136:6789/0 conn(0x7f0ab00cb6b0 legacy=0x7f0ab00cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:50.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.610+0000 7f0ab641a700 1 -- 172.21.15.17:0/4233539839 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab015b410 con 0x7f0ab0150360 2023-10-06T04:44:50.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.610+0000 7f0ab641a700 1 --2- 172.21.15.17:0/4233539839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ab0150360 0x7f0ab0150730 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f0aa80099b0 tx=0x7f0aa8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3509f531ed5a3028 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:50.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.610+0000 7f0ab5418700 1 -- 172.21.15.17:0/4233539839 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa800b7e0 con 0x7f0ab0150360 2023-10-06T04:44:50.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.610+0000 7f0ab5418700 1 -- 172.21.15.17:0/4233539839 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa800b940 con 0x7f0ab0150360 2023-10-06T04:44:50.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.610+0000 7f0ab5418700 1 -- 172.21.15.17:0/4233539839 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa800bce0 con 0x7f0ab0150360 2023-10-06T04:44:50.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.611+0000 7f0ab867e700 1 -- 172.21.15.17:0/4233539839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ab0150360 msgr2=0x7f0ab0150730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:50.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.611+0000 7f0ab867e700 1 --2- 172.21.15.17:0/4233539839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ab0150360 0x7f0ab0150730 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f0aa80099b0 tx=0x7f0aa8009250 comp rx=0 tx=0).stop 2023-10-06T04:44:50.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.611+0000 7f0ab867e700 1 -- 172.21.15.17:0/4233539839 shutdown_connections 2023-10-06T04:44:50.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.611+0000 7f0ab867e700 1 --2- 172.21.15.17:0/4233539839 >> v2:172.21.15.136:3300/0 conn(0x7f0ab00cbb30 0x7f0ab0159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:50.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.611+0000 7f0ab867e700 1 --2- 172.21.15.17:0/4233539839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ab0150360 0x7f0ab0150730 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:50.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.611+0000 7f0ab867e700 1 -- 172.21.15.17:0/4233539839 >> 172.21.15.17:0/4233539839 conn(0x7f0ab008a180 msgr2=0x7f0ab0099aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:50.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.611+0000 7f0ab867e700 1 -- 172.21.15.17:0/4233539839 shutdown_connections 2023-10-06T04:44:50.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.611+0000 7f0ab867e700 1 -- 172.21.15.17:0/4233539839 wait complete. 2023-10-06T04:44:50.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.612+0000 7f0ab867e700 1 Processor -- start 2023-10-06T04:44:50.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.612+0000 7f0ab867e700 1 -- start start 2023-10-06T04:44:50.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.613+0000 7f0ab867e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ab00cb6b0 0x7f0ab006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:50.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.613+0000 7f0ab867e700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0ab00cbb30 0x7f0ab016d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:50.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.613+0000 7f0ab867e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ab0150360 0x7f0ab014e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:50.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.613+0000 7f0ab867e700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab01560d0 con 0x7f0ab00cb6b0 2023-10-06T04:44:50.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.613+0000 7f0ab867e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab016e2e0 con 0x7f0ab0150360 2023-10-06T04:44:50.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.613+0000 7f0ab867e700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab016e5c0 con 0x7f0ab00cbb30 2023-10-06T04:44:50.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.613+0000 7f0ab641a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ab00cb6b0 0x7f0ab006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:50.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.613+0000 7f0ab641a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ab00cb6b0 0x7f0ab006f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46394/0 (socket says 172.21.15.17:46394) 2023-10-06T04:44:50.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.613+0000 7f0ab641a700 1 -- 172.21.15.17:0/1683341226 learned_addr learned my addr 172.21.15.17:0/1683341226 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:50.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.613+0000 7f0ab6c1b700 1 --2- 172.21.15.17:0/1683341226 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ab0150360 0x7f0ab014e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:50.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.613+0000 7f0ab5c19700 1 --2- 172.21.15.17:0/1683341226 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0ab00cbb30 0x7f0ab016d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:50.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.613+0000 7f0ab641a700 1 -- 172.21.15.17:0/1683341226 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0ab00cbb30 msgr2=0x7f0ab016d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:50.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.613+0000 7f0ab641a700 1 --2- 172.21.15.17:0/1683341226 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0ab00cbb30 0x7f0ab016d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:50.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.613+0000 7f0ab641a700 1 -- 172.21.15.17:0/1683341226 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ab0150360 msgr2=0x7f0ab014e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:50.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.613+0000 7f0ab641a700 1 --2- 172.21.15.17:0/1683341226 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ab0150360 0x7f0ab014e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:50.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.613+0000 7f0ab641a700 1 -- 172.21.15.17:0/1683341226 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa80094f0 con 0x7f0ab00cb6b0 2023-10-06T04:44:50.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.613+0000 7f0ab641a700 1 --2- 172.21.15.17:0/1683341226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ab00cb6b0 0x7f0ab006f040 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8009290 tx=0x7f0aa8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:50.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.614+0000 7f0aae7fc700 1 -- 172.21.15.17:0/1683341226 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8011d70 con 0x7f0ab00cb6b0 2023-10-06T04:44:50.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.614+0000 7f0aae7fc700 1 -- 172.21.15.17:0/1683341226 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa8020070 con 0x7f0ab00cb6b0 2023-10-06T04:44:50.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.614+0000 7f0aae7fc700 1 -- 172.21.15.17:0/1683341226 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa801b6a0 con 0x7f0ab00cb6b0 2023-10-06T04:44:50.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.614+0000 7f0ab867e700 1 -- 172.21.15.17:0/1683341226 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ab0155d60 con 0x7f0ab00cb6b0 2023-10-06T04:44:50.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.614+0000 7f0ab867e700 1 -- 172.21.15.17:0/1683341226 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ab0153f60 con 0x7f0ab00cb6b0 2023-10-06T04:44:50.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.614+0000 7f0ab867e700 1 -- 172.21.15.17:0/1683341226 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0ab00718b0 con 0x7f0ab00cb6b0 2023-10-06T04:44:50.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.615+0000 7f0aae7fc700 1 -- 172.21.15.17:0/1683341226 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0aa8022030 con 0x7f0ab00cb6b0 2023-10-06T04:44:50.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.615+0000 7f0aae7fc700 1 --2- 172.21.15.17:0/1683341226 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0a9c066f30 0x7f0a9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:50.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.615+0000 7f0aae7fc700 1 -- 172.21.15.17:0/1683341226 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f0aa8086270 con 0x7f0ab00cb6b0 2023-10-06T04:44:50.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.615+0000 7f0ab5c19700 1 --2- 172.21.15.17:0/1683341226 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0a9c066f30 0x7f0a9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:50.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.615+0000 7f0aae7fc700 1 --2- 172.21.15.17:0/1683341226 >> [v2:172.21.15.136:6808/90901,v1:172.21.15.136:6809/90901] conn(0x7f0a9c06d3a0 0x7f0a9c06f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:50.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.615+0000 7f0aae7fc700 1 -- 172.21.15.17:0/1683341226 --> [v2:172.21.15.136:6808/90901,v1:172.21.15.136:6809/90901] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0a9c06fe80 con 0x7f0a9c06d3a0 2023-10-06T04:44:50.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.615+0000 7f0aae7fc700 1 -- 172.21.15.17:0/1683341226 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0aa80888b0 con 0x7f0ab00cb6b0 2023-10-06T04:44:50.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.616+0000 7f0ab6c1b700 1 --2- 172.21.15.17:0/1683341226 >> [v2:172.21.15.136:6808/90901,v1:172.21.15.136:6809/90901] conn(0x7f0a9c06d3a0 0x7f0a9c06f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:50.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.616+0000 7f0ab5c19700 1 --2- 172.21.15.17:0/1683341226 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0a9c066f30 0x7f0a9c0693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4006fd0 tx=0x7f0aa4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:50.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.616+0000 7f0ab6c1b700 1 --2- 172.21.15.17:0/1683341226 >> [v2:172.21.15.136:6808/90901,v1:172.21.15.136:6809/90901] conn(0x7f0a9c06d3a0 0x7f0a9c06f7b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:50.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.617+0000 7f0aae7fc700 1 -- 172.21.15.17:0/1683341226 <== osd.5 v2:172.21.15.136:6808/90901 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f0a9c06fe80 con 0x7f0a9c06d3a0 2023-10-06T04:44:50.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.631+0000 7f0ab867e700 1 -- 172.21.15.17:0/1683341226 --> [v2:172.21.15.136:6808/90901,v1:172.21.15.136:6809/90901] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0ab006ce80 con 0x7f0a9c06d3a0 2023-10-06T04:44:50.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.631+0000 7f0aae7fc700 1 -- 172.21.15.17:0/1683341226 <== osd.5 v2:172.21.15.136:6808/90901 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f0ab006ce80 con 0x7f0a9c06d3a0 2023-10-06T04:44:50.633 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-06T04:44:50.633 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:44:50.633 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-06T04:44:50.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.631+0000 7f0ab867e700 1 -- 172.21.15.17:0/1683341226 >> [v2:172.21.15.136:6808/90901,v1:172.21.15.136:6809/90901] conn(0x7f0a9c06d3a0 msgr2=0x7f0a9c06f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:50.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.631+0000 7f0ab867e700 1 --2- 172.21.15.17:0/1683341226 >> [v2:172.21.15.136:6808/90901,v1:172.21.15.136:6809/90901] conn(0x7f0a9c06d3a0 0x7f0a9c06f7b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:50.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.632+0000 7f0ab867e700 1 -- 172.21.15.17:0/1683341226 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0a9c066f30 msgr2=0x7f0a9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:50.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.632+0000 7f0ab867e700 1 --2- 172.21.15.17:0/1683341226 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0a9c066f30 0x7f0a9c0693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4006fd0 tx=0x7f0aa4008040 comp rx=0 tx=0).stop 2023-10-06T04:44:50.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.632+0000 7f0ab867e700 1 -- 172.21.15.17:0/1683341226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ab00cb6b0 msgr2=0x7f0ab006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:50.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.632+0000 7f0ab867e700 1 --2- 172.21.15.17:0/1683341226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ab00cb6b0 0x7f0ab006f040 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8009290 tx=0x7f0aa8016000 comp rx=0 tx=0).stop 2023-10-06T04:44:50.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.632+0000 7f0ab6c1b700 1 -- 172.21.15.17:0/1683341226 reap_dead start 2023-10-06T04:44:50.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.632+0000 7f0ab867e700 1 -- 172.21.15.17:0/1683341226 shutdown_connections 2023-10-06T04:44:50.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.632+0000 7f0ab867e700 1 -- 172.21.15.17:0/1683341226 >> 172.21.15.17:0/1683341226 conn(0x7f0ab008a180 msgr2=0x7f0ab00b5960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:50.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.632+0000 7f0ab867e700 1 -- 172.21.15.17:0/1683341226 shutdown_connections 2023-10-06T04:44:50.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.632+0000 7f0ab867e700 1 -- 172.21.15.17:0/1683341226 wait complete. 2023-10-06T04:44:50.645 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-06T04:44:50.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.762+0000 7f72be77d700 1 Processor -- start 2023-10-06T04:44:50.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.762+0000 7f72be77d700 1 -- start start 2023-10-06T04:44:50.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.763+0000 7f72be77d700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f72b81576b0 0x7f72b80c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:50.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.763+0000 7f72be77d700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f72b80c7030 0x7f72b806e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:50.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.763+0000 7f72be77d700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b806eba0 con 0x7f72b806e210 2023-10-06T04:44:50.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.763+0000 7f72be77d700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b8157a80 con 0x7f72b81576b0 2023-10-06T04:44:50.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.763+0000 7f72be77d700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b80c7650 con 0x7f72b80c7030 2023-10-06T04:44:50.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.763+0000 7f72b77fe700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f72b806e210 0x7f72b80c6920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42730/0 (socket says 172.21.15.17:42730) 2023-10-06T04:44:50.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.763+0000 7f72b77fe700 1 -- 172.21.15.17:0/3417522208 learned_addr learned my addr 172.21.15.17:0/3417522208 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:50.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.764+0000 7f72bcd1a700 1 --2- 172.21.15.17:0/3417522208 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f72b80c7030 0x7f72b806e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:50.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.764+0000 7f72b7fff700 1 --2- 172.21.15.17:0/3417522208 >> v2:172.21.15.136:3300/0 conn(0x7f72b81576b0 0x7f72b80c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:50.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.764+0000 7f72b6ffd700 1 -- 172.21.15.17:0/3417522208 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4091285970 0 0) 0x7f72b806eba0 con 0x7f72b806e210 2023-10-06T04:44:50.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.764+0000 7f72b6ffd700 1 -- 172.21.15.17:0/3417522208 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72a4003570 con 0x7f72b806e210 2023-10-06T04:44:50.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.764+0000 7f72b6ffd700 1 -- 172.21.15.17:0/3417522208 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3178314112 0 0) 0x7f72a4003570 con 0x7f72b806e210 2023-10-06T04:44:50.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.764+0000 7f72b6ffd700 1 -- 172.21.15.17:0/3417522208 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f72b80c7030 msgr2=0x7f72b806e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:50.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.764+0000 7f72b6ffd700 1 --2- 172.21.15.17:0/3417522208 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f72b80c7030 0x7f72b806e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:50.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.764+0000 7f72b6ffd700 1 -- 172.21.15.17:0/3417522208 >> v2:172.21.15.136:3300/0 conn(0x7f72b81576b0 msgr2=0x7f72b80c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:50.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.764+0000 7f72b6ffd700 1 --2- 172.21.15.17:0/3417522208 >> v2:172.21.15.136:3300/0 conn(0x7f72b81576b0 0x7f72b80c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:50.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.764+0000 7f72b6ffd700 1 -- 172.21.15.17:0/3417522208 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b80c7930 con 0x7f72b806e210 2023-10-06T04:44:50.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.764+0000 7f72b6ffd700 1 -- 172.21.15.17:0/3417522208 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4268781140 0 0) 0x7f72a0001470 con 0x7f72b806e210 2023-10-06T04:44:50.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.764+0000 7f72b6ffd700 1 -- 172.21.15.17:0/3417522208 >> v1:172.21.15.17:6789/0 conn(0x7f72b806e210 legacy=0x7f72b80c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:50.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.764+0000 7f72b6ffd700 1 --2- 172.21.15.17:0/3417522208 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f72a4003a60 0x7f72a4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:50.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.764+0000 7f72b6ffd700 1 --2- 172.21.15.17:0/3417522208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72a4004810 0x7f72a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:50.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.764+0000 7f72b6ffd700 1 --2- 172.21.15.17:0/3417522208 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f72a40051c0 0x7f72a400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:50.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.764+0000 7f72b6ffd700 1 -- 172.21.15.17:0/3417522208 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b8157a80 con 0x7f72a4004810 2023-10-06T04:44:50.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.764+0000 7f72b6ffd700 1 -- 172.21.15.17:0/3417522208 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b80c7650 con 0x7f72a4003a60 2023-10-06T04:44:50.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.764+0000 7f72b6ffd700 1 -- 172.21.15.17:0/3417522208 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a400bfa0 con 0x7f72a40051c0 2023-10-06T04:44:50.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.764+0000 7f72b7fff700 1 --2- 172.21.15.17:0/3417522208 >> v2:172.21.15.136:3300/0 conn(0x7f72b81576b0 0x7f72b80c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:44:50.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.764+0000 7f72bcd1a700 1 --2- 172.21.15.17:0/3417522208 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f72b80c7030 0x7f72b806e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:44:50.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.764+0000 7f72b77fe700 1 --2- 172.21.15.17:0/3417522208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72a4004810 0x7f72a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:50.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.764+0000 7f72b7fff700 1 --2- 172.21.15.17:0/3417522208 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f72a4003a60 0x7f72a4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:50.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.764+0000 7f72bcd1a700 1 --2- 172.21.15.17:0/3417522208 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f72a40051c0 0x7f72a400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:50.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.765+0000 7f72b77fe700 1 -- 172.21.15.17:0/3417522208 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f72a40051c0 msgr2=0x7f72a400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:50.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.765+0000 7f72b77fe700 1 --2- 172.21.15.17:0/3417522208 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f72a40051c0 0x7f72a400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:50.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.765+0000 7f72b77fe700 1 -- 172.21.15.17:0/3417522208 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f72a4003a60 msgr2=0x7f72a4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:50.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.765+0000 7f72b77fe700 1 --2- 172.21.15.17:0/3417522208 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f72a4003a60 0x7f72a4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:50.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.765+0000 7f72b77fe700 1 -- 172.21.15.17:0/3417522208 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a4003570 con 0x7f72a4004810 2023-10-06T04:44:50.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.765+0000 7f72b77fe700 1 --2- 172.21.15.17:0/3417522208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72a4004810 0x7f72a4004c80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f72a000c3c0 tx=0x7f72a0001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dc7fe5152f59509 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:50.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.765+0000 7f72b6ffd700 1 -- 172.21.15.17:0/3417522208 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a000cc90 con 0x7f72a4004810 2023-10-06T04:44:50.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.765+0000 7f72b6ffd700 1 -- 172.21.15.17:0/3417522208 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a000ce30 con 0x7f72a4004810 2023-10-06T04:44:50.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.765+0000 7f72b6ffd700 1 -- 172.21.15.17:0/3417522208 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a0005b70 con 0x7f72a4004810 2023-10-06T04:44:50.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.765+0000 7f72be77d700 1 -- 172.21.15.17:0/3417522208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72a4004810 msgr2=0x7f72a4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:50.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.765+0000 7f72be77d700 1 --2- 172.21.15.17:0/3417522208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72a4004810 0x7f72a4004c80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f72a000c3c0 tx=0x7f72a0001e90 comp rx=0 tx=0).stop 2023-10-06T04:44:50.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.765+0000 7f72bcd1a700 1 -- 172.21.15.17:0/3417522208 reap_dead start 2023-10-06T04:44:50.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.765+0000 7f72be77d700 1 -- 172.21.15.17:0/3417522208 shutdown_connections 2023-10-06T04:44:50.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.765+0000 7f72be77d700 1 -- 172.21.15.17:0/3417522208 >> 172.21.15.17:0/3417522208 conn(0x7f72b806d030 msgr2=0x7f72b80cc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:50.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.765+0000 7f72be77d700 1 -- 172.21.15.17:0/3417522208 shutdown_connections 2023-10-06T04:44:50.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.765+0000 7f72be77d700 1 -- 172.21.15.17:0/3417522208 wait complete. 2023-10-06T04:44:50.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.767+0000 7f72be77d700 1 Processor -- start 2023-10-06T04:44:50.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.767+0000 7f72be77d700 1 -- start start 2023-10-06T04:44:50.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.767+0000 7f72be77d700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f72a4004810 0x7f72b814f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:50.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.767+0000 7f72be77d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f72b814fa20 0x7f72b80ae250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:50.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.767+0000 7f72be77d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72b80af120 0x7f72b80af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:50.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.767+0000 7f72be77d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b80addc0 con 0x7f72b80af120 2023-10-06T04:44:50.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.767+0000 7f72be77d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b80ca8a0 con 0x7f72b814fa20 2023-10-06T04:44:50.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.767+0000 7f72be77d700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b80cab80 con 0x7f72a4004810 2023-10-06T04:44:50.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.768+0000 7f72bcd1a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72b80af120 0x7f72b80af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:50.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.768+0000 7f72bcd1a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72b80af120 0x7f72b80af5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38734/0 (socket says 172.21.15.17:38734) 2023-10-06T04:44:50.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.768+0000 7f72bcd1a700 1 -- 172.21.15.17:0/3807193920 learned_addr learned my addr 172.21.15.17:0/3807193920 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:50.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.768+0000 7f72b7fff700 1 --2- 172.21.15.17:0/3807193920 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f72a4004810 0x7f72b814f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:50.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.768+0000 7f72b77fe700 1 --2- 172.21.15.17:0/3807193920 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f72b814fa20 0x7f72b80ae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:50.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.768+0000 7f72bcd1a700 1 -- 172.21.15.17:0/3807193920 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f72a4004810 msgr2=0x7f72b814f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:50.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.768+0000 7f72bcd1a700 1 --2- 172.21.15.17:0/3807193920 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f72a4004810 0x7f72b814f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:50.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.768+0000 7f72bcd1a700 1 -- 172.21.15.17:0/3807193920 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f72b814fa20 msgr2=0x7f72b80ae250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:50.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.768+0000 7f72bcd1a700 1 --2- 172.21.15.17:0/3807193920 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f72b814fa20 0x7f72b80ae250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:50.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.768+0000 7f72bcd1a700 1 -- 172.21.15.17:0/3807193920 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b80cae60 con 0x7f72b80af120 2023-10-06T04:44:50.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.768+0000 7f72b77fe700 1 --2- 172.21.15.17:0/3807193920 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f72b814fa20 0x7f72b80ae250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:44:50.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.768+0000 7f72bcd1a700 1 --2- 172.21.15.17:0/3807193920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72b80af120 0x7f72b80af5a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f72b815b0b0 tx=0x7f72b000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:50.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.768+0000 7f72affff700 1 -- 172.21.15.17:0/3807193920 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b000e070 con 0x7f72b80af120 2023-10-06T04:44:50.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.768+0000 7f72affff700 1 -- 172.21.15.17:0/3807193920 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b0011d50 con 0x7f72b80af120 2023-10-06T04:44:50.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.768+0000 7f72be77d700 1 -- 172.21.15.17:0/3807193920 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b80ada50 con 0x7f72b80af120 2023-10-06T04:44:50.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.768+0000 7f72affff700 1 -- 172.21.15.17:0/3807193920 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b00166c0 con 0x7f72b80af120 2023-10-06T04:44:50.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.768+0000 7f72be77d700 1 -- 172.21.15.17:0/3807193920 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b80ae790 con 0x7f72b80af120 2023-10-06T04:44:50.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.769+0000 7f72be77d700 1 -- 172.21.15.17:0/3807193920 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b814fdf0 con 0x7f72b80af120 2023-10-06T04:44:50.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.770+0000 7f72affff700 1 -- 172.21.15.17:0/3807193920 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f72b0016ab0 con 0x7f72b80af120 2023-10-06T04:44:50.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.770+0000 7f72affff700 1 --2- 172.21.15.17:0/3807193920 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7298066f30 0x7f72980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:50.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.770+0000 7f72affff700 1 -- 172.21.15.17:0/3807193920 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f72b0084f10 con 0x7f72b80af120 2023-10-06T04:44:50.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.770+0000 7f72b7fff700 1 --2- 172.21.15.17:0/3807193920 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7298066f30 0x7f72980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:50.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.770+0000 7f72b7fff700 1 --2- 172.21.15.17:0/3807193920 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7298066f30 0x7f72980693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f72a8006f00 tx=0x7f72a8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:50.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.774+0000 7f72affff700 1 -- 172.21.15.17:0/3807193920 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f72b0052320 con 0x7f72b80af120 2023-10-06T04:44:50.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.969+0000 7f72be77d700 1 -- 172.21.15.17:0/3807193920 --> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f72b8063ff0 con 0x7f7298066f30 2023-10-06T04:44:50.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.969+0000 7f72affff700 1 -- 172.21.15.17:0/3807193920 <== mgr.4104 v2:172.21.15.17:6832/90424 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f72b8063ff0 con 0x7f7298066f30 2023-10-06T04:44:50.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.971+0000 7f72be77d700 1 -- 172.21.15.17:0/3807193920 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7298066f30 msgr2=0x7f72980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:50.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.971+0000 7f72be77d700 1 --2- 172.21.15.17:0/3807193920 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7298066f30 0x7f72980693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f72a8006f00 tx=0x7f72a8008040 comp rx=0 tx=0).stop 2023-10-06T04:44:50.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.971+0000 7f72be77d700 1 -- 172.21.15.17:0/3807193920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72b80af120 msgr2=0x7f72b80af5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:50.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.971+0000 7f72be77d700 1 --2- 172.21.15.17:0/3807193920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72b80af120 0x7f72b80af5a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f72b815b0b0 tx=0x7f72b000b040 comp rx=0 tx=0).stop 2023-10-06T04:44:50.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.972+0000 7f72be77d700 1 -- 172.21.15.17:0/3807193920 shutdown_connections 2023-10-06T04:44:50.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.972+0000 7f72be77d700 1 --2- 172.21.15.17:0/3807193920 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f7298066f30 0x7f72980693e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:50.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.972+0000 7f72be77d700 1 --2- 172.21.15.17:0/3807193920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72b80af120 0x7f72b80af5a0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:50.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.972+0000 7f72be77d700 1 --2- 172.21.15.17:0/3807193920 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f72a4004810 0x7f72b814f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:50.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.972+0000 7f72be77d700 1 --2- 172.21.15.17:0/3807193920 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f72b814fa20 0x7f72b80ae250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:50.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.972+0000 7f72be77d700 1 -- 172.21.15.17:0/3807193920 >> 172.21.15.17:0/3807193920 conn(0x7f72b806d030 msgr2=0x7f72b81520c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:50.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.972+0000 7f72be77d700 1 -- 172.21.15.17:0/3807193920 shutdown_connections 2023-10-06T04:44:50.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:50.972+0000 7f72be77d700 1 -- 172.21.15.17:0/3807193920 wait complete. 2023-10-06T04:44:50.975 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 5 to deep-scrub 2023-10-06T04:44:50.985 INFO:tasks.ceph:Scrubbing osd.6 2023-10-06T04:44:50.986 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:44:51.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.107+0000 7f9984a08700 1 Processor -- start 2023-10-06T04:44:51.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.107+0000 7f9984a08700 1 -- start start 2023-10-06T04:44:51.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.108+0000 7f9984a08700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f998006dc00 0x7f99801590e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:51.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.108+0000 7f9984a08700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f998006dfd0 0x7f9980159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:51.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.108+0000 7f9984a08700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f998015d280 con 0x7f998015a030 2023-10-06T04:44:51.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.108+0000 7f9984a08700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f998015e290 con 0x7f998006dc00 2023-10-06T04:44:51.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.108+0000 7f9984a08700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f998015ab90 con 0x7f998006dfd0 2023-10-06T04:44:51.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.108+0000 7f997f7fe700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f998006dc00 0x7f99801590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:51.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.108+0000 7f997ffff700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f998015a030 0x7f998015a480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42736/0 (socket says 172.21.15.17:42736) 2023-10-06T04:44:51.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.108+0000 7f997ffff700 1 -- 172.21.15.17:0/1557883961 learned_addr learned my addr 172.21.15.17:0/1557883961 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:51.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.108+0000 7f997effd700 1 --2- 172.21.15.17:0/1557883961 >> v2:172.21.15.136:3300/0 conn(0x7f998006dfd0 0x7f9980159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:51.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.108+0000 7f997f7fe700 1 -- 172.21.15.17:0/1557883961 >> v2:172.21.15.136:3300/0 conn(0x7f998006dfd0 msgr2=0x7f9980159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:51.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.108+0000 7f997f7fe700 1 --2- 172.21.15.17:0/1557883961 >> v2:172.21.15.136:3300/0 conn(0x7f998006dfd0 0x7f9980159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.108+0000 7f997f7fe700 1 -- 172.21.15.17:0/1557883961 >> v1:172.21.15.17:6789/0 conn(0x7f998015a030 legacy=0x7f998015a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:51.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.108+0000 7f997f7fe700 1 -- 172.21.15.17:0/1557883961 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998015de00 con 0x7f998006dc00 2023-10-06T04:44:51.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.108+0000 7f997e7fc700 1 -- 172.21.15.17:0/1557883961 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3051004048 0 0) 0x7f998015d280 con 0x7f998015a030 2023-10-06T04:44:51.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.109+0000 7f997f7fe700 1 --2- 172.21.15.17:0/1557883961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f998006dc00 0x7f99801590e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f998006d5a0 tx=0x7f99700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0fbed67735397a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:51.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.109+0000 7f997e7fc700 1 -- 172.21.15.17:0/1557883961 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997000b6b0 con 0x7f998006dc00 2023-10-06T04:44:51.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.109+0000 7f997e7fc700 1 -- 172.21.15.17:0/1557883961 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997000b810 con 0x7f998006dc00 2023-10-06T04:44:51.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.109+0000 7f997e7fc700 1 -- 172.21.15.17:0/1557883961 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997000bbb0 con 0x7f998006dc00 2023-10-06T04:44:51.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.109+0000 7f9984a08700 1 -- 172.21.15.17:0/1557883961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f998006dc00 msgr2=0x7f99801590e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:51.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.109+0000 7f9984a08700 1 --2- 172.21.15.17:0/1557883961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f998006dc00 0x7f99801590e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f998006d5a0 tx=0x7f99700091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.109+0000 7f9984a08700 1 -- 172.21.15.17:0/1557883961 shutdown_connections 2023-10-06T04:44:51.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.109+0000 7f9984a08700 1 --2- 172.21.15.17:0/1557883961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f998006dc00 0x7f99801590e0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.109+0000 7f9984a08700 1 --2- 172.21.15.17:0/1557883961 >> v2:172.21.15.136:3300/0 conn(0x7f998006dfd0 0x7f9980159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.109+0000 7f9984a08700 1 -- 172.21.15.17:0/1557883961 >> 172.21.15.17:0/1557883961 conn(0x7f99800d0550 msgr2=0x7f99800d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:51.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.109+0000 7f9984a08700 1 -- 172.21.15.17:0/1557883961 shutdown_connections 2023-10-06T04:44:51.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.109+0000 7f9984a08700 1 -- 172.21.15.17:0/1557883961 wait complete. 2023-10-06T04:44:51.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.110+0000 7f9984a08700 1 Processor -- start 2023-10-06T04:44:51.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.111+0000 7f9984a08700 1 -- start start 2023-10-06T04:44:51.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.111+0000 7f9984a08700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f998006dc00 0x7f998016a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:51.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.111+0000 7f9984a08700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f998006dfd0 0x7f9980155380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:51.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.111+0000 7f9984a08700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f998015a030 0x7f998015c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:51.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.111+0000 7f9984a08700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99801558c0 con 0x7f998015a030 2023-10-06T04:44:51.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.111+0000 7f9984a08700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998016a440 con 0x7f998006dc00 2023-10-06T04:44:51.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.111+0000 7f9984a08700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998015cf00 con 0x7f998006dfd0 2023-10-06T04:44:51.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.111+0000 7f997ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f998015a030 0x7f998015c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:51.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.111+0000 7f997ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f998015a030 0x7f998015c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38742/0 (socket says 172.21.15.17:38742) 2023-10-06T04:44:51.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.111+0000 7f997ffff700 1 -- 172.21.15.17:0/1536320690 learned_addr learned my addr 172.21.15.17:0/1536320690 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:51.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.112+0000 7f997effd700 1 --2- 172.21.15.17:0/1536320690 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f998006dfd0 0x7f9980155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:51.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.112+0000 7f997f7fe700 1 --2- 172.21.15.17:0/1536320690 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f998006dc00 0x7f998016a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:51.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.112+0000 7f997ffff700 1 -- 172.21.15.17:0/1536320690 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f998006dfd0 msgr2=0x7f9980155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:51.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.112+0000 7f997ffff700 1 --2- 172.21.15.17:0/1536320690 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f998006dfd0 0x7f9980155380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.112+0000 7f997ffff700 1 -- 172.21.15.17:0/1536320690 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f998006dc00 msgr2=0x7f998016a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:51.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.112+0000 7f997ffff700 1 --2- 172.21.15.17:0/1536320690 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f998006dc00 0x7f998016a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.112+0000 7f997ffff700 1 -- 172.21.15.17:0/1536320690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9970009420 con 0x7f998015a030 2023-10-06T04:44:51.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.112+0000 7f997ffff700 1 --2- 172.21.15.17:0/1536320690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f998015a030 0x7f998015c520 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f997800cc90 tx=0x7f9978001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:51.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.112+0000 7f99677fe700 1 -- 172.21.15.17:0/1536320690 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997800cea0 con 0x7f998015a030 2023-10-06T04:44:51.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.112+0000 7f99677fe700 1 -- 172.21.15.17:0/1536320690 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997800ab70 con 0x7f998015a030 2023-10-06T04:44:51.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.112+0000 7f9984a08700 1 -- 172.21.15.17:0/1536320690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9980169df0 con 0x7f998015a030 2023-10-06T04:44:51.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.112+0000 7f99677fe700 1 -- 172.21.15.17:0/1536320690 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99780070f0 con 0x7f998015a030 2023-10-06T04:44:51.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.112+0000 7f9984a08700 1 -- 172.21.15.17:0/1536320690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f998015d1e0 con 0x7f998015a030 2023-10-06T04:44:51.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.113+0000 7f9984a08700 1 -- 172.21.15.17:0/1536320690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9980063ff0 con 0x7f998015a030 2023-10-06T04:44:51.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.113+0000 7f99677fe700 1 -- 172.21.15.17:0/1536320690 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f99780074a0 con 0x7f998015a030 2023-10-06T04:44:51.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.114+0000 7f99677fe700 1 --2- 172.21.15.17:0/1536320690 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f996c066f30 0x7f996c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:51.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.114+0000 7f99677fe700 1 -- 172.21.15.17:0/1536320690 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f9978084870 con 0x7f998015a030 2023-10-06T04:44:51.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.114+0000 7f997f7fe700 1 --2- 172.21.15.17:0/1536320690 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f996c066f30 0x7f996c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:51.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.114+0000 7f99677fe700 1 --2- 172.21.15.17:0/1536320690 >> [v2:172.21.15.136:6823/90927,v1:172.21.15.136:6825/90927] conn(0x7f996c06d3a0 0x7f996c06f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:51.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.114+0000 7f99677fe700 1 -- 172.21.15.17:0/1536320690 --> [v2:172.21.15.136:6823/90927,v1:172.21.15.136:6825/90927] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f996c06fe80 con 0x7f996c06d3a0 2023-10-06T04:44:51.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.114+0000 7f99677fe700 1 -- 172.21.15.17:0/1536320690 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9978089240 con 0x7f998015a030 2023-10-06T04:44:51.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.114+0000 7f997effd700 1 --2- 172.21.15.17:0/1536320690 >> [v2:172.21.15.136:6823/90927,v1:172.21.15.136:6825/90927] conn(0x7f996c06d3a0 0x7f996c06f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:51.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.114+0000 7f997f7fe700 1 --2- 172.21.15.17:0/1536320690 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f996c066f30 0x7f996c0693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f99700093f0 tx=0x7f9970017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:51.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.115+0000 7f997effd700 1 --2- 172.21.15.17:0/1536320690 >> [v2:172.21.15.136:6823/90927,v1:172.21.15.136:6825/90927] conn(0x7f996c06d3a0 0x7f996c06f7b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:51.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.116+0000 7f99677fe700 1 -- 172.21.15.17:0/1536320690 <== osd.6 v2:172.21.15.136:6823/90927 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f996c06fe80 con 0x7f996c06d3a0 2023-10-06T04:44:51.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.129+0000 7f9984a08700 1 -- 172.21.15.17:0/1536320690 --> [v2:172.21.15.136:6823/90927,v1:172.21.15.136:6825/90927] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f998006eb90 con 0x7f996c06d3a0 2023-10-06T04:44:51.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.130+0000 7f99677fe700 1 -- 172.21.15.17:0/1536320690 <== osd.6 v2:172.21.15.136:6823/90927 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f998006eb90 con 0x7f996c06d3a0 2023-10-06T04:44:51.132 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-06T04:44:51.132 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:44:51.133 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-06T04:44:51.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.130+0000 7f9984a08700 1 -- 172.21.15.17:0/1536320690 >> [v2:172.21.15.136:6823/90927,v1:172.21.15.136:6825/90927] conn(0x7f996c06d3a0 msgr2=0x7f996c06f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:51.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.130+0000 7f9984a08700 1 --2- 172.21.15.17:0/1536320690 >> [v2:172.21.15.136:6823/90927,v1:172.21.15.136:6825/90927] conn(0x7f996c06d3a0 0x7f996c06f7b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.131+0000 7f9984a08700 1 -- 172.21.15.17:0/1536320690 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f996c066f30 msgr2=0x7f996c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:51.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.131+0000 7f9984a08700 1 --2- 172.21.15.17:0/1536320690 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f996c066f30 0x7f996c0693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f99700093f0 tx=0x7f9970017000 comp rx=0 tx=0).stop 2023-10-06T04:44:51.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.131+0000 7f9984a08700 1 -- 172.21.15.17:0/1536320690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f998015a030 msgr2=0x7f998015c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:51.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.131+0000 7f9984a08700 1 --2- 172.21.15.17:0/1536320690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f998015a030 0x7f998015c520 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f997800cc90 tx=0x7f9978001a80 comp rx=0 tx=0).stop 2023-10-06T04:44:51.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.131+0000 7f997ffff700 1 -- 172.21.15.17:0/1536320690 reap_dead start 2023-10-06T04:44:51.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.131+0000 7f9984a08700 1 -- 172.21.15.17:0/1536320690 shutdown_connections 2023-10-06T04:44:51.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.131+0000 7f9984a08700 1 -- 172.21.15.17:0/1536320690 >> 172.21.15.17:0/1536320690 conn(0x7f99800d0550 msgr2=0x7f9980156880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:51.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.131+0000 7f9984a08700 1 -- 172.21.15.17:0/1536320690 shutdown_connections 2023-10-06T04:44:51.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.131+0000 7f9984a08700 1 -- 172.21.15.17:0/1536320690 wait complete. 2023-10-06T04:44:51.145 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-06T04:44:51.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.263+0000 7fb1ec317700 1 Processor -- start 2023-10-06T04:44:51.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.264+0000 7fb1ec317700 1 -- start start 2023-10-06T04:44:51.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.264+0000 7fb1ec317700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb1e41509a0 0x7fb1e4164760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:51.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.264+0000 7fb1ec317700 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1e415aed0 con 0x7fb1e415d610 2023-10-06T04:44:51.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.264+0000 7fb1ec317700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1e40cb680 con 0x7fb1e415d9e0 2023-10-06T04:44:51.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.264+0000 7fb1ec317700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1e40cb960 con 0x7fb1e41509a0 2023-10-06T04:44:51.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.265+0000 7fb1ea0b3700 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fb1e415d610 0x7fb1e40cac70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42748/0 (socket says 172.21.15.17:42748) 2023-10-06T04:44:51.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.265+0000 7fb1ea0b3700 1 -- 172.21.15.17:0/754106026 learned_addr learned my addr 172.21.15.17:0/754106026 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:51.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.265+0000 7fb1ea8b4700 1 --2- 172.21.15.17:0/754106026 >> v2:172.21.15.136:3300/0 conn(0x7fb1e41509a0 0x7fb1e4164760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:51.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.265+0000 7fb1e90b1700 1 -- 172.21.15.17:0/754106026 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 280481355 0 0) 0x7fb1e415aed0 con 0x7fb1e415d610 2023-10-06T04:44:51.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.265+0000 7fb1e90b1700 1 -- 172.21.15.17:0/754106026 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1cc003570 con 0x7fb1e415d610 2023-10-06T04:44:51.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.265+0000 7fb1e90b1700 1 -- 172.21.15.17:0/754106026 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 547001634 0 0) 0x7fb1cc003570 con 0x7fb1e415d610 2023-10-06T04:44:51.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.265+0000 7fb1e90b1700 1 -- 172.21.15.17:0/754106026 >> v2:172.21.15.136:3300/0 conn(0x7fb1e41509a0 msgr2=0x7fb1e4164760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:51.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.265+0000 7fb1e90b1700 1 --2- 172.21.15.17:0/754106026 >> v2:172.21.15.136:3300/0 conn(0x7fb1e41509a0 0x7fb1e4164760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.265+0000 7fb1e90b1700 1 -- 172.21.15.17:0/754106026 >> v1:172.21.15.136:6789/0 conn(0x7fb1e415d9e0 legacy=0x7fb1e4150290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:51.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.265+0000 7fb1e90b1700 1 -- 172.21.15.17:0/754106026 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e40cbc40 con 0x7fb1e415d610 2023-10-06T04:44:51.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.265+0000 7fb1e90b1700 1 -- 172.21.15.17:0/754106026 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4268781140 0 0) 0x7fb1dc0015f0 con 0x7fb1e415d610 2023-10-06T04:44:51.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.265+0000 7fb1e90b1700 1 -- 172.21.15.17:0/754106026 >> v1:172.21.15.17:6789/0 conn(0x7fb1e415d610 legacy=0x7fb1e40cac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:51.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.265+0000 7fb1e90b1700 1 --2- 172.21.15.17:0/754106026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1cc003a60 0x7fb1cc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:51.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.265+0000 7fb1e90b1700 1 --2- 172.21.15.17:0/754106026 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb1cc004810 0x7fb1cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:51.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.265+0000 7fb1e90b1700 1 --2- 172.21.15.17:0/754106026 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1cc0051c0 0x7fb1cc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:51.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.265+0000 7fb1e90b1700 1 -- 172.21.15.17:0/754106026 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e40cb960 con 0x7fb1cc003a60 2023-10-06T04:44:51.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.265+0000 7fb1e90b1700 1 -- 172.21.15.17:0/754106026 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1cc00c0d0 con 0x7fb1cc0051c0 2023-10-06T04:44:51.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.265+0000 7fb1e90b1700 1 -- 172.21.15.17:0/754106026 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1cc00c290 con 0x7fb1cc004810 2023-10-06T04:44:51.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.265+0000 7fb1ea0b3700 1 --2- 172.21.15.17:0/754106026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1cc003a60 0x7fb1cc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:51.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.266+0000 7fb1ea8b4700 1 --2- 172.21.15.17:0/754106026 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1cc0051c0 0x7fb1cc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:51.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.266+0000 7fb1e98b2700 1 --2- 172.21.15.17:0/754106026 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb1cc004810 0x7fb1cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:51.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.266+0000 7fb1ea0b3700 1 -- 172.21.15.17:0/754106026 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb1cc004810 msgr2=0x7fb1cc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:51.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.266+0000 7fb1ea0b3700 1 --2- 172.21.15.17:0/754106026 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb1cc004810 0x7fb1cc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.266+0000 7fb1ea0b3700 1 -- 172.21.15.17:0/754106026 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1cc0051c0 msgr2=0x7fb1cc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:51.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.266+0000 7fb1ea0b3700 1 --2- 172.21.15.17:0/754106026 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1cc0051c0 0x7fb1cc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.266+0000 7fb1ea8b4700 1 -- 172.21.15.17:0/754106026 reap_dead start 2023-10-06T04:44:51.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.266+0000 7fb1ea0b3700 1 -- 172.21.15.17:0/754106026 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1cc003570 con 0x7fb1cc003a60 2023-10-06T04:44:51.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.266+0000 7fb1e98b2700 1 --2- 172.21.15.17:0/754106026 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb1cc004810 0x7fb1cc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:51.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.266+0000 7fb1ea0b3700 1 --2- 172.21.15.17:0/754106026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1cc003a60 0x7fb1cc003e70 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc00c3c0 tx=0x7fb1dc007920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b47b7bbd5c068399 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:51.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.266+0000 7fb1e90b1700 1 -- 172.21.15.17:0/754106026 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc00cc10 con 0x7fb1cc003a60 2023-10-06T04:44:51.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.266+0000 7fb1e90b1700 1 -- 172.21.15.17:0/754106026 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1dc00cd90 con 0x7fb1cc003a60 2023-10-06T04:44:51.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.266+0000 7fb1e90b1700 1 -- 172.21.15.17:0/754106026 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc007320 con 0x7fb1cc003a60 2023-10-06T04:44:51.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.267+0000 7fb1ec317700 1 -- 172.21.15.17:0/754106026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1cc003a60 msgr2=0x7fb1cc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:51.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.267+0000 7fb1ec317700 1 --2- 172.21.15.17:0/754106026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1cc003a60 0x7fb1cc003e70 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc00c3c0 tx=0x7fb1dc007920 comp rx=0 tx=0).stop 2023-10-06T04:44:51.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.267+0000 7fb1ec317700 1 -- 172.21.15.17:0/754106026 shutdown_connections 2023-10-06T04:44:51.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.267+0000 7fb1ec317700 1 --2- 172.21.15.17:0/754106026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1cc003a60 0x7fb1cc003e70 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.267+0000 7fb1ec317700 1 -- 172.21.15.17:0/754106026 >> 172.21.15.17:0/754106026 conn(0x7fb1e4099960 msgr2=0x7fb1e406cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:51.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.267+0000 7fb1ec317700 1 -- 172.21.15.17:0/754106026 shutdown_connections 2023-10-06T04:44:51.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.267+0000 7fb1ec317700 1 -- 172.21.15.17:0/754106026 wait complete. 2023-10-06T04:44:51.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.268+0000 7fb1ec317700 1 Processor -- start 2023-10-06T04:44:51.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.268+0000 7fb1ec317700 1 -- start start 2023-10-06T04:44:51.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.269+0000 7fb1ec317700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb1cc003a60 0x7fb1e414fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:51.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.269+0000 7fb1ec317700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1e4153ae0 0x7fb1e40ce410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:51.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.269+0000 7fb1ec317700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1e40ce950 0x7fb1e40b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:51.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.269+0000 7fb1ec317700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e40c6ea0 con 0x7fb1e40ce950 2023-10-06T04:44:51.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.269+0000 7fb1ec317700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e40cedd0 con 0x7fb1e4153ae0 2023-10-06T04:44:51.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.269+0000 7fb1ec317700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e4153650 con 0x7fb1cc003a60 2023-10-06T04:44:51.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.269+0000 7fb1ea8b4700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1e40ce950 0x7fb1e40b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:51.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.269+0000 7fb1ea8b4700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1e40ce950 0x7fb1e40b3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38752/0 (socket says 172.21.15.17:38752) 2023-10-06T04:44:51.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.269+0000 7fb1ea8b4700 1 -- 172.21.15.17:0/3126110954 learned_addr learned my addr 172.21.15.17:0/3126110954 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:51.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.269+0000 7fb1e98b2700 1 --2- 172.21.15.17:0/3126110954 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1e4153ae0 0x7fb1e40ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:51.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.269+0000 7fb1ea0b3700 1 --2- 172.21.15.17:0/3126110954 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb1cc003a60 0x7fb1e414fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:51.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.269+0000 7fb1ea8b4700 1 -- 172.21.15.17:0/3126110954 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb1cc003a60 msgr2=0x7fb1e414fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:51.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.269+0000 7fb1ea8b4700 1 --2- 172.21.15.17:0/3126110954 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb1cc003a60 0x7fb1e414fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.269+0000 7fb1ea8b4700 1 -- 172.21.15.17:0/3126110954 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1e4153ae0 msgr2=0x7fb1e40ce410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:51.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.269+0000 7fb1ea8b4700 1 --2- 172.21.15.17:0/3126110954 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1e4153ae0 0x7fb1e40ce410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.269+0000 7fb1ea8b4700 1 -- 172.21.15.17:0/3126110954 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e4152a40 con 0x7fb1e40ce950 2023-10-06T04:44:51.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.269+0000 7fb1ea8b4700 1 --2- 172.21.15.17:0/3126110954 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1e40ce950 0x7fb1e40b3480 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb1d40094d0 tx=0x7fb1d400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:51.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.269+0000 7fb1e27fc700 1 -- 172.21.15.17:0/3126110954 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d400e040 con 0x7fb1e40ce950 2023-10-06T04:44:51.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.269+0000 7fb1e27fc700 1 -- 172.21.15.17:0/3126110954 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d400f040 con 0x7fb1e40ce950 2023-10-06T04:44:51.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.269+0000 7fb1e27fc700 1 -- 172.21.15.17:0/3126110954 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d400fdc0 con 0x7fb1e40ce950 2023-10-06T04:44:51.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.269+0000 7fb1ec317700 1 -- 172.21.15.17:0/3126110954 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e4152d20 con 0x7fb1e40ce950 2023-10-06T04:44:51.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.270+0000 7fb1ec317700 1 -- 172.21.15.17:0/3126110954 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e41532e0 con 0x7fb1e40ce950 2023-10-06T04:44:51.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.270+0000 7fb1ec317700 1 -- 172.21.15.17:0/3126110954 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e4153800 con 0x7fb1e40ce950 2023-10-06T04:44:51.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.271+0000 7fb1e27fc700 1 -- 172.21.15.17:0/3126110954 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb1d4015640 con 0x7fb1e40ce950 2023-10-06T04:44:51.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.271+0000 7fb1e27fc700 1 --2- 172.21.15.17:0/3126110954 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fb1d0066f30 0x7fb1d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:51.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.271+0000 7fb1e27fc700 1 -- 172.21.15.17:0/3126110954 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fb1d4084cf0 con 0x7fb1e40ce950 2023-10-06T04:44:51.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.271+0000 7fb1ea0b3700 1 --2- 172.21.15.17:0/3126110954 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fb1d0066f30 0x7fb1d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:51.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.272+0000 7fb1ea0b3700 1 --2- 172.21.15.17:0/3126110954 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fb1d0066f30 0x7fb1d00693e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc008fd0 tx=0x7fb1dc015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:51.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.275+0000 7fb1e27fc700 1 -- 172.21.15.17:0/3126110954 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1e4153800 con 0x7fb1e40ce950 2023-10-06T04:44:51.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.471+0000 7fb1ec317700 1 -- 172.21.15.17:0/3126110954 --> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1e41537c0 con 0x7fb1d0066f30 2023-10-06T04:44:51.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.471+0000 7fb1e27fc700 1 -- 172.21.15.17:0/3126110954 <== mgr.4104 v2:172.21.15.17:6832/90424 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb1e41537c0 con 0x7fb1d0066f30 2023-10-06T04:44:51.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.473+0000 7fb1ec317700 1 -- 172.21.15.17:0/3126110954 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fb1d0066f30 msgr2=0x7fb1d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:51.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.473+0000 7fb1ec317700 1 --2- 172.21.15.17:0/3126110954 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fb1d0066f30 0x7fb1d00693e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc008fd0 tx=0x7fb1dc015000 comp rx=0 tx=0).stop 2023-10-06T04:44:51.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.473+0000 7fb1ec317700 1 -- 172.21.15.17:0/3126110954 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1e40ce950 msgr2=0x7fb1e40b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:51.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.473+0000 7fb1ec317700 1 --2- 172.21.15.17:0/3126110954 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1e40ce950 0x7fb1e40b3480 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb1d40094d0 tx=0x7fb1d400b040 comp rx=0 tx=0).stop 2023-10-06T04:44:51.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.473+0000 7fb1ec317700 1 -- 172.21.15.17:0/3126110954 shutdown_connections 2023-10-06T04:44:51.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.473+0000 7fb1ec317700 1 --2- 172.21.15.17:0/3126110954 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fb1d0066f30 0x7fb1d00693e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.473+0000 7fb1ec317700 1 --2- 172.21.15.17:0/3126110954 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1e40ce950 0x7fb1e40b3480 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.473+0000 7fb1ec317700 1 --2- 172.21.15.17:0/3126110954 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb1cc003a60 0x7fb1e414fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.473+0000 7fb1ec317700 1 --2- 172.21.15.17:0/3126110954 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1e4153ae0 0x7fb1e40ce410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.473+0000 7fb1ec317700 1 -- 172.21.15.17:0/3126110954 >> 172.21.15.17:0/3126110954 conn(0x7fb1e4099960 msgr2=0x7fb1e40cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:51.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.473+0000 7fb1ec317700 1 -- 172.21.15.17:0/3126110954 shutdown_connections 2023-10-06T04:44:51.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.473+0000 7fb1ec317700 1 -- 172.21.15.17:0/3126110954 wait complete. 2023-10-06T04:44:51.477 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 6 to deep-scrub 2023-10-06T04:44:51.487 INFO:tasks.ceph:Scrubbing osd.7 2023-10-06T04:44:51.487 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:44:51.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.608+0000 7f25824db700 1 Processor -- start 2023-10-06T04:44:51.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.608+0000 7f25824db700 1 -- start start 2023-10-06T04:44:51.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.609+0000 7f25824db700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f257c0ce720 0x7f257c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:51.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.609+0000 7f25824db700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f257c0ceaf0 0x7f257c06d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:51.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.609+0000 7f25824db700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f257c06dbb0 0x7f257c15ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:51.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.609+0000 7f25824db700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f257c0cef40 con 0x7f257c06dbb0 2023-10-06T04:44:51.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.609+0000 7f25824db700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f257c06e030 con 0x7f257c0ceaf0 2023-10-06T04:44:51.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.609+0000 7f25824db700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f257c0b0b00 con 0x7f257c0ce720 2023-10-06T04:44:51.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.609+0000 7f2580a78700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f257c06dbb0 0x7f257c15ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:51.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.609+0000 7f2580a78700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f257c06dbb0 0x7f257c15ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38766/0 (socket says 172.21.15.17:38766) 2023-10-06T04:44:51.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.609+0000 7f2580a78700 1 -- 172.21.15.17:0/729914506 learned_addr learned my addr 172.21.15.17:0/729914506 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:51.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.609+0000 7f257bfff700 1 --2- 172.21.15.17:0/729914506 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f257c0ce720 0x7f257c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:51.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.609+0000 7f257b7fe700 1 --2- 172.21.15.17:0/729914506 >> v2:172.21.15.136:3300/0 conn(0x7f257c0ceaf0 0x7f257c06d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:51.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.609+0000 7f2580a78700 1 -- 172.21.15.17:0/729914506 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f257c0ce720 msgr2=0x7f257c06f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:51.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.609+0000 7f2580a78700 1 --2- 172.21.15.17:0/729914506 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f257c0ce720 0x7f257c06f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.609+0000 7f2580a78700 1 -- 172.21.15.17:0/729914506 >> v2:172.21.15.136:3300/0 conn(0x7f257c0ceaf0 msgr2=0x7f257c06d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:51.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.609+0000 7f2580a78700 1 --2- 172.21.15.17:0/729914506 >> v2:172.21.15.136:3300/0 conn(0x7f257c0ceaf0 0x7f257c06d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.609+0000 7f2580a78700 1 -- 172.21.15.17:0/729914506 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f257c06e280 con 0x7f257c06dbb0 2023-10-06T04:44:51.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.609+0000 7f257b7fe700 1 --2- 172.21.15.17:0/729914506 >> v2:172.21.15.136:3300/0 conn(0x7f257c0ceaf0 0x7f257c06d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:51.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.609+0000 7f2580a78700 1 --2- 172.21.15.17:0/729914506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f257c06dbb0 0x7f257c15ca00 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f257c0711b0 tx=0x7f2574009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b2f30aee1b35d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:51.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.609+0000 7f257affd700 1 -- 172.21.15.17:0/729914506 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257400e070 con 0x7f257c06dbb0 2023-10-06T04:44:51.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.610+0000 7f257affd700 1 -- 172.21.15.17:0/729914506 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f257400ba20 con 0x7f257c06dbb0 2023-10-06T04:44:51.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.610+0000 7f257affd700 1 -- 172.21.15.17:0/729914506 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25740092e0 con 0x7f257c06dbb0 2023-10-06T04:44:51.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.610+0000 7f25824db700 1 -- 172.21.15.17:0/729914506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f257c06dbb0 msgr2=0x7f257c15ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:51.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.610+0000 7f25824db700 1 --2- 172.21.15.17:0/729914506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f257c06dbb0 0x7f257c15ca00 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f257c0711b0 tx=0x7f2574009840 comp rx=0 tx=0).stop 2023-10-06T04:44:51.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.610+0000 7f25824db700 1 -- 172.21.15.17:0/729914506 shutdown_connections 2023-10-06T04:44:51.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.610+0000 7f25824db700 1 --2- 172.21.15.17:0/729914506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f257c06dbb0 0x7f257c15ca00 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.610+0000 7f25824db700 1 --2- 172.21.15.17:0/729914506 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f257c0ce720 0x7f257c06f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.610+0000 7f25824db700 1 --2- 172.21.15.17:0/729914506 >> v2:172.21.15.136:3300/0 conn(0x7f257c0ceaf0 0x7f257c06d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.610+0000 7f25824db700 1 -- 172.21.15.17:0/729914506 >> 172.21.15.17:0/729914506 conn(0x7f257c070440 msgr2=0x7f257c070840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:51.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.610+0000 7f25824db700 1 -- 172.21.15.17:0/729914506 shutdown_connections 2023-10-06T04:44:51.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.610+0000 7f25824db700 1 -- 172.21.15.17:0/729914506 wait complete. 2023-10-06T04:44:51.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.611+0000 7f25824db700 1 Processor -- start 2023-10-06T04:44:51.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.611+0000 7f25824db700 1 -- start start 2023-10-06T04:44:51.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.612+0000 7f25824db700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f257c06dbb0 0x7f257c0a98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:51.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.612+0000 7f25824db700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f257c0ce720 0x7f257c16a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:51.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.612+0000 7f25824db700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f257c0ceaf0 0x7f257c0b3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:51.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.612+0000 7f25824db700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257c16a7c0 con 0x7f257c06dbb0 2023-10-06T04:44:51.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.612+0000 7f25824db700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257c0c1cc0 con 0x7f257c0ceaf0 2023-10-06T04:44:51.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.612+0000 7f25824db700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f257c0a9f30 con 0x7f257c0ce720 2023-10-06T04:44:51.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.612+0000 7f257bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f257c06dbb0 0x7f257c0a98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:51.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.612+0000 7f257bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f257c06dbb0 0x7f257c0a98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38768/0 (socket says 172.21.15.17:38768) 2023-10-06T04:44:51.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.612+0000 7f257bfff700 1 -- 172.21.15.17:0/1461385421 learned_addr learned my addr 172.21.15.17:0/1461385421 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:51.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.612+0000 7f2580a78700 1 --2- 172.21.15.17:0/1461385421 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f257c0ceaf0 0x7f257c0b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:51.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.612+0000 7f257b7fe700 1 --2- 172.21.15.17:0/1461385421 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f257c0ce720 0x7f257c16a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:51.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.612+0000 7f257bfff700 1 -- 172.21.15.17:0/1461385421 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f257c0ce720 msgr2=0x7f257c16a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:51.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.612+0000 7f257bfff700 1 --2- 172.21.15.17:0/1461385421 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f257c0ce720 0x7f257c16a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.612+0000 7f257bfff700 1 -- 172.21.15.17:0/1461385421 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f257c0ceaf0 msgr2=0x7f257c0b3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:51.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.612+0000 7f257bfff700 1 --2- 172.21.15.17:0/1461385421 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f257c0ceaf0 0x7f257c0b3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.612+0000 7f257bfff700 1 -- 172.21.15.17:0/1461385421 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2574009ae0 con 0x7f257c06dbb0 2023-10-06T04:44:51.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.612+0000 7f257b7fe700 1 --2- 172.21.15.17:0/1461385421 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f257c0ce720 0x7f257c16a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:44:51.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.613+0000 7f257bfff700 1 --2- 172.21.15.17:0/1461385421 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f257c06dbb0 0x7f257c0a98a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f256c00ec80 tx=0x7f256c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:51.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.613+0000 7f2563fff700 1 -- 172.21.15.17:0/1461385421 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c00c850 con 0x7f257c06dbb0 2023-10-06T04:44:51.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.613+0000 7f2563fff700 1 -- 172.21.15.17:0/1461385421 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256c00c9d0 con 0x7f257c06dbb0 2023-10-06T04:44:51.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.613+0000 7f25824db700 1 -- 172.21.15.17:0/1461385421 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f257c0aa210 con 0x7f257c06dbb0 2023-10-06T04:44:51.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.613+0000 7f2563fff700 1 -- 172.21.15.17:0/1461385421 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c00cd90 con 0x7f257c06dbb0 2023-10-06T04:44:51.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.613+0000 7f25824db700 1 -- 172.21.15.17:0/1461385421 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f257c0aa7d0 con 0x7f257c06dbb0 2023-10-06T04:44:51.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.613+0000 7f25824db700 1 -- 172.21.15.17:0/1461385421 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f257c0718b0 con 0x7f257c06dbb0 2023-10-06T04:44:51.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.614+0000 7f2563fff700 1 -- 172.21.15.17:0/1461385421 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f256c013680 con 0x7f257c06dbb0 2023-10-06T04:44:51.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.615+0000 7f2563fff700 1 --2- 172.21.15.17:0/1461385421 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2568066f30 0x7f25680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:51.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.615+0000 7f2563fff700 1 -- 172.21.15.17:0/1461385421 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f256c084b10 con 0x7f257c06dbb0 2023-10-06T04:44:51.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.615+0000 7f257b7fe700 1 --2- 172.21.15.17:0/1461385421 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2568066f30 0x7f25680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:51.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.615+0000 7f2563fff700 1 --2- 172.21.15.17:0/1461385421 >> [v2:172.21.15.136:6816/90934,v1:172.21.15.136:6817/90934] conn(0x7f256806d3a0 0x7f256806f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:51.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.615+0000 7f2563fff700 1 -- 172.21.15.17:0/1461385421 --> [v2:172.21.15.136:6816/90934,v1:172.21.15.136:6817/90934] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f256806fe80 con 0x7f256806d3a0 2023-10-06T04:44:51.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.615+0000 7f2563fff700 1 -- 172.21.15.17:0/1461385421 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f256c084e00 con 0x7f257c06dbb0 2023-10-06T04:44:51.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.615+0000 7f2580a78700 1 --2- 172.21.15.17:0/1461385421 >> [v2:172.21.15.136:6816/90934,v1:172.21.15.136:6817/90934] conn(0x7f256806d3a0 0x7f256806f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:51.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.615+0000 7f257b7fe700 1 --2- 172.21.15.17:0/1461385421 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2568066f30 0x7f25680693e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2570006f00 tx=0x7f2570008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:51.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.615+0000 7f2580a78700 1 --2- 172.21.15.17:0/1461385421 >> [v2:172.21.15.136:6816/90934,v1:172.21.15.136:6817/90934] conn(0x7f256806d3a0 0x7f256806f7b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:51.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.616+0000 7f2563fff700 1 -- 172.21.15.17:0/1461385421 <== osd.7 v2:172.21.15.136:6816/90934 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f256806fe80 con 0x7f256806d3a0 2023-10-06T04:44:51.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.630+0000 7f25824db700 1 -- 172.21.15.17:0/1461385421 --> [v2:172.21.15.136:6816/90934,v1:172.21.15.136:6817/90934] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f257c15c410 con 0x7f256806d3a0 2023-10-06T04:44:51.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.630+0000 7f2563fff700 1 -- 172.21.15.17:0/1461385421 <== osd.7 v2:172.21.15.136:6816/90934 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f257c15c410 con 0x7f256806d3a0 2023-10-06T04:44:51.633 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-06T04:44:51.633 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:44:51.633 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-06T04:44:51.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.631+0000 7f25824db700 1 -- 172.21.15.17:0/1461385421 >> [v2:172.21.15.136:6816/90934,v1:172.21.15.136:6817/90934] conn(0x7f256806d3a0 msgr2=0x7f256806f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:51.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.631+0000 7f25824db700 1 --2- 172.21.15.17:0/1461385421 >> [v2:172.21.15.136:6816/90934,v1:172.21.15.136:6817/90934] conn(0x7f256806d3a0 0x7f256806f7b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.631+0000 7f25824db700 1 -- 172.21.15.17:0/1461385421 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2568066f30 msgr2=0x7f25680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:51.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.631+0000 7f25824db700 1 --2- 172.21.15.17:0/1461385421 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f2568066f30 0x7f25680693e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2570006f00 tx=0x7f2570008040 comp rx=0 tx=0).stop 2023-10-06T04:44:51.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.631+0000 7f25824db700 1 -- 172.21.15.17:0/1461385421 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f257c06dbb0 msgr2=0x7f257c0a98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:51.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.631+0000 7f25824db700 1 --2- 172.21.15.17:0/1461385421 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f257c06dbb0 0x7f257c0a98a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f256c00ec80 tx=0x7f256c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.631+0000 7f2580a78700 1 -- 172.21.15.17:0/1461385421 reap_dead start 2023-10-06T04:44:51.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.631+0000 7f25824db700 1 -- 172.21.15.17:0/1461385421 shutdown_connections 2023-10-06T04:44:51.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.631+0000 7f25824db700 1 -- 172.21.15.17:0/1461385421 >> 172.21.15.17:0/1461385421 conn(0x7f257c070440 msgr2=0x7f257c0c75f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:51.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.631+0000 7f25824db700 1 -- 172.21.15.17:0/1461385421 shutdown_connections 2023-10-06T04:44:51.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.631+0000 7f25824db700 1 -- 172.21.15.17:0/1461385421 wait complete. 2023-10-06T04:44:51.645 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-06T04:44:51.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.763+0000 7f0ef1b18700 1 Processor -- start 2023-10-06T04:44:51.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.763+0000 7f0ef1b18700 1 -- start start 2023-10-06T04:44:51.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.764+0000 7f0ef1b18700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0eec15d610 0x7f0eec0cac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:51.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.764+0000 7f0ef1b18700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0eec0cb1b0 0x7f0eec150290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:51.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.764+0000 7f0ef1b18700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eec15aed0 con 0x7f0eec15d9e0 2023-10-06T04:44:51.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.764+0000 7f0ef1b18700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eec0cb680 con 0x7f0eec0cb1b0 2023-10-06T04:44:51.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.764+0000 7f0ef1b18700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec0cb960 con 0x7f0eec15d610 2023-10-06T04:44:51.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.764+0000 7f0eeaffd700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0eec0cb1b0 0x7f0eec150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:51.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.764+0000 7f0eebfff700 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f0eec15d9e0 0x7f0eec159dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.17:56038/0 (socket says 172.21.15.17:56038) 2023-10-06T04:44:51.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.764+0000 7f0eeaffd700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0eec0cb1b0 0x7f0eec150290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.17:47048/0 (socket says 172.21.15.17:47048) 2023-10-06T04:44:51.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.764+0000 7f0eebfff700 1 -- 172.21.15.17:0/1410908108 learned_addr learned my addr 172.21.15.17:0/1410908108 (peer_addr_for_me v1:172.21.15.17:0/0) 2023-10-06T04:44:51.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.764+0000 7f0eeb7fe700 1 --2- 172.21.15.17:0/1410908108 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0eec15d610 0x7f0eec0cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:51.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.764+0000 7f0eeaffd700 1 -- 172.21.15.17:0/1410908108 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0eec15d610 msgr2=0x7f0eec0cac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:51.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.764+0000 7f0eeaffd700 1 --2- 172.21.15.17:0/1410908108 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0eec15d610 0x7f0eec0cac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.764+0000 7f0eeaffd700 1 -- 172.21.15.17:0/1410908108 >> v1:172.21.15.136:6789/0 conn(0x7f0eec15d9e0 legacy=0x7f0eec159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:51.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.764+0000 7f0eeaffd700 1 -- 172.21.15.17:0/1410908108 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eec0cbc40 con 0x7f0eec0cb1b0 2023-10-06T04:44:51.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.764+0000 7f0eea7fc700 1 -- 172.21.15.17:0/1410908108 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2120595478 0 0) 0x7f0eec15aed0 con 0x7f0eec15d9e0 2023-10-06T04:44:51.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.765+0000 7f0eeaffd700 1 --2- 172.21.15.17:0/1410908108 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0eec0cb1b0 0x7f0eec150290 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0ed40098e0 tx=0x7f0ed40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df3af657331d7143 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:51.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.765+0000 7f0eea7fc700 1 -- 172.21.15.17:0/1410908108 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed400b640 con 0x7f0eec0cb1b0 2023-10-06T04:44:51.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.765+0000 7f0eea7fc700 1 -- 172.21.15.17:0/1410908108 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed400b7a0 con 0x7f0eec0cb1b0 2023-10-06T04:44:51.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.765+0000 7f0eea7fc700 1 -- 172.21.15.17:0/1410908108 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed400bb40 con 0x7f0eec0cb1b0 2023-10-06T04:44:51.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.765+0000 7f0ef1b18700 1 -- 172.21.15.17:0/1410908108 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0eec0cb1b0 msgr2=0x7f0eec150290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:51.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.765+0000 7f0ef1b18700 1 --2- 172.21.15.17:0/1410908108 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0eec0cb1b0 0x7f0eec150290 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0ed40098e0 tx=0x7f0ed40091a0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.765+0000 7f0ef1b18700 1 -- 172.21.15.17:0/1410908108 shutdown_connections 2023-10-06T04:44:51.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.765+0000 7f0ef1b18700 1 --2- 172.21.15.17:0/1410908108 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0eec15d610 0x7f0eec0cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.765+0000 7f0ef1b18700 1 --2- 172.21.15.17:0/1410908108 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0eec0cb1b0 0x7f0eec150290 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.765+0000 7f0ef1b18700 1 -- 172.21.15.17:0/1410908108 >> 172.21.15.17:0/1410908108 conn(0x7f0eec099960 msgr2=0x7f0eec06cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:51.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.765+0000 7f0ef1b18700 1 -- 172.21.15.17:0/1410908108 shutdown_connections 2023-10-06T04:44:51.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.765+0000 7f0ef1b18700 1 -- 172.21.15.17:0/1410908108 wait complete. 2023-10-06T04:44:51.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.767+0000 7f0ef1b18700 1 Processor -- start 2023-10-06T04:44:51.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.767+0000 7f0ef1b18700 1 -- start start 2023-10-06T04:44:51.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.767+0000 7f0ef1b18700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0eec0cb1b0 0x7f0eec16a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:51.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.767+0000 7f0ef1b18700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0eec15d610 0x7f0eec16d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:51.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.767+0000 7f0ef1b18700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0eec15d9e0 0x7f0eec0c4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:51.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.767+0000 7f0ef1b18700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec153690 con 0x7f0eec15d9e0 2023-10-06T04:44:51.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.767+0000 7f0ef1b18700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec0cfdf0 con 0x7f0eec15d610 2023-10-06T04:44:51.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.767+0000 7f0ef1b18700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec0c5680 con 0x7f0eec0cb1b0 2023-10-06T04:44:51.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.768+0000 7f0eebfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0eec15d9e0 0x7f0eec0c4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:51.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.768+0000 7f0eebfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0eec15d9e0 0x7f0eec0c4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38778/0 (socket says 172.21.15.17:38778) 2023-10-06T04:44:51.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.768+0000 7f0eebfff700 1 -- 172.21.15.17:0/4187769058 learned_addr learned my addr 172.21.15.17:0/4187769058 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:51.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.768+0000 7f0eeb7fe700 1 --2- 172.21.15.17:0/4187769058 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0eec0cb1b0 0x7f0eec16a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:51.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.768+0000 7f0eeaffd700 1 --2- 172.21.15.17:0/4187769058 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0eec15d610 0x7f0eec16d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:51.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.768+0000 7f0eebfff700 1 -- 172.21.15.17:0/4187769058 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0eec0cb1b0 msgr2=0x7f0eec16a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:51.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.768+0000 7f0eebfff700 1 --2- 172.21.15.17:0/4187769058 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0eec0cb1b0 0x7f0eec16a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.768+0000 7f0eebfff700 1 -- 172.21.15.17:0/4187769058 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0eec15d610 msgr2=0x7f0eec16d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:51.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.768+0000 7f0eebfff700 1 --2- 172.21.15.17:0/4187769058 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0eec15d610 0x7f0eec16d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.768+0000 7f0eebfff700 1 -- 172.21.15.17:0/4187769058 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed4009420 con 0x7f0eec15d9e0 2023-10-06T04:44:51.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.768+0000 7f0eebfff700 1 --2- 172.21.15.17:0/4187769058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0eec15d9e0 0x7f0eec0c4e30 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f0ee400c530 tx=0x7f0ee4007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:51.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.768+0000 7f0ee37fe700 1 -- 172.21.15.17:0/4187769058 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee4005b30 con 0x7f0eec15d9e0 2023-10-06T04:44:51.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.768+0000 7f0ee37fe700 1 -- 172.21.15.17:0/4187769058 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee4005c90 con 0x7f0eec15d9e0 2023-10-06T04:44:51.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.768+0000 7f0ef1b18700 1 -- 172.21.15.17:0/4187769058 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eec0c5960 con 0x7f0eec15d9e0 2023-10-06T04:44:51.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.768+0000 7f0ee37fe700 1 -- 172.21.15.17:0/4187769058 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee4007320 con 0x7f0eec15d9e0 2023-10-06T04:44:51.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.768+0000 7f0ef1b18700 1 -- 172.21.15.17:0/4187769058 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eec0cfa80 con 0x7f0eec15d9e0 2023-10-06T04:44:51.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.769+0000 7f0ef1b18700 1 -- 172.21.15.17:0/4187769058 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eec0cf600 con 0x7f0eec15d9e0 2023-10-06T04:44:51.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.770+0000 7f0ee37fe700 1 -- 172.21.15.17:0/4187769058 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0ee401b3b0 con 0x7f0eec15d9e0 2023-10-06T04:44:51.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.770+0000 7f0ee37fe700 1 --2- 172.21.15.17:0/4187769058 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0ecc066f30 0x7f0ecc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:51.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.770+0000 7f0ee37fe700 1 -- 172.21.15.17:0/4187769058 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f0ee4083710 con 0x7f0eec15d9e0 2023-10-06T04:44:51.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.770+0000 7f0eeb7fe700 1 --2- 172.21.15.17:0/4187769058 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0ecc066f30 0x7f0ecc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:51.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.771+0000 7f0eeb7fe700 1 --2- 172.21.15.17:0/4187769058 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0ecc066f30 0x7f0ecc0693e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0edc00f5b0 tx=0x7f0edc00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:51.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.774+0000 7f0ee37fe700 1 -- 172.21.15.17:0/4187769058 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0eec0cf600 con 0x7f0eec15d9e0 2023-10-06T04:44:51.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.966+0000 7f0ef1b18700 1 -- 172.21.15.17:0/4187769058 --> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f0eec0cf600 con 0x7f0ecc066f30 2023-10-06T04:44:51.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.966+0000 7f0ee37fe700 1 -- 172.21.15.17:0/4187769058 <== mgr.4104 v2:172.21.15.17:6832/90424 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0eec0cf600 con 0x7f0ecc066f30 2023-10-06T04:44:51.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.968+0000 7f0ef1b18700 1 -- 172.21.15.17:0/4187769058 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0ecc066f30 msgr2=0x7f0ecc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:51.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.968+0000 7f0ef1b18700 1 --2- 172.21.15.17:0/4187769058 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0ecc066f30 0x7f0ecc0693e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0edc00f5b0 tx=0x7f0edc00b040 comp rx=0 tx=0).stop 2023-10-06T04:44:51.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.968+0000 7f0ef1b18700 1 -- 172.21.15.17:0/4187769058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0eec15d9e0 msgr2=0x7f0eec0c4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:51.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.968+0000 7f0ef1b18700 1 --2- 172.21.15.17:0/4187769058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0eec15d9e0 0x7f0eec0c4e30 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f0ee400c530 tx=0x7f0ee4007f90 comp rx=0 tx=0).stop 2023-10-06T04:44:51.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.968+0000 7f0ef1b18700 1 -- 172.21.15.17:0/4187769058 shutdown_connections 2023-10-06T04:44:51.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.968+0000 7f0ef1b18700 1 --2- 172.21.15.17:0/4187769058 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0ecc066f30 0x7f0ecc0693e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.968+0000 7f0ef1b18700 1 --2- 172.21.15.17:0/4187769058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0eec15d9e0 0x7f0eec0c4e30 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.968+0000 7f0ef1b18700 1 --2- 172.21.15.17:0/4187769058 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0eec0cb1b0 0x7f0eec16a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.968+0000 7f0ef1b18700 1 --2- 172.21.15.17:0/4187769058 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0eec15d610 0x7f0eec16d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:51.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.968+0000 7f0ef1b18700 1 -- 172.21.15.17:0/4187769058 >> 172.21.15.17:0/4187769058 conn(0x7f0eec099960 msgr2=0x7f0eec06e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:51.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.968+0000 7f0ef1b18700 1 -- 172.21.15.17:0/4187769058 shutdown_connections 2023-10-06T04:44:51.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:51.968+0000 7f0ef1b18700 1 -- 172.21.15.17:0/4187769058 wait complete. 2023-10-06T04:44:51.973 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 7 to deep-scrub 2023-10-06T04:44:51.982 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:44:52.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.098+0000 7f988837c700 1 Processor -- start 2023-10-06T04:44:52.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.098+0000 7f988837c700 1 -- start start 2023-10-06T04:44:52.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.099+0000 7f988837c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9880159630 0x7f98800cd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:52.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.099+0000 7f988837c700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f98800cd590 0x7f98800ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:52.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.099+0000 7f988837c700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f98800ce840 0x7f988015d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:52.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.099+0000 7f988837c700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98800cda00 con 0x7f98800ce840 2023-10-06T04:44:52.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.099+0000 7f988837c700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98800cfc80 con 0x7f98800cd590 2023-10-06T04:44:52.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.099+0000 7f988837c700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98800cf070 con 0x7f9880159630 2023-10-06T04:44:52.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.100+0000 7f9886919700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f98800ce840 0x7f988015d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:52.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.100+0000 7f9886919700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f98800ce840 0x7f988015d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38786/0 (socket says 172.21.15.17:38786) 2023-10-06T04:44:52.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.100+0000 7f9886919700 1 -- 172.21.15.17:0/985156878 learned_addr learned my addr 172.21.15.17:0/985156878 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:52.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.100+0000 7f9885917700 1 --2- 172.21.15.17:0/985156878 >> v2:172.21.15.136:3300/0 conn(0x7f98800cd590 0x7f98800ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:52.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.100+0000 7f9886118700 1 --2- 172.21.15.17:0/985156878 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9880159630 0x7f98800cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:52.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.100+0000 7f9886919700 1 -- 172.21.15.17:0/985156878 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9880159630 msgr2=0x7f98800cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:52.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.100+0000 7f9886919700 1 --2- 172.21.15.17:0/985156878 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9880159630 0x7f98800cd050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:52.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.100+0000 7f9886919700 1 -- 172.21.15.17:0/985156878 >> v2:172.21.15.136:3300/0 conn(0x7f98800cd590 msgr2=0x7f98800ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:44:52.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.100+0000 7f9886919700 1 --2- 172.21.15.17:0/985156878 >> v2:172.21.15.136:3300/0 conn(0x7f98800cd590 0x7f98800ce300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:52.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.100+0000 7f9886919700 1 -- 172.21.15.17:0/985156878 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98800cf350 con 0x7f98800ce840 2023-10-06T04:44:52.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.100+0000 7f9886919700 1 --2- 172.21.15.17:0/985156878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98800ce840 0x7f988015d2d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f98800d1760 tx=0x7f9870009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23f5c8e3aad92472 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:52.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.100+0000 7f9885116700 1 -- 172.21.15.17:0/985156878 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987000e070 con 0x7f98800ce840 2023-10-06T04:44:52.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.100+0000 7f9885116700 1 -- 172.21.15.17:0/985156878 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f987000ba50 con 0x7f98800ce840 2023-10-06T04:44:52.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.100+0000 7f9885116700 1 -- 172.21.15.17:0/985156878 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98700092e0 con 0x7f98800ce840 2023-10-06T04:44:52.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.101+0000 7f988837c700 1 -- 172.21.15.17:0/985156878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98800ce840 msgr2=0x7f988015d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:52.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.101+0000 7f988837c700 1 --2- 172.21.15.17:0/985156878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98800ce840 0x7f988015d2d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f98800d1760 tx=0x7f9870009840 comp rx=0 tx=0).stop 2023-10-06T04:44:52.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.101+0000 7f988837c700 1 -- 172.21.15.17:0/985156878 shutdown_connections 2023-10-06T04:44:52.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.101+0000 7f988837c700 1 --2- 172.21.15.17:0/985156878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98800ce840 0x7f988015d2d0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:52.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.101+0000 7f988837c700 1 --2- 172.21.15.17:0/985156878 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9880159630 0x7f98800cd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:52.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.101+0000 7f988837c700 1 --2- 172.21.15.17:0/985156878 >> v2:172.21.15.136:3300/0 conn(0x7f98800cd590 0x7f98800ce300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:52.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.101+0000 7f988837c700 1 -- 172.21.15.17:0/985156878 >> 172.21.15.17:0/985156878 conn(0x7f988006cff0 msgr2=0x7f988006d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:52.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.101+0000 7f988837c700 1 -- 172.21.15.17:0/985156878 shutdown_connections 2023-10-06T04:44:52.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.101+0000 7f988837c700 1 -- 172.21.15.17:0/985156878 wait complete. 2023-10-06T04:44:52.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.102+0000 7f988837c700 1 Processor -- start 2023-10-06T04:44:52.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.102+0000 7f988837c700 1 -- start start 2023-10-06T04:44:52.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.103+0000 7f988837c700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f98800cd590 0x7f98800b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:52.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.103+0000 7f988837c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98800ce840 0x7f9880156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:52.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.103+0000 7f988837c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9880159630 0x7f98800b4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:52.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.103+0000 7f988837c700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98800b40a0 con 0x7f98800ce840 2023-10-06T04:44:52.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.103+0000 7f988837c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98800b3490 con 0x7f9880159630 2023-10-06T04:44:52.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.103+0000 7f988837c700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98800b3770 con 0x7f98800cd590 2023-10-06T04:44:52.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.103+0000 7f9885917700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98800ce840 0x7f9880156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:52.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.103+0000 7f9885917700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98800ce840 0x7f9880156740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38798/0 (socket says 172.21.15.17:38798) 2023-10-06T04:44:52.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.103+0000 7f9885917700 1 -- 172.21.15.17:0/2554489181 learned_addr learned my addr 172.21.15.17:0/2554489181 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:44:52.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.103+0000 7f9886118700 1 --2- 172.21.15.17:0/2554489181 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f98800cd590 0x7f98800b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:52.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.103+0000 7f9886919700 1 --2- 172.21.15.17:0/2554489181 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9880159630 0x7f98800b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:52.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.103+0000 7f9885917700 1 -- 172.21.15.17:0/2554489181 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f98800cd590 msgr2=0x7f98800b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:52.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.103+0000 7f9885917700 1 --2- 172.21.15.17:0/2554489181 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f98800cd590 0x7f98800b5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:52.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.103+0000 7f9885917700 1 -- 172.21.15.17:0/2554489181 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9880159630 msgr2=0x7f98800b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:52.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.103+0000 7f9885917700 1 --2- 172.21.15.17:0/2554489181 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9880159630 0x7f98800b4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:52.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.103+0000 7f9885917700 1 -- 172.21.15.17:0/2554489181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9870009ae0 con 0x7f98800ce840 2023-10-06T04:44:52.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.103+0000 7f9885917700 1 --2- 172.21.15.17:0/2554489181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98800ce840 0x7f9880156740 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f987400d890 tx=0x7f9874008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:52.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.103+0000 7f987e7fc700 1 -- 172.21.15.17:0/2554489181 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98740125f0 con 0x7f98800ce840 2023-10-06T04:44:52.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.103+0000 7f987e7fc700 1 -- 172.21.15.17:0/2554489181 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9874012770 con 0x7f98800ce840 2023-10-06T04:44:52.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.103+0000 7f988837c700 1 -- 172.21.15.17:0/2554489181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98800b3a50 con 0x7f98800ce840 2023-10-06T04:44:52.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.103+0000 7f987e7fc700 1 -- 172.21.15.17:0/2554489181 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9874012b30 con 0x7f98800ce840 2023-10-06T04:44:52.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.104+0000 7f988837c700 1 -- 172.21.15.17:0/2554489181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98801496d0 con 0x7f98800ce840 2023-10-06T04:44:52.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.104+0000 7f988837c700 1 -- 172.21.15.17:0/2554489181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9880063ff0 con 0x7f98800ce840 2023-10-06T04:44:52.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.105+0000 7f987e7fc700 1 -- 172.21.15.17:0/2554489181 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f987401e460 con 0x7f98800ce840 2023-10-06T04:44:52.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.105+0000 7f987e7fc700 1 --2- 172.21.15.17:0/2554489181 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f986c066f30 0x7f986c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:44:52.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.105+0000 7f987e7fc700 1 -- 172.21.15.17:0/2554489181 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f9874084b50 con 0x7f98800ce840 2023-10-06T04:44:52.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.105+0000 7f9886118700 1 --2- 172.21.15.17:0/2554489181 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f986c066f30 0x7f986c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:44:52.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.106+0000 7f9886118700 1 --2- 172.21.15.17:0/2554489181 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f986c066f30 0x7f986c0693e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9878006fd0 tx=0x7f9878008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:44:52.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.109+0000 7f987e7fc700 1 -- 172.21.15.17:0/2554489181 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9874051ec0 con 0x7f98800ce840 2023-10-06T04:44:52.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.297+0000 7f988837c700 1 -- 172.21.15.17:0/2554489181 --> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f98800b41e0 con 0x7f986c066f30 2023-10-06T04:44:52.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.300+0000 7f987e7fc700 1 -- 172.21.15.17:0/2554489181 <== mgr.4104 v2:172.21.15.17:6832/90424 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72979 (secure 0 0 0) 0x7f98800b41e0 con 0x7f986c066f30 2023-10-06T04:44:52.303 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:44:52.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.302+0000 7f988837c700 1 -- 172.21.15.17:0/2554489181 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f986c066f30 msgr2=0x7f986c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:52.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.302+0000 7f988837c700 1 --2- 172.21.15.17:0/2554489181 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f986c066f30 0x7f986c0693e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9878006fd0 tx=0x7f9878008040 comp rx=0 tx=0).stop 2023-10-06T04:44:52.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.302+0000 7f988837c700 1 -- 172.21.15.17:0/2554489181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98800ce840 msgr2=0x7f9880156740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:44:52.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.302+0000 7f988837c700 1 --2- 172.21.15.17:0/2554489181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98800ce840 0x7f9880156740 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f987400d890 tx=0x7f9874008040 comp rx=0 tx=0).stop 2023-10-06T04:44:52.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.302+0000 7f988837c700 1 -- 172.21.15.17:0/2554489181 shutdown_connections 2023-10-06T04:44:52.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.302+0000 7f988837c700 1 --2- 172.21.15.17:0/2554489181 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f986c066f30 0x7f986c0693e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:52.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.302+0000 7f988837c700 1 --2- 172.21.15.17:0/2554489181 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9880159630 0x7f98800b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:52.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.302+0000 7f988837c700 1 --2- 172.21.15.17:0/2554489181 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f98800cd590 0x7f98800b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:52.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.302+0000 7f988837c700 1 --2- 172.21.15.17:0/2554489181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98800ce840 0x7f9880156740 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:44:52.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.302+0000 7f988837c700 1 -- 172.21.15.17:0/2554489181 >> 172.21.15.17:0/2554489181 conn(0x7f988006cff0 msgr2=0x7f9880154f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:44:52.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.302+0000 7f988837c700 1 -- 172.21.15.17:0/2554489181 shutdown_connections 2023-10-06T04:44:52.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:44:52.302+0000 7f988837c700 1 -- 172.21.15.17:0/2554489181 wait complete. 2023-10-06T04:44:52.311 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-06T04:44:52.316 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2023-10-06T04:44:50.351294+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2391240,"kb_used_data":4744,"kb_used_omap":0,"kb_used_meta":2386432,"kb_avail":752583480,"statfs":{"total":773094113280,"available":770645483520,"internally_reserved":0,"allocated":4857856,"data_stored":2721840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2443706368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":-4,"num_read_kb":-4,"num_write":-6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.890362"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T04:44:42.073653+0000","last_change":"2023-10-06T04:43:24.001927+0000","last_active":"2023-10-06T04:44:42.073653+0000","last_peered":"2023-10-06T04:44:42.073653+0000","last_clean":"2023-10-06T04:44:42.073653+0000","last_became_active":"2023-10-06T04:43:24.001591+0000","last_became_peered":"2023-10-06T04:43:24.001591+0000","last_unstale":"2023-10-06T04:44:42.073653+0000","last_undegraded":"2023-10-06T04:44:42.073653+0000","last_fullsized":"2023-10-06T04:44:42.073653+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:47.262845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:44:40.557451+0000","last_change":"2023-10-06T04:43:23.708597+0000","last_active":"2023-10-06T04:44:40.557451+0000","last_peered":"2023-10-06T04:44:40.557451+0000","last_clean":"2023-10-06T04:44:40.557451+0000","last_became_active":"2023-10-06T04:43:23.708317+0000","last_became_peered":"2023-10-06T04:43:23.708317+0000","last_unstale":"2023-10-06T04:44:40.557451+0000","last_undegraded":"2023-10-06T04:44:40.557451+0000","last_fullsized":"2023-10-06T04:44:40.557451+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:56.213068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:44:40.557924+0000","last_change":"2023-10-06T04:43:23.708753+0000","last_active":"2023-10-06T04:44:40.557924+0000","last_peered":"2023-10-06T04:44:40.557924+0000","last_clean":"2023-10-06T04:44:40.557924+0000","last_became_active":"2023-10-06T04:43:23.708483+0000","last_became_peered":"2023-10-06T04:43:23.708483+0000","last_unstale":"2023-10-06T04:44:40.557924+0000","last_undegraded":"2023-10-06T04:44:40.557924+0000","last_fullsized":"2023-10-06T04:44:40.557924+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:47.262845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":181,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T04:44:41.465376+0000","last_change":"2023-10-06T04:43:23.706116+0000","last_active":"2023-10-06T04:44:41.465376+0000","last_peered":"2023-10-06T04:44:41.465376+0000","last_clean":"2023-10-06T04:44:41.465376+0000","last_became_active":"2023-10-06T04:43:23.705090+0000","last_became_peered":"2023-10-06T04:43:23.705090+0000","last_unstale":"2023-10-06T04:44:41.465376+0000","last_undegraded":"2023-10-06T04:44:41.465376+0000","last_fullsized":"2023-10-06T04:44:41.465376+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:29.869173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":31,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T04:44:41.466946+0000","last_change":"2023-10-06T04:43:24.002162+0000","last_active":"2023-10-06T04:44:41.466946+0000","last_peered":"2023-10-06T04:44:41.466946+0000","last_clean":"2023-10-06T04:44:41.466946+0000","last_became_active":"2023-10-06T04:43:24.001883+0000","last_became_peered":"2023-10-06T04:43:24.001883+0000","last_unstale":"2023-10-06T04:44:41.466946+0000","last_undegraded":"2023-10-06T04:44:41.466946+0000","last_fullsized":"2023-10-06T04:44:41.466946+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:51:11.168258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":31,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T04:44:41.467149+0000","last_change":"2023-10-06T04:43:24.002057+0000","last_active":"2023-10-06T04:44:41.467149+0000","last_peered":"2023-10-06T04:44:41.467149+0000","last_clean":"2023-10-06T04:44:41.467149+0000","last_became_active":"2023-10-06T04:43:24.001809+0000","last_became_peered":"2023-10-06T04:43:24.001809+0000","last_unstale":"2023-10-06T04:44:41.467149+0000","last_undegraded":"2023-10-06T04:44:41.467149+0000","last_fullsized":"2023-10-06T04:44:41.467149+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:49.693980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T04:44:41.469408+0000","last_change":"2023-10-06T04:43:24.002394+0000","last_active":"2023-10-06T04:44:41.469408+0000","last_peered":"2023-10-06T04:44:41.469408+0000","last_clean":"2023-10-06T04:44:41.469408+0000","last_became_active":"2023-10-06T04:43:24.001915+0000","last_became_peered":"2023-10-06T04:43:24.001915+0000","last_unstale":"2023-10-06T04:44:41.469408+0000","last_undegraded":"2023-10-06T04:44:41.469408+0000","last_fullsized":"2023-10-06T04:44:41.469408+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:45.031820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:44:40.558608+0000","last_change":"2023-10-06T04:43:24.002424+0000","last_active":"2023-10-06T04:44:40.558608+0000","last_peered":"2023-10-06T04:44:40.558608+0000","last_clean":"2023-10-06T04:44:40.558608+0000","last_became_active":"2023-10-06T04:43:24.002147+0000","last_became_peered":"2023-10-06T04:43:24.002147+0000","last_unstale":"2023-10-06T04:44:40.558608+0000","last_undegraded":"2023-10-06T04:44:40.558608+0000","last_fullsized":"2023-10-06T04:44:40.558608+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:45.031820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T04:44:40.558932+0000","last_change":"2023-10-06T04:43:23.707408+0000","last_active":"2023-10-06T04:44:40.558932+0000","last_peered":"2023-10-06T04:44:40.558932+0000","last_clean":"2023-10-06T04:44:40.558932+0000","last_became_active":"2023-10-06T04:43:23.707115+0000","last_became_peered":"2023-10-06T04:43:23.707115+0000","last_unstale":"2023-10-06T04:44:40.558932+0000","last_undegraded":"2023-10-06T04:44:40.558932+0000","last_fullsized":"2023-10-06T04:44:40.558932+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:43:22.693369+0000","last_clean_scrub_stamp":"2023-10-06T04:43:22.693369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:32:56.213068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298316,"kb_used_data":1028,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073524,"statfs":{"total":96636764160,"available":96331288576,"internally_reserved":0,"allocated":1052672,"data_stored":783006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.47099999999999997}]},{"osd":1,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.64300000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":7.9580000000000002,"5min":7.9580000000000002,"15min":7.9580000000000002},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":8.0519999999999996,"5min":8.0519999999999996,"15min":8.0519999999999996},"last":0.501}]},{"osd":3,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.622}]},{"osd":4,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.71699999999999997}]},{"osd":5,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.70399999999999996}]},{"osd":6,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.753}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297736,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074104,"statfs":{"total":96636764160,"available":96331882496,"internally_reserved":0,"allocated":458752,"data_stored":192638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.81200000000000006}]},{"osd":1,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.47299999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.50800000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.68600000000000005}]},{"osd":4,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.67200000000000004}]},{"osd":5,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.65500000000000003}]},{"osd":7,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.45000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302412,"kb_used_data":1028,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069428,"statfs":{"total":96636764160,"available":96327094272,"internally_reserved":0,"allocated":1052672,"data_stored":783006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.32300000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.27400000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.36699999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.55400000000000005}]},{"osd":5,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.56200000000000006}]},{"osd":6,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.66100000000000003}]},{"osd":7,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.57099999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297736,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074104,"statfs":{"total":96636764160,"available":96331882496,"internally_reserved":0,"allocated":458752,"data_stored":192638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.307,"15min":0.307},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":0.30199999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":2.8900000000000001,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":0.36099999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":4.3120000000000003,"5min":4.3120000000000003,"15min":4.3120000000000003},"last":0.375},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":4.1980000000000004,"5min":4.1980000000000004,"15min":4.1980000000000004},"last":0.47599999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.8220000000000001,"5min":2.8220000000000001,"15min":2.8220000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.51200000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.57599999999999996}]},{"osd":6,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":2.7850000000000001,"5min":2.7850000000000001,"15min":2.7850000000000001},"last":0.45700000000000002}]},{"osd":7,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":2.8570000000000002,"5min":2.8570000000000002,"15min":2.8570000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.623}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301832,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070008,"statfs":{"total":96636764160,"available":96327688192,"internally_reserved":0,"allocated":458752,"data_stored":192638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.35299999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":6.1280000000000001,"5min":6.1280000000000001,"15min":6.1280000000000001},"last":0.29699999999999999},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":19.983000000000001,"5min":19.983000000000001,"15min":19.983000000000001},"last":0.45200000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.41499999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.81299999999999994}]},{"osd":5,"last update":"Fri Oct 6 04:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.73199999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":6.0499999999999998,"5min":6.0499999999999998,"15min":6.0499999999999998},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.88}]},{"osd":7,"last update":"Fri Oct 6 04:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":6.0949999999999998,"5min":6.0949999999999998,"15min":6.0949999999999998},"last":0.70499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297736,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074104,"statfs":{"total":96636764160,"available":96331882496,"internally_reserved":0,"allocated":458752,"data_stored":192638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":11.978,"5min":11.978,"15min":11.978},"last":0.41999999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":12.920999999999999,"5min":12.920999999999999,"15min":12.920999999999999},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.45100000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.496},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.63500000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":0.38100000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.67400000000000004}]},{"osd":6,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":0.437}]},{"osd":7,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.754}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297736,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074104,"statfs":{"total":96636764160,"available":96331882496,"internally_reserved":0,"allocated":458752,"data_stored":192638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.51500000000000001}]},{"osd":1,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.439}]},{"osd":2,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.59099999999999997}]},{"osd":3,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.501}]},{"osd":5,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.49299999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.47899999999999998}]},{"osd":7,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.53800000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297736,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074104,"statfs":{"total":96636764160,"available":96331882496,"internally_reserved":0,"allocated":458752,"data_stored":192638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.55700000000000005}]},{"osd":1,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.54100000000000004}]},{"osd":2,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.495},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.51600000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.52900000000000003}]},{"osd":4,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.34499999999999997}]},{"osd":6,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.48399999999999999}]},{"osd":7,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.44500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:44:52.323 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2023-10-06T04:43:22.693369+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=43, tm_sec=22, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=44, tm_sec=46, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:44:52.323 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2023-10-06T04:43:22.693369+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=43, tm_sec=22, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=44, tm_sec=46, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:44:52.323 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2023-10-06T04:43:22.693369+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=43, tm_sec=22, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=44, tm_sec=46, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:44:52.324 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-06T04:43:22.693369+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=43, tm_sec=22, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=44, tm_sec=46, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:44:52.324 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2023-10-06T04:43:22.693369+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=43, tm_sec=22, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=44, tm_sec=46, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:44:52.324 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-06T04:43:22.693369+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=43, tm_sec=22, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=44, tm_sec=46, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:44:52.324 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2023-10-06T04:43:22.693369+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=43, tm_sec=22, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=44, tm_sec=46, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:44:52.325 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2023-10-06T04:43:22.693369+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=43, tm_sec=22, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=44, tm_sec=46, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:44:52.325 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2023-10-06T04:43:22.693369+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=43, tm_sec=22, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=44, tm_sec=46, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:44:52.325 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-06T04:44:59.804 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:44:59.807 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:45:12.327 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:45:12.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.459+0000 7f988d20e700 1 Processor -- start 2023-10-06T04:45:12.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.459+0000 7f988d20e700 1 -- start start 2023-10-06T04:45:12.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.460+0000 7f988d20e700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f98880c9e10 0x7f98880ca290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:12.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.460+0000 7f988d20e700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f98880af000 0x7f98880af3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:12.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.460+0000 7f988d20e700 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98880af930 con 0x7f988813fb70 2023-10-06T04:45:12.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.460+0000 7f988d20e700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98880ca8d0 con 0x7f98880c9e10 2023-10-06T04:45:12.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.460+0000 7f988d20e700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98880cabb0 con 0x7f98880af000 2023-10-06T04:45:12.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.460+0000 7f988659c700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f98880c9e10 0x7f98880ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:12.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.460+0000 7f988659c700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f98880c9e10 0x7f98880ca290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53158/0 (socket says 172.21.15.17:53158) 2023-10-06T04:45:12.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.460+0000 7f988659c700 1 -- 172.21.15.17:0/2782537391 learned_addr learned my addr 172.21.15.17:0/2782537391 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:45:12.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.460+0000 7f988759e700 1 --2- 172.21.15.17:0/2782537391 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f98880af000 0x7f98880af3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:12.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.460+0000 7f988659c700 1 -- 172.21.15.17:0/2782537391 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f98880af000 msgr2=0x7f98880af3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:12.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.460+0000 7f988659c700 1 --2- 172.21.15.17:0/2782537391 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f98880af000 0x7f98880af3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:12.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.460+0000 7f988659c700 1 -- 172.21.15.17:0/2782537391 >> v1:172.21.15.136:6789/0 conn(0x7f988813fb70 legacy=0x7f988806b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:12.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.460+0000 7f988659c700 1 -- 172.21.15.17:0/2782537391 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f988806ad00 con 0x7f98880c9e10 2023-10-06T04:45:12.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.460+0000 7f988759e700 1 --2- 172.21.15.17:0/2782537391 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f98880af000 0x7f98880af3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:45:12.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.460+0000 7f988659c700 1 --2- 172.21.15.17:0/2782537391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98880c9e10 0x7f98880ca290 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f98700099b0 tx=0x7f9870009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=923f8f604cc034f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:12.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.460+0000 7f9885d9b700 1 -- 172.21.15.17:0/2782537391 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987000b820 con 0x7f98880c9e10 2023-10-06T04:45:12.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.460+0000 7f9885d9b700 1 -- 172.21.15.17:0/2782537391 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f987000b980 con 0x7f98880c9e10 2023-10-06T04:45:12.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.460+0000 7f9885d9b700 1 -- 172.21.15.17:0/2782537391 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987000bd20 con 0x7f98880c9e10 2023-10-06T04:45:12.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.461+0000 7f988d20e700 1 -- 172.21.15.17:0/2782537391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98880c9e10 msgr2=0x7f98880ca290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:12.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.461+0000 7f988d20e700 1 --2- 172.21.15.17:0/2782537391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98880c9e10 0x7f98880ca290 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f98700099b0 tx=0x7f9870009250 comp rx=0 tx=0).stop 2023-10-06T04:45:12.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.461+0000 7f988d20e700 1 -- 172.21.15.17:0/2782537391 shutdown_connections 2023-10-06T04:45:12.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.461+0000 7f988d20e700 1 --2- 172.21.15.17:0/2782537391 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f98880af000 0x7f98880af3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:12.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.461+0000 7f988d20e700 1 --2- 172.21.15.17:0/2782537391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98880c9e10 0x7f98880ca290 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:12.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.461+0000 7f988d20e700 1 -- 172.21.15.17:0/2782537391 >> 172.21.15.17:0/2782537391 conn(0x7f98880675f0 msgr2=0x7f98880679f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:12.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.461+0000 7f988d20e700 1 -- 172.21.15.17:0/2782537391 shutdown_connections 2023-10-06T04:45:12.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.461+0000 7f988d20e700 1 -- 172.21.15.17:0/2782537391 wait complete. 2023-10-06T04:45:12.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.462+0000 7f988d20e700 1 Processor -- start 2023-10-06T04:45:12.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.462+0000 7f988d20e700 1 -- start start 2023-10-06T04:45:12.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.463+0000 7f988d20e700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f98880af000 0x7f9888165940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:12.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.463+0000 7f988d20e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98880c9e10 0x7f9888157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:12.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.463+0000 7f988d20e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f988813fb70 0x7f98881581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:12.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.463+0000 7f988d20e700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98880c4c70 con 0x7f98880c9e10 2023-10-06T04:45:12.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.463+0000 7f988d20e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9888156e10 con 0x7f988813fb70 2023-10-06T04:45:12.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.463+0000 7f988d20e700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98880c4060 con 0x7f98880af000 2023-10-06T04:45:12.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.463+0000 7f988659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98880c9e10 0x7f9888157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:12.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.463+0000 7f988659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98880c9e10 0x7f9888157c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53174/0 (socket says 172.21.15.17:53174) 2023-10-06T04:45:12.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.463+0000 7f988659c700 1 -- 172.21.15.17:0/1672929037 learned_addr learned my addr 172.21.15.17:0/1672929037 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:45:12.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.463+0000 7f9886d9d700 1 --2- 172.21.15.17:0/1672929037 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f98880af000 0x7f9888165940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:12.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.463+0000 7f988759e700 1 --2- 172.21.15.17:0/1672929037 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f988813fb70 0x7f98881581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:12.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.463+0000 7f988659c700 1 -- 172.21.15.17:0/1672929037 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f98880af000 msgr2=0x7f9888165940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:12.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.463+0000 7f988659c700 1 --2- 172.21.15.17:0/1672929037 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f98880af000 0x7f9888165940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:12.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.463+0000 7f988659c700 1 -- 172.21.15.17:0/1672929037 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f988813fb70 msgr2=0x7f98881581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:12.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.463+0000 7f988659c700 1 --2- 172.21.15.17:0/1672929037 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f988813fb70 0x7f98881581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:12.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.464+0000 7f988659c700 1 -- 172.21.15.17:0/1672929037 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98700094f0 con 0x7f98880c9e10 2023-10-06T04:45:12.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.464+0000 7f988659c700 1 --2- 172.21.15.17:0/1672929037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98880c9e10 0x7f9888157c70 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f9870009290 tx=0x7f9870016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:12.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.464+0000 7f987effd700 1 -- 172.21.15.17:0/1672929037 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9870020070 con 0x7f98880c9e10 2023-10-06T04:45:12.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.464+0000 7f987effd700 1 -- 172.21.15.17:0/1672929037 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9870011e20 con 0x7f98880c9e10 2023-10-06T04:45:12.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.464+0000 7f988d20e700 1 -- 172.21.15.17:0/1672929037 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98880c4340 con 0x7f98880c9e10 2023-10-06T04:45:12.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.464+0000 7f987effd700 1 -- 172.21.15.17:0/1672929037 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987001a790 con 0x7f98880c9e10 2023-10-06T04:45:12.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.464+0000 7f988d20e700 1 -- 172.21.15.17:0/1672929037 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98880c4900 con 0x7f98880c9e10 2023-10-06T04:45:12.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.465+0000 7f988d20e700 1 -- 172.21.15.17:0/1672929037 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9888063ff0 con 0x7f98880c9e10 2023-10-06T04:45:12.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.465+0000 7f987effd700 1 -- 172.21.15.17:0/1672929037 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f987001abc0 con 0x7f98880c9e10 2023-10-06T04:45:12.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.466+0000 7f987effd700 1 --2- 172.21.15.17:0/1672929037 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9868066f30 0x7f98680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:12.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.466+0000 7f987effd700 1 -- 172.21.15.17:0/1672929037 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f9870087840 con 0x7f98880c9e10 2023-10-06T04:45:12.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.466+0000 7f9886d9d700 1 --2- 172.21.15.17:0/1672929037 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9868066f30 0x7f98680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:12.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.466+0000 7f9886d9d700 1 --2- 172.21.15.17:0/1672929037 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9868066f30 0x7f98680693e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9878009af0 tx=0x7f9878009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:12.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.470+0000 7f987effd700 1 -- 172.21.15.17:0/1672929037 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9870054bb0 con 0x7f98880c9e10 2023-10-06T04:45:12.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.662+0000 7f988d20e700 1 -- 172.21.15.17:0/1672929037 --> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f98880c4db0 con 0x7f9868066f30 2023-10-06T04:45:12.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.664+0000 7f987effd700 1 -- 172.21.15.17:0/1672929037 <== mgr.4104 v2:172.21.15.17:6832/90424 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73070 (secure 0 0 0) 0x7f98880c4db0 con 0x7f9868066f30 2023-10-06T04:45:12.667 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:45:12.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.667+0000 7f988d20e700 1 -- 172.21.15.17:0/1672929037 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9868066f30 msgr2=0x7f98680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:12.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.667+0000 7f988d20e700 1 --2- 172.21.15.17:0/1672929037 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9868066f30 0x7f98680693e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9878009af0 tx=0x7f9878009060 comp rx=0 tx=0).stop 2023-10-06T04:45:12.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.667+0000 7f988d20e700 1 -- 172.21.15.17:0/1672929037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98880c9e10 msgr2=0x7f9888157c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:12.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.667+0000 7f988d20e700 1 --2- 172.21.15.17:0/1672929037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98880c9e10 0x7f9888157c70 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f9870009290 tx=0x7f9870016000 comp rx=0 tx=0).stop 2023-10-06T04:45:12.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.667+0000 7f988d20e700 1 -- 172.21.15.17:0/1672929037 shutdown_connections 2023-10-06T04:45:12.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.667+0000 7f988d20e700 1 --2- 172.21.15.17:0/1672929037 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f9868066f30 0x7f98680693e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:12.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.667+0000 7f988d20e700 1 --2- 172.21.15.17:0/1672929037 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f988813fb70 0x7f98881581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:12.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.667+0000 7f988d20e700 1 --2- 172.21.15.17:0/1672929037 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f98880af000 0x7f9888165940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:12.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.667+0000 7f988d20e700 1 --2- 172.21.15.17:0/1672929037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98880c9e10 0x7f9888157c70 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:12.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.667+0000 7f988d20e700 1 -- 172.21.15.17:0/1672929037 >> 172.21.15.17:0/1672929037 conn(0x7f98880675f0 msgr2=0x7f98880c8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:12.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.667+0000 7f988d20e700 1 -- 172.21.15.17:0/1672929037 shutdown_connections 2023-10-06T04:45:12.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.667+0000 7f988d20e700 1 -- 172.21.15.17:0/1672929037 wait complete. 2023-10-06T04:45:12.670 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-06T04:45:12.680 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2023-10-06T04:45:12.355979+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2391240,"kb_used_data":4744,"kb_used_omap":0,"kb_used_meta":2386432,"kb_avail":752583480,"statfs":{"total":773094113280,"available":770645483520,"internally_reserved":0,"allocated":4857856,"data_stored":2721840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2443706368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002640"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:44:54.966920+0000","last_change":"2023-10-06T04:44:54.966890+0000","last_active":"2023-10-06T04:44:54.966920+0000","last_peered":"2023-10-06T04:44:54.966920+0000","last_clean":"2023-10-06T04:44:54.966920+0000","last_became_active":"2023-10-06T04:43:24.001591+0000","last_became_peered":"2023-10-06T04:43:24.001591+0000","last_unstale":"2023-10-06T04:44:54.966920+0000","last_undegraded":"2023-10-06T04:44:54.966920+0000","last_fullsized":"2023-10-06T04:44:54.966920+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:54.966771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:54.966771+0000","last_clean_scrub_stamp":"2023-10-06T04:44:54.966771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:38:12.325934+0000","scrub_duration":0.0023501609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:44:53.544136+0000","last_change":"2023-10-06T04:44:53.544106+0000","last_active":"2023-10-06T04:44:53.544136+0000","last_peered":"2023-10-06T04:44:53.544136+0000","last_clean":"2023-10-06T04:44:53.544136+0000","last_became_active":"2023-10-06T04:43:23.708317+0000","last_became_peered":"2023-10-06T04:43:23.708317+0000","last_unstale":"2023-10-06T04:44:53.544136+0000","last_undegraded":"2023-10-06T04:44:53.544136+0000","last_fullsized":"2023-10-06T04:44:53.544136+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:53.543992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:53.543992+0000","last_clean_scrub_stamp":"2023-10-06T04:44:53.543992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:38:10.903155+0000","scrub_duration":0.001970557,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:44:51.223137+0000","last_change":"2023-10-06T04:44:51.223099+0000","last_active":"2023-10-06T04:44:51.223137+0000","last_peered":"2023-10-06T04:44:51.223137+0000","last_clean":"2023-10-06T04:44:51.223137+0000","last_became_active":"2023-10-06T04:43:23.708483+0000","last_became_peered":"2023-10-06T04:43:23.708483+0000","last_unstale":"2023-10-06T04:44:51.223137+0000","last_undegraded":"2023-10-06T04:44:51.223137+0000","last_fullsized":"2023-10-06T04:44:51.223137+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:51.223006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:51.223006+0000","last_clean_scrub_stamp":"2023-10-06T04:44:51.223006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:00:47.073521+0000","scrub_duration":0.0019298570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"39'119","reported_seq":194,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:45:09.165729+0000","last_change":"2023-10-06T04:45:09.165680+0000","last_active":"2023-10-06T04:45:09.165729+0000","last_peered":"2023-10-06T04:45:09.165729+0000","last_clean":"2023-10-06T04:45:09.165729+0000","last_became_active":"2023-10-06T04:43:23.705090+0000","last_became_peered":"2023-10-06T04:43:23.705090+0000","last_unstale":"2023-10-06T04:45:09.165729+0000","last_undegraded":"2023-10-06T04:45:09.165729+0000","last_fullsized":"2023-10-06T04:45:09.165729+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'119","last_scrub_stamp":"2023-10-06T04:45:09.165560+0000","last_deep_scrub":"39'119","last_deep_scrub_stamp":"2023-10-06T04:45:09.165560+0000","last_clean_scrub_stamp":"2023-10-06T04:45:09.165560+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:40:34.667543+0000","scrub_duration":0.0048878050000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:44:52.316931+0000","last_change":"2023-10-06T04:44:52.316901+0000","last_active":"2023-10-06T04:44:52.316931+0000","last_peered":"2023-10-06T04:44:52.316931+0000","last_clean":"2023-10-06T04:44:52.316931+0000","last_became_active":"2023-10-06T04:43:24.001883+0000","last_became_peered":"2023-10-06T04:43:24.001883+0000","last_unstale":"2023-10-06T04:44:52.316931+0000","last_undegraded":"2023-10-06T04:44:52.316931+0000","last_fullsized":"2023-10-06T04:44:52.316931+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:52.316789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:52.316789+0000","last_clean_scrub_stamp":"2023-10-06T04:44:52.316789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:13:52.015283+0000","scrub_duration":0.001552941,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:44:57.232759+0000","last_change":"2023-10-06T04:44:57.232732+0000","last_active":"2023-10-06T04:44:57.232759+0000","last_peered":"2023-10-06T04:44:57.232759+0000","last_clean":"2023-10-06T04:44:57.232759+0000","last_became_active":"2023-10-06T04:43:24.001809+0000","last_became_peered":"2023-10-06T04:43:24.001809+0000","last_unstale":"2023-10-06T04:44:57.232759+0000","last_undegraded":"2023-10-06T04:44:57.232759+0000","last_fullsized":"2023-10-06T04:44:57.232759+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:57.232621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:57.232621+0000","last_clean_scrub_stamp":"2023-10-06T04:44:57.232621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:38:14.591784+0000","scrub_duration":0.0024371900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:44:52.167273+0000","last_change":"2023-10-06T04:44:52.167242+0000","last_active":"2023-10-06T04:44:52.167273+0000","last_peered":"2023-10-06T04:44:52.167273+0000","last_clean":"2023-10-06T04:44:52.167273+0000","last_became_active":"2023-10-06T04:43:24.001915+0000","last_became_peered":"2023-10-06T04:43:24.001915+0000","last_unstale":"2023-10-06T04:44:52.167273+0000","last_undegraded":"2023-10-06T04:44:52.167273+0000","last_fullsized":"2023-10-06T04:44:52.167273+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:52.167110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:52.167110+0000","last_clean_scrub_stamp":"2023-10-06T04:44:52.167110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:13:51.865604+0000","scrub_duration":0.0016779480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:44:52.664234+0000","last_change":"2023-10-06T04:44:52.664204+0000","last_active":"2023-10-06T04:44:52.664234+0000","last_peered":"2023-10-06T04:44:52.664234+0000","last_clean":"2023-10-06T04:44:52.664234+0000","last_became_active":"2023-10-06T04:43:24.002147+0000","last_became_peered":"2023-10-06T04:43:24.002147+0000","last_unstale":"2023-10-06T04:44:52.664234+0000","last_undegraded":"2023-10-06T04:44:52.664234+0000","last_fullsized":"2023-10-06T04:44:52.664234+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:52.664095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:52.664095+0000","last_clean_scrub_stamp":"2023-10-06T04:44:52.664095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:00:48.514610+0000","scrub_duration":0.0020258920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:44:54.698327+0000","last_change":"2023-10-06T04:44:54.698299+0000","last_active":"2023-10-06T04:44:54.698327+0000","last_peered":"2023-10-06T04:44:54.698327+0000","last_clean":"2023-10-06T04:44:54.698327+0000","last_became_active":"2023-10-06T04:43:23.707115+0000","last_became_peered":"2023-10-06T04:43:23.707115+0000","last_unstale":"2023-10-06T04:44:54.698327+0000","last_undegraded":"2023-10-06T04:44:54.698327+0000","last_fullsized":"2023-10-06T04:44:54.698327+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:44:54.698166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:44:54.698166+0000","last_clean_scrub_stamp":"2023-10-06T04:44:54.698166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:55:12.638098+0000","scrub_duration":0.0021996979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298316,"kb_used_data":1028,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073524,"statfs":{"total":96636764160,"available":96331288576,"internally_reserved":0,"allocated":1052672,"data_stored":783006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.57299999999999995}]},{"osd":1,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.64700000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":7.9580000000000002,"5min":7.9580000000000002,"15min":7.9580000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":8.0519999999999996,"5min":8.0519999999999996,"15min":8.0519999999999996},"last":0.53100000000000003}]},{"osd":3,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.67200000000000004}]},{"osd":4,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.42899999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.504}]},{"osd":6,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.52200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297736,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074104,"statfs":{"total":96636764160,"available":96331882496,"internally_reserved":0,"allocated":458752,"data_stored":192638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.63500000000000001}]},{"osd":1,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.52100000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.622},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.67900000000000005}]},{"osd":3,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.49199999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.70899999999999996}]},{"osd":5,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.64700000000000002}]},{"osd":7,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.66200000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302412,"kb_used_data":1028,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069428,"statfs":{"total":96636764160,"available":96327094272,"internally_reserved":0,"allocated":1052672,"data_stored":783006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.42499999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.36499999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.38400000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.51500000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.63100000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.59299999999999997}]},{"osd":7,"last update":"Fri Oct 6 04:44:21 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.61299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297736,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074104,"statfs":{"total":96636764160,"available":96331882496,"internally_reserved":0,"allocated":458752,"data_stored":192638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.307,"15min":0.307},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.309},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":0.38600000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":2.8900000000000001,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":0.33000000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":4.3120000000000003,"5min":4.3120000000000003,"15min":4.3120000000000003},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":4.1980000000000004,"5min":4.1980000000000004,"15min":4.1980000000000004},"last":0.45800000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.8220000000000001,"5min":2.8220000000000001,"15min":2.8220000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.54400000000000004}]},{"osd":5,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.64500000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":2.7850000000000001,"5min":2.7850000000000001,"15min":2.7850000000000001},"last":0.53000000000000003}]},{"osd":7,"last update":"Fri Oct 6 04:44:24 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":2.8570000000000002,"5min":2.8570000000000002,"15min":2.8570000000000002},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.66300000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301832,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070008,"statfs":{"total":96636764160,"available":96327688192,"internally_reserved":0,"allocated":458752,"data_stored":192638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.33400000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":6.1280000000000001,"5min":6.1280000000000001,"15min":6.1280000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":19.983000000000001,"5min":19.983000000000001,"15min":19.983000000000001},"last":0.39200000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.373}]},{"osd":4,"last update":"Fri Oct 6 04:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.60299999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.55800000000000005}]},{"osd":6,"last update":"Fri Oct 6 04:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":6.0499999999999998,"5min":6.0499999999999998,"15min":6.0499999999999998},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.47299999999999998}]},{"osd":7,"last update":"Fri Oct 6 04:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":6.0949999999999998,"5min":6.0949999999999998,"15min":6.0949999999999998},"last":0.50700000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297736,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074104,"statfs":{"total":96636764160,"available":96331882496,"internally_reserved":0,"allocated":458752,"data_stored":192638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.313},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":11.978,"5min":11.978,"15min":11.978},"last":0.377}]},{"osd":1,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":12.920999999999999,"5min":12.920999999999999,"15min":12.920999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.39900000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.47399999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":0.52000000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.60299999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":0.54500000000000004}]},{"osd":7,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.52900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297736,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074104,"statfs":{"total":96636764160,"available":96331882496,"internally_reserved":0,"allocated":458752,"data_stored":192638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.59499999999999997}]},{"osd":1,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.56200000000000006}]},{"osd":2,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.55100000000000005}]},{"osd":3,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.60899999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.50900000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.44},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.46999999999999997}]},{"osd":7,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.49099999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297736,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074104,"statfs":{"total":96636764160,"available":96331882496,"internally_reserved":0,"allocated":458752,"data_stored":192638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.65800000000000003}]},{"osd":1,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.501},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.627}]},{"osd":2,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.64500000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.56200000000000006}]},{"osd":4,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.40100000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.45200000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.46899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:45:12.683 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-06T04:45:12.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.800+0000 7fac10a74700 1 Processor -- start 2023-10-06T04:45:12.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.800+0000 7fac10a74700 1 -- start start 2023-10-06T04:45:12.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.801+0000 7fac10a74700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac0c1572f0 0x7fac0c15a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:12.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.801+0000 7fac10a74700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fac0c156b30 0x7fac0c0b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:12.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.801+0000 7fac10a74700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fac0c0b0e00 0x7fac0c0b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:12.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.801+0000 7fac10a74700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac0c14da00 con 0x7fac0c156b30 2023-10-06T04:45:12.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.801+0000 7fac10a74700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac0c15af10 con 0x7fac0c0b0e00 2023-10-06T04:45:12.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.801+0000 7fac10a74700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c15a950 con 0x7fac0c1572f0 2023-10-06T04:45:12.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.801+0000 7fac0affd700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fac0c156b30 0x7fac0c0b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:12.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.801+0000 7fac0affd700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fac0c156b30 0x7fac0c0b08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53182/0 (socket says 172.21.15.17:53182) 2023-10-06T04:45:12.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.801+0000 7fac0affd700 1 -- 172.21.15.17:0/4058673438 learned_addr learned my addr 172.21.15.17:0/4058673438 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:45:12.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.801+0000 7fac0bfff700 1 --2- 172.21.15.17:0/4058673438 >> v2:172.21.15.136:3300/0 conn(0x7fac0c0b0e00 0x7fac0c0b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:12.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.801+0000 7fac0b7fe700 1 --2- 172.21.15.17:0/4058673438 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac0c1572f0 0x7fac0c15a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:12.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.801+0000 7fac0affd700 1 -- 172.21.15.17:0/4058673438 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac0c1572f0 msgr2=0x7fac0c15a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:12.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.801+0000 7fac0affd700 1 --2- 172.21.15.17:0/4058673438 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac0c1572f0 0x7fac0c15a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:12.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.801+0000 7fac0affd700 1 -- 172.21.15.17:0/4058673438 >> v2:172.21.15.136:3300/0 conn(0x7fac0c0b0e00 msgr2=0x7fac0c0b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:12.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.801+0000 7fac0affd700 1 --2- 172.21.15.17:0/4058673438 >> v2:172.21.15.136:3300/0 conn(0x7fac0c0b0e00 0x7fac0c0b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:12.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.801+0000 7fac0affd700 1 -- 172.21.15.17:0/4058673438 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac0c15ac30 con 0x7fac0c156b30 2023-10-06T04:45:12.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.802+0000 7fac0affd700 1 --2- 172.21.15.17:0/4058673438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac0c156b30 0x7fac0c0b08c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fac0c0acb60 tx=0x7fac00009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=972cd719250aa07c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:12.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.802+0000 7fac0a7fc700 1 -- 172.21.15.17:0/4058673438 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0000b860 con 0x7fac0c156b30 2023-10-06T04:45:12.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.802+0000 7fac0a7fc700 1 -- 172.21.15.17:0/4058673438 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0000b9c0 con 0x7fac0c156b30 2023-10-06T04:45:12.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.802+0000 7fac0a7fc700 1 -- 172.21.15.17:0/4058673438 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0000bd60 con 0x7fac0c156b30 2023-10-06T04:45:12.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.802+0000 7fac10a74700 1 -- 172.21.15.17:0/4058673438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac0c156b30 msgr2=0x7fac0c0b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:12.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.802+0000 7fac10a74700 1 --2- 172.21.15.17:0/4058673438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac0c156b30 0x7fac0c0b08c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fac0c0acb60 tx=0x7fac00009250 comp rx=0 tx=0).stop 2023-10-06T04:45:12.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.802+0000 7fac10a74700 1 -- 172.21.15.17:0/4058673438 shutdown_connections 2023-10-06T04:45:12.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.802+0000 7fac10a74700 1 --2- 172.21.15.17:0/4058673438 >> v2:172.21.15.136:3300/0 conn(0x7fac0c0b0e00 0x7fac0c0b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:12.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.802+0000 7fac10a74700 1 --2- 172.21.15.17:0/4058673438 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac0c1572f0 0x7fac0c15a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:12.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.802+0000 7fac10a74700 1 --2- 172.21.15.17:0/4058673438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac0c156b30 0x7fac0c0b08c0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:12.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.802+0000 7fac10a74700 1 -- 172.21.15.17:0/4058673438 >> 172.21.15.17:0/4058673438 conn(0x7fac0c06d670 msgr2=0x7fac0c06da70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:12.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.802+0000 7fac10a74700 1 -- 172.21.15.17:0/4058673438 shutdown_connections 2023-10-06T04:45:12.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.802+0000 7fac10a74700 1 -- 172.21.15.17:0/4058673438 wait complete. 2023-10-06T04:45:12.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.804+0000 7fac10a74700 1 Processor -- start 2023-10-06T04:45:12.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.804+0000 7fac10a74700 1 -- start start 2023-10-06T04:45:12.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.804+0000 7fac10a74700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac0c0b0e00 0x7fac0c144d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:12.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.804+0000 7fac10a74700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac0c156b30 0x7fac0c1486f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:12.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.804+0000 7fac10a74700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac0c1572f0 0x7fac0c155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:12.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.804+0000 7fac10a74700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c146a40 con 0x7fac0c156b30 2023-10-06T04:45:12.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.804+0000 7fac10a74700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c146c70 con 0x7fac0c1572f0 2023-10-06T04:45:12.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.804+0000 7fac10a74700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c146f10 con 0x7fac0c0b0e00 2023-10-06T04:45:12.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.804+0000 7fac0affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac0c156b30 0x7fac0c1486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:12.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.804+0000 7fac0affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac0c156b30 0x7fac0c1486f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53188/0 (socket says 172.21.15.17:53188) 2023-10-06T04:45:12.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.804+0000 7fac0affd700 1 -- 172.21.15.17:0/3730499821 learned_addr learned my addr 172.21.15.17:0/3730499821 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:45:12.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.805+0000 7fac0bfff700 1 --2- 172.21.15.17:0/3730499821 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac0c1572f0 0x7fac0c155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:12.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.805+0000 7fac0b7fe700 1 --2- 172.21.15.17:0/3730499821 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac0c0b0e00 0x7fac0c144d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:12.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.805+0000 7fac0affd700 1 -- 172.21.15.17:0/3730499821 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac0c0b0e00 msgr2=0x7fac0c144d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:12.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.805+0000 7fac0affd700 1 --2- 172.21.15.17:0/3730499821 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac0c0b0e00 0x7fac0c144d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:12.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.805+0000 7fac0affd700 1 -- 172.21.15.17:0/3730499821 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac0c1572f0 msgr2=0x7fac0c155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:12.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.805+0000 7fac0affd700 1 --2- 172.21.15.17:0/3730499821 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac0c1572f0 0x7fac0c155450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:12.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.805+0000 7fac0affd700 1 -- 172.21.15.17:0/3730499821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac000094f0 con 0x7fac0c156b30 2023-10-06T04:45:12.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.805+0000 7fac0b7fe700 1 --2- 172.21.15.17:0/3730499821 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac0c0b0e00 0x7fac0c144d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:12.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.805+0000 7fac0affd700 1 --2- 172.21.15.17:0/3730499821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac0c156b30 0x7fac0c1486f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fac0c06f2c0 tx=0x7fac00017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:12.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.805+0000 7fabf37fe700 1 -- 172.21.15.17:0/3730499821 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac00011e70 con 0x7fac0c156b30 2023-10-06T04:45:12.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.805+0000 7fabf37fe700 1 -- 172.21.15.17:0/3730499821 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac00024440 con 0x7fac0c156b30 2023-10-06T04:45:12.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.805+0000 7fac10a74700 1 -- 172.21.15.17:0/3730499821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac0c1471f0 con 0x7fac0c156b30 2023-10-06T04:45:12.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.805+0000 7fabf37fe700 1 -- 172.21.15.17:0/3730499821 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac00024800 con 0x7fac0c156b30 2023-10-06T04:45:12.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.805+0000 7fac10a74700 1 -- 172.21.15.17:0/3730499821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac0c147830 con 0x7fac0c156b30 2023-10-06T04:45:12.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.806+0000 7fac10a74700 1 -- 172.21.15.17:0/3730499821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac0c1479c0 con 0x7fac0c156b30 2023-10-06T04:45:12.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.807+0000 7fabf37fe700 1 -- 172.21.15.17:0/3730499821 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fac0001a420 con 0x7fac0c156b30 2023-10-06T04:45:12.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.807+0000 7fabf37fe700 1 --2- 172.21.15.17:0/3730499821 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fabf8066f30 0x7fabf80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:12.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.807+0000 7fabf37fe700 1 -- 172.21.15.17:0/3730499821 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fac00086310 con 0x7fac0c156b30 2023-10-06T04:45:12.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.807+0000 7fac0b7fe700 1 --2- 172.21.15.17:0/3730499821 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fabf8066f30 0x7fabf80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:12.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.807+0000 7fac0b7fe700 1 --2- 172.21.15.17:0/3730499821 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fabf8066f30 0x7fabf80693e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fabfc005fd0 tx=0x7fabfc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:12.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:12.811+0000 7fabf37fe700 1 -- 172.21.15.17:0/3730499821 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac00053720 con 0x7fac0c156b30 2023-10-06T04:45:13.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.002+0000 7fac10a74700 1 -- 172.21.15.17:0/3730499821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fac0c04c380 con 0x7fac0c156b30 2023-10-06T04:45:13.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.006+0000 7fabf37fe700 1 -- 172.21.15.17:0/3730499821 <== mon.0 v2:172.21.15.17:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fac00053720 con 0x7fac0c156b30 2023-10-06T04:45:13.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.006+0000 7fabf37fe700 1 -- 172.21.15.17:0/3730499821 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v15)=0 v15) v1 ==== 123+0+0 (secure 0 0 0) 0x7fac00056d40 con 0x7fac0c156b30 2023-10-06T04:45:13.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.009+0000 7fac10a74700 1 -- 172.21.15.17:0/3730499821 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fabf8066f30 msgr2=0x7fabf80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:13.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.009+0000 7fac10a74700 1 --2- 172.21.15.17:0/3730499821 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fabf8066f30 0x7fabf80693e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fabfc005fd0 tx=0x7fabfc008040 comp rx=0 tx=0).stop 2023-10-06T04:45:13.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.009+0000 7fac10a74700 1 -- 172.21.15.17:0/3730499821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac0c156b30 msgr2=0x7fac0c1486f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:13.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.009+0000 7fac10a74700 1 --2- 172.21.15.17:0/3730499821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac0c156b30 0x7fac0c1486f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fac0c06f2c0 tx=0x7fac00017000 comp rx=0 tx=0).stop 2023-10-06T04:45:13.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.009+0000 7fac10a74700 1 -- 172.21.15.17:0/3730499821 shutdown_connections 2023-10-06T04:45:13.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.009+0000 7fac10a74700 1 --2- 172.21.15.17:0/3730499821 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7fabf8066f30 0x7fabf80693e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:13.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.009+0000 7fac10a74700 1 --2- 172.21.15.17:0/3730499821 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac0c1572f0 0x7fac0c155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:13.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.009+0000 7fac10a74700 1 --2- 172.21.15.17:0/3730499821 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac0c0b0e00 0x7fac0c144d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:13.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.009+0000 7fac10a74700 1 --2- 172.21.15.17:0/3730499821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac0c156b30 0x7fac0c1486f0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:13.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.009+0000 7fac10a74700 1 -- 172.21.15.17:0/3730499821 >> 172.21.15.17:0/3730499821 conn(0x7fac0c06d670 msgr2=0x7fac0c1596d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:13.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.009+0000 7fac10a74700 1 -- 172.21.15.17:0/3730499821 shutdown_connections 2023-10-06T04:45:13.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.009+0000 7fac10a74700 1 -- 172.21.15.17:0/3730499821 wait complete. 2023-10-06T04:45:13.023 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T04:45:13.024 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:45:13.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.141+0000 7f003a4e8700 1 Processor -- start 2023-10-06T04:45:13.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.141+0000 7f003a4e8700 1 -- start start 2023-10-06T04:45:13.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.142+0000 7f003a4e8700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f00340ccfc0 0x7f00340cc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:13.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.142+0000 7f003a4e8700 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f00340cf3b0 0x7f00341594a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:13.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.142+0000 7f003a4e8700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f00340cc750 0x7f00341599e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:13.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.142+0000 7f003a4e8700 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00340cbd80 con 0x7f00340ccfc0 2023-10-06T04:45:13.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.142+0000 7f003a4e8700 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00340af5f0 con 0x7f00340cf3b0 2023-10-06T04:45:13.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.142+0000 7f003a4e8700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00340af8d0 con 0x7f00340cc750 2023-10-06T04:45:13.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.142+0000 7f00394e6700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f00340ccfc0 0x7f00340cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:13.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.142+0000 7f00394e6700 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f00340ccfc0 0x7f00340cc210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53190/0 (socket says 172.21.15.17:53190) 2023-10-06T04:45:13.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.142+0000 7f00394e6700 1 -- 172.21.15.17:0/1267451735 learned_addr learned my addr 172.21.15.17:0/1267451735 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:45:13.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.142+0000 7f0039ce7700 1 --2- 172.21.15.17:0/1267451735 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f00340cc750 0x7f00341599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:13.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.142+0000 7f0038ce5700 1 --2- 172.21.15.17:0/1267451735 >> v2:172.21.15.136:3300/0 conn(0x7f00340cf3b0 0x7f00341594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:13.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.142+0000 7f00394e6700 1 -- 172.21.15.17:0/1267451735 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f00340cc750 msgr2=0x7f00341599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:13.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.143+0000 7f00394e6700 1 --2- 172.21.15.17:0/1267451735 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f00340cc750 0x7f00341599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:13.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.143+0000 7f00394e6700 1 -- 172.21.15.17:0/1267451735 >> v2:172.21.15.136:3300/0 conn(0x7f00340cf3b0 msgr2=0x7f00341594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:45:13.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.143+0000 7f00394e6700 1 --2- 172.21.15.17:0/1267451735 >> v2:172.21.15.136:3300/0 conn(0x7f00340cf3b0 0x7f00341594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:13.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.143+0000 7f00394e6700 1 -- 172.21.15.17:0/1267451735 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00340afbb0 con 0x7f00340ccfc0 2023-10-06T04:45:13.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.143+0000 7f0038ce5700 1 --2- 172.21.15.17:0/1267451735 >> v2:172.21.15.136:3300/0 conn(0x7f00340cf3b0 0x7f00341594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:45:13.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.143+0000 7f00394e6700 1 --2- 172.21.15.17:0/1267451735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00340ccfc0 0x7f00340cc210 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f002c0099b0 tx=0x7f002c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db3f6089cebbf746 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:13.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.143+0000 7f0033fff700 1 -- 172.21.15.17:0/1267451735 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002c00b820 con 0x7f00340ccfc0 2023-10-06T04:45:13.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.143+0000 7f0033fff700 1 -- 172.21.15.17:0/1267451735 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f002c00b980 con 0x7f00340ccfc0 2023-10-06T04:45:13.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.143+0000 7f0033fff700 1 -- 172.21.15.17:0/1267451735 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002c00bd40 con 0x7f00340ccfc0 2023-10-06T04:45:13.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.143+0000 7f003a4e8700 1 -- 172.21.15.17:0/1267451735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00340ccfc0 msgr2=0x7f00340cc210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:13.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.143+0000 7f003a4e8700 1 --2- 172.21.15.17:0/1267451735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00340ccfc0 0x7f00340cc210 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f002c0099b0 tx=0x7f002c009250 comp rx=0 tx=0).stop 2023-10-06T04:45:13.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.143+0000 7f003a4e8700 1 -- 172.21.15.17:0/1267451735 shutdown_connections 2023-10-06T04:45:13.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.143+0000 7f003a4e8700 1 --2- 172.21.15.17:0/1267451735 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f00340cc750 0x7f00341599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:13.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.143+0000 7f003a4e8700 1 --2- 172.21.15.17:0/1267451735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00340ccfc0 0x7f00340cc210 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:13.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.143+0000 7f003a4e8700 1 --2- 172.21.15.17:0/1267451735 >> v2:172.21.15.136:3300/0 conn(0x7f00340cf3b0 0x7f00341594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:13.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.143+0000 7f003a4e8700 1 -- 172.21.15.17:0/1267451735 >> 172.21.15.17:0/1267451735 conn(0x7f003406cff0 msgr2=0x7f003406da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:13.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.144+0000 7f003a4e8700 1 -- 172.21.15.17:0/1267451735 shutdown_connections 2023-10-06T04:45:13.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.144+0000 7f003a4e8700 1 -- 172.21.15.17:0/1267451735 wait complete. 2023-10-06T04:45:13.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.145+0000 7f003a4e8700 1 Processor -- start 2023-10-06T04:45:13.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.145+0000 7f003a4e8700 1 -- start start 2023-10-06T04:45:13.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.146+0000 7f003a4e8700 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f00340cc750 0x7f0034144100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:13.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.146+0000 7f003a4e8700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f00340ccfc0 0x7f00341552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:13.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.146+0000 7f003a4e8700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0034155800 0x7f0034169d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:13.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.146+0000 7f003a4e8700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0034155c80 con 0x7f0034155800 2023-10-06T04:45:13.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.146+0000 7f003a4e8700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003416afa0 con 0x7f00340ccfc0 2023-10-06T04:45:13.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.146+0000 7f003a4e8700 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00340c8e00 con 0x7f00340cc750 2023-10-06T04:45:13.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.146+0000 7f0039ce7700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0034155800 0x7f0034169d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:13.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.146+0000 7f0039ce7700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0034155800 0x7f0034169d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53202/0 (socket says 172.21.15.17:53202) 2023-10-06T04:45:13.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.146+0000 7f0039ce7700 1 -- 172.21.15.17:0/696886165 learned_addr learned my addr 172.21.15.17:0/696886165 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-06T04:45:13.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.146+0000 7f0038ce5700 1 --2- 172.21.15.17:0/696886165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f00340ccfc0 0x7f00341552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:13.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.146+0000 7f00394e6700 1 --2- 172.21.15.17:0/696886165 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f00340cc750 0x7f0034144100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:13.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.146+0000 7f0039ce7700 1 -- 172.21.15.17:0/696886165 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f00340cc750 msgr2=0x7f0034144100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:13.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.146+0000 7f0039ce7700 1 --2- 172.21.15.17:0/696886165 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f00340cc750 0x7f0034144100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:13.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.146+0000 7f0039ce7700 1 -- 172.21.15.17:0/696886165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f00340ccfc0 msgr2=0x7f00341552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:13.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.146+0000 7f0039ce7700 1 --2- 172.21.15.17:0/696886165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f00340ccfc0 0x7f00341552c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:13.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.146+0000 7f0039ce7700 1 -- 172.21.15.17:0/696886165 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f002c0094f0 con 0x7f0034155800 2023-10-06T04:45:13.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.146+0000 7f0039ce7700 1 --2- 172.21.15.17:0/696886165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0034155800 0x7f0034169d90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f0024007f50 tx=0x7f0024009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:13.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.146+0000 7f00317fa700 1 -- 172.21.15.17:0/696886165 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002400eb70 con 0x7f0034155800 2023-10-06T04:45:13.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.146+0000 7f00317fa700 1 -- 172.21.15.17:0/696886165 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f002400ecf0 con 0x7f0034155800 2023-10-06T04:45:13.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.146+0000 7f00317fa700 1 -- 172.21.15.17:0/696886165 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0024014690 con 0x7f0034155800 2023-10-06T04:45:13.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.146+0000 7f003a4e8700 1 -- 172.21.15.17:0/696886165 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00340b35b0 con 0x7f0034155800 2023-10-06T04:45:13.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.147+0000 7f003a4e8700 1 -- 172.21.15.17:0/696886165 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f003416ac90 con 0x7f0034155800 2023-10-06T04:45:13.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.147+0000 7f003a4e8700 1 -- 172.21.15.17:0/696886165 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00340c8f70 con 0x7f0034155800 2023-10-06T04:45:13.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.148+0000 7f00317fa700 1 -- 172.21.15.17:0/696886165 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0024014a00 con 0x7f0034155800 2023-10-06T04:45:13.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.148+0000 7f00317fa700 1 --2- 172.21.15.17:0/696886165 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0020066f30 0x7f00200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:45:13.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.148+0000 7f00317fa700 1 -- 172.21.15.17:0/696886165 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f0024084980 con 0x7f0034155800 2023-10-06T04:45:13.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.148+0000 7f00394e6700 1 --2- 172.21.15.17:0/696886165 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0020066f30 0x7f00200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:45:13.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.149+0000 7f00394e6700 1 --2- 172.21.15.17:0/696886165 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0020066f30 0x7f00200693e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f002c0099b0 tx=0x7f002c009250 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:45:13.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.152+0000 7f00317fa700 1 -- 172.21.15.17:0/696886165 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0024051e10 con 0x7f0034155800 2023-10-06T04:45:13.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.390+0000 7f003a4e8700 1 -- 172.21.15.17:0/696886165 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f003404c380 con 0x7f0034155800 2023-10-06T04:45:13.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.391+0000 7f00317fa700 1 -- 172.21.15.17:0/696886165 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f0024014cb0 con 0x7f0034155800 2023-10-06T04:45:13.392 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-06T04:45:13.393 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6834/3741747962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3741747962},{"type":"v1","addr":"172.21.15.136:6834","nonce":3741747962}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4688,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/264192509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6833","nonce":264192509},{"type":"v1","addr":"172.21.15.136:6835","nonce":264192509}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4909,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6836/1154731767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1154731767},{"type":"v1","addr":"172.21.15.17:6836","nonce":1154731767}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5463,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1976810558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6835","nonce":1976810558},{"type":"v1","addr":"172.21.15.17:6837","nonce":1976810558}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[]} 2023-10-06T04:45:13.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.393+0000 7f003a4e8700 1 -- 172.21.15.17:0/696886165 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0020066f30 msgr2=0x7f00200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:13.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.393+0000 7f003a4e8700 1 --2- 172.21.15.17:0/696886165 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0020066f30 0x7f00200693e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f002c0099b0 tx=0x7f002c009250 comp rx=0 tx=0).stop 2023-10-06T04:45:13.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.393+0000 7f003a4e8700 1 -- 172.21.15.17:0/696886165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0034155800 msgr2=0x7f0034169d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:45:13.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.393+0000 7f003a4e8700 1 --2- 172.21.15.17:0/696886165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0034155800 0x7f0034169d90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f0024007f50 tx=0x7f0024009860 comp rx=0 tx=0).stop 2023-10-06T04:45:13.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.393+0000 7f003a4e8700 1 -- 172.21.15.17:0/696886165 shutdown_connections 2023-10-06T04:45:13.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.393+0000 7f003a4e8700 1 --2- 172.21.15.17:0/696886165 >> [v2:172.21.15.17:6832/90424,v1:172.21.15.17:6833/90424] conn(0x7f0020066f30 0x7f00200693e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:13.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.393+0000 7f003a4e8700 1 --2- 172.21.15.17:0/696886165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0034155800 0x7f0034169d90 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:13.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.393+0000 7f003a4e8700 1 --2- 172.21.15.17:0/696886165 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f00340cc750 0x7f0034144100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:13.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.393+0000 7f003a4e8700 1 --2- 172.21.15.17:0/696886165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f00340ccfc0 0x7f00341552c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:45:13.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.393+0000 7f003a4e8700 1 -- 172.21.15.17:0/696886165 >> 172.21.15.17:0/696886165 conn(0x7f003406cff0 msgr2=0x7f00340b2430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:45:13.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.393+0000 7f003a4e8700 1 -- 172.21.15.17:0/696886165 shutdown_connections 2023-10-06T04:45:13.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-06T04:45:13.393+0000 7f003a4e8700 1 -- 172.21.15.17:0/696886165 wait complete. 2023-10-06T04:45:13.396 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 19 2023-10-06T04:45:13.407 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-06T04:45:13.407 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-06T04:45:13.407 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T04:45:13.407 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:45:13.416 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T04:45:13.417 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T04:45:13.417 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:45:13.465 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T04:45:13.466 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T04:45:13.466 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:45:13.476 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T04:45:13.477 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T04:45:13.477 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:45:13.528 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T04:45:13.528 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-06T04:45:13.528 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-06T04:45:13.528 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:45:13.561 INFO:tasks.ceph.osd.0:Stopped 2023-10-06T04:45:13.561 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-06T04:45:13.561 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:45:13.632 INFO:tasks.ceph.osd.1:Stopped 2023-10-06T04:45:13.633 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-06T04:45:13.633 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:45:13.707 INFO:tasks.ceph.osd.2:Stopped 2023-10-06T04:45:13.707 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-06T04:45:13.707 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:45:13.778 INFO:tasks.ceph.osd.3:Stopped 2023-10-06T04:45:13.778 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-06T04:45:13.778 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:45:13.823 INFO:tasks.ceph.osd.4:Stopped 2023-10-06T04:45:13.823 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-06T04:45:13.823 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:45:13.862 INFO:tasks.ceph.osd.5:Stopped 2023-10-06T04:45:13.862 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-06T04:45:13.862 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:45:13.930 INFO:tasks.ceph.osd.6:Stopped 2023-10-06T04:45:13.930 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-06T04:45:13.930 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:45:13.998 INFO:tasks.ceph.osd.7:Stopped 2023-10-06T04:45:13.998 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-06T04:45:13.998 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-06T04:45:13.998 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:45:14.023 INFO:tasks.ceph.mgr.y:Stopped 2023-10-06T04:45:14.026 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-06T04:45:14.027 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:45:14.063 INFO:tasks.ceph.mgr.x:Stopped 2023-10-06T04:45:14.063 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-06T04:45:14.063 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-06T04:45:14.063 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:45:14.074 INFO:tasks.ceph.mon.a:Stopped 2023-10-06T04:45:14.074 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-06T04:45:14.074 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:45:14.115 INFO:tasks.ceph.mon.b:Stopped 2023-10-06T04:45:14.115 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-06T04:45:14.115 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:45:14.166 INFO:tasks.ceph.mon.c:Stopped 2023-10-06T04:45:14.167 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-06T04:45:14.167 DEBUG:teuthology.orchestra.run.smithi017:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T04:45:14.197 INFO:teuthology.orchestra.run.smithi017.stdout:1696567408.7842107 mon.a (mon.0) 214 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T04:45:14.197 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-06T04:45:14.197 DEBUG:teuthology.orchestra.run.smithi017:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T04:45:14.267 DEBUG:teuthology.orchestra.run.smithi017:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T04:45:14.337 DEBUG:teuthology.orchestra.run.smithi017:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T04:45:14.406 INFO:teuthology.orchestra.run.smithi017.stdout:1696567408.7842107 mon.a (mon.0) 214 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T04:45:14.406 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi017.front.sepia.ceph.com 2023-10-06T04:45:14.407 DEBUG:teuthology.orchestra.run.smithi017:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-06T04:45:14.615 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi017.front.sepia.ceph.com 2023-10-06T04:45:14.615 DEBUG:teuthology.orchestra.run.smithi017:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-06T04:45:14.709 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi017.front.sepia.ceph.com 2023-10-06T04:45:14.709 DEBUG:teuthology.orchestra.run.smithi017:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-06T04:45:14.770 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi017.front.sepia.ceph.com 2023-10-06T04:45:14.770 DEBUG:teuthology.orchestra.run.smithi017:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-06T04:45:14.831 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi136.front.sepia.ceph.com 2023-10-06T04:45:14.831 DEBUG:teuthology.orchestra.run.smithi136:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-06T04:45:15.008 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi136.front.sepia.ceph.com 2023-10-06T04:45:15.009 DEBUG:teuthology.orchestra.run.smithi136:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-06T04:45:15.080 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi136.front.sepia.ceph.com 2023-10-06T04:45:15.081 DEBUG:teuthology.orchestra.run.smithi136:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-06T04:45:15.145 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi136.front.sepia.ceph.com 2023-10-06T04:45:15.146 DEBUG:teuthology.orchestra.run.smithi136:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-06T04:45:15.213 INFO:tasks.ceph:Archiving mon data... 2023-10-06T04:45:15.215 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412287/data/mon.a.tgz 2023-10-06T04:45:15.215 DEBUG:teuthology.orchestra.run.smithi017:> mktemp 2023-10-06T04:45:15.231 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.W2FjMu6n5d 2023-10-06T04:45:15.232 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.W2FjMu6n5d 2023-10-06T04:45:15.354 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.W2FjMu6n5d 2023-10-06T04:45:15.436 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.W2FjMu6n5d is 276KB 2023-10-06T04:45:15.531 DEBUG:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.W2FjMu6n5d 2023-10-06T04:45:15.545 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412287/data/mon.b.tgz 2023-10-06T04:45:15.545 DEBUG:teuthology.orchestra.run.smithi136:> mktemp 2023-10-06T04:45:15.561 INFO:teuthology.orchestra.run.smithi136.stdout:/tmp/tmp.9h1vjpOS5K 2023-10-06T04:45:15.561 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.9h1vjpOS5K 2023-10-06T04:45:15.712 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0666 /tmp/tmp.9h1vjpOS5K 2023-10-06T04:45:15.793 DEBUG:teuthology.orchestra.remote:smithi136:/tmp/tmp.9h1vjpOS5K is 367KB 2023-10-06T04:45:15.887 DEBUG:teuthology.orchestra.run.smithi136:> rm -fr /tmp/tmp.9h1vjpOS5K 2023-10-06T04:45:15.901 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412287/data/mon.c.tgz 2023-10-06T04:45:15.901 DEBUG:teuthology.orchestra.run.smithi136:> mktemp 2023-10-06T04:45:15.955 INFO:teuthology.orchestra.run.smithi136.stdout:/tmp/tmp.XkqJth7e06 2023-10-06T04:45:15.955 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.XkqJth7e06 2023-10-06T04:45:16.082 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0666 /tmp/tmp.XkqJth7e06 2023-10-06T04:45:16.163 DEBUG:teuthology.orchestra.remote:smithi136:/tmp/tmp.XkqJth7e06 is 367KB 2023-10-06T04:45:16.259 DEBUG:teuthology.orchestra.run.smithi136:> rm -fr /tmp/tmp.XkqJth7e06 2023-10-06T04:45:16.274 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-06T04:45:16.274 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T04:45:16.277 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T04:45:16.336 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-06T04:45:16.336 DEBUG:teuthology.orchestra.run.smithi017:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T04:45:16.345 DEBUG:teuthology.orchestra.run.smithi136:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T04:45:16.370 INFO:teuthology.orchestra.run.smithi017.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T04:45:16.401 INFO:teuthology.orchestra.run.smithi136.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T04:45:16.407 INFO:tasks.ceph:Archiving crash dumps... 2023-10-06T04:45:16.408 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412287/remote/smithi017/crash 2023-10-06T04:45:16.409 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T04:45:16.443 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412287/remote/smithi136/crash 2023-10-06T04:45:16.444 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T04:45:16.470 INFO:tasks.ceph:Shutting down logrotate 2023-10-06T04:45:16.470 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:45:16.486 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:45:16.564 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T04:45:16.591 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T04:45:16.615 INFO:tasks.ceph:Compressing logs... 2023-10-06T04:45:16.615 DEBUG:teuthology.orchestra.run.smithi017:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T04:45:16.634 DEBUG:teuthology.orchestra.run.smithi136:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T04:45:17.559 INFO:tasks.ceph:Archiving logs... 2023-10-06T04:45:17.559 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412287/remote/smithi017/log 2023-10-06T04:45:17.560 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T04:45:17.853 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412287/remote/smithi136/log 2023-10-06T04:45:17.853 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T04:45:17.971 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-06T04:45:17.999 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-06T04:45:17.999 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T04:45:18.002 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T04:45:18.072 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-06T04:45:18.084 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-06T04:45:18.084 DEBUG:teuthology.orchestra.run.smithi017:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T04:45:18.087 DEBUG:teuthology.orchestra.run.smithi136:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T04:45:18.099 INFO:teuthology.orchestra.run.smithi017.stderr:bash: ntpq: command not found 2023-10-06T04:45:18.100 INFO:teuthology.orchestra.run.smithi136.stderr:bash: ntpq: command not found 2023-10-06T04:45:18.103 INFO:teuthology.orchestra.run.smithi017.stdout:210 Number of sources = 4 2023-10-06T04:45:18.103 INFO:teuthology.orchestra.run.smithi017.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T04:45:18.103 INFO:teuthology.orchestra.run.smithi017.stdout:=============================================================================== 2023-10-06T04:45:18.103 INFO:teuthology.orchestra.run.smithi017.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 27 +454us[ +459us] +/- 81ms 2023-10-06T04:45:18.103 INFO:teuthology.orchestra.run.smithi017.stdout:^* hv02.front.sepia.ceph.com 3 6 377 26 -420us[ -415us] +/- 58ms 2023-10-06T04:45:18.103 INFO:teuthology.orchestra.run.smithi017.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 27 +116us[ +122us] +/- 64ms 2023-10-06T04:45:18.103 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:45:18.104 INFO:teuthology.orchestra.run.smithi136.stdout:210 Number of sources = 4 2023-10-06T04:45:18.104 INFO:teuthology.orchestra.run.smithi136.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T04:45:18.104 INFO:teuthology.orchestra.run.smithi136.stdout:=============================================================================== 2023-10-06T04:45:18.104 INFO:teuthology.orchestra.run.smithi136.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 26 +506us[ +506us] +/- 81ms 2023-10-06T04:45:18.104 INFO:teuthology.orchestra.run.smithi136.stdout:^* hv02.front.sepia.ceph.com 3 6 377 26 -402us[ -395us] +/- 58ms 2023-10-06T04:45:18.105 INFO:teuthology.orchestra.run.smithi136.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 28 +115us[ +123us] +/- 64ms 2023-10-06T04:45:18.105 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:45:18.105 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-06T04:45:18.115 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-06T04:45:18.116 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-06T04:45:18.124 DEBUG:teuthology.orchestra.run.smithi017:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T04:45:18.243 DEBUG:teuthology.orchestra.run.smithi136:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T04:45:18.332 DEBUG:teuthology.orchestra.run.smithi017:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T04:45:18.363 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:45:18.363 DEBUG:teuthology.orchestra.run.smithi136:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T04:45:18.392 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:45:18.392 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-06T04:45:18.405 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-06T04:45:18.421 INFO:teuthology.task.internal:Duration was 818.563242 seconds 2023-10-06T04:45:18.421 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-06T04:45:18.433 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-06T04:45:18.433 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T04:45:18.436 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T04:45:18.479 INFO:teuthology.orchestra.run.smithi136.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T04:45:18.480 INFO:teuthology.orchestra.run.smithi017.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T04:45:18.727 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-06T04:45:18.727 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi017.front.sepia.ceph.com 2023-10-06T04:45:18.727 DEBUG:teuthology.orchestra.run.smithi017:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T04:45:18.747 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi136.front.sepia.ceph.com 2023-10-06T04:45:18.747 DEBUG:teuthology.orchestra.run.smithi136:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T04:45:18.771 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-06T04:45:18.771 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T04:45:18.790 DEBUG:teuthology.orchestra.run.smithi136:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T04:45:18.848 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-06T04:45:18.849 DEBUG:teuthology.orchestra.run.smithi017:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T04:45:18.872 DEBUG:teuthology.orchestra.run.smithi136:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T04:45:18.961 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-06T04:45:18.975 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-06T04:45:18.975 DEBUG:teuthology.orchestra.run.smithi017:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T04:45:19.001 DEBUG:teuthology.orchestra.run.smithi136:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T04:45:19.027 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-06T04:45:19.044 DEBUG:teuthology.orchestra.run.smithi017:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T04:45:19.047 DEBUG:teuthology.orchestra.run.smithi136:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T04:45:19.069 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = core 2023-10-06T04:45:19.090 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern = core 2023-10-06T04:45:19.103 DEBUG:teuthology.orchestra.run.smithi017:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T04:45:19.137 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:45:19.138 DEBUG:teuthology.orchestra.run.smithi136:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T04:45:19.157 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:45:19.158 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-06T04:45:19.168 INFO:teuthology.task.internal:Transferring archived files... 2023-10-06T04:45:19.169 DEBUG:teuthology.misc:Transferring archived files from smithi017:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412287/remote/smithi017 2023-10-06T04:45:19.169 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T04:45:19.215 DEBUG:teuthology.misc:Transferring archived files from smithi136:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412287/remote/smithi136 2023-10-06T04:45:19.215 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T04:45:19.250 INFO:teuthology.task.internal:Removing archive directory... 2023-10-06T04:45:19.250 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T04:45:19.253 DEBUG:teuthology.orchestra.run.smithi136:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T04:45:19.299 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-06T04:45:19.311 INFO:teuthology.task.internal:Not uploading archives. 2023-10-06T04:45:19.311 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-06T04:45:19.324 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-06T04:45:19.324 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T04:45:19.326 DEBUG:teuthology.orchestra.run.smithi136:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T04:45:19.338 INFO:teuthology.orchestra.run.smithi017.stdout: 262183 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 04:45 /home/ubuntu/cephtest 2023-10-06T04:45:19.353 INFO:teuthology.orchestra.run.smithi136.stdout: 262495 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 04:45 /home/ubuntu/cephtest 2023-10-06T04:45:19.355 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-06T04:45:19.365 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-06T04:45:19.413 INFO:teuthology.nuke:Checking targets against current locks 2023-10-06T04:45:19.440 DEBUG:teuthology.nuke:shortname: smithi017 2023-10-06T04:45:19.440 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T04:45:19.463 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412287', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 04:24:35.095401', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLin3JPzMpt4MygFVK2Xo2yDds7MpsWZR3TG0Y6x1MO6/IALD42nl0EeiRysfiezTJ7J19DcOw7w6ozualHKTbE='} 2023-10-06T04:45:19.467 DEBUG:teuthology.nuke:shortname: smithi136 2023-10-06T04:45:19.468 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T04:45:19.487 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi136.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412287', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 04:24:35.094038', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCT8z47jvyl4oo/EdApCPMBw2AAaO3RiCmjP65ogxYBMvnojcE6lkXAmmIf2dACNsYqr1Q5eQIPCZvP4rYGbt58='} 2023-10-06T04:45:19.521 INFO:teuthology.orchestra.console.smithi017:Power off 2023-10-06T04:45:19.521 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T04:45:19.541 INFO:teuthology.orchestra.console.smithi136:Power off 2023-10-06T04:45:19.541 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T04:45:19.555 DEBUG:teuthology.orchestra.console.smithi017:power off output: Chassis Power Control: Down/Off 2023-10-06T04:45:19.556 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:45:19.570 DEBUG:teuthology.orchestra.console.smithi136:power off output: Chassis Power Control: Down/Off 2023-10-06T04:45:19.571 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:45:19.585 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2023-10-06T04:45:19.597 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2023-10-06T04:45:23.586 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:45:23.598 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:45:23.697 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2023-10-06T04:45:23.709 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2023-10-06T04:45:27.701 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:45:27.709 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:45:27.811 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2023-10-06T04:45:27.817 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2023-10-06T04:45:27.913 INFO:teuthology.orchestra.console.smithi017:Power off completed 2023-10-06T04:45:31.821 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:45:31.931 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2023-10-06T04:45:32.032 INFO:teuthology.orchestra.console.smithi136:Power off completed 2023-10-06T04:45:32.136 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/backtrace} duration: 818.5632424354553 failure_reason: '"1696567408.7842107 mon.a (mon.0) 214 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-10-06T04:45:32.136 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T04:45:32.214 INFO:teuthology.run:FAIL